database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
17,943 Commits 1 Branch 0 Tags
c5ab7ca573aeaab54b5dcd1cfff8a8561f41d1e2
Commit Graph

17943 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
xueweizhang
c5ab7ca573 [fix](planner) remove and retain input slot for aggregate slot which is not materialized (#33033) 
Signed-off-by: nextdreamblue <zxw520blue1@163.com>
 2024-04-10 11:34:30 +08:00
Pxl
5b162a80f2 [Improvement](materialized-view) The materialized view can not involved auto increment column (#32885) 
The materialized view can not involved auto increment column
 2024-04-10 11:34:30 +08:00
wangbo
35fa9f98e9 1 Add running query num/waiting query num (#33024) 
1 Add running query num/waiting query num
2 Fix auth regression test
 2024-04-10 11:34:30 +08:00
zhangdong
d7c1c7dcd4 [fix](mtmv)partition limit #32978 2024-04-10 11:34:30 +08:00
zhangstar333
59aa923bce [bug](function) fix milliseconds_diff function return wrong result (#32897) 
* [bug](function) fix milliseconds_diff function return wrong result
 2024-04-10 11:34:30 +08:00
zzzxl
3b7d75fb4b [fix](inverted index) Clear the index cache corresponding to the table after deleting the table. (#32921) 2024-04-10 11:34:30 +08:00
HappenLee
193600ad9d [Performance](sink) opt mysql result writer (#31816) 2024-04-10 11:34:30 +08:00
minghong
fdb9500023 [fix](nereids) null-safe-eq runtime filter denies outer join #32927 2024-04-10 11:34:30 +08:00
starocean999
1f1932c6b7 [enhancement](nereids)add some date functions for constant fold (#32772) 2024-04-10 11:34:30 +08:00
starocean999
814e4ed3ec [fix](nereids)partition prune should consider <=> operator (#32965) 2024-04-10 11:34:30 +08:00
starocean999
2ee6f28cec [fix](nereids)column name should be case insensitive when selecting mv (#33002) 2024-04-10 11:34:30 +08:00
Jerry Hu
a7be070021 [chore](session_variable) change parallel_scan_min_rows_per_scanner' default value to 16384 (#32939) 2024-04-10 11:34:30 +08:00
zzzxl
7b26feb6de [fix](invert index) Fix the issue of high memory usage. (#31739) 2024-04-10 11:34:30 +08:00
Gabriel
53309e32a9 [Improvement](execution) Use single phase execution commit if only 1 BE is used (#32937) 2024-04-10 11:34:30 +08:00
Dongyang Li
e214eb1ea7 [chore](ci) fix ci check (#32992) 
Co-authored-by: stephen <hello-stephen@qq.com>
 2024-04-10 11:34:30 +08:00
Dongyang Li
3ee14a80ab [chore](ci) adjust ckb expect result (#32856) 
Co-authored-by: stephen <hello-stephen@qq.com>
 2024-04-10 11:34:30 +08:00
RotKang
7e802c9127 [fix](variant)group name optimization (#32598) 
1. Change the group name stars to repo_name
 2024-04-10 11:34:30 +08:00
morrySnow
a6fc2ae176 [fix](test) replace 'null' to null for date/datetime column (#32972) 2024-04-10 11:34:30 +08:00
Qi Chen
528a889077 [Fix](hive-writer) Fix correct num when hive writing data to an unpartitioned table if size large than hive_sink_max_file_size. (#32959) 2024-04-10 11:34:29 +08:00
wangbo
97a2977f2a [improvement](executor)Add tag property for workload group #32874 2024-04-10 11:34:29 +08:00
Xin Liao
f1ee7f5767 [fix](merge-iterator) fix NOT_IMPLEMENTED_ERROR when read next block view (#32961) 2024-04-10 11:34:29 +08:00
Jibing-Li
dcddd88e01 Limit the max string length to 1024 while collecting column stats to control BE memory usage. (#32470) 2024-04-10 11:34:29 +08:00
Jibing-Li
0499d4013e Support identical column name in different index. (#32792) 2024-04-10 11:34:29 +08:00
morrySnow
121a0901c8 [chore](test) let suite compatible with Nereids (#32964) 2024-04-10 11:34:29 +08:00
Jensen
407f8642da [Enhancement](data skew) extends show data skew (#32732) 2024-04-10 11:34:29 +08:00
HappenLee
3a6c37c6d5 [exec](column) change some complex column move to noexcept (#32954) 2024-04-10 11:34:29 +08:00
morrySnow
ed0949f6c5 [fix](compile) fe cannot compile in idea (#32955) 2024-04-10 11:34:29 +08:00
jakevin
e980cd3e7f [feature](Nereids): add ColumnPruningPostProcessor. (#32800) 2024-04-10 11:34:29 +08:00
zhangdong
26e86d53a4 [enhance](mtmv)support olap table partition column is null (#32698) 2024-04-10 11:34:29 +08:00
seawinde
22a7fc3c55 [improvement](mtmv) Support to get tables in materialized view when collecting table in plan (#32797) 
Support to get tables in materialized view when collecting table in plan

table scehma as fllowing:

create materialized view mv1
BUILD IMMEDIATE REFRESH COMPLETE ON MANUAL
DISTRIBUTED BY RANDOM BUCKETS 1 
PROPERTIES ('replication_num' = '1')
 as 
select 
  t1.c1, 
  t3.c2 
from 
  table1 t1 
  inner join table3 t3 on t1.c1 = t3.c2

if get table from the plan as follwoing, we can get [table1, table3, table2], the mv1 is expanded to get base tables;

SELECT 
  mv1.*, 
  uuid() 
FROM 
  mv1 LEFT SEMI 
  JOIN table2 ON mv1.c1 = table2.c1 
WHERE 
  mv1.c1 IN (
    SELECT 
      c1 
    FROM 
      table2
  ) 
  OR mv1.c1 < 10
 2024-04-10 11:34:29 +08:00
Jensen
bb8bc75af4 [feature](agg) add aggregate function sum0 (#32541) 2024-04-10 11:34:29 +08:00
HappenLee
e3bd2311b1 [Performance](exec) replace SipHash in function by XXHash (#32919) 2024-04-10 11:34:29 +08:00
amory
28e2d89ce3 [Improve](inverted_index) update clucene and improve array inverted index writer (#32436) 2024-04-10 11:34:29 +08:00
Jerry Hu
8e6ed80692 [improvement](spill) Disable DistinctStreamingAgg when spill is enabled (#32932) 2024-04-10 11:34:29 +08:00
Jerry Hu
830d4c14c1 [fix](spill) SpillStream's writer maybe may not have been finalized (#32931) 2024-04-10 11:34:29 +08:00
Xinyi Zou
80cdc74908 [fix](arrow-flight) Fix reach limit of connections error (#32911) 
Fix Reach limit of connections error
in fe.conf , arrow_flight_token_cache_size is mandatory less than qe_max_connection/2. arrow flight sql is a stateless protocol, connection is usually not actively disconnected, bearer token is evict from the cache will unregister ConnectContext.

Fix ConnectContext.command not be reset to COM_SLEEP in time, this will result in frequent kill connection after query timeout.

Fix bearer token evict log and exception.

TODO: use arrow flight session: https://mail.google.com/mail/u/0/#inbox/FMfcgzGxRdxBLQLTcvvtRpqsvmhrHpdH
 2024-04-10 11:34:29 +08:00
yujun
d959291c98 [improvement](decommission be) decommission check replica num (#32748) 2024-04-10 11:34:28 +08:00
Xinyi Zou
06e5c6c966 [fix](grace-exit) Stop incorrectly of reportwork cause heap use after free #32929 2024-04-10 11:34:28 +08:00
zhiqiang
f23a72b937 [chore](log) print query id before logging profile in be.INFO (#32922) 2024-04-10 11:34:28 +08:00
Jerry Hu
87f99271e1 [fix](spill) Avoid releasing resources while spill tasks are executing (#32783) 2024-04-10 11:34:28 +08:00
Yulei-Yang
f5340039fc [fix](multicatalog) fix no data error when read hive table on cosn (#32815) 
Currently, when reading a hive on cosn table, doris return empty result, but the table has data.
iceberg on cosn is ok.
The reason is misuse of cosn's file sytem. according to cosn's doc, its fs.cosn.impl should be org.apache.hadoop.fs.CosFileSystem
 2024-04-10 11:34:28 +08:00
morrySnow
66536c2976 [fix](Nereids) NPE when create table with implicit index type (#32893) 2024-04-10 11:34:28 +08:00
xy720
dcfdbf0629 [chore](show) support statement to show views from table (#32358) 
MySQL [test]> show views;
+----------------+
| Tables_in_test |
+----------------+
| t1_view        |
| t2_view        |
+----------------+
2 rows in set (0.00 sec)

MySQL [test]> show views like '%t1%';
+----------------+
| Tables_in_test |
+----------------+
| t1_view        |
+----------------+
1 row in set (0.01 sec)

MySQL [test]> show views where create_time > '2024-03-18';
+----------------+
| Tables_in_test |
+----------------+
| t2_view        |
+----------------+
1 row in set (0.02 sec)
 2024-04-10 11:34:28 +08:00
zhengyu
96b995504c [enhancement](statistics) excluded delta rows num for rollup&mv tablets (#32568) 
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
Co-authored-by: tsy <tangsiyang2001@foxmail.com>
 2024-04-10 11:34:28 +08:00
Mingyu Chen
e8d67e79fd [fix](test) fix duplicated catalog name in regression cases (#32442) 
Each suite should use different catalog name,
other it will effect each other when running cases concurrently.
 2024-04-10 11:34:28 +08:00
Mingyu Chen
217514e5dd [minor](test) Add Iceberg hadoop catalog FE unit test (#32449) 
For easy testing the behavior of Iceberg's HadoopCatalog.listNamespaces()
 2024-04-10 11:34:28 +08:00
yiguolei
b130df2488 2.1.2-rc04 2024-04-09 16:28:27 +08:00
XuJianxu
c35b2becdd [fix][docker] fix kafka test scritps (#33417) 
Co-authored-by: 胥剑旭 <xujianxu@xujianxudeMacBook-Pro.local>
 2024-04-09 16:11:09 +08:00
yiguolei
005f7af21f [bugfix](deadlock) should not use query cancelled in fragment mgr 2024-04-09 16:09:01 +08:00
zclllyybb
e574b35833 [Enhancement](partition) Refine some auto partition behaviours (#32737) (#33412) 
fix legacy planner grammer
fix nereids planner parsing
fix cases
forbid auto range partition with null column
fix CreateTableStmt with auto partition and some partition items.
1 and 2 are about #31585
doc pr: apache/doris-website#488
 2024-04-09 15:51:02 +08:00