database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
15,329 Commits 1 Branch 0 Tags
a0fee4c96ecd8ef229c2ba3dc407dc9873fe8b23
Commit Graph

15329 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
minghong
a0fee4c96e [fix](nereids) runtime filter prune skip filter with invisible column (#28010) 
if a conjunct only contains invisible column, this conjunct should not be used in runtime filter pruner
 2023-12-06 12:42:40 +08:00
yiguolei
24fdb7ad4e [refactor](unusedcode) remove internalquery since it is useless (#28039) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-12-06 12:30:49 +08:00
Calvin Kirs
cbf1f8620a [Feature](job)support cancel task and fix log invalid (#27703) 
- Running task can be show and fix cancel fail
- When the insert task scheduling cycle is reached, if there are still tasks running, the scheduling of this task will be canceled at this time.
- refactor job status changes SQL
- Fix timer job window error
- Support cancel task
 2023-12-06 10:44:09 +08:00
lihangyu
4c90b459e5 [regression-test](variant) fix variant p2 cases (#28025) 2023-12-06 10:37:18 +08:00
zclllyybb
202cc84f2f [Test](auto-partition) Add auto partition p1 test (#28028) 
Add auto partition p1 test
 2023-12-06 10:20:39 +08:00
Gabriel
1be513b927 [pipelineX](local shuffle) Fix local shuffle for colocate/bucket join (#28032) 2023-12-06 10:02:36 +08:00
walter
73404405e6 [fix](hdfs) Fix hdfsExists that return staled root cause (#27991) 
The HDFS native client won't clear the last exception as expected so `hdfsGetLastExceptionRootCause` might return a staled root cause. This PR saves the last root cause here and verifies after hdfsExists returns a non-zero code.
 2023-12-06 08:24:13 +08:00
walter
57fb1df833 [fix](regression) backup restore cases adapt force_olap_table_replica_num option (#27986) 2023-12-06 08:23:40 +08:00
Kaijie Chen
36c54da03d fix owned slice capacity (#28002) 2023-12-06 00:26:34 +08:00
Mingyu Chen
aaa44fa3dc [deps](odbc) undefined the BOOL in include/sqltypes.h (#28014) 
When `ENABLE_PCH = false`, this define will be conflict with BOOL in `include/arrow/type_fwd.h`.
The ODBC table will be deprecated in 2.1, so I just simply undefined the BOOL in include/sqltypes.h
to make compile OK
 2023-12-06 00:16:23 +08:00
slothever
e431c2b980 [Improvement](multi-catalog)make location easier to modified, decoupling all storage with single location class (#27874) 
decoupling all storage with single location class
 2023-12-06 00:13:54 +08:00
TengJianPing
fd1db4da3d [agg](profile) fix incorrent profile (#28004) 2023-12-05 20:48:10 +08:00
AKIRA
7f1b558011 [fix](stats) truncate min/max if too long (#27955) 
For some string value the max/min might be a very long string
which might take too many memory of FE,
so we truncate to 1024 chars if it's too long
 2023-12-05 20:40:38 +08:00
zzzxl
05adbfdb3d [feature](inverted index) match_phrase_prefix feature added (#27404) 
select count() from test_index_match_phrase_prefix where request match_phrase_prefix 'xxx';
 2023-12-05 20:15:13 +08:00
Yongqiang YANG
ffa4ea66d5 [enhancement](main) donot coredump when be can not start (#27928) 2023-12-05 20:11:24 +08:00
Gabriel
ea275e687a [pipelineX](minor) remove unused code (#28016) 2023-12-05 19:41:40 +08:00
morrySnow
e79422addc [refactor](Nereids) compatible with all ability legacy planner (#27947) 
refactor:
1. split InsertIntoTableCommand into three sub command
- InsertIntoTableCommand
- InsertOverwriteTableCommand
- BatchInsertIntoTableCommand

feature:
1. support DEFAULT keywords in values list
2. support empty values list
3. support temporary partition
4. support insert into values in txn model

fix:
1. should start transaction before release read lock on target table
 2023-12-05 19:10:55 +08:00
yiguolei
8e161ad0f2 [debug](timeout) add some log to debug timeout== 0 (#28011) 
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-12-05 18:35:36 +08:00
wangbo
59c0db4080 Fix workload group unstable (#28003) 2023-12-05 17:55:43 +08:00
lw112
8dc67d3be6 [case](regression-test) add backup recovery for inverted index and bl… (#27616) 2023-12-05 17:11:02 +08:00
zhangdong
6074cddcf8 [feature](mtmv)add Job and task tvf (#27967) 
add:
select * from jobs("type"="mv");
select * from tasks("type"="mv");
select * from jobs("type"="insert");
select * from tasks("type"="insert");

add check priv for mv_infos("database"="xxx");

change JobType MTMV==>MV
 2023-12-05 15:12:36 +08:00
Jibing-Li
02512cd0e2 [fix](stats)Drop stats or update updated rows after truncate table (#27931) 
1. Also clear follower's stats cache when doing drop stats.
2. Drop stats when truncate a table.
 2023-12-05 14:53:35 +08:00
Pxl
8a761dff84 [Bug](materialized-view) fix create mv failed on unique table (#27971) 
fix create mv failed on unique table
 2023-12-05 14:53:09 +08:00
wangbo
3595f21405 [improvement](executor)clear unused cgroup path (#27798) 
* clear unused cgroup path

* use C++ api

* add gcc header
 2023-12-05 14:18:23 +08:00
zclllyybb
c98b80ae6a [Feature](functions) support ignore and nullable functions (#27848) 
support ignore and nullable functions
 2023-12-05 14:09:32 +08:00
amory
79f6f85cf1 [FIX](serde)fix datetimev2 serde parse from string with scale (#27965) 2023-12-05 13:58:32 +08:00
Dongyang Li
aa75f81af5 [fix](case) add "nonConcurrent" to prevent effect other case (#27941) 
same as #27940
 2023-12-05 13:04:25 +08:00
HappenLee
54fe1a166b [Refactor](scan) refactor scan scheduler to improve performance (#27948) 
* [Refactor](scan) refactor scan scheduler to improve performance

* fix pipeline x core
 2023-12-05 13:03:16 +08:00
HappenLee
da87fcb477 [bug](function) fix compound expr coredump problem (#27988) 2023-12-05 13:00:14 +08:00
Xinyi Zou
fa0b495b33 [fix](cache)Fix partition cache support DATEV2 (#27978) 2023-12-05 12:59:47 +08:00
TengJianPing
17016b9797 [improvement](decimal) use new way for decimal arithmetic precision promotion (#27787) 
* [DNM](decimal) use new way for decimal arithmetic precision promotion

* [improvement](decimal) [DNM](decimal) use new way for decimal arithmetic precision promotion
1. [DNM](decimal) use new way for decimal arithmetic precision promotion
2. throw exception if it overflows for decimal arithmetics
3. throw exception if it overflows when casting among number types

* fix compile error of gcc

* improvement

---------

Co-authored-by: morrySnow <morrysnow@126.com>
 2023-12-05 12:54:40 +08:00
zhangstar333
ca6949ee3e [Bug](partition) fix auto list partition erros of incorrect partition name (#27974) 
the partition name need limit it's length and can't have negative "-"
 2023-12-05 12:54:06 +08:00
谢健
2f63999066 [fix](Nereids): Preserve "" in single quote strings and '' in double quote strings. (#27959) 2023-12-05 12:30:03 +08:00
amory
358d73a0ae [FIX](complextype) fix empty quote with complex type (#27942) 2023-12-05 12:25:26 +08:00
Kaijie Chen
fd2e60a2db [fix](move-memtable) exclude memtable insert memory in query tracker (#27953) 2023-12-05 12:04:15 +08:00
Kaijie Chen
a13227cf4b [fix](move-memtable) fix sink v2 profile (#27982) 2023-12-05 11:53:18 +08:00
seawinde
da40e1c767 [feature](nereids) Matiarilzed view query rewrite util implementation (#27568) 
The basic util implementatation which is used by materialized view rewrite
 2023-12-05 11:48:04 +08:00
谢健
26d642d5e9 [enhancement](Nereids) format some code in functional deps (#27797) 2023-12-05 11:45:03 +08:00
谢健
4afe07e12c [feature](Nereids): support drop constraint on table (#27944) 2023-12-05 11:41:25 +08:00
airborne12
1ed99c4d8a [Improvement](inverted index) improve inverted index bkd performance in high concurrent scenario (#27820) 
Improve BKD performance by enable bkd reader cache and improvement of fast compare and visit in compressed values in BKD tree.
 2023-12-05 11:39:53 +08:00
Kaijie Chen
75d0beb8cc [fix](move-memtable) only report load stream profile in the end (#27983) 2023-12-05 11:30:54 +08:00
Kaijie Chen
bd9db7423b [fix](move-memtable) free resources before storage engine stop (#27980) 2023-12-05 11:15:05 +08:00
HHoflittlefish777
d69cdf8635 [improve](heartbeat) show more info when receive invalid cluster id (#27975) 2023-12-05 11:10:22 +08:00
Ma1oneZhang
a06ac930a0 [refactor](memtable) remove unused stream output (#27889) 
Co-authored-by: ziyang zhang <zhangziyang@stu.cdut.edu.cn>
 2023-12-05 11:10:10 +08:00
yuxuan-luo
3412a022f4 [fix](restore) fix Restore from __keep_on_local__ throws null pointer… (#26943) 
Co-authored-by: walter <patricknicholas@foxmail.com>
Co-authored-by: hugoluo <hugoluo@tencent.com>
Co-authored-by: walter <patricknicholas@foxmail.com>
 2023-12-05 10:55:28 +08:00
starocean999
3c97e69f3c [fix](Nereids) should not push down project to the nullable side of outer join (#27912) 2023-12-05 10:43:33 +08:00
jakevin
50ad40a7a8 [test](Nereids): add infer-predicates regression test (#27850) 2023-12-05 10:16:01 +08:00
Tiewei Fang
20d4d7eb2b [fix](Hudi-catalog) fix hudi catalog code (#27963) 
In the original logic, `allfields.addall` will modify the objects in `hmsTable`.
 2023-12-04 22:28:19 +08:00
Qi Chen
2b4c4bb442 [Fix][Opt](parquet-reader) Fix filter push down with decimal types in parquet reader. (#27897) 
Fix filter push down with decimal types in parquet reader introduced by #22842
 2023-12-04 22:25:39 +08:00
plat1ko
1afdbfe723 [enhance](BE) Refactor TaskWorkerPool (#27555) 2023-12-04 21:46:10 +08:00