database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
15,046 Commits 1 Branch 0 Tags
dbff9d7a89746cd71b8fb68fbfbed368cc9902ff
Commit Graph

6248 Commits

Author SHA1 Message Date
zhangdong
dfe3a2dd01 [feature](mtmv)(3)Implementing multi table materialized views (#26146) 
Introduction to Main Classes：
- MTMVService：MTMV services for other modules to call
- MTMVHookService：All operations that affect the MTMV
  - MTMVJobManager：All operations that affect the MTMV job
  - MTMVCacheManager：All operations that affect the MTMV Cache
- MTMVTask&MTMVJob：Inherit from job framework
 2023-11-24 12:34:38 +08:00
Kang
da71fde066 [fix](build index) Fix inverted index hardlink leak and missing problem (#26903) 2023-11-24 10:30:21 +08:00
AlexYue
0a8e3d2199 [enhance](PrefetchReader) Make the prefetch timeout one config (#27371) 2023-11-24 10:24:15 +08:00
walter
9a92323221 [fix](fs) prefetch buffer check status before verifing buf size (#27388) 2023-11-24 10:19:37 +08:00
xy720
75c9f00137 [Bug](bitmap) Fix heap-use-after-free in the bitmap functions (#27411) 2023-11-24 10:09:31 +08:00
Gabriel
5a82a5746e [pipelineX](bug) Fix core dump if cancelled (#27449) 2023-11-24 09:21:17 +08:00
Xin Liao
df628e1538 [chore](merge-on-write) disable rowid conversion check for mow table by default (#27482) 2023-11-23 23:39:01 +08:00
zclllyybb
b580ee91ce [fix](compile) fix macOS compile and format code (#27494) 2023-11-23 23:24:10 +08:00
yiguolei
aa766a7b4a [bugfix](pipeline core) lock fragment context during task close to avoid concurrent delete (#27484) 2023-11-23 21:43:39 +08:00
Ashin Gau
dd65cc1d14 [opt](MergedIO) no need to merge large columns (#27315) 
1. Fix a profile bug of `MergeRangeFileReader`, and add a profile `ApplyBytes` to show the total bytes  of ranges.
2. There's no need to merge large columns, because `MergeRangeFileReader` will increase the copy time.
 2023-11-23 19:15:47 +08:00
zclllyybb
2ea33518b0 [Opt](load) use batching to optimize auto partition (#26915) 
use batching to optimize auto partition
 2023-11-23 19:12:28 +08:00
Mryange
ca7dbc3636 [refactor](pipelineX) refine union dependency (#27348) 2023-11-23 16:28:32 +08:00
walter
b457856bd2 [chore](be) remove bthread scanner related codes (#27417) 2023-11-23 15:18:49 +08:00
yujun
afe5af433a [log](tablet) add create / gc tablet log (#27452) 2023-11-23 14:42:47 +08:00
Mryange
699798eaa7 [fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT (#27343) 
* fix

* fix nullable

* remove null

* add case
 2023-11-23 14:26:19 +08:00
Kaijie Chen
7a75f8c380 [improve](move-memtable) set brpc streaming params in config (#27442) 2023-11-23 14:14:43 +08:00
Xinyi Zou
4fc638c98c [fix](memory) Fix make_top_consumption_snapshots heap-use-after-free #27434 2023-11-23 13:59:53 +08:00
Gabriel
75d1594d11 [pipelineX](minor) remove unused code (#27446) 2023-11-23 11:53:06 +08:00
Kaijie Chen
b79f5d77f1 [improve](move-memtable) improve logging messages (#27443) 2023-11-23 11:46:29 +08:00
Pxl
301bfe4d5d [Bug](mark-join) fix mark join report error when probe block have column do not output (#27360) 
fix mark join report error when probe block have column do not output
 2023-11-23 11:16:02 +08:00
yiguolei
179d4ab754 [bugfix](potential bug) add lock when modify total tasks number (#27428) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-11-23 09:28:09 +08:00
Gabriel
fe5c4e3b46 [pipelineX](api) Fix core dump for pipelineX API (#27437) 2023-11-23 00:24:32 +08:00
Gabriel
1b3512d942 [pipelineX](bug) Fix cancel timeout (#27396) 2023-11-22 22:31:34 +08:00
zclllyybb
a68b62b421 [refactor](datatype) Introduce a toolkits for clarify datelike types usage (#26810) 2023-11-22 22:08:13 +08:00
HappenLee
3e1a5b6e29 [profile](rf) make runtime filter profile readable (#27323) 2023-11-22 21:13:35 +08:00
zzzxl
7cdad51133 [feature](invert index) add the reader buffer as a parameter (#27339) 
The inverted index read buffer is configurable
 2023-11-22 19:29:20 +08:00
Gabriel
f49722163e [pipelineX](bug) Fix query timeout due to broadcast (#27398) 2023-11-22 19:25:04 +08:00
Gabriel
5442e8d1fc [pipelineX](dependency) split different dependencies (#27366) 2023-11-22 12:50:39 +08:00
TengJianPing
604842526b [improvement](expr) improve if expr performance (#27296) 2023-11-22 12:48:06 +08:00
Pxl
b541de7a03 do not push down agg on aggregate column (#27356) 
do not push down agg on aggregate column
 2023-11-22 10:53:29 +08:00
Yulei-Yang
4fbcad9c7c [minor](show_export) make result of file url usable (#27209) 
* [minor](show_export) make result of file url usable

* update regression-test

* update regression-test
 2023-11-22 10:14:45 +08:00
Jerry Hu
6e86bf5b1b [test](decimalv2) add some regression cases about decimalv2 (#27352) 
All cases' results are tested and passed with decimalv3
Cases about:
Calculation ( +, - , *, /)
Kinds of predicates(<, >, =, <>, in, not in, is null, is not null)
Load test(from csv and select into)
Runtime filter
Delete conditions
Key columns(agg/duplicate/uniq model, distributed/partition, bitmap index...)
 2023-11-21 21:36:20 +08:00
abmdocrt
1cd1c58eee [Feature](group commit) move group_commit_interval_ms from be.conf to table property (#27116) 2023-11-21 20:50:02 +08:00
Jack Drogon
2f04873da9 [fix](clone) Fix engine_clone file exist (#27361) 
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
 2023-11-21 20:30:27 +08:00
yiguolei
ffd4face00 [refactor](callonce) remove callonce usage in pipeline task to get full stack trace when core (#27331) 
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-11-21 19:42:39 +08:00
TengJianPing
1ebb54afdc [fix](null equal) fix coredump of pushing eq_for_null (#27341) 2023-11-21 18:36:33 +08:00
amory
f7a1c3edac [FIX](jsonb)fix jsonb is not in predict column #27325 2023-11-21 18:35:12 +08:00
yujun
e58983e59c [improvement](publish version) reduce publish version not exist log (#27332) 2023-11-21 18:00:01 +08:00
Gabriel
721282242b [pipelineX](bug) Fix potential memory access problem (#27326) 2023-11-21 14:36:25 +08:00
TengJianPing
016dccb4b7 [fix](null_equal) fix wrong result and coredump of operator <=> (#27312) 
* [fix](null_equal) fix wrong result and coredump of operator <=>

* fix
 2023-11-21 14:32:03 +08:00
HappenLee
fcf7691e2f [pipeline](close) change the close order in pipeline engine (#27290) 2023-11-21 14:10:21 +08:00
Mryange
d809bee46e [refactor](profilev2) add BlocksProduced RowsProduced counter #27291 2023-11-21 12:01:11 +08:00
HHoflittlefish777
3e8177bbbd Revert "[improvement](routine-load) add routine load rows check (#25818)" (#27304) 
This reverts commit 5e3277e8fbc92f08344bc86e9b2c74033a8bbc01.
 2023-11-21 11:28:05 +08:00
Xinyi Zou
2548e27c97 [fix](memory) Fix work load group meaningless GC #27307 2023-11-21 09:59:21 +08:00
Gabriel
87a7de7660 [pipelineX](bug) Fix 'No broadcast buffer left' (#27298) 2023-11-20 22:37:21 +08:00
amory
c0f22e8feb [FIX](complextype)fix struct nested complex collection type and and regresstest (#26973) 2023-11-20 22:29:12 +08:00
Gabriel
840f3b6439 [pipelineX](dependency) Wake by task by read dependency (#27260) 2023-11-20 22:00:59 +08:00
airborne12
20d7ab061b [PipelineX](complex type pushdown) do not push down complex type to storage layer based on PR#25007 (#27278) 2023-11-20 18:47:59 +08:00
qiye
273cbfc36c [fix](inverted index) reset fs_writer to nullptr before throw exception (#27202) 2023-11-20 17:40:56 +08:00
yiguolei
6ed0be8e3c [refactor](profilev2) unify the counter name in shuffle operator and normal operator (#27267) 
using blocksproduced and rowsproduced to unify the counter name in DataStreamSender and other exec node, or exchange operator and other operators.
blocks produced and rows produced are more easy to understand.
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-11-20 14:21:39 +08:00