Commit Graph

6115 Commits

Author SHA1 Message Date
8910772cb8 [pipelineX](log) refine debug string (#27712) 2023-11-28 21:15:52 +08:00
f54db85ea3 [Opt](compression) Opt gzip decompress by libdeflate on X86 and X86_64 platforms: 2. Opt gzip decompression by libdeflate lib. (#27669)
Opt gzip decompress by libdeflate on X86 and X86_64 platforms: 2. Opt gzip decompression by libdeflate after adding libdeflate lib in #27542.
2023-11-28 20:05:24 +08:00
Pxl
d969047b50 [Refactor](join) refactor of hash join (#27557)
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table

Co-authored-by: HappenLee <happenlee@hotmail.com>
Co-authored-by: BiteTheDDDDt <pxl290@qq.com>
2023-11-28 19:46:00 +08:00
38d30f21f1 [pipelineX](bug) Fix scan dependency timeout (#27696) 2023-11-28 18:21:11 +08:00
Pxl
91b0edfaa2 [Bug](join) try fix wrong _has_null_in_build_side setted (#27684)
try fix wrong _has_null_in_build_side setted
2023-11-28 17:42:14 +08:00
b93dd1d5f7 [enhancement](load) improve error msg for load when cancelled by mem gc (#26809)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
2023-11-28 17:36:11 +08:00
c203d36300 [pipelineX](bug) Add logs (#27665) 2023-11-28 15:53:40 +08:00
f565f60bc3 [refactor](standard)BE:Initialize pointer variables in the class to nullptr by default (#27587) 2023-11-28 13:02:30 +08:00
fe7ff6f113 [Opt](functions) Opt tvf number for performance regression framework (#27582)
Opt tvf number for performance regression framework
2023-11-28 10:43:51 +08:00
b48c40ed31 Make blockschduler first stop then delete (#27645) 2023-11-28 10:09:15 +08:00
ea7eca9345 [pipelineX](bug) Add some logs (#27596) 2023-11-28 10:02:13 +08:00
13b26ee920 [Fix](core) Fix wal space back pressure core and add regression test (#27311) 2023-11-27 15:10:26 +08:00
3838b6fbae [refine](pipelineX) refine some code in pipelineX (#27472) 2023-11-27 11:04:16 +08:00
d0fea8db27 [chore][log] Opt log, revert some log introduced by #25739 (#26365) 2023-11-27 10:48:02 +08:00
d10a708fa2 [improve](jdbc catalog) add profile for jdbc scan (#27447) 2023-11-27 10:33:39 +08:00
baadc14e60 [Enhancement](function) support unix_timestamp with float (#26827)
---------

Co-authored-by: YangWithU <plzw8@outlook.com>
2023-11-27 09:58:53 +08:00
5700332c3c [enhance](S3) Print the error detail for every s3 operation (#27572) 2023-11-26 18:54:43 +08:00
b6dd43bb9d [fix](load) return error instead of panic when slot and expr do not (#27423) 2023-11-26 18:53:37 +08:00
148f365da8 [fix](move-memtable) handle tablet location not found (#27561) 2023-11-26 18:42:15 +08:00
3d2b194985 [refactor](if_function) handle result status of function (#27491) 2023-11-25 10:35:55 +08:00
f3204ec18c [fix](memory) Fix thread_context check failed: thread_mem_tracker()->label() == "Orphan" #27468 2023-11-24 20:57:41 +08:00
553e4a8903 [feature-wip](merge-on-write) MOW table support different primary keys and sort keys (#24788) 2023-11-24 16:37:30 +08:00
2152d5a5dd [regression test](control) add some regression case for control (#27346)
* [regression test](control) add some regression case for control

```
1. CANCEL DECOMMISSION BACKEND
2. SET REPLICA STATUS
3. CLEAN TRASH
4. SET REPLICA VERSION
5. BAD REPLICA
```
2023-11-24 16:13:12 +08:00
89d5efac46 [pipelineX](dependency) Use dependency to replace ready_to_execute (#27528) 2023-11-24 16:03:14 +08:00
126714ace4 [fix](pipelineX) fix nullptr in loca exchange dependency (#27488)
fix nullptr in loca exchange dependency
2023-11-24 15:12:25 +08:00
dfe3a2dd01 [feature](mtmv)(3)Implementing multi table materialized views (#26146)
Introduction to Main Classes:
- MTMVService:MTMV services for other modules to call
- MTMVHookService:All operations that affect the MTMV
  - MTMVJobManager:All operations that affect the MTMV job
  - MTMVCacheManager:All operations that affect the MTMV Cache
- MTMVTask&MTMVJob:Inherit from job framework
2023-11-24 12:34:38 +08:00
da71fde066 [fix](build index) Fix inverted index hardlink leak and missing problem (#26903) 2023-11-24 10:30:21 +08:00
0a8e3d2199 [enhance](PrefetchReader) Make the prefetch timeout one config (#27371) 2023-11-24 10:24:15 +08:00
9a92323221 [fix](fs) prefetch buffer check status before verifing buf size (#27388) 2023-11-24 10:19:37 +08:00
75c9f00137 [Bug](bitmap) Fix heap-use-after-free in the bitmap functions (#27411) 2023-11-24 10:09:31 +08:00
5a82a5746e [pipelineX](bug) Fix core dump if cancelled (#27449) 2023-11-24 09:21:17 +08:00
df628e1538 [chore](merge-on-write) disable rowid conversion check for mow table by default (#27482) 2023-11-23 23:39:01 +08:00
b580ee91ce [fix](compile) fix macOS compile and format code (#27494) 2023-11-23 23:24:10 +08:00
aa766a7b4a [bugfix](pipeline core) lock fragment context during task close to avoid concurrent delete (#27484) 2023-11-23 21:43:39 +08:00
dd65cc1d14 [opt](MergedIO) no need to merge large columns (#27315)
1. Fix a profile bug of `MergeRangeFileReader`, and add a profile `ApplyBytes` to show the total bytes  of ranges.
2. There's no need to merge large columns, because `MergeRangeFileReader` will increase the copy time.
2023-11-23 19:15:47 +08:00
2ea33518b0 [Opt](load) use batching to optimize auto partition (#26915)
use batching to optimize auto partition
2023-11-23 19:12:28 +08:00
ca7dbc3636 [refactor](pipelineX) refine union dependency (#27348) 2023-11-23 16:28:32 +08:00
b457856bd2 [chore](be) remove bthread scanner related codes (#27417) 2023-11-23 15:18:49 +08:00
afe5af433a [log](tablet) add create / gc tablet log (#27452) 2023-11-23 14:42:47 +08:00
699798eaa7 [fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT (#27343)
* fix

* fix nullable

* remove null

* add case
2023-11-23 14:26:19 +08:00
7a75f8c380 [improve](move-memtable) set brpc streaming params in config (#27442) 2023-11-23 14:14:43 +08:00
4fc638c98c [fix](memory) Fix make_top_consumption_snapshots heap-use-after-free #27434 2023-11-23 13:59:53 +08:00
75d1594d11 [pipelineX](minor) remove unused code (#27446) 2023-11-23 11:53:06 +08:00
b79f5d77f1 [improve](move-memtable) improve logging messages (#27443) 2023-11-23 11:46:29 +08:00
Pxl
301bfe4d5d [Bug](mark-join) fix mark join report error when probe block have column do not output (#27360)
fix mark join report error when probe block have column do not output
2023-11-23 11:16:02 +08:00
179d4ab754 [bugfix](potential bug) add lock when modify total tasks number (#27428)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2023-11-23 09:28:09 +08:00
fe5c4e3b46 [pipelineX](api) Fix core dump for pipelineX API (#27437) 2023-11-23 00:24:32 +08:00
1b3512d942 [pipelineX](bug) Fix cancel timeout (#27396) 2023-11-22 22:31:34 +08:00
a68b62b421 [refactor](datatype) Introduce a toolkits for clarify datelike types usage (#26810) 2023-11-22 22:08:13 +08:00
3e1a5b6e29 [profile](rf) make runtime filter profile readable (#27323) 2023-11-22 21:13:35 +08:00