Commit Graph

1457 Commits

Author SHA1 Message Date
6231300e9e [Fix](Rf) fix in_or_bloom filter merge error in broadcast join remote target tpcds q78 (#30492) 2024-01-29 19:03:47 +08:00
0433b8730d [Feature](profile)add shuffle send rows/bytes #30456 2024-01-28 18:25:08 +08:00
f571ffe57f (fix)[group commit] Row count is incorrect when enable pipeline load (#30447) 2024-01-27 09:13:21 +08:00
18b5b72cd9 [improve](stack_trace) avoid print stack trace in group commit (#30399) 2024-01-27 09:08:29 +08:00
144204fecc [Refactor](Rf) refactor the code of runtime filter (#30268) 2024-01-27 09:08:29 +08:00
007a489f46 [memoryleak](execontext) dctor should be virtual to avoid memory leak (#30359)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-25 21:37:33 +08:00
5ba9987d3a [Fix](executor)Release resource correctly when drop workload group (#30279) 2024-01-25 13:24:52 +08:00
1a51d04cb8 [fix](move-memtable) fix schema use-after-free in delta writer v2 (#30254) 2024-01-24 10:00:25 +08:00
ce5ba61640 [refactor](close)Full refactor async writer (#30082)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-23 13:22:15 +08:00
9c742d46a2 [fix](group commit) abort txn should use label if replay wal failed (#30219) 2024-01-23 10:12:35 +08:00
9e0c518aaf [Feature](executor)Workload Group support Non-Pipeline Execution (#30164) 2024-01-23 10:11:25 +08:00
60ce22f15e [fix](auto-partition) Fix a concurrent bug (#30086)
when incremental opening, it may be a mistake to send new packet from sender to reciever cuz' re-constructed send closure.
now fixed it.
2024-01-23 10:09:54 +08:00
f66f6b2a82 [refactor](close) refactor ispendingfinish logic and close logic to do close more quickly (#30021) 2024-01-23 10:06:05 +08:00
fd6ec97731 [fix](injection) don't disturb CLOSE_LOAD message in LoadStream (#30097) 2024-01-19 15:48:56 +08:00
990d5d8664 [cleanup](insert-into) clean up some insert into log (#30063) 2024-01-18 12:03:07 +08:00
6ef9ed08aa [fix](multi-table-load) fix multi table load can not finish (#29957) 2024-01-18 10:03:35 +08:00
2dcdf07dd4 [Feature](profile)Support active_queries TVF (#29999) 2024-01-16 21:25:02 +08:00
e1bcdc35fd (fix)[group-commit] Fix some group commit case (#30008) 2024-01-16 18:46:19 +08:00
e35b26f4fc [feature](auditlog)Add runtime cpu time/peak memory metric (#29925) 2024-01-16 18:39:00 +08:00
41875a0bf5 [fix](move-memtable) check segment id in add_segment (#29898) 2024-01-16 18:30:23 +08:00
60f6436f26 [fix](schema cache) adjust the destruction order of _tablet_schema_cache and storage engine (#29923) 2024-01-13 23:36:15 +08:00
ad986a78ae [Fix](executor)Fix Grayscale upgrade be code dump when report statistics #29843 2024-01-12 13:58:19 +08:00
d525f576e1 [improve] Use lru cache to count the number of column in tablet schema to control memory (#29668) 2024-01-12 13:58:19 +08:00
cbffdbb8bf [bug](group_commit) fix relay wal problem on materialized-view (#29848) 2024-01-12 13:58:19 +08:00
c9a949130b [Case](wal) Add wal group commit sink case with low disk space fault injection (#29731) 2024-01-12 11:59:52 +08:00
8c0b046ad4 [case](wal)Add wal backpressure case (#29725) 2024-01-12 11:59:52 +08:00
58f8994f5d [Fix](core) Fix initializing the WalManager could prevent the BE from starting (#29688) 2024-01-12 11:59:27 +08:00
0d691c638b [Feature](profile)Support report runtime workload statistics #29591 2024-01-12 11:59:27 +08:00
f8d3b20911 [improve](fmt) use format_to and FMT_COMPILE to speed up write data #29682 2024-01-12 11:53:57 +08:00
48f58510a8 [refactor](tabletwriter) make tablet writer's rpc callback safe, could exit any time (#29684)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-12 11:46:29 +08:00
aec373e2a0 [fix](regression) remove a buggy fault-injection case which make BE crash (#29673)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
2024-01-12 11:46:29 +08:00
xy
374c638788 [improvement](executor) improve readability and efficiency of the checks (#29696)
Co-authored-by: xingying01 <xingying01@corp.netease.com>
2024-01-12 11:44:21 +08:00
2959219b4d [Enhancement](wal) Add fault injection case for wal back pressure (#29689) 2024-01-12 11:44:21 +08:00
aa4de6f39a (feature)[pipelineX]Make operator_id negative in pipelineX (#29649)
"operator_id" should be invisible, but the local shuffle is a planned operator in the BE (Backend), without a plan node ID. We use it in profiles and other places, and there might be duplicates. Therefore, we switch it to a negative number here to distinguish it as a plan node ID.
2024-01-12 11:44:21 +08:00
8fc9c18c85 [improvement](jdbc catalog) Put the jdbc connection pool parameters into catalog properties (#29195) 2024-01-12 11:40:28 +08:00
c58d18147b [refactor](resultwriter) rename append_block to write method is more meaningful (#29635)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-08 00:00:33 +08:00
0b731800a0 [enhancement](group_commit) refector wal manager code (#29560) 2024-01-07 18:54:41 +08:00
b0cac0014d [enhance](FS) Improve FS error code (#29432) 2024-01-06 21:17:22 +08:00
1ae23a3206 [Fix](group commit) Fix wal mem back pressure fault injection case (#29493) 2024-01-06 18:39:26 +08:00
db17f5fe79 [improve](move-memtbale) enable move memtable in routine load (#28974) 2024-01-06 18:22:01 +08:00
85dd606fd1 [fix](group_commit) Fix group_commit ut (#29587) 2024-01-06 18:11:13 +08:00
a0c3ddf902 [fix](memory) Fix LRUCacheType::NUMBER charge (#29588)
if LRUCacheType::NUMBER, charge not add handle_size, because charge at this time is no longer the memory size, but an independent weight.
2024-01-06 10:37:56 +08:00
eea6219920 [improvement](group commit) Add an option of enable relay wal on all regression test (#28757) 2024-01-05 18:27:31 +08:00
e2e9b9d8a3 [improve](insert-into) record rows info in log for check (#29581) 2024-01-05 17:28:07 +08:00
e8e1a6ff03 [refactor](fold) refactor fold executor could get error status (#29541)
before _get_result return std::string, so ignore the error status.
2024-01-05 14:23:56 +08:00
bfd23e30f6 [improve](load) handle EAGAIN in load stream (#29437) 2024-01-04 23:02:11 +08:00
96acef908a [fix](move-memtable) check eos when close stream (#29547) 2024-01-04 22:56:52 +08:00
bd8113f424 [bugfix](scannerscheduler) should minus num_of_scanners before check should schedule #28926 (#29331)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-03 20:47:35 +08:00
c84cd30223 [pipelineX](fix) Fix query cancel timeout (#29460)
There are 2 potential reasons to cancel pipelineX query timeout.

Cancel fragment context first and set ready to execute will set cancel flag to false.
Dead lock.
2024-01-03 20:29:04 +08:00
e3c9f535dc [refactor](wal) refactor some wal code (#29434) 2024-01-03 14:45:57 +08:00