Commit Graph

6723 Commits

Author SHA1 Message Date
b0cac0014d [enhance](FS) Improve FS error code (#29432) 2024-01-06 21:17:22 +08:00
d61fec3ff8 (feature)(LOG) Support to change be vlog level dynamically using http (#28785) 2024-01-06 20:12:35 +08:00
28f18a33ea [improve](config) print value in error message (#29207) 2024-01-06 18:43:52 +08:00
1ae23a3206 [Fix](group commit) Fix wal mem back pressure fault injection case (#29493) 2024-01-06 18:39:26 +08:00
db17f5fe79 [improve](move-memtbale) enable move memtable in routine load (#28974) 2024-01-06 18:22:01 +08:00
85dd606fd1 [fix](group_commit) Fix group_commit ut (#29587) 2024-01-06 18:11:13 +08:00
2adb0fcc50 [opt](hive) support orc generated from hive 1.x for all file scan node (#28806) 2024-01-06 17:33:16 +08:00
e62573448a [fix](snapshot) Restore convert rowset meta tablet id (#29478) 2024-01-06 17:17:14 +08:00
2c888667ed [improvement](function) standardize some ip functions' signatures #29614
The signatures of functions in these PRs should be more standard:
#27342,
#25510,
#20936,
including the following:
ipv4numtostring,
ipv4stringtonum,
ipv4stringtonumordefault,
ipv4stringtonumornull,
ipv6numtostring.

This PR will add necessary underscores between the words of each of them,
like changing ipv4numtostring to ipv4_num_to_string.
2024-01-06 16:16:38 +08:00
5789b7e380 [fix](jin) add datetimev2 precision (#29528) 2024-01-06 13:35:26 +08:00
cbcb81f381 [FIX](complextype)fix compare_at base function support nested types (#29297) 2024-01-06 12:05:43 +08:00
a0c3ddf902 [fix](memory) Fix LRUCacheType::NUMBER charge (#29588)
if LRUCacheType::NUMBER, charge not add handle_size, because charge at this time is no longer the memory size, but an independent weight.
2024-01-06 10:37:56 +08:00
88323c73fd [Fix](wal) Fix update wal dir core (#29583) 2024-01-05 21:39:23 +08:00
f40cce1406 [Fix](partition) Skip rowset partition id eq 0 smaller than config wh… (#29510) 2024-01-05 19:39:51 +08:00
7402fee1fc [feature](function) support ip function ipv6_string_to_num(_or_default, _or_null), inet6_aton (#28361) 2024-01-05 19:24:45 +08:00
xy
2a6150b057 [optimize](cooldown)If cooldowned_rowsets is empty, there is no need to follow the logic of traversing the files (#27324)
Co-authored-by: xingying01 <xingying01@corp.netease.com>
2024-01-05 18:59:09 +08:00
eea6219920 [improvement](group commit) Add an option of enable relay wal on all regression test (#28757) 2024-01-05 18:27:31 +08:00
e2e9b9d8a3 [improve](insert-into) record rows info in log for check (#29581) 2024-01-05 17:28:07 +08:00
fa4721125e [Fix](show data) Inverted index size not added to data size after index build (#29568) 2024-01-05 16:21:45 +08:00
xy
d86277c2c2 [optimize](cooldown)Improved filtering conditions for cooldown tablet (#27338)
Co-authored-by: xingying01 <xingying01@corp.netease.com>
2024-01-05 15:03:54 +08:00
e8e1a6ff03 [refactor](fold) refactor fold executor could get error status (#29541)
before _get_result return std::string, so ignore the error status.
2024-01-05 14:23:56 +08:00
fb13943a10 [Fix](Variant) fix heap use after free when updating tablet schema (#29554)
`_context->tablet_schema` maybe updated so use `_context->original_tablet_schema` instead
2024-01-05 11:42:39 +08:00
46ccbebfb0 [improve](function) get result from constant_col when expr is const (#29403) 2024-01-05 11:26:17 +08:00
8c40f04f2b [Opt](parquet-reader) Opt ColumnSelectVector::set_run_length_null_map() in parquet reader. (#28954) (#29527) 2024-01-05 11:13:40 +08:00
a04911a93f [fix](pipelinex) coredump caused by null pointer of Dependency::_shared_state (#29559) 2024-01-05 10:40:32 +08:00
08f2b83b81 [fix](profile) Fix row distribution timer in loadv1 (#29495)
Fix row distribution timer in loadv1
2024-01-05 10:02:18 +08:00
99edbaf3cf [improve](move-memtable) add stream sink file writer finalize fault injection (#29552) 2024-01-04 23:02:58 +08:00
bfd23e30f6 [improve](load) handle EAGAIN in load stream (#29437) 2024-01-04 23:02:11 +08:00
35150bbc22 [improve](move-memtable) log rpc failures in stream file writer (#29267) 2024-01-04 23:00:46 +08:00
96acef908a [fix](move-memtable) check eos when close stream (#29547) 2024-01-04 22:56:52 +08:00
d8ad6ebff2 [enhancement](disk) log disk path when creating tablet (#29464) 2024-01-04 20:36:37 +08:00
92533d544f [LOG](exec) Add timer for hostname_to_ip (#29497) 2024-01-04 18:27:27 +08:00
f28dbc702c [bugfix](scanner done) should not set process status to query context (#29512)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-04 15:18:10 +08:00
329d20df3b [fix](regression) spare .testfile to make disk checker happy when injecting fault (#29477)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
2024-01-04 15:09:57 +08:00
bfe65565d8 [feature](paimon)support native reader (#29339)
Support native reader fro paimon.

Upgrade paimon 0.5 to 0.6 : apache/doris-shade#32
2024-01-04 14:31:48 +08:00
Pxl
d8a08dad90 [Bug](mark-join) fix wrong result on mark join + other conjunct (#29321)
fix wrong result on mark join + other conjunct
2024-01-04 11:58:39 +08:00
4ba4767eef [improvement](scan) make global runtime filter support in-list filter (#29394) 2024-01-04 09:12:30 +08:00
3888a7cc0b [fix](group_commit) Fix check auth error when relaying wal (#29461) 2024-01-03 23:19:16 +08:00
d6cb2d6d5c [improvement](compaction) start 1 cumu compaction thread each disk by default (#29430) 2024-01-03 20:48:11 +08:00
bd8113f424 [bugfix](scannerscheduler) should minus num_of_scanners before check should schedule #28926 (#29331)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-03 20:47:35 +08:00
c84cd30223 [pipelineX](fix) Fix query cancel timeout (#29460)
There are 2 potential reasons to cancel pipelineX query timeout.

Cancel fragment context first and set ready to execute will set cancel flag to false.
Dead lock.
2024-01-03 20:29:04 +08:00
e3c9f535dc [refactor](wal) refactor some wal code (#29434) 2024-01-03 14:45:57 +08:00
329d57fdd7 [regression](move-memtable) test LoadStream on_idle_timeout (#29354)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
2024-01-03 14:07:51 +08:00
1fbbff32b2 [fix](pipelinex) coredump caused by VRuntimeFilterSlots::_is_global was not set (#29446) 2024-01-03 12:40:41 +08:00
c0db8533af [fix](load) fix single replica load with auto partition 2024-01-03 11:53:09 +08:00
xy
fab1a627fc [fix](scan) _insert_data_normal should catch exception when BlockReader::_unique_key_next_block (#29426)
Co-authored-by: xingying01 <xingying01@corp.netease.com>
2024-01-03 11:44:02 +08:00
1e8bb75182 [improve](move-memtable) add log on idle timeout (#29438) 2024-01-03 11:26:26 +08:00
be1d9c3358 [fix](memory) Fix mem tracker web page notice #29361 2024-01-03 11:25:00 +08:00
14e7eb7624 [Opt](rf) Opt broadcast join remote runtime filter merge and wait (#29439) 2024-01-03 11:21:28 +08:00
3a8ae590ec [fix](pipelineX) Fix unexpected OOM on pipelineX (#29436) 2024-01-03 10:40:44 +08:00