Commit Graph

18049 Commits

Author SHA1 Message Date
babec88aa9 fix cloud mode from PR #32748 2024-04-11 23:01:06 +08:00
dc8da9ee89 [Fix](nereids) fix qualifier problem that affects delete stmt in another catalog (#33528)
* [Fix](nereids) fix qualifier problem that affects delete stmt in another catalog

* [Fix](nereids) fix qualifier problem that affects delete stmt in another catalog

* [Fix](nereids) fix qualifier problem that affects delete stmt in another catalog

* [Fix](nereids) fix qualifier problem that affects delete stmt in another catalog

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-04-11 21:43:01 +08:00
3d66723214 [branch-2.1](auto-partition) pick auto partition and some more prs (#33523) 2024-04-11 17:12:17 +08:00
af95302088 fix compile 2024-04-11 13:10:24 +08:00
69fc8cf06d [branch-2.1](memory) Fix rowid storage reader memory tracker (#33521)
fix:
F20240411 10:26:06.693233 1368925 thread_context.h:293] __builtin_unreachable, If you crash here, it means that SCOPED_ATTACH_TASK and SCOPED_SWITCH_THREAD_MEM_TRACKER_LIMITER are not used correctly. starting position of each thread is expected to use SCOPED_ATTACH_TASK to bind a MemTrackerLimiter belonging to Query/Load/Compaction/Other Tasks, otherwise memory alloc using Doris Allocator in the thread will crash. If you want to switch MemTrackerLimiter during thread execution, please use SCOPED_SWITCH_THREAD_MEM_TRACKER_LIMITER, do not repeat Attach. Of course, you can modify enable_memory_orphan_check=false in be.conf to avoid this crash.
*** Check failure stack trace: ***
    @     0x562d9b5aa6a6  google::LogMessage::SendToLog()
    @     0x562d9b5a70f0  google::LogMessage::Flush()
    @     0x562d9b5aaee9  google::LogMessageFatal::~LogMessageFatal()
    @     0x562d7ebd1b7e  doris::thread_context()
    @     0x562d7ec203b8  Allocator<>::sys_memory_check()
    @     0x562d7ec255a3  Allocator<>::memory_check()
    @     0x562d7ec274a1  Allocator<>::alloc_impl()
    @     0x562d7ec27227  Allocator<>::alloc()
    @     0x562d67a12207  doris::vectorized::PODArrayBase<>::alloc<>()
    @     0x562d67a11fde  doris::vectorized::PODArrayBase<>::realloc<>()
    @     0x562d67a11e26  doris::vectorized::PODArrayBase<>::reserve<>()
    @     0x562d77331ee3  doris::vectorized::ColumnVector<>::reserve()
    @     0x562d7e64328e  doris::vectorized::ColumnNullable::reserve()
    @     0x562d7ec79a84  doris::vectorized::Block::Block()
    @     0x562d6b86b81b  doris::PInternalServiceImpl::_multi_get()
    @     0x562d6b8a4a07  doris::PInternalServiceImpl::multiget_data()::$_0::operator()()
2024-04-11 13:10:24 +08:00
Pxl
5688c28364 [Bug](runtime-filter) try to fix heap use after free on runtime filter send filter size (#33465) (#33522) 2024-04-11 13:10:24 +08:00
9a3b19d21e [fix](cases) Add check status timeout for backup/restore cases (#32975) 2024-04-11 13:10:24 +08:00
ff38e7c497 [log](chore) print isBad in Replica::toString() (#33427) 2024-04-11 09:31:50 +08:00
b5a84f7d23 Fix alter column stats without min max value deserialize failure. (#33406) 2024-04-11 09:31:50 +08:00
f7d52b5b1c [feature](expr) add type check when expr prepare (#33330) 2024-04-11 09:31:50 +08:00
bc929686e3 [feature](debug point) add macro DBUG_RUN_CALLBACK (#33407) 2024-04-11 09:31:50 +08:00
e4eb76212a [fix](Nereids): add order for constraint test (#33323) 2024-04-11 09:31:50 +08:00
ef26479282 [improve](serde) support complex type in write/read pb serde (#33124)
support complex type and ip/jsonb in DataTypeSerDe::write_column_to_pb/read_column_from_pb function
2024-04-11 09:31:50 +08:00
Pxl
3070eda58c [Bug](load) fix stream load file on hll type mv column (#33373)
fix stream load file on hll type mv column
2024-04-11 09:31:50 +08:00
f35dd3fc35 [chore](test) let some case suitable for legacy planner and nereids (#33352) 2024-04-11 09:31:50 +08:00
a38b97fbdd [bugfix](profile) should use backend ip:heartbeat port as key during merge profile (#33368) 2024-04-11 09:31:50 +08:00
ea1e542e31 [fix](partial-update) remove unnecessary DECHEK on IndexChannel::num_rows_filtered (#33160) 2024-04-11 09:31:50 +08:00
2708641bee [Fix]fix insert overwrite non-partition table null pointer exception (#33205)
fix legacy planner bug when insert overwrite non-partition table.
2024-04-11 09:31:50 +08:00
38b2e58d59 [Improvement](executor)cancel query when a query is queued (#33339) 2024-04-11 09:31:50 +08:00
326eee5d04 [Fix](schema change) Fix schema change fault when add complex type column (#31824)
Problem: An error is encountered when executing a schema change on a unique table to add a column with a complex type, such as bitmap, as documented in https://github.com/apache/doris/issues/31365

Reason: The error arises because the schema change logic erroneously applies an aggregation check for new columns across all table types, demanding an explicit aggregation type declaration. However, unique and duplicate tables inherently assume default aggregation types for newly added columns, leading to this misstep.

Solution: The schema change process for introducing new columns needs to distinguish between table types accurately. For unique and duplicate tables, it should automatically assign the appropriate aggregation type, which, for the purpose of smooth integration with subsequent processes, should be set to NONE.
2024-04-11 09:31:50 +08:00
Pxl
3081fc584d [Improvement](runtime-filter) support sync join node build side's size to init bloom runtime filter (#32180)
support sync join node build side's size to init bloom runtime filter
2024-04-11 09:31:50 +08:00
58347aa2b7 [branch-2.1](bugfix) fix alter tablet not have memtracker
[branch-2.1](memory) Fix EngineAlterTabletTask attach memory tracker #33506
2024-04-11 09:29:42 +08:00
3e7b253e41 [fix](compress) data decompress failed while max_len equals 8M (#33456)
* fix data decompress failed while max_len equals MAX_COMPRESSION_BUFFER_SIZE_FOR_REUSE

* update code format error
2024-04-11 08:36:44 +08:00
f3a60374b5 [branch-2.1](memory) Fix EngineStorageMigrationTask MemTracker attach thread (#33509) 2024-04-11 08:35:13 +08:00
6bef95eb4f [fix](memory) Fix memory tracker destructor deadlock (#33497) 2024-04-10 22:46:53 +08:00
6bf1fa4b63 [branch-2.1](memory) Fix SnapshotManager MemTracker attach thread #33501 2024-04-10 22:22:12 +08:00
90ee9c171e [bug](mem_tracker) fix mem_tracker dcheck failed as not used correctly (#33349) (#33486)
* [bug](mem_tracker) fix mem_tracker dcheck failed as not used correctly
2024-04-10 22:22:12 +08:00
75f497976c [opt](Nereids) auto fallback when query unsupport table type (#33357) 2024-04-10 16:24:13 +08:00
e2ad7149c3 [feature](debug point) Add handler to debug point (#33350) 2024-04-10 16:24:13 +08:00
ecbd92204d [fix](Nereids) variant push down not work on slot without table (#33356) 2024-04-10 16:23:41 +08:00
53505e903b [scan](improvement) Adjust parallel scanners num (#33223) 2024-04-10 16:23:20 +08:00
0e262ba0e4 [improvement](spill) improve cancel of spill and improve log printing (#33229)
* [improvement](spill) improve cancel of spill and improve log printing

* fix
2024-04-10 16:23:20 +08:00
28acfaed2b [fix](pipeline)group by and output is empty (#33192) 2024-04-10 16:23:20 +08:00
045dd05f2a [fix](Nereids): don't transpose agg and join if join is mark join (#33312) 2024-04-10 16:23:20 +08:00
0d0a96d097 [fix](test) Fix auto partition dbgen product data (#33313)
Fix auto partition dbgen product data
2024-04-10 16:23:04 +08:00
Pxl
6462264e77 [Improvement](materialized-view) adjust priority of materialized view match rule (#33305)
adjust priority of materialized view match rule
2024-04-10 16:23:04 +08:00
4eee1a1f0d [fix](nereids) make runtime filter targets in fixed order (#33191)
* make runtime filter targets in fixed order
2024-04-10 16:22:39 +08:00
159ebc76e7 [fix](npe) fix kafka be id npe (#33151) 2024-04-10 16:22:27 +08:00
741d4ff97e [fix](group commit) Fix syntax error when insert into table which column names contain keyword (#33322) 2024-04-10 16:22:09 +08:00
d667df2d06 [improvement](spill) avoid unnecessary spilling in hash join build phase (#33277) 2024-04-10 16:21:50 +08:00
4079a7b6ab [fix](txn insert) Fix txn insert into values for sequence column or column name is keyword (#33336) 2024-04-10 16:21:31 +08:00
29777bc3a8 [fix](fe)reduce memory usage in alter (#32810) (#33474)
Co-authored-by: kylinmac <kylinmac@163.com>
2024-04-10 16:04:50 +08:00
5e73d7a281 [fix](compaction) fix incorrect grouping of vertical compaction columns in tables only with key columns (#32896) (#33470) 2024-04-10 16:04:33 +08:00
f8d1fa2be3 [chore](multi-table-load) add context info in log when using single-stream-multi-table load (#33317) 2024-04-10 16:03:05 +08:00
d1099852b5 [fix](Nereids) partial update generate column in wrong way (#33326)
intro by PR #31461
2024-04-10 16:02:54 +08:00
f31e273ae8 [fix](Nereids) variant column prune push down failed on variant literal (#33328) 2024-04-10 16:02:54 +08:00
be9fe12b26 Fix compatibility issues with GLIBC(>= 2.34) for prebuilt thirdparty packages (#33314)
Some symbols changed after GLIBC 2.34 according to the release notes(https://lists.gnu.org/archive/html/info-gnu/2021-08/msg00001.html).

This may cause linkage errors if we use GLIBC(>= 2.34).
2024-04-10 16:02:34 +08:00
Pxl
5c0256e4bf [Bug](case) fix wrong case test_mv_partition (#33324)
fix wrong case test_mv_partition
2024-04-10 16:02:20 +08:00
93b20f0cc4 [chore](Nereids) create policy always allow fallback (#33226) 2024-04-10 16:01:58 +08:00
bcc819ddd9 [fix](Nereids) array_range not support amount without unit (#33231) 2024-04-10 16:01:58 +08:00