Commit Graph

18429 Commits

Author SHA1 Message Date
97df5981a1 [Fix](inverted index) update clucene (#28356) 2023-12-14 10:01:23 +08:00
1901f0f35b [fix](function) bad performance caused by creating Status::RuntimeError (#28362) 2023-12-14 09:29:22 +08:00
e5be751697 [bug](exchange) Fix core dump if prepare failed (#28363) 2023-12-13 22:59:12 +08:00
33e24436d6 [fix](regression) mow cases should use assertEquals not assertTrue (#28338) 2023-12-13 22:14:32 +08:00
a271fee3c5 [test](statistics)Add external empty table test case. (#28267) 2023-12-13 21:48:01 +08:00
e4f7b25276 [optimize](invert index) inverted indexes optimize the file cache (#27887)
Arrange idx files in the order of segment, fnm, tii, tis to ensure that data opened during the open index phase is added to the idx file cache.
2023-12-13 20:48:53 +08:00
099b1b7106 [fix](statistics)Fix column stats trigger info bug (#28303)
Before, we didn't update the jobType info in ColStatsMeta. This will case the jobType always be the type
when it first be set. For example, if we manually analyzed table, the jobType will always be MANUAL,
even if this table is auto analyzed again later.
2023-12-13 20:31:03 +08:00
0868526f6a [fix](sequence column) fix update fail on nereids planner (#28031)
1. if we set enable_fallback_to_original_planner to false, the UPDATE sql in regression case test_unique_table_sequence will fail due to:“Table test_uniq_sequence has sequence column, need to specify the sequence column”,The bug is introduced by [fix](sequence column) insert into should require sequence column in all scenario #27780
2. fix insert fail in transaction mode, which is introduced by [refactor](Nereids) let insert into compatible with legacy planner #27947
3. add cases with session variable enable_fallback_to_original_planner false
2023-12-13 19:41:41 +08:00
dbc2b081d7 [fix](Nereids) could not do partition prunning when predicates is NULL (#28294) 2023-12-13 19:36:42 +08:00
ec91dd1129 [opt](vfilescanner) interrupt running parquet/orc readers when scannode is finished (#28223)
VScanNode::get_next will check whether the ScanNode has reached limit condition, and send eos to TaskScheduler, and TaskScheduler will try to close ScanNode.
However, ScanNode must wait all running scanners finished, so even if ScanNode has reached limit condition, it can't be closed immediately.
This PR try to interrupt the running readers, and make ScanNode to end as soon as possible.
2023-12-13 19:31:08 +08:00
524bce3c07 [doc](auditlog) update description of field sql_digest (#28340) 2023-12-13 19:27:48 +08:00
4f5821407f [case]Load data with load_parallelism=any > 1 and stream load with compress type (#27306) 2023-12-13 18:41:14 +08:00
43327383c3 [regression test](broker laod) add exception case for merge type (#27840) 2023-12-13 18:34:34 +08:00
9b94faf403 fix](memory_leak) fix memory leak on vrow_distribution #28336 2023-12-13 18:22:14 +08:00
ea832744df [fix](journal) ensure txns are matched with the master before replaying (#28192) 2023-12-13 18:14:51 +08:00
62859f38c1 [fix](nereids)cast string to integer type use wrong datatype's valueOf method (#28174)
select cast('12.31' as tinyint);
select cast('12.31' as smallint);
select cast('12.31' as int);

should return NULL
2023-12-13 17:53:07 +08:00
ac262fa176 [fix](partial update) Fix session variable enable_unique_key_partial_update will affect the behavior of insert statement when the target table is not unique table (#28321) 2023-12-13 17:14:30 +08:00
e6e8632167 [improvement](merge-on-write) Optimize publish when there are missing versions (#28012)
1. Do not retry publishing on be When there are too many missing versions, just
add to async publish task.
2. To reduce memory consumption, clean up the tasks when there are too many
async publish tasks.
2023-12-13 16:59:25 +08:00
dee89d2c4a [refactor](Nereids) let create table compatible with legacy planner (#28078) 2023-12-13 16:35:40 +08:00
8ac52aeda7 [fix](nereids) wrong result when simplify int compare with decimal literal (#28195)
SimplifyComparisonPredicate rule create wrong result when simplify int compare with decimal literal
2023-12-13 16:13:42 +08:00
3e08bec27f [opt](regression test) use select count from tablet api (#28327) 2023-12-13 16:12:56 +08:00
2005fee430 [fix](user) Avoid throw unknown UserProperty after FE rollback version (#28325)
After using SET PROPERTY to modify the user property, if FE rolls back to a version without this property, `Unknown user property` error will be reported when replay EditLog, just ignore it.
2023-12-13 16:00:04 +08:00
5f66335e54 [feature](pipelineX) add local_shuffle in set_operation / assert_num operator (#28293) 2023-12-13 15:15:20 +08:00
cd6d75e518 [fix](memory) TabletSchema and Schema no longer track memory, only track columns count. (#28149)
TabletSchema and Schema no longer track memory, only track columns count. because cannot accurately track memory size.

TabletMeta MemTracker changed to track TabletSchema columns count.

Segment::_meta_mem_usage Unknown value overflow, causes the value of SegmentMeta MemTracker is similar to -2912341218700198079. So, temporarily put it in experimental type tracker.
2023-12-13 15:06:46 +08:00
613b0bd552 [fix](decimal) fix decimal overflow caused by null value (#28260) 2023-12-13 14:53:39 +08:00
862cb0912a [fix](load) count MemTable::to_block memory in flush tracker (#28312) 2023-12-13 14:49:25 +08:00
764d893cbf Remove unused const variables NUMBER, ZERO in vnumbers_tvf.cpp (#28317)
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
2023-12-13 13:16:48 +08:00
78b0fec33a [Fix](Outfile) Support export nested complex type data to orc file format (#28182) 2023-12-13 11:55:27 +08:00
a719d7a222 [fix](memory) Fix LRU Cache of type NUMBER charge (#28175) 2023-12-13 11:15:57 +08:00
b901800963 [Fix] Support BE log sys_log_level modify to take effect dynamically (apache#26060) (#28203) 2023-12-13 11:08:48 +08:00
805673dd53 [typo](doc)Add spark load faq (#28015) 2023-12-13 09:45:15 +08:00
bb4c192a57 [improvement](doris compose) show all cluster (#28288) 2023-12-13 01:35:41 +08:00
eda2818b95 [fix](group commit) Fix insert_group_commit_into_unique_sync_mode (#28283) 2023-12-13 01:12:57 +08:00
9372959410 Revert "[regression-test](case) forbid group commit case first #28244" (#28250)
This reverts commit ad483efca50f2ecb3fc88bd7dab8b1bc46e7f2e7.
2023-12-13 01:12:11 +08:00
78cf401c92 [enhancement](err-msg) expose real error msg for invalid delete conf (#28287) 2023-12-13 01:07:31 +08:00
5e374c6a35 Fix FE web insecure cookie setting #26056 (#26057)
* Fix FE web insecure cookie setting #26056

* [Bug] FE web insecure cookie setting #26056
2023-12-12 22:50:40 +08:00
15553e6335 [Bug](fold-constant) fix result error with fold constant on BE (#28194) 2023-12-12 21:24:29 +08:00
cdb452ff3d [typo](docs)update jdk download version to 8u391 #28216
Co-authored-by: Yijia Su <suyijia@selectdb.com>
2023-12-12 21:20:54 +08:00
7f604276c7 [improvement](truncate table) truncate skip empty partition (#28229) 2023-12-12 21:12:31 +08:00
7f9cecb623 [fix](fe) Key column varchar length change should't light schema change (#28235) 2023-12-12 21:08:38 +08:00
13b9350aeb [Bug](scan)fix some case query timeout of not schedule scanner (#28243)
now in pipeline, when result block queue is empty, will be reschedule, and then choose a batch of scanner,
but sometimes, get_available_thread_slot_num() will return thread_slot_num <= 0, so it's will do nothing,
and then block queue will always empty.
have no chance to reschedule again until query timeout.
2023-12-12 21:00:22 +08:00
ace2b45c37 [fix](decimalv2) avoid crashing caused by decimalv2 arithmetic with check_overflow_for_decimal enabled (#28219) 2023-12-12 20:32:10 +08:00
5c1d69de70 [opt](session var) throw exception when setting query time out to zero (#28247) 2023-12-12 20:30:47 +08:00
0a5a579151 [test](jdbc catalog) Use different table names to prevent case errors (#28276) 2023-12-12 19:19:02 +08:00
15f5acf1ae [feature](pipelineX) add local_shuffle in sort partition sort analytic node (#28265) 2023-12-12 18:47:46 +08:00
b821c377b6 [Refact](inverted index) comment out block_column_predicate for inverted index and refact some code (#28281) 2023-12-12 18:12:01 +08:00
6e5f84635b [fix](Nereids): remove duplicated dependency (#28279) 2023-12-12 17:57:52 +08:00
7ac12ac7d7 [feature](Nereids): return edges that can be pulled up (#28280) 2023-12-12 17:55:59 +08:00
f401a9c7ec [fix](pipelineX) fix use-after-free in filter timer queue (#28236) 2023-12-12 17:25:14 +08:00
4e50b2791a [fix](Nereids) pull up cte anchor should also pull up cte in apply (#28214) 2023-12-12 16:56:04 +08:00