Commit Graph

21458 Commits

Author SHA1 Message Date
a3753c7edb [opt](nereids) optimize not found function error message (#47919) (#48102)
cherry pick from #47919
2025-02-21 10:13:46 +08:00
3738d0fddc branch-2.1: [fix](nereids) fix push down non-foldable filter through project #47989 (#48084)
cherry pick from #47989
2025-02-21 10:09:03 +08:00
4d5c337b23 branch-2.1: [feature](restore) support force_replace restore#47314 (#48051)
pick: https://github.com/apache/doris/pull/47314
2025-02-21 08:34:55 +08:00
3fa4413e3b branch-2.1: [fix](restore) Lock tablet before modify segment files #45711 (#48047)
cherry pick from #45711
2025-02-21 08:33:10 +08:00
46c2a0493c branch-2.1: [fix](paimon) avoid get paimon table when replay (#48151)
### What problem does this PR solve?

`catalog.getPaimonTable(dbName, name);` will try forward request to
master FE.
When in replay logic, forwarding will fail, cause fe failed to start.
Introduced from #43959
2025-02-21 01:07:55 +08:00
360933b885 branch-2.1: [feat](binlog) Speed binlog gc by locked binlogs #47547 (#48128)
cherry pick from #47547
2025-02-20 17:08:26 +08:00
7f65836d9a branch-2.1: [fix](nereids)check if correlated filter exists before converting apply to join #47985 (#48091)
Cherry-picked from #47985

Co-authored-by: starocean999 <lichi@selectdb.com>
2025-02-20 16:29:06 +08:00
c5d4b1173d branch-2.1: [enhance](mtmv)Mtmv support audit log #41499 (#47923)
pick from master #41499
2025-02-20 14:01:54 +08:00
bb6641b63e [cherry-pick](branch-21) add more signatures for lag/lead fucntion (#47940) (#48076) 2025-02-19 20:41:40 +08:00
caad4a7ff1 branch-2.1: [fix](table) Filter base idx id for get sycned table ddl #47970 (#48065)
pick: https://github.com/apache/doris/pull/47970
2025-02-19 19:26:50 +08:00
ae0779641c branch-2.1: [feat](binlog) Add lock binlog method #46887 (#48046)
cherry pick from #46887
2025-02-19 19:24:37 +08:00
4a39b2b338 branch-2.1: [fix](partition) Add partition of mismatched type to table #47200 (#48066)
pick: https://github.com/apache/doris/pull/47200
2025-02-19 19:17:58 +08:00
b2143d05c2 [branch-2.1](regression-test) flush hudi p2 cases (#48042)
### What problem does this PR solve?
Related PR: #47764
There is no hadoop-hudi-jni-scanner in 2.1, remove related cases
2025-02-19 19:00:39 +08:00
867ef1570a branch-2.1: [fix](Export) Fix the issue where the show export status stays stuck on EXPORTING. #47974 (#48060)
Cherry-picked from #47974

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2025-02-19 18:10:32 +08:00
a6fe815f06 branch-2.1: [Bug](function) add index check on function like #47991 (#48019)
Cherry-picked from #47991

Co-authored-by: Pxl <xl@selectdb.com>
2025-02-19 15:22:51 +08:00
bc6af178b3 branch-2.1: [fix](parquet)Fix data column and null map column not equal when reading Parquet complex type cross-page data #47734 (#48039)
Cherry-picked from #47734

Co-authored-by: daidai <changyuwei@selectdb.com>
2025-02-19 15:21:13 +08:00
a7f9188f79 branch-2.1: [improvement](info) Add F/L commitSeq and commitTs for get_lag #46769 (#47139)
Cherry-picked from #46769

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2025-02-19 10:32:36 +08:00
7f3681b3d7 branch-2.1: [BugFix](Variant) limit cast elimination to one level cast #47778 (#47955)
Cherry-picked from #47778

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2025-02-19 09:30:46 +08:00
9d5ec37309 branch-2.1: [fix](group commit) replay wal failed when enable global enable_memtable_on_sink_node #47968 (#48026)
Cherry-picked from #47968

Co-authored-by: meiyi <meiyi@selectdb.com>
2025-02-19 09:29:31 +08:00
c7ad5b6904 branch-2.1: [Bug](set) fix find null get wrong result on set operators #48001 (#48020)
Cherry-picked from #48001

Co-authored-by: Pxl <xl@selectdb.com>
2025-02-19 09:26:49 +08:00
c099ccdbd0 branch-2.1: [improve](load) print error string in local fs error messages #47918 (#48010)
Cherry-picked from #47918

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
2025-02-19 09:25:41 +08:00
dd86f9db6c branch-2.1: [opt](Nereids) support bind asterisk in aggregate (#48006) 2025-02-18 16:31:31 +08:00
203680f0ac branch-2.1: [fix](bdb) reset interrupted flag before calling bdbje #47874 (#47943)
Cherry-picked from #47874

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2025-02-18 13:50:51 +08:00
e153103e4d branch-2.1: [improve](load) improve error message "close wait failed coz rpc error" #47518 (#47805)
Cherry-picked from #47518

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
2025-02-18 09:38:28 +08:00
efa5125cdf branch-2.1: [chore](rename) Forbid renaming partition columns since this is a buggy feature #47596 (#47938)
Cherry-picked from #47596

Co-authored-by: Siyang Tang <tangsiyang@selectdb.com>
2025-02-18 09:16:10 +08:00
aabe704c7d [test](mv)Fix test mv case fail because doesn't find test method (#47953) 2025-02-17 14:50:30 +08:00
3a74799607 branch-2.1: [fix](Nereids) fix fold constant of time acquired functions #47288 (#47920)
pick from master #47288

Problem Summary:
explain select substr(current_date, 1, 10);
when logicalPlanBuilder build ast from original sql of date acquired
functions like current_date, it would add an alias above. Which would
stop folding constant when fold constant rule traversing expression tree
So remove alias when translate to ast
2025-02-17 14:36:02 +08:00
056022b423 branch-2.1: [chore](persist) save base index id & index names in TableAddOrDropColumnsInfo #47881 (#47936)
Cherry-picked from #47881

Co-authored-by: walter <maochuan@selectdb.com>
2025-02-16 21:17:41 +08:00
a8fad9d4f2 branch-2.1: [fix](Nereids) normalize plan should also lock target table #47843 (#47916)
pick from master #47843
2025-02-15 08:53:26 +08:00
e38902db18 branch-2.1: [improve](routine load) ensure abnormal jobs do not interfere with normal task scheduling #47530 (#47848)
Cherry-picked from #47530

Co-authored-by: hui lai <laihui@selectdb.com>
2025-02-14 21:52:03 +08:00
3f7308baa5 [fix](regression) regression case: limit_push_down is unstable (Branch-2.1) (#47895) 2025-02-14 21:51:23 +08:00
0034c63b86 branch-2.1: [fix](routine load) fix incorrect auto-resume interval caused by excessive auto-resume attempts #47528 (#47811)
Cherry-picked from #47528

Co-authored-by: hui lai <laihui@selectdb.com>
2025-02-14 20:36:57 +08:00
156a2e336e branch-2.1: [hotfix](external) Fixed External meta replay check (#47931)
cherry-pick from #47928
2025-02-14 20:34:51 +08:00
1fb96b8f27 branch-2.1: [opt](Nereids) avoid lock failed if async mv has invalid base info #47771 (#47914)
pick from master #47771
2025-02-14 17:51:37 +08:00
fb31586612 branch-2.1: [test](jdbc catalog) add more jdbc catalog extreme test (#47799)
cherry-pick (#47525)
2025-02-14 17:03:49 +08:00
f4e7337896 branch-2.1: [fix](Nereids) let anonymous alias same as user input #47093 (#47770)
pick from master #47093
2025-02-14 16:53:57 +08:00
8d3fe30bde [test](mv) Fix test case use wrong (#47885) 2025-02-14 10:22:05 +08:00
03529e3743 branch-2.1: [fix](nereids) fix join condition with AddMinMax rule hung #47772 (#47808)
Cherry-picked from #47772

Co-authored-by: 924060929 <lanhuajian@selectdb.com>
2025-02-14 10:20:14 +08:00
3ec900e878 branch-2.1:[opt](jdbc catalog) Compatible with higher ClickHouse JDBC Driver versions (#47832)
cherry-pick from (#46026)
2025-02-13 16:55:25 +08:00
8fb10b0fa0 branch-2.1: [opt](paimon) Optimize error prompt #47593 (#47790)
Cherry-picked from #47593

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2025-02-13 16:49:41 +08:00
13c8b1797d [fix](nereids)fix logical repeat computefd (#47798) 2025-02-13 16:27:30 +08:00
058929528c branch-2.1: [fix](mv) Fix use sync mv wrongly when use rbo materialized view rewrite rule #47650 (#47835)
Cherry-picked from #47650

Co-authored-by: seawinde <wusi@selectdb.com>
2025-02-13 16:10:20 +08:00
c4a10849d5 branch-2.1: [fix](nereids) fix nereids dead loop due to simplify range output in-predicate's options in random order #47830 (#47828)
### What problem does this PR solve?

cherry-pick: #47830

#45181 introduce a dead loop for nereids optimizer, then cause error
'Nereids cost too much time'.

simplify range process in-predicate steps as follow:
1.  Extract in-predicate's options into a set S1;
2. Use a discrete value desc to hold the value, use a new set S2, and
S2.addAll(S1);
3. Turn discrete value desc back to a new in-predicate, the new
in-predicate's options add all S2.

Before #45181, S2 is an order set(TreeSet), so the result in-predicate's
options are always order. But this PR change S2 as a unorder
set(HashSet). Then will cause dead loop: in-predicate => S1 => new S2 =>
new in-predicate => new S1 => new S2 => ...

fix: 
1. S1 use linked hash set;
2. don't use a new S2, just let S2 = S1;

then the result in-predicate's  options' order will be kept.
2025-02-13 11:10:22 +08:00
f8fb5f90b8 branch-2.1: [fix](Nereids) not release lock if schema changed when insert #47733 (#47833)
Cherry-picked from #47733

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2025-02-12 19:52:41 +08:00
8c6c642462 branch-2.1: [fix](nereids)keep at least one hash output slot when prune slots in hash join node #47318 (#47683)
Cherry-picked from #47318

Co-authored-by: starocean999 <lichi@selectdb.com>
2025-02-12 17:53:30 +08:00
48bcdf539a branch-2.1: [fix](table) Supply rollup for get ddl for sync #47732 (#47796)
Cherry-picked from #47732

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2025-02-12 16:19:22 +08:00
eee254efab [regression-test](case) remove test_auto_partition_behavior before fix (#47818) 2025-02-12 15:23:45 +08:00
f85176bee0 branch-2.1: [improve](move-memtable) improve error log and message for "not enough streams" #47470 (#47722)
Cherry-picked from #47470

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
2025-02-12 14:42:11 +08:00
cb3e77379d branch-2.1: [fix](backup) filter the staled task response by job id #47416 (#47445)
Cherry-picked from #47416

Co-authored-by: walter <maochuan@selectdb.com>
2025-02-12 14:41:32 +08:00
e8531621c0 branch-2.1: [feat](binlog) Support getting binlogs in batch #47557 (#47640)
Cherry-picked from #47557

Co-authored-by: walter <maochuan@selectdb.com>
2025-02-12 14:38:55 +08:00