Commit Graph

5812 Commits

Author SHA1 Message Date
7e615afbce branch-2.1: [fix](regression-test) fix test_outfile_csv_with_names_and_types case #46214 (#46272)
Cherry-picked from #46214

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2025-01-02 15:06:39 +08:00
b5beaf4eb1 branch-2.1: [fix](mtmv)The refresh method for MTMV is commit. If the status is PAUSED, no more tasks should be generated #46020 (#46265)
Cherry-picked from #46020

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-01-02 14:03:28 +08:00
ffb8077ecb [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size… (#46249)
… from default to 2048 (#34105)

since 50 may cause performance issue introduced by #33853

Co-authored-by: lihangyu <15605149486@163.com>
2025-01-02 10:50:12 +08:00
a6fc852ce7 branch-2.1: [opt](catalog) use table in db object return get db #46211 (#46229)
Cherry-picked from #46211

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
Co-authored-by: morningman <yunyou@selectdb.com>
2025-01-01 08:00:49 +08:00
0ee1a6273f [branch-2.1](regression) disable hudi p2 jni reader test for branch-2.1 (#46231) 2025-01-01 08:00:15 +08:00
2f6c13d4c0 branch-2.1: [regression-test](fix) remove interrupt() in test_routine_load_eof.groovy #46044 (#46098)
Cherry-picked from #46044

Co-authored-by: shuke <shuke@selectdb.com>
2024-12-31 23:17:46 +08:00
84126ea721 [regression-test](fix) fix test_cumu_compaction_with_delete.groovy global var (#46165) 2024-12-31 23:08:04 +08:00
fbfb36b8e2 branch-2.1: [test](catalog) add lower case meta auth test #46114 (#46129)
Cherry-picked from #46114

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
2024-12-31 22:10:11 +08:00
Pxl
43c646363e [Bug](runtime-filter) support ip rf and use exception to replace dche… (#41531)
…ck when PrimitiveType to PColumnType (#39985)

use exception to replace dcheck when PrimitiveType to PColumnType
```cpp
*** SIGABRT unknown detail explain (@0x11d3f) received by PID 73023 (TID 74292 OR 0x7fd758225640) from PID 73023; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_master/doris/be/src/common/signal_handler.h:421
 1# 0x00007FDDBE6B9520 in /lib/x86_64-linux-gnu/libc.so.6
 2# pthread_kill at ./nptl/pthread_kill.c:89
 3# raise at ../sysdeps/posix/raise.c:27
 4# abort at ./stdlib/abort.c:81
 5# 0x000056123F81A94D in /root/output/be/lib/doris_be
 6# 0x000056123F80CF8A in /root/output/be/lib/doris_be
 7# google::LogMessage::SendToLog() in /root/output/be/lib/doris_be
 8# google::LogMessage::Flush() in /root/output/be/lib/doris_be
 9# google::LogMessageFatal::~LogMessageFatal() in /root/output/be/lib/doris_be
10# doris::to_proto(doris::PrimitiveType) at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:114
11# doris::IRuntimeFilter::push_to_remote(doris::TNetworkAddress const*) at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:1143
12# doris::IRuntimeFilter::publish(bool)::$_0::operator()(doris::IRuntimeFilter*) const at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:959
13# doris::IRuntimeFilter::publish(bool)::$_2::operator()() const at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:983
14# doris::IRuntimeFilter::publish(bool) at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:997
```

## Proposed changes
pick from #39985
2024-12-30 20:56:11 +08:00
c6742cbe7e branch-2.1: [fix](test) Inverted index property inconsistent #45834 (#46143)
pick: https://github.com/apache/doris/pull/45834
2024-12-30 20:05:13 +08:00
d5b145ab07 [regression-test](fix) rm unused case regression-test/suites/nereids_rules_p0/defer_materialize_topn/one_phase.groovy (#46167) 2024-12-30 17:37:48 +08:00
7040abfb04 [fix](correctness) Fix operator initialization (#45728) (#46150)
Now we plan for local exchange depends on operator initialization. This
PR fixed a wrong order between those two steps.

pick #45728
2024-12-30 17:01:33 +08:00
6c9167d9d9 branch-2.1: [test](doc) add job-scheduler example in doris's doc to regression test #42904 (#45968)
Cherry-picked from #42904

Co-authored-by: yagagagaga <zhangminke@selectdb.com>
2024-12-30 10:44:58 +08:00
5425e4686b branch-2.1: [fix](auth) fix use database stmt access unauthorized catalog #45720 (#45978)
Cherry-picked from #45720

Co-authored-by: Petrichor <xiaowenli@selectdb.com>
2024-12-30 10:43:28 +08:00
a835203947 branch-2.1: [regression-test](fix) enlarge statistic test case's waiting time #45590 (#46017)
Cherry-picked from #45590

Co-authored-by: shuke <shuke@selectdb.com>
2024-12-30 10:41:55 +08:00
1d742b5f7d [Cherry-pick](branch-2.1) Pick "[Enhancement](compaction) Do not set failure time when cumulative compaction dealing with delete rowset (#43466)" (#46117)
Before this PR, in cases where there is an alternating distribution of
data rowset -> delete rowset -> data rowset -> delete rowset, cumulative
compaction would only move the cumulative point forward to allow base
compaction to handle the delete rowset. Cumulative compaction itself
would not process the data and would return be marked as failure. This
would cause the compaction submission task process to pause for 5
seconds, impacting efficiency.

This PR modifies the return status to OK for such cases, which improves
the efficiency of the compaction submission task.
2024-12-30 10:18:57 +08:00
a490a366e4 [improvement](statistics)Support get oracle jdbc row count. (#45214) (#46133)
backport: https://github.com/apache/doris/pull/45214
2024-12-29 22:17:57 +08:00
6dd92be33d [feature](statistics)Support get row count for pg and sql server. (#42674) (#46131)
backport: https://github.com/apache/doris/pull/42674
2024-12-29 19:37:21 +08:00
a380f5d222 [enchement](utf8)import enable_text_validate_utf8 session var (#45537) (#46070)
bp #45537
2024-12-28 10:05:03 +08:00
829d9b3454 branch-2.1: [Fix](PreparedStatement) nondeterministic functions in prepared statement should not be short circuited #46003 (#46109)
Cherry-picked from #46003

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2024-12-27 21:02:36 +08:00
a1840a0630 [cherry-pick](branch-2.1)regression-test alter table partition (#43561)
prick from :https://github.com/apache/doris/pull/41437
2024-12-27 19:48:07 +08:00
6cee95540d branch-2.1: [fix](variant) disable column name with dot character for variant type #45927 (#45992)
Cherry-picked from #45927

Co-authored-by: camby <cambyzhu@tencent.com>
2024-12-27 19:12:44 +08:00
4746e9e3a2 [opt](inverted index)Optimize code to get rid of heap use after free (#45745) (#46075)
bp #45745
2024-12-27 16:46:58 +08:00
dd916c0626 [regression-test](fix) fix regression case bugs (#46055)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
schema change case bugs when cherry pick
2024-12-27 14:57:25 +08:00
fcc4d0d451 [fix](inverted index) Modify Error Handling for File Open Failure (#45773)
https://github.com/apache/doris/pull/44551
2024-12-27 14:09:57 +08:00
25edcd2f37 [fix](regression)Fix paimon row count case. (#45994) (#46012)
backport: https://github.com/apache/doris/pull/45994
2024-12-27 07:18:00 +08:00
a93ae03ecb branch-2.1: [fix](case)fix manager regression case. #45993 (#46033)
Cherry-picked from #45993

Co-authored-by: daidai <changyuwei@selectdb.com>
2024-12-26 22:32:28 +08:00
8b9167cac9 [regression-test](fix) fix two case use same table (#46053) 2024-12-26 21:58:30 +08:00
4a07efe119 [improvement](statistics)Async drop table stats while doing truncate and schema change(#45923) (#46010)
backport: https://github.com/apache/doris/pull/45923
2024-12-26 21:57:18 +08:00
0c13cf84d0 [regression-test](fix) fix regression-test/suites/schema_change_p0/test_uniq_mv_schema_change.groovy bug (#46050) 2024-12-26 21:28:36 +08:00
3a8df5fe00 [regression-test](fix) fix global var bug (#46013) 2024-12-26 15:28:55 +08:00
f951c6aed0 [fix](case)fix acid regression case. (#45999)
### What problem does this PR solve?

Problem Summary:
just fix error case.
2024-12-26 15:23:25 +08:00
02519c37ea branch-2.1: [test](mysql catalog) fix mysql jdbc catalog test case (#45988) 2024-12-26 15:06:24 +08:00
bceebfcf38 branch-2.1: [test](jdbc catalog) add some jdbc query tvf test (#45991)
cherry-pick #45938
2024-12-26 15:05:50 +08:00
1396f5a950 [2.1][improvement](jdbc catalog) Optimize JdbcCatalog case mapping stability (#43256)
cherry-pick #41510
2024-12-26 14:57:56 +08:00
879bb79655 [regression-test](fix) fix two case bug (#45974) 2024-12-26 10:25:32 +08:00
289d621faa [improvement](information_schema)Show view definition in information_schema.views. (#45857) (#45930)
backport: https://github.com/apache/doris/pull/45857
2024-12-26 10:11:13 +08:00
bccfb04436 branch-2.1: [fix](parser) Syntax error for add partition with null null #45865 (#45913)
Cherry-picked from #45865

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2024-12-25 22:15:20 +08:00
20c49c3638 [regression-test](fix) fix global var (#45917) 2024-12-25 15:29:40 +08:00
303f6bd849 [test](regression-test) use unified trigger_and_wait_compaction metho… (#45908) 2024-12-25 13:59:51 +08:00
547e88b1ee branch-2.1: [fix](csv reader) fix core dump when parsing csv with enclose #45485 (#45889)
Cherry-picked from #45485

Co-authored-by: hui lai <laihui@selectdb.com>
2024-12-25 12:09:20 +08:00
fdb65197e7 [feat](mtmv)mtmv support paimon partition refresh(#43959,#44911) (#45878)
pick: #44911 #43959

only pick code about paimon, not pick some code about MTMV REFRESH
2024-12-25 12:08:27 +08:00
6c2107788c [fix](nereids) support one phase DeferMaterializeTopN #45693-branch-2.1 (#45845) 2024-12-25 12:00:58 +08:00
1314a2b942 branch-2.1: [test](nereids) add test simplify comparison predicate #44886 (#45804)
cherry pick from #44886
2024-12-24 21:43:15 +08:00
f0031d9954 [cherry-pick](branch-21)support posexplode table function (#43221) (#45783)
cherry-pick from master #43221
2024-12-24 21:42:30 +08:00
0b41c927e3 branch-2.1: [case](auth)Add case for auth #45478 (#45819)
Cherry-picked from #45478

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2024-12-24 21:41:48 +08:00
0a64cea3bf [fix](mtmv) Fix mv is deleted in nested mv causing query err and fix some test (#45744) (#45862)
pr: 
https://github.com/apache/doris/pull/45744

commitId: 067643df
2024-12-24 20:03:24 +08:00
bcc2c155df [test] fix partition prune unstable cases (#44976) (#45846)
cherry-pick #44976 to branch-2.1
2024-12-24 19:06:26 +08:00
c9d3f1122b [regression-test](framework) disable defining global variable in test… (#45840) 2024-12-24 17:21:27 +08:00
8b35b0e477 branch-2.1: [fix](function) fixed some nested type func's param type which is not suitable and make result wrong #44923 (#45798)
Cherry-picked from #44923
2024-12-24 14:57:33 +08:00