Commit Graph

5833 Commits

Author SHA1 Message Date
dda058c433 branch-2.1: [fix](test)fix unstable case correctness_p0/test_mv_case/test_mv_case #46101 (#46431)
Cherry-picked from #46101

Co-authored-by: starocean999 <lichi@selectdb.com>
2025-01-06 17:42:40 +08:00
6958dec242 branch-2.1: [fix](regression)Fix schema change statistics case. Neredis not allow change MV schema. #46433 (#46448)
Cherry-picked from #46433

Co-authored-by: James <lijibing@selectdb.com>
2025-01-06 16:50:52 +08:00
7b8a93879c [test](mtmv)Test and check the differences between MTMV and OLAP (#44793)
pick from #36520 
pick from #44417 

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-01-06 09:57:59 +08:00
12350ca867 branch-2.1: [Improve](mtmv) skip the generation of invalid task for refresh mtmv #46280 (#46392)
Cherry-picked from #46280

Co-authored-by: shee <13843187+qzsee@users.noreply.github.com>
Co-authored-by: garenshi <garenshi@tencent.com>
2025-01-05 08:59:11 +08:00
3d6ad47d08 branch-2.1: [fix](test) fix unstable lower case test #46410 (#46416)
Cherry-picked from #46410

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2025-01-04 22:28:29 +08:00
1b1d7e2f29 branch-2.1: [fix](test) fix test_autoinc_broker_load.groovy #46320 (#46338)
Cherry-picked from #46320

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2025-01-04 14:17:31 +08:00
012848060b branch-2.1: [fix](test) Fix mysql catalog check db test #46263 (#46343)
Cherry-picked from #46263

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
2025-01-04 10:45:26 +08:00
db224ba15f [fix](variant) fix schema change for variant from not null to null (#46403)
cherry-pick from #46279
2025-01-04 09:00:43 +08:00
d8c94d6392 branch-2.1: [fix](regression)fix hive translation unstable case. #46385 (#46409)
Cherry-picked from #46385

Co-authored-by: daidai <changyuwei@selectdb.com>
2025-01-04 08:59:56 +08:00
e9921d7a07 branch-2.1: [fix](external catalog) Fixed non-master FE log replay during refresh (#46373)
cherry-pick #46369
2025-01-03 22:03:30 +08:00
69de40ca27 branch-2.1: [fix](regression-test) fix injection would not be removed when exception #46357 (#46360)
Cherry-picked from #46357

Co-authored-by: hui lai <laihui@selectdb.com>
2025-01-03 22:02:50 +08:00
384b78fa4e [Fix]delete internal group (#46351) 2025-01-03 21:59:36 +08:00
333b54eaba [fix](ip) fix ip nullable param without check (#44700) (#46252)
if we use ipv6_cidr_to_range function with nullable func which with
invalid ipv6 will make be core
```
mysql> select id, ipv6_cidr_to_range(nullable(''), 32) from fn_test_ip_nullable order by id;
```
2025-01-03 21:24:37 +08:00
26f570f40e [test](test) fix unstable paimon test cases (#46383)
cherry-pick #46381
2025-01-03 20:04:59 +08:00
ff68859546 branch-2.1: [improvement](http) improve table schema api for catalog table #45933 (#45982)
Cherry-picked from #45933

Co-authored-by: wudi <wudi@selectdb.com>
2025-01-03 16:40:12 +08:00
025038410c [opt](test) add more debug info in test_jdbc_catalog_ddl.groovy (#46323)
cherry-pick #46322
2025-01-03 09:14:54 +08:00
79955e3d94 branch-2.1: [fix](regression-test) flush out file to fix hudi p2 #46258 (#46317)
Cherry-picked from #46258

Co-authored-by: Socrates <suyiteng@selectdb.com>
2025-01-03 09:13:48 +08:00
86f2050af7 [fix](test) use different catalog name for test_hive_parquet_skip_page (#46314)
cherry-pick #46315
2025-01-03 09:13:06 +08:00
e5aeacae59 branch-2.1: [test](case) skip unstable case in cloud mode #46274 (#46298)
skip unstable case in cloud mode
2025-01-02 20:32:28 +08:00
7206ca39ec [fix](DECIMAL) error DECIMAL cat to BOOLEAN (#44326) (#46275)
In the past, there were issues with converting `double` and `decimal` to
`boolean`.
For example, a `double` value like 0.13 would first be cast to `uint8`,
resulting in 0.
Then, it would be converted to `bool`, yielding 0 (incorrect, as the
expected result is 1).

Similarly, `decimal` values were directly cast to `uint8`, leading to
non-0/1 values for `bool`.
This issue arises because Doris internally uses `uint8` to represent
`boolean`.

before
```
mysql> select cast(40.123 as BOOLEAN);
+-------------------------+
| cast(40.123 as BOOLEAN) |
+-------------------------+
|                      40 |
+-------------------------+
```

now
```
mysql> select cast(40.123 as BOOLEAN);
+-------------------------+
| cast(40.123 as BOOLEAN) |
+-------------------------+
|                       1 |
+-------------------------+
```

### What problem does this PR solve?

pick #44326
Related PR: #[44326](https://github.com/mrhhsg/doris/tree/pick_44326)

Problem Summary:
2025-01-02 18:42:04 +08:00
068ff8deae branch-2.1: [opt](show) let all types table support show index #45861 (#45898)
Cherry-picked from #45861

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2025-01-02 17:13:58 +08:00
7e615afbce branch-2.1: [fix](regression-test) fix test_outfile_csv_with_names_and_types case #46214 (#46272)
Cherry-picked from #46214

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2025-01-02 15:06:39 +08:00
b5beaf4eb1 branch-2.1: [fix](mtmv)The refresh method for MTMV is commit. If the status is PAUSED, no more tasks should be generated #46020 (#46265)
Cherry-picked from #46020

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-01-02 14:03:28 +08:00
ffb8077ecb [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size… (#46249)
… from default to 2048 (#34105)

since 50 may cause performance issue introduced by #33853

Co-authored-by: lihangyu <15605149486@163.com>
2025-01-02 10:50:12 +08:00
a6fc852ce7 branch-2.1: [opt](catalog) use table in db object return get db #46211 (#46229)
Cherry-picked from #46211

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
Co-authored-by: morningman <yunyou@selectdb.com>
2025-01-01 08:00:49 +08:00
0ee1a6273f [branch-2.1](regression) disable hudi p2 jni reader test for branch-2.1 (#46231) 2025-01-01 08:00:15 +08:00
2f6c13d4c0 branch-2.1: [regression-test](fix) remove interrupt() in test_routine_load_eof.groovy #46044 (#46098)
Cherry-picked from #46044

Co-authored-by: shuke <shuke@selectdb.com>
2024-12-31 23:17:46 +08:00
84126ea721 [regression-test](fix) fix test_cumu_compaction_with_delete.groovy global var (#46165) 2024-12-31 23:08:04 +08:00
fbfb36b8e2 branch-2.1: [test](catalog) add lower case meta auth test #46114 (#46129)
Cherry-picked from #46114

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
2024-12-31 22:10:11 +08:00
Pxl
43c646363e [Bug](runtime-filter) support ip rf and use exception to replace dche… (#41531)
…ck when PrimitiveType to PColumnType (#39985)

use exception to replace dcheck when PrimitiveType to PColumnType
```cpp
*** SIGABRT unknown detail explain (@0x11d3f) received by PID 73023 (TID 74292 OR 0x7fd758225640) from PID 73023; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_master/doris/be/src/common/signal_handler.h:421
 1# 0x00007FDDBE6B9520 in /lib/x86_64-linux-gnu/libc.so.6
 2# pthread_kill at ./nptl/pthread_kill.c:89
 3# raise at ../sysdeps/posix/raise.c:27
 4# abort at ./stdlib/abort.c:81
 5# 0x000056123F81A94D in /root/output/be/lib/doris_be
 6# 0x000056123F80CF8A in /root/output/be/lib/doris_be
 7# google::LogMessage::SendToLog() in /root/output/be/lib/doris_be
 8# google::LogMessage::Flush() in /root/output/be/lib/doris_be
 9# google::LogMessageFatal::~LogMessageFatal() in /root/output/be/lib/doris_be
10# doris::to_proto(doris::PrimitiveType) at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:114
11# doris::IRuntimeFilter::push_to_remote(doris::TNetworkAddress const*) at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:1143
12# doris::IRuntimeFilter::publish(bool)::$_0::operator()(doris::IRuntimeFilter*) const at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:959
13# doris::IRuntimeFilter::publish(bool)::$_2::operator()() const at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:983
14# doris::IRuntimeFilter::publish(bool) at /home/zcp/repo_center/doris_master/doris/be/src/exprs/runtime_filter.cpp:997
```

## Proposed changes
pick from #39985
2024-12-30 20:56:11 +08:00
c6742cbe7e branch-2.1: [fix](test) Inverted index property inconsistent #45834 (#46143)
pick: https://github.com/apache/doris/pull/45834
2024-12-30 20:05:13 +08:00
d5b145ab07 [regression-test](fix) rm unused case regression-test/suites/nereids_rules_p0/defer_materialize_topn/one_phase.groovy (#46167) 2024-12-30 17:37:48 +08:00
7040abfb04 [fix](correctness) Fix operator initialization (#45728) (#46150)
Now we plan for local exchange depends on operator initialization. This
PR fixed a wrong order between those two steps.

pick #45728
2024-12-30 17:01:33 +08:00
6c9167d9d9 branch-2.1: [test](doc) add job-scheduler example in doris's doc to regression test #42904 (#45968)
Cherry-picked from #42904

Co-authored-by: yagagagaga <zhangminke@selectdb.com>
2024-12-30 10:44:58 +08:00
5425e4686b branch-2.1: [fix](auth) fix use database stmt access unauthorized catalog #45720 (#45978)
Cherry-picked from #45720

Co-authored-by: Petrichor <xiaowenli@selectdb.com>
2024-12-30 10:43:28 +08:00
a835203947 branch-2.1: [regression-test](fix) enlarge statistic test case's waiting time #45590 (#46017)
Cherry-picked from #45590

Co-authored-by: shuke <shuke@selectdb.com>
2024-12-30 10:41:55 +08:00
1d742b5f7d [Cherry-pick](branch-2.1) Pick "[Enhancement](compaction) Do not set failure time when cumulative compaction dealing with delete rowset (#43466)" (#46117)
Before this PR, in cases where there is an alternating distribution of
data rowset -> delete rowset -> data rowset -> delete rowset, cumulative
compaction would only move the cumulative point forward to allow base
compaction to handle the delete rowset. Cumulative compaction itself
would not process the data and would return be marked as failure. This
would cause the compaction submission task process to pause for 5
seconds, impacting efficiency.

This PR modifies the return status to OK for such cases, which improves
the efficiency of the compaction submission task.
2024-12-30 10:18:57 +08:00
a490a366e4 [improvement](statistics)Support get oracle jdbc row count. (#45214) (#46133)
backport: https://github.com/apache/doris/pull/45214
2024-12-29 22:17:57 +08:00
6dd92be33d [feature](statistics)Support get row count for pg and sql server. (#42674) (#46131)
backport: https://github.com/apache/doris/pull/42674
2024-12-29 19:37:21 +08:00
a380f5d222 [enchement](utf8)import enable_text_validate_utf8 session var (#45537) (#46070)
bp #45537
2024-12-28 10:05:03 +08:00
829d9b3454 branch-2.1: [Fix](PreparedStatement) nondeterministic functions in prepared statement should not be short circuited #46003 (#46109)
Cherry-picked from #46003

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2024-12-27 21:02:36 +08:00
a1840a0630 [cherry-pick](branch-2.1)regression-test alter table partition (#43561)
prick from :https://github.com/apache/doris/pull/41437
2024-12-27 19:48:07 +08:00
6cee95540d branch-2.1: [fix](variant) disable column name with dot character for variant type #45927 (#45992)
Cherry-picked from #45927

Co-authored-by: camby <cambyzhu@tencent.com>
2024-12-27 19:12:44 +08:00
4746e9e3a2 [opt](inverted index)Optimize code to get rid of heap use after free (#45745) (#46075)
bp #45745
2024-12-27 16:46:58 +08:00
dd916c0626 [regression-test](fix) fix regression case bugs (#46055)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
schema change case bugs when cherry pick
2024-12-27 14:57:25 +08:00
fcc4d0d451 [fix](inverted index) Modify Error Handling for File Open Failure (#45773)
https://github.com/apache/doris/pull/44551
2024-12-27 14:09:57 +08:00
25edcd2f37 [fix](regression)Fix paimon row count case. (#45994) (#46012)
backport: https://github.com/apache/doris/pull/45994
2024-12-27 07:18:00 +08:00
a93ae03ecb branch-2.1: [fix](case)fix manager regression case. #45993 (#46033)
Cherry-picked from #45993

Co-authored-by: daidai <changyuwei@selectdb.com>
2024-12-26 22:32:28 +08:00
8b9167cac9 [regression-test](fix) fix two case use same table (#46053) 2024-12-26 21:58:30 +08:00
4a07efe119 [improvement](statistics)Async drop table stats while doing truncate and schema change(#45923) (#46010)
backport: https://github.com/apache/doris/pull/45923
2024-12-26 21:57:18 +08:00