Commit Graph

3525 Commits

Author SHA1 Message Date
f733aa5dcf branch-2.1: [fix](fold) fixed an issue with be computing constants #43410 (#45712)
Cherry-picked from #43410
2024-12-20 20:26:27 +08:00
19c0e89da7 [enchement](iceberg)support read iceberg partition evolution table. (#45367) (#45569)
cherry-pick #45367

Co-authored-by: daidai <changyuwei@selectdb.com>
2024-12-20 08:56:51 +08:00
4b7c2eaa7d [branch-2.1](fix) fix incorrect result of hash join with const column (#45630) 2024-12-19 19:14:38 +08:00
f966088fd0 branch-2.1: [fix](nereids) fix ExtractAndNormalizeWindowExpression bug #45553 (#45635)
Cherry-picked from #45553

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-12-19 19:13:03 +08:00
55e5e69a81 [branch-2.1]Fix test_audit_log_behavior failed (#45636) 2024-12-19 17:43:11 +08:00
d6c629d293 branch-2.1: [fix](tvf) Tvf supports to parse the enclose character in csv files #45407 (#45570)
Cherry-picked from #45407

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2024-12-19 16:23:44 +08:00
7957e6fe0f branch-2.1: [Fix] Add column with default value string throw exception #45000 (#45316)
Cherry-picked from #45000

Co-authored-by: Uniqueyou <134280716+wyxxxcat@users.noreply.github.com>
2024-12-19 14:07:43 +08:00
7d32e4f71f branch-2.1: [Fix](ORC) Not push down fixed char type in orc reader #45484 (#45525)
cherry-pick #45484
2024-12-19 14:06:00 +08:00
afeb5863ad branch-2.1: [fix](nereids) fix compare with date like literal #45382 (#45595)
cherry pick from #45382
2024-12-18 22:59:27 +08:00
Pxl
fe0cc289de [Bug](function) fix wrong result on group_concat with distinct+order_… (#45513) 2024-12-18 22:49:18 +08:00
1980e098bc branch-2.1: [Test](binlog) Check correctly for show create database #45472 (#45551)
Cherry-picked from #45472

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2024-12-18 22:43:15 +08:00
855e9a508c [fix](catalog) opt the count pushdown rule for iceberg/paimon/hive scan node (#44038) (#45564)
bp #44038
2024-12-18 09:54:56 +08:00
748648ef1e branch-2.1: [fix](nereids) fix bug when sum0 distinct appear in cte #45447 (#45511)
Cherry-picked from #45447

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-12-17 20:10:43 +08:00
01684ce3b1 branch-2.1: [fix](mysql-buffer) fix special buffer size with nested type #45126 (#45458)
Cherry-picked from #45126

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-12-17 17:48:10 +08:00
191ef9b8b0 branch-2.1: [fix](schema-change) fix array/map/struct in schema-change not-null to null will make core #45305 (#45482)
Cherry-picked from #45305

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-12-17 17:05:17 +08:00
79662fcc94 [branch-2.1](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT (#45358)
pick https://github.com/apache/doris/pull/35239


add special logic to deal smooth upgrade

The origin PR is https://github.com/apache/doris/pull/35239. for
branch-3.0 it was merged in 3.0.0 but forgot to register old version.
now in branch-3.0 we fix it in
https://github.com/apache/doris/pull/45428 which must be merged in
3.0.4. and do same thing in this PR which must be merged in 2.1.8.
then:
```
FROM    TO    result
217-    218+    
217-    303-    💥
218+    303-    
218+    304+    
303-    304+    
```
this is our best result.
2024-12-17 11:51:07 +08:00
c561bdb906 [cherry-pick](branch-21) fix first/last value return error with ignore null (#44996) (#45486)
cherry-pick from master https://github.com/apache/doris/pull/44996
2024-12-17 10:04:02 +08:00
17f4c1a17a branch-2.1: [enhance](nereids) remove first_value and second_value second parameter if the second parameter is false #45264 (#45454)
Cherry-picked from #45264

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-12-16 17:00:18 +08:00
4df7069e59 branch-2.1: [fix](ip)fix default value for ip #45194 (#45392)
Cherry-picked from #45194

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-12-16 14:38:12 +08:00
d13241115d [branch-2.1]downgrade resource tag when there is not queryable repli… (#45387)
pick #44255
2024-12-16 10:17:34 +08:00
b881157d52 branch-2.1: [regression](paimon) test Paimon's connectivity of cloud filesystems #45268 (#45378)
Cherry-picked from #45268

Co-authored-by: Socrates <suyiteng@selectdb.com>
2024-12-14 19:22:16 -08:00
667f5e6e6a [feat](iceberg)Supports using rest type catalog to read tables in unity catalog for 2.1 (#43525) (#45217)
bp: #43525
2024-12-12 00:49:36 -08:00
8217371d15 branch-2.1: [chore](regression-test) move some variant cases to directory #45169 (#45259)
Cherry-picked from #45169

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2024-12-12 12:16:04 +08:00
0c55edd3bf branch-2.1: [opt](compaction) Don't check missed rows in cumu compaction if input rowsets are not in tablet (#45279) (#45304)
pick https://github.com/apache/doris/pull/45279
2024-12-12 11:14:30 +08:00
da885691ca branch-2.1: [fix](column_array)fix filter_generic in column_array func #41990 (#44983)
Cherry-picked from #41990

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-12-12 09:52:26 +08:00
fb407f2e94 [opt](lambda) let lambda expression support refer outer slot (#45186) 2024-12-11 18:55:49 +08:00
f83d98bb2e branch-2.1: [fix](Outfile) add more regression-test cases for Select into outfile #45230 (#45275)
Cherry-picked from #45230

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2024-12-11 14:57:15 +08:00
a233349ea2 [enchement](mc)Optimize reading of maxcompute partition tables. (#45148) (#45246)
bp #45148

### What problem does this PR solve?
Problem Summary:
Optimize reading of maxcompute partition tables:
1. Introduce batch mode to generate splits for Maxcompute partition
tables to optimize scenarios with a large number of partitions. Control
it through the variable `num_partitions_in_batch_mode`.
2. Introduce catalog parameter `mc.split_cross_partition`. The parameter
is true, which is more friendly to reading partition tables, and false,
which is more friendly to debug.
3. Add `-Darrow.enable_null_check_for_get=false` to be jvm to improve
the efficiency of mc arrow data conversion.
2024-12-11 14:56:27 +08:00
55be65d0bd branch-2.1: [enhance](nereids) SqlParser support load data into temporary partition #45025 (#45228)
Cherry-picked from #45025

Co-authored-by: zxealous <zhouchangyue@baidu.com>
2024-12-11 14:38:39 +08:00
1662e4709a Pick some pr to 21 #43010 #43030 #43785 #44779 #44786 #44857 (#45129) 2024-12-09 11:46:48 +08:00
b4e2e2cf78 branch-2.1: [fix](hudi)Add hudi catalog read partition table partition prune #44669 (#45113)
Cherry-picked from #44669

Co-authored-by: daidai <changyuwei@selectdb.com>
2024-12-06 14:41:27 -08:00
6ddc45b3fd branch-2.1: [opt](auto-inc) Allow to miss auto-increment column and other value columns in partial update #44528 (#45073)
pick https://github.com/apache/doris/pull/44528
2024-12-06 22:40:44 +08:00
d4a6fd1850 Revert #43255 & #44615 (#45096)
Revert "branch-2.1: [enhance](orc) Optimize ORC Predicate Pushdown for
OR-connected Predicate #43255 (#44438)"
Revert "[fix](orc) check all the cases before build_search_argument
(#44615) (#44801)"
2024-12-06 21:14:13 +08:00
53291bd040 branch-2.1: [fix](hudi) upgrade hudi to 0.15.0 (#44267)(#44995) (#45041)
cherry-pick pr: #44267 #44995
2024-12-05 23:18:37 -08:00
f0324e2a56 branch-2.1: [improvement](information_schema)Support show default value in information_schema. #44849 (#45080)
Cherry-picked from #44849

Co-authored-by: James <lijibing@selectdb.com>
2024-12-06 14:54:09 +08:00
f038f28682 branch-2.1: [fix](mtmv) Fixed an error in setting variables in nested materialize views #44960 (#45038)
Cherry-picked from #44960
2024-12-06 14:04:13 +08:00
682cec9b9a [test](stream load) add cases to ensure the correctness of the document (#43016) (#44385)
pick #43016
2024-12-06 11:04:51 +08:00
fa633d751d [pick](branch-2.1) pick #44489 #44894 (#45024)
### What problem does this PR solve?

pick #44489 #44894
2024-12-05 17:04:15 +08:00
dcf3eb3434 branch-2.1: [fix](agg) Fixed a core dump when using the IPv6 type in array_agg. #44877 (#44918)
Cherry-picked from #44877

Co-authored-by: Mryange <yanxuecheng@selectdb.com>
2024-12-04 22:05:00 +08:00
823c24d7b5 branch-2.1: [fix](mtmv) Fix filter position different but same causing rewritten by materialized view fail #44575 (#44900)
Cherry-picked from #44575

Co-authored-by: seawinde <wusi@selectdb.com>
2024-12-04 22:03:26 +08:00
191c86bb8b branch-2.1: [fix](nereids) fix merge_percentile_to_array when has same agg function #44783 (#44879)
Cherry-picked from #44783

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-12-04 22:02:16 +08:00
60dde858b9 [fix](maxcompute)add mc catalog read partition table partition prune(#44508) (#44830) 2024-12-04 18:06:31 +08:00
5c686c32a2 branch-2.1: [fix](mtmv) Fix mv rewrite fail when base table add column #44867 (#44956)
Cherry-picked from #44867

Co-authored-by: seawinde <wusi@selectdb.com>
2024-12-04 17:43:49 +08:00
3820657e28 [fix](regression-test) Fix some schema change case not pick to 2.1 sufficiently (#44921)
pick: #37390 (partly)
2024-12-04 14:26:41 +08:00
d10cb19b07 [fix](sync mv) fix rewrite wrongly with sync mv (#44866)
Cherry-picked from https://github.com/apache/doris/pull/39284
2024-12-03 19:59:41 +08:00
3e1692298b [Feat](nereids) support pull up predicate from set operator (#39450) (#44056)
cherry-pick #39450 to branch-2.1
2024-12-03 16:24:52 +08:00
a95201aa3a branch-2.1: [fix](outfile) add regression test for outfile #44734 (#44809)
Cherry-picked from #44734

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2024-12-02 10:08:05 +08:00
4d023cf0b2 [fix](nereids) fix UnknownValue's reference in simplify range rule #44637 (#44771)
cherry pick from #44637
2024-11-29 20:58:40 +08:00
22b7c4ca21 [feature](nereids)support show view command in nereids (#44698) 2024-11-29 20:48:30 +08:00
82c7a9d15a [Fix](Variant) create table should not automatically add variant to key (#44736)
#36609
2024-11-29 09:34:43 +08:00