f733aa5dcf
branch-2.1: [fix](fold) fixed an issue with be computing constants #43410 ( #45712 )
...
Cherry-picked from #43410
2024-12-20 20:26:27 +08:00
2a5f4c7979
[fix](ranger) make RangerDorisAccessController as singleton to avoid more and more ranger policy refresher ( #45645 )
...
Issue Number: close #45641
Problem Summary:
doris create new RangerDorisAccessController twice when do every
checkpoint, and the new RangerDorisAccessController instance create a
new ranger policy refresher. Too many policy refreshers will cause
ranger admin overload
2024-12-20 17:13:23 +08:00
17cc76e589
branch-2.1: [fix](variable) force update variable not work as expected #45648 ( #45696 )
...
Cherry-picked from #45648
Co-authored-by: morrySnow <zhangwenxin@selectdb.com >
2024-12-20 14:44:07 +08:00
7e5d880431
branch-2.1: [fix](iceberg) Fill in the detailed error information #45415 ( #45688 )
...
Cherry-picked from #45415
Co-authored-by: wuwenchi <wuwenchi@selectdb.com >
2024-12-20 13:32:02 +08:00
b39358fd0a
[Fix](branch-2.1) Fix arrow-flight-sql to use pipeline ( #45661 )
...
### What problem does this PR solve?
Fix arrow-flight-sql to use pipeline
2024-12-20 11:22:15 +08:00
afb59f5f0d
[opt](Nereids) lock table in ascending order of table IDs ( #45045 ) ( #45679 )
...
pick from master #45045
2024-12-20 11:02:03 +08:00
2f62954525
branch-2.1: [fix](create table) fix create table fail msg #45623 ( #45651 )
...
cherry pick from #45623
2024-12-20 10:58:54 +08:00
19c0e89da7
[enchement](iceberg)support read iceberg partition evolution table. ( #45367 ) ( #45569 )
...
cherry-pick #45367
Co-authored-by: daidai <changyuwei@selectdb.com >
2024-12-20 08:56:51 +08:00
cc691b6e01
branch-2.1: [Fix](Job)Fix redundant job scheduling by preventing same state transitions (e.g., RUNNING → RUNNING) #45495 ( #45647 )
...
Cherry-picked from #45495
Co-authored-by: Calvin Kirs <guoqiang@selectdb.com >
2024-12-19 23:28:37 +08:00
e91a810df8
branch-2.1: [fix](sql cache) fix prepare statement with sql cache throw NullPointerException #45640 ( #45650 )
...
fix prepare statement with sql cache throw NullPointerException:
```shell
java.lang.NullPointerException: Cannot read field "originStmt" because the return value of "org.apache.doris.analysis.StatementBase.getOrigStmt()" is null
```
2024-12-19 20:01:40 +08:00
f966088fd0
branch-2.1: [fix](nereids) fix ExtractAndNormalizeWindowExpression bug #45553 ( #45635 )
...
Cherry-picked from #45553
Co-authored-by: feiniaofeiafei <moailing@selectdb.com >
2024-12-19 19:13:03 +08:00
d6c629d293
branch-2.1: [fix](tvf) Tvf supports to parse the enclose character in csv files #45407 ( #45570 )
...
Cherry-picked from #45407
Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com >
2024-12-19 16:23:44 +08:00
7f8ec3e679
branch-2.1: [fix](export) Make enable_outfile_to_local available for export command #45241 ( #45515 )
...
Cherry-picked from #45241
Co-authored-by: Siyang Tang <tangsiyang@selectdb.com >
2024-12-19 14:08:33 +08:00
7957e6fe0f
branch-2.1: [Fix] Add column with default value string throw exception #45000 ( #45316 )
...
Cherry-picked from #45000
Co-authored-by: Uniqueyou <134280716+wyxxxcat@users.noreply.github.com >
2024-12-19 14:07:43 +08:00
90ca889f84
branch-2.1: [fix](external)fix split and get the schema #45408 ( #45566 )
...
Cherry-picked from #45408
Co-authored-by: wuwenchi <wuwenchi@selectdb.com >
2024-12-19 14:06:36 +08:00
55ef1a60b3
branch-2.1: [fix](sql) Fix error result for column tosql #44997 ( #45582 )
...
Cherry-picked from https://github.com/apache/doris/pull/44997
2024-12-19 10:00:07 +08:00
afeb5863ad
branch-2.1: [fix](nereids) fix compare with date like literal #45382 ( #45595 )
...
cherry pick from #45382
2024-12-18 22:59:27 +08:00
44e60a93c5
branch-2.1: [fix] (property) Filter table property storage_policy for db sync #44756 ( #45578 )
...
Cherry-picked from #44756
Co-authored-by: Uniqueyou <wangyixuan@selectdb.com >
2024-12-18 22:53:41 +08:00
ab427f60a2
branch-2.1: [feat](binlog) Add Support recover binlog #44818 ( #45294 )
...
Cherry-picked from #44818
Co-authored-by: Vallish Pai <vallishpai@gmail.com >
2024-12-18 22:53:04 +08:00
fca9c91193
[fix](restore) Add restore_reset_index_id config #45283 ( #45574 )
...
cherry pick from #45283
2024-12-18 22:45:53 +08:00
bc048a3e36
[bugfix](fe) should use equals not == to get failed to select replica message ( #45602 )
...
### What problem does this PR solve?
The original code use == to filter tag, it is wrong.
2024-12-18 22:26:26 +08:00
ca24cd1cd9
branch-2.1 [Fix](Insert-Job)Resolving Task Status Discrepancies in Query Execution Records ( #45342 ) ( #45451 )
...
bp #45342
2024-12-18 16:49:21 +08:00
855e9a508c
[fix](catalog) opt the count pushdown rule for iceberg/paimon/hive scan node ( #44038 ) ( #45564 )
...
bp #44038
2024-12-18 09:54:56 +08:00
416f3cf2ba
branch-2.1: [fix](iceberg)Fill in the detailed error information #45285 ( #45338 )
...
Cherry-picked from #45285
Co-authored-by: wuwenchi <wuwenchi@selectdb.com >
2024-12-18 07:58:09 +08:00
fb31042327
branch-2.1: [fix](hive)Clear processed tasks #45309 ( #45339 )
...
Cherry-picked from #45309
Co-authored-by: wuwenchi <wuwenchi@selectdb.com >
2024-12-17 22:00:57 +08:00
5517045598
branch-2.1: [chore](checkpoint) add enable_checkpoint config #45301 ( #45328 )
...
Cherry-picked from #45301
Co-authored-by: walter <maochuan@selectdb.com >
2024-12-17 20:11:51 +08:00
748648ef1e
branch-2.1: [fix](nereids) fix bug when sum0 distinct appear in cte #45447 ( #45511 )
...
Cherry-picked from #45447
Co-authored-by: feiniaofeiafei <moailing@selectdb.com >
2024-12-17 20:10:43 +08:00
a8e172ea5d
branch-2.1: [Fix](show-stmt) Raise an error when show partitions with complex predicate #45257 ( #45519 )
...
Cherry-picked from #45257
Co-authored-by: zclllyybb <zhaochangle@selectdb.com >
2024-12-17 18:03:47 +08:00
b6a1803127
[improve](backup) Add config ignore_backup_tmp_partitions #45240 ( #45331 )
...
cherry pick from #45240
2024-12-17 14:31:06 +08:00
79662fcc94
[branch-2.1](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT ( #45358 )
...
pick https://github.com/apache/doris/pull/35239
add special logic to deal smooth upgrade
The origin PR is https://github.com/apache/doris/pull/35239 . for
branch-3.0 it was merged in 3.0.0 but forgot to register old version.
now in branch-3.0 we fix it in
https://github.com/apache/doris/pull/45428 which must be merged in
3.0.4. and do same thing in this PR which must be merged in 2.1.8.
then:
```
FROM TO result
217- 218+ ✅
217- 303- 💥
218+ 303- ✅
218+ 304+ ✅
303- 304+ ✅
```
this is our best result.
2024-12-17 11:51:07 +08:00
f3f9cba6bd
[improvement](statistics)Set enableQueryCache to false for statistics queries. ( #45474 ) ( #45493 )
...
backport: https://github.com/apache/doris/pull/45474
2024-12-17 09:47:34 +08:00
7e9f6951c0
[fix](statistics)Fix skip analyze empty table case. ( #45441 ) ( #45455 )
...
backport: https://github.com/apache/doris/pull/45441
2024-12-16 17:28:05 +08:00
17f4c1a17a
branch-2.1: [enhance](nereids) remove first_value and second_value second parameter if the second parameter is false #45264 ( #45454 )
...
Cherry-picked from #45264
Co-authored-by: feiniaofeiafei <moailing@selectdb.com >
2024-12-16 17:00:18 +08:00
4d1f4fb5d2
branch-2.1: [fix](nereids)EliminateGroupBy rule should keep output's datatype unchanged #45359 ( #45399 )
...
Cherry-picked from #45359
Co-authored-by: starocean999 <lichi@selectdb.com >
2024-12-16 14:58:09 +08:00
4df7069e59
branch-2.1: [fix](ip)fix default value for ip #45194 ( #45392 )
...
Cherry-picked from #45194
Co-authored-by: amory <wangqiannan@selectdb.com >
2024-12-16 14:38:12 +08:00
d13241115d
[branch-2.1]downgrade resource tag when there is not queryable repli… ( #45387 )
...
pick #44255
2024-12-16 10:17:34 +08:00
249ffa44c0
branch-2.1 [Chore](dependencies)Upgrade Fe dependencies #44872 ( #45362 )
...
#44872
2024-12-14 19:13:08 -08:00
4d6d9a6c8c
branch-2.1: [fix](persist) Fix TableAddOrDropInvertedIndicesInfo.equals #45335 ( #45364 )
...
Cherry-picked from #45335
Co-authored-by: walter <maochuan@selectdb.com >
2024-12-13 09:58:26 +08:00
95ffc7a65f
branch-2.1: [fix](job)Fix millisecond offset issue in time window scheduling trigger time calculation #45176 ( #45353 )
...
Cherry-picked from #45176
Co-authored-by: Calvin Kirs <guoqiang@selectdb.com >
2024-12-12 19:09:15 +08:00
667f5e6e6a
[feat](iceberg)Supports using rest type catalog to read tables in unity catalog for 2.1 ( #43525 ) ( #45217 )
...
bp: #43525
2024-12-12 00:49:36 -08:00
5901e94f29
branch-2.1: [Job](Fix)Improve Event Publishing with Timeout #45103 ( #45300 )
...
Cherry-picked from #45103
Co-authored-by: Calvin Kirs <guoqiang@selectdb.com >
2024-12-12 09:52:00 +08:00
36695e871a
[feature](statistics)Support auto analyze columns that haven't been analyzed for a long time. #42399 ( #45250 )
...
backport: https://github.com/apache/doris/pull/42399
2024-12-12 01:57:44 +08:00
fb407f2e94
[opt](lambda) let lambda expression support refer outer slot ( #45186 )
2024-12-11 18:55:49 +08:00
239aea5d2a
[fix](restore) avoid NPE for restore job #36395 ( #45292 )
...
cherry pick from #36395
Co-authored-by: Xujian Duan <50550370+DarvenDuan@users.noreply.github.com >
2024-12-11 18:44:55 +08:00
76613668f7
[fix](bloomFilter)fix data type supported behavior same in FE and BE … ( #45178 )
2024-12-11 18:04:04 +08:00
e68460a730
branch-2.1: [enhance](auth)When authorization includes create, not check if resources exist #45125 ( #45166 )
...
Cherry-picked from #45125
Co-authored-by: zhangdong <zhangdong@selectdb.com >
2024-12-11 14:57:46 +08:00
f83d98bb2e
branch-2.1: [fix](Outfile) add more regression-test cases for Select into outfile #45230 ( #45275 )
...
Cherry-picked from #45230
Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com >
2024-12-11 14:57:15 +08:00
a233349ea2
[enchement](mc)Optimize reading of maxcompute partition tables. ( #45148 ) ( #45246 )
...
bp #45148
### What problem does this PR solve?
Problem Summary:
Optimize reading of maxcompute partition tables:
1. Introduce batch mode to generate splits for Maxcompute partition
tables to optimize scenarios with a large number of partitions. Control
it through the variable `num_partitions_in_batch_mode`.
2. Introduce catalog parameter `mc.split_cross_partition`. The parameter
is true, which is more friendly to reading partition tables, and false,
which is more friendly to debug.
3. Add `-Darrow.enable_null_check_for_get=false` to be jvm to improve
the efficiency of mc arrow data conversion.
2024-12-11 14:56:27 +08:00
55be65d0bd
branch-2.1: [enhance](nereids) SqlParser support load data into temporary partition #45025 ( #45228 )
...
Cherry-picked from #45025
Co-authored-by: zxealous <zhouchangyue@baidu.com >
2024-12-11 14:38:39 +08:00
cbab6f55c3
branch-2.1: [fix](nereids) not rewrite first_value when first_value ignore nulls #45065 ( #45236 )
...
Cherry-picked from #45065
Co-authored-by: feiniaofeiafei <moailing@selectdb.com >
2024-12-11 14:36:48 +08:00
