c016eb49c5
[enhance](mtmv)When obtaining the partition list fails, treat the pai… ( #46708 )
...
…mon table as an unpartitioned table (#46641 )
pick: https://github.com/apache/doris/pull/46641
2025-01-10 10:46:09 +08:00
26bdd23e05
branch-2.1: [fix](nereids) analyzing job should not be blocked by enable_stats=false #46630 ( #46691 )
...
Cherry-picked from #46630
Co-authored-by: minghong <zhouminghong@selectdb.com >
2025-01-09 22:21:02 +08:00
04b840713b
branch-2.1: [fix](jdbc catalog) Use factory methods to return mapped types instead ( #46698 )
...
cherry-pick #46623
2025-01-09 18:12:03 +08:00
912e4ca010
branch-2.1: [fix](Nereids) fix fe folding constant of string functions and add more cases #45233 ( #46523 )
...
pick: #45233
Issue Number: #44666
Related PR: #40441
Problem Summary:
- select substring_index('哈哈哈AAA','A', 1); String.split function has
second parameter 'limit', which is default zero. When 'limit' is zero,
it means it would remove trailing empty strings split of '哈哈哈AAA', which
would be '哈哈哈' only. But what we expect is '哈哈哈', '','','' when part
function is used by substring index. So we should change splitpart limit
to -1 to enable trailing empty character in splitpart list
- reorganize fold constant of string functions in fe and add more cases
---------
Co-authored-by: Mryange <59914473+Mryange@users.noreply.github.com >
2025-01-09 17:05:13 +08:00
4f41bad283
branch-2.1: [fix](Nereids) fix cast string to date #46065 ( #46526 )
...
pick: #46065
Related PR: #35637
Problem Summary:
When cast("201-01-01" as datetimev2(0)), The result is "2020-01-01" but
it is wrong. It should be result in "0201-01-01".
201 would be regarded as 20xy-0z as related pr show, it was a bug. But
actually it should not have this trasformation and result in
2025-01-09 17:03:36 +08:00
afeff5daee
branch-2.1: [fix](nereids) fix bug in PhysicalTopN.equals() #46547 ( #46633 )
...
Cherry-picked from #46547
Co-authored-by: minghong <zhouminghong@selectdb.com >
2025-01-09 10:28:40 +08:00
ca5a4f6d35
[Fix](Variant) variant should not implicit be short key column when create mv ( #46539 )
...
cherry-pick from #46444
2025-01-09 08:15:22 +08:00
ebb425dd84
branch-2.1: [fix](planner) fix core when select and filter by slot in old planner #46541 ( #46638 )
...
Cherry-picked from #46541
Co-authored-by: Lijia Liu <liutang123@yeah.net >
Co-authored-by: liutang123 <liulijia@gmail.com >
2025-01-08 22:32:35 +08:00
b99ef07a3b
branch-2.1: [fix](Nereids) fix log and power #46077 ( #46635 )
...
Cherry-picked from #46077
Co-authored-by: LiBinfeng <libinfeng@selectdb.com >
2025-01-08 22:31:22 +08:00
f2419c49a7
branch-2.1: [opt](jni) Modify Exception Cause Formatting in JniUtil for Better Readability #46437 ( #46602 )
...
Cherry-picked from #46437
Co-authored-by: zy-kkk <zhongyk10@gmail.com >
2025-01-08 22:30:19 +08:00
6a68b09100
branch-2.1: [fix](cache) fix mtmv cache can not use test #46537 ( #46607 )
...
Cherry-picked from #46537
Co-authored-by: 924060929 <lanhuajian@selectdb.com >
2025-01-08 21:09:53 +08:00
2687dedabf
[fix](nereids) fix sql cache bug and some tests ( #46443 ) ( #46505 )
...
cherry pick from #46443
2025-01-08 14:45:06 +08:00
f6ea71ab61
branch-2.1: [chore](MTMV) catch all exception when get mtmvs to avoid plan failed #46474 ( #46536 )
...
Cherry-picked from #46474
Co-authored-by: morrySnow <zhangwenxin@selectdb.com >
2025-01-08 13:56:18 +08:00
4b3422fc8e
branch-2.1: [fix](bf index) add ngram bf index validation in nereids index definition check #45780 ( #46216 )
...
cherry pick from #45780
2025-01-08 10:04:21 +08:00
6bf31a2a0d
branch-2.1: [fix](variable) variable version not persist in image #46463 ( #46499 )
...
Cherry-picked from #46463
Co-authored-by: morrySnow <zhangwenxin@selectdb.com >
2025-01-07 16:41:49 +08:00
abbf75e9fe
branch-2.1: [fix](Nereids) insert into with cte cannot be explained ( #46384 ) ( #46501 )
...
pick from master #46384
2025-01-07 13:44:32 +08:00
52455ed6d5
branch-2.1: [opt](cache) enhance cache key computation by removing comments and trimming SQL input #46099 ( #46472 )
...
Cherry-picked from #46099
Co-authored-by: York Cao <52438394+Baymine@users.noreply.github.com >
2025-01-07 13:39:48 +08:00
5962dceddb
branch-2.1: [fix](hms)fix hive catalog follower not get event. #46485 ( #46490 )
...
Cherry-picked from #46485
Co-authored-by: daidai <changyuwei@selectdb.com >
2025-01-07 12:19:06 +08:00
ccb6c2610a
branch-2.1: [fix](nereids)fix bug of PushDownFilterThroughSetOperation ( #46370 ) ( #46456 )
...
pick from master #46370
Co-authored-by: feiniaofeiafei <moailing@selectdb.com >
2025-01-06 21:34:40 +08:00
53889cbbb6
branch-2.1: [enhance](auth)Reduce the scope of permission locks #46115 ( #46451 )
...
Cherry-picked from #46115
Co-authored-by: zhangdong <zhangdong@selectdb.com >
2025-01-06 18:51:09 +08:00
12350ca867
branch-2.1: [Improve](mtmv) skip the generation of invalid task for refresh mtmv #46280 ( #46392 )
...
Cherry-picked from #46280
Co-authored-by: shee <13843187+qzsee@users.noreply.github.com >
Co-authored-by: garenshi <garenshi@tencent.com >
2025-01-05 08:59:11 +08:00
a4c328c4cd
branch-2.1: [fix](compile) fix fe compile failed by code too large #46408 ( #46420 )
...
Cherry-picked from #46408
Co-authored-by: 924060929 <lanhuajian@selectdb.com >
2025-01-05 05:07:49 +08:00
eb867f593a
branch-2.1: [opt](iceberg) opt the error msg when create db which already exists #46334 ( #46414 )
...
Cherry-picked from #46334
Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com >
2025-01-04 19:05:52 +08:00
1405c48a77
[opt](coordinator) optimize parallel degree of shuffle when use nereids ( #44754 ) ( #46397 )
...
cherry pick from #44754
2025-01-04 19:04:17 +08:00
2358dc4403
[fix](nereids) Create Runtime filter even if equal.right is not in aliasTransferMap (branch-2.1) ( #46407 )
...
### What problem does this PR solve?
pick #46406
Related PR: #40815
2025-01-04 11:54:08 +08:00
714b90a7fe
branch-2.1: [fix](arrow-flight-sql) Fix arrow-flight-sql ConnectContext to use a unified ID #46284 ( #46389 )
...
Cherry-picked from #46284
Co-authored-by: Xinyi Zou <zouxinyi@selectdb.com >
2025-01-04 10:36:09 +08:00
8b45258ae6
[fix](external)using saved member variables for 2.1 ( #46156 ) ( #46400 )
...
bp: #46156
2025-01-04 09:01:14 +08:00
e9921d7a07
branch-2.1: [fix](external catalog) Fixed non-master FE log replay during refresh ( #46373 )
...
cherry-pick #46369
2025-01-03 22:03:30 +08:00
384b78fa4e
[Fix]delete internal group ( #46351 )
2025-01-03 21:59:36 +08:00
c2a17b8ad9
[fix](schema-change) Fix job replay failure when partitions added to table after job finish ( #46166 ) ( #46367 )
...
Cherry-picked from #46166
2025-01-03 19:25:43 +08:00
ff68859546
branch-2.1: [improvement](http) improve table schema api for catalog table #45933 ( #45982 )
...
Cherry-picked from #45933
Co-authored-by: wudi <wudi@selectdb.com >
2025-01-03 16:40:12 +08:00
05292563ca
branch-2.1: [fix](statistics)Fix sample all tablets scale factor incorrect bug. #46306 ( #46329 )
...
Cherry-picked from #46306
Co-authored-by: James <lijibing@selectdb.com >
2025-01-03 16:28:59 +08:00
98a8738a7d
[fix](metaCache)fix bug that names cache can not invalidate.( #46287 ) ( #46349 )
...
bp #46287
2025-01-03 14:51:40 +08:00
86f2050af7
[fix](test) use different catalog name for test_hive_parquet_skip_page ( #46314 )
...
cherry-pick #46315
2025-01-03 09:13:06 +08:00
c385293ee9
branch-2.1: [opt](nereids) improve prune partition with lots of in (xxx) #46261 ( #46286 )
...
improve prune partition with lots of `in (xxx)`
this can reduce from 35s to 300ms when there have 4000 options
2025-01-02 18:52:31 +08:00
068ff8deae
branch-2.1: [opt](show) let all types table support show index #45861 ( #45898 )
...
Cherry-picked from #45861
Co-authored-by: morrySnow <zhangwenxin@selectdb.com >
2025-01-02 17:13:58 +08:00
2c7e5cae9a
branch-2.1: [fix](catalog) Fix mark handling for failed tasks to maintain getLeftMarks #46205 ( #46256 )
...
cherry pick from #46205
2025-01-02 16:39:43 +08:00
f6d98a6061
branch-2.1: [Bug](auto-partition) fix auto partition could set storage_medium properties #45955 ( #46260 )
...
Cherry-picked from #45955
Co-authored-by: zhangstar333 <zhangsida@selectdb.com >
2025-01-02 16:38:55 +08:00
bfab6361f7
branch-2.1: [fix](report) report queue size based on the number of Bes and config #46190 ( #46243 )
...
Cherry-picked from #46190
Co-authored-by: deardeng <dengxin@selectdb.com >
2025-01-02 15:11:03 +08:00
fbc361ec7c
branch-2.1: [opt](arrow-flight-sql) Support arrow-flight-sql protocol getStreamCatalogs, getStreamSchemas, getStreamTables #46217 ( #46268 )
...
Cherry-picked from #46217
Co-authored-by: Xinyi Zou <zouxinyi@selectdb.com >
2025-01-02 15:07:04 +08:00
b5beaf4eb1
branch-2.1: [fix](mtmv)The refresh method for MTMV is commit. If the status is PAUSED, no more tasks should be generated #46020 ( #46265 )
...
Cherry-picked from #46020
Co-authored-by: zhangdong <zhangdong@selectdb.com >
2025-01-02 14:03:28 +08:00
9e45c70923
branch-2.1: [chore](restore) log the table name and partition info when partition type is different #46213 ( #46234 )
...
Cherry-picked from #46213
Co-authored-by: walter <maochuan@selectdb.com >
2025-01-01 08:09:11 +08:00
a6fc852ce7
branch-2.1: [opt](catalog) use table in db object return get db #46211 ( #46229 )
...
Cherry-picked from #46211
Co-authored-by: zy-kkk <zhongyk10@gmail.com >
Co-authored-by: morningman <yunyou@selectdb.com >
2025-01-01 08:00:49 +08:00
9593a7bfc3
branch-2.1: [fix](split)Fixed the bug that batch mode split could not query data in multiple be scenarios. #46218 ( #46227 )
...
Cherry-picked from #46218
Co-authored-by: daidai <changyuwei@selectdb.com >
2025-01-01 00:34:48 +08:00
28960b7b7d
[Improve](nereids) use hash set replace three set in DiscreteValue to improve in predicate performance ( #45181 ) ( #46220 )
...
### What problem does this PR solve?
cp #45181
2024-12-31 23:04:57 +08:00
1d8b3a0bcc
branch-2.1: [fix](audit) fix the delay in loading audit log #46175 ( #46193 )
...
Cherry-picked from #46175
Co-authored-by: shee <13843187+qzsee@users.noreply.github.com >
2024-12-31 22:56:12 +08:00
f59c285538
branch-2.1: [fix](index)Add duplicated indexes check in add index #46155 ( #46210 )
...
Cherry-picked from #46155
Co-authored-by: qiye <luen@selectdb.com >
2024-12-31 22:46:29 +08:00
9eb07e578e
branch-2.1 [Fix](catalog)Remove the fs.disable.cache parameter to prevent excessive FS-associated objects and memory leaks ( #46184 ) ( #46191 )
...
…
#46184
(cherry picked from commit 17667aeb92efc5580b8615e53a3ef4f514a27204)
2024-12-31 16:54:10 +08:00
fa20529dd9
[enhance](auth)Optimize the authentication logic of Ranger Doris( #41207 ) ( #46179 )
...
pick: https://github.com/apache/doris/pull/41207
only pick Performance optimization related
2024-12-31 11:54:27 +08:00
aa8c93cfe2
branch-2.1: [fix](sql) Wrong result for alter set property #46028 ( #46141 )
...
pick https://github.com/apache/doris/pull/46028
2024-12-31 09:52:43 +08:00
