database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
20,993 Commits 1 Branch 0 Tags
bc048a3e3693bccf9c8f85be9cc51e01a854592f
Commit Graph

20993 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yiguolei
bc048a3e36 [bugfix](fe) should use equals not == to get failed to select replica message (#45602) 
### What problem does this PR solve?

The original code use == to filter tag, it is wrong.
 2024-12-18 22:26:26 +08:00
Calvin Kirs
ca24cd1cd9 branch-2.1 [Fix](Insert-Job)Resolving Task Status Discrepancies in Query Execution Records (#45342) (#45451) 
bp #45342
 2024-12-18 16:49:21 +08:00
Mingyu Chen (Rayner)
855e9a508c [fix](catalog) opt the count pushdown rule for iceberg/paimon/hive scan node (#44038) (#45564) 
bp #44038
 2024-12-18 09:54:56 +08:00
github-actions[bot]
416f3cf2ba branch-2.1: [fix](iceberg)Fill in the detailed error information #45285 (#45338) 
Cherry-picked from #45285

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
 2024-12-18 07:58:09 +08:00
github-actions[bot]
fb31042327 branch-2.1: [fix](hive)Clear processed tasks #45309 (#45339) 
Cherry-picked from #45309

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
 2024-12-17 22:00:57 +08:00
github-actions[bot]
5517045598 branch-2.1: [chore](checkpoint) add enable_checkpoint config #45301 (#45328) 
Cherry-picked from #45301

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-17 20:11:51 +08:00
github-actions[bot]
748648ef1e branch-2.1: [fix](nereids) fix bug when sum0 distinct appear in cte #45447 (#45511) 
Cherry-picked from #45447

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2024-12-17 20:10:43 +08:00
github-actions[bot]
a8e172ea5d branch-2.1: [Fix](show-stmt) Raise an error when show partitions with complex predicate #45257 (#45519) 
Cherry-picked from #45257

Co-authored-by: zclllyybb <zhaochangle@selectdb.com>
 2024-12-17 18:03:47 +08:00
github-actions[bot]
01684ce3b1 branch-2.1: [fix](mysql-buffer) fix special buffer size with nested type #45126 (#45458) 
Cherry-picked from #45126

Co-authored-by: amory <wangqiannan@selectdb.com>
 2024-12-17 17:48:10 +08:00
Pxl
900086667f [Chore](pipeline) catch exception on task::prepare to avoid exception make backend coredump #45479 (#45516) 
…dump

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
 2024-12-17 17:22:05 +08:00
Pxl
7856662ecf [Bug](pipeline) make sink operator process eos signals after wake_up_early #45207 (#45400) 
make sink operator process eos signals after wake_up_early #45207  (#45400)
 2024-12-17 17:21:42 +08:00
github-actions[bot]
191ef9b8b0 branch-2.1: [fix](schema-change) fix array/map/struct in schema-change not-null to null will make core #45305 (#45482) 
Cherry-picked from #45305

Co-authored-by: amory <wangqiannan@selectdb.com>
 2024-12-17 17:05:17 +08:00
Kaijie Chen
8dc845671f [test](load) injection cases should check Exception is thrown (#44713) (#45321) 
backport #44713
 2024-12-17 14:37:27 +08:00
walter
b6a1803127 [improve](backup) Add config ignore_backup_tmp_partitions #45240 (#45331) 
cherry pick from #45240
 2024-12-17 14:31:06 +08:00
github-actions[bot]
8faf010c64 branch-2.1: [fix](function) The parameters after the first of the mask function need to be restricted to constants #45348 (#45498) 
Cherry-picked from #45348

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
 2024-12-17 14:25:05 +08:00
zclllyybb
79662fcc94 [branch-2.1](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT (#45358) 
pick https://github.com/apache/doris/pull/35239


add special logic to deal smooth upgrade

The origin PR is https://github.com/apache/doris/pull/35239. for
branch-3.0 it was merged in 3.0.0 but forgot to register old version.
now in branch-3.0 we fix it in
https://github.com/apache/doris/pull/45428 which must be merged in
3.0.4. and do same thing in this PR which must be merged in 2.1.8.
then:
```
FROM    TO    result
217-    218+    ✅
217-    303-    💥
218+    303-    ✅
218+    304+    ✅
303-    304+    ✅
```
this is our best result.
 2024-12-17 11:51:07 +08:00
zhangstar333
c561bdb906 [cherry-pick](branch-21) fix first/last value return error with ignore null (#44996) (#45486) 
cherry-pick from master https://github.com/apache/doris/pull/44996
 2024-12-17 10:04:02 +08:00
James
f3f9cba6bd [improvement](statistics)Set enableQueryCache to false for statistics queries. (#45474) (#45493) 
backport: https://github.com/apache/doris/pull/45474
 2024-12-17 09:47:34 +08:00
James
7e9f6951c0 [fix](statistics)Fix skip analyze empty table case. (#45441) (#45455) 
backport: https://github.com/apache/doris/pull/45441
 2024-12-16 17:28:05 +08:00
github-actions[bot]
17f4c1a17a branch-2.1: [enhance](nereids) remove first_value and second_value second parameter if the second parameter is false #45264 (#45454) 
Cherry-picked from #45264

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2024-12-16 17:00:18 +08:00
github-actions[bot]
9e5c53d576 branch-2.1: [Fix](job-case)Fix status typo #45326 (#45341) 
Cherry-picked from #45326

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-16 15:01:19 +08:00
github-actions[bot]
23c5d52b04 branch-2.1: [fix](s3) improve error msg #45360 (#45432) 
Cherry-picked from #45360

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2024-12-16 14:59:08 +08:00
github-actions[bot]
4d1f4fb5d2 branch-2.1: [fix](nereids)EliminateGroupBy rule should keep output's datatype unchanged #45359 (#45399) 
Cherry-picked from #45359

Co-authored-by: starocean999 <lichi@selectdb.com>
 2024-12-16 14:58:09 +08:00
github-actions[bot]
00e6902212 branch-2.1: [chore](arrow-flight-sql) Add Arrow Flight Sql demo for Java #45306 (#45389) 
Cherry-picked from #45306

Co-authored-by: Xinyi Zou <zouxinyi@selectdb.com>
 2024-12-16 14:56:56 +08:00
github-actions[bot]
4df7069e59 branch-2.1: [fix](ip)fix default value for ip #45194 (#45392) 
Cherry-picked from #45194

Co-authored-by: amory <wangqiannan@selectdb.com>
 2024-12-16 14:38:12 +08:00
wangbo
d13241115d [branch-2.1]downgrade resource tag when there is not queryable repli… (#45387) 
pick #44255
 2024-12-16 10:17:34 +08:00
github-actions[bot]
b881157d52 branch-2.1: [regression](paimon) test Paimon's connectivity of cloud filesystems #45268 (#45378) 
Cherry-picked from #45268

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2024-12-14 19:22:16 -08:00
github-actions[bot]
1db78d4496 branch-2.1: [fix](hive) fix block decompressor bug #45289 (#45379) 
Cherry-picked from #45289

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2024-12-14 19:20:55 -08:00
Calvin Kirs
249ffa44c0 branch-2.1 [Chore](dependencies)Upgrade Fe dependencies #44872 (#45362) 
#44872
 2024-12-14 19:13:08 -08:00
meiyi
6dabdd6a8c branch-2.1: [fix](txn insert) txn insert show error url #45254 (#45381) 
Cherry-picked from https://github.com/apache/doris/pull/45254
 2024-12-13 17:36:02 +08:00
wangbo
384a1a4bd7 [branch-2.1]log more detail when query hits policy (#44685) (#45366) 
pick #44685
 2024-12-13 10:24:53 +08:00
github-actions[bot]
4d6d9a6c8c branch-2.1: [fix](persist) Fix TableAddOrDropInvertedIndicesInfo.equals #45335 (#45364) 
Cherry-picked from #45335

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-13 09:58:26 +08:00
github-actions[bot]
95ffc7a65f branch-2.1: [fix](job)Fix millisecond offset issue in time window scheduling trigger time calculation #45176 (#45353) 
Cherry-picked from #45176

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-12 19:09:15 +08:00
wuwenchi
667f5e6e6a [feat](iceberg)Supports using rest type catalog to read tables in unity catalog for 2.1 (#43525) (#45217) 
bp: #43525
 2024-12-12 00:49:36 -08:00
github-actions[bot]
8217371d15 branch-2.1: [chore](regression-test) move some variant cases to directory #45169 (#45259) 
Cherry-picked from #45169

Co-authored-by: lihangyu <lihangyu@selectdb.com>
 2024-12-12 12:16:04 +08:00
bobhan1
0c55edd3bf branch-2.1: [opt](compaction) Don't check missed rows in cumu compaction if input rowsets are not in tablet (#45279) (#45304) 
pick https://github.com/apache/doris/pull/45279
 2024-12-12 11:14:30 +08:00
github-actions[bot]
da885691ca branch-2.1: [fix](column_array)fix filter_generic in column_array func #41990 (#44983) 
Cherry-picked from #41990

Co-authored-by: amory <wangqiannan@selectdb.com>
 2024-12-12 09:52:26 +08:00
github-actions[bot]
5901e94f29 branch-2.1: [Job](Fix)Improve Event Publishing with Timeout #45103 (#45300) 
Cherry-picked from #45103

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-12 09:52:00 +08:00
github-actions[bot]
9a4f63f180 branch-2.1: [fix](Outfile) fix the unclear error code #45119 (#45277) 
Cherry-picked from #45119

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-12 09:32:26 +08:00
James
36695e871a [feature](statistics)Support auto analyze columns that haven't been analyzed for a long time. #42399 (#45250) 
backport: https://github.com/apache/doris/pull/42399
 2024-12-12 01:57:44 +08:00
shee
fb407f2e94 [opt](lambda) let lambda expression support refer outer slot (#45186) 2024-12-11 18:55:49 +08:00
github-actions[bot]
6d4e541976 branch-2.1: [fix](restore) avoid NPE for restore job #36395 (#45282) 
Cherry-picked from #36395

Co-authored-by: Xujian Duan <50550370+DarvenDuan@users.noreply.github.com>
 2024-12-11 18:47:20 +08:00
walter
239aea5d2a [fix](restore) avoid NPE for restore job #36395 (#45292) 
cherry pick from #36395

Co-authored-by: Xujian Duan <50550370+DarvenDuan@users.noreply.github.com>
 2024-12-11 18:44:55 +08:00
amory
76613668f7 [fix](bloomFilter)fix data type supported behavior same in FE and BE … (#45178) 2024-12-11 18:04:04 +08:00
github-actions[bot]
e68460a730 branch-2.1: [enhance](auth)When authorization includes create, not check if resources exist #45125 (#45166) 
Cherry-picked from #45125

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2024-12-11 14:57:46 +08:00
github-actions[bot]
f83d98bb2e branch-2.1: [fix](Outfile) add more regression-test cases for Select into outfile #45230 (#45275) 
Cherry-picked from #45230

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-11 14:57:15 +08:00
daidai
a233349ea2 [enchement](mc)Optimize reading of maxcompute partition tables. (#45148) (#45246) 
bp #45148

### What problem does this PR solve?
Problem Summary:
Optimize reading of maxcompute partition tables:
1. Introduce batch mode to generate splits for Maxcompute partition
tables to optimize scenarios with a large number of partitions. Control
it through the variable `num_partitions_in_batch_mode`.
2. Introduce catalog parameter `mc.split_cross_partition`. The parameter
is true, which is more friendly to reading partition tables, and false,
which is more friendly to debug.
3. Add `-Darrow.enable_null_check_for_get=false` to be jvm to improve
the efficiency of mc arrow data conversion.
 2024-12-11 14:56:27 +08:00
github-actions[bot]
55be65d0bd branch-2.1: [enhance](nereids) SqlParser support load data into temporary partition #45025 (#45228) 
Cherry-picked from #45025

Co-authored-by: zxealous <zhouchangyue@baidu.com>
 2024-12-11 14:38:39 +08:00
github-actions[bot]
cbab6f55c3 branch-2.1: [fix](nereids) not rewrite first_value when first_value ignore nulls #45065 (#45236) 
Cherry-picked from #45065

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2024-12-11 14:36:48 +08:00
github-actions[bot]
44fa86040f branch-2.1: [Enhancement](compaction)Optimize compaction task permit allocation #45197 (#45243) 
Cherry-picked from #45197

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
 2024-12-11 14:35:07 +08:00