Commit Graph

21924 Commits

Author SHA1 Message Date
a461ff3c8a branch-2.1: [fix](load) fix concurrent read and write to runningTxnIds #51615 (#51640)
Cherry-picked from #51615

Co-authored-by: hui lai <laihui@selectdb.com>
2025-06-17 09:26:33 +08:00
ee09f55ca2 branch-2.1: [fix](mtmv)Fix issue that refreshState turns to init when replaying alterStatus editLog #51439 (#51544)
Cherry-picked from #51439

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-06-16 17:30:14 +08:00
03b2606696 [opt](catalog) throw explict error when operation is not supported (#51589) (#51723)
bp #51589
2025-06-16 17:09:14 +08:00
3a1e95c6c2 branch-2.1: [improvement](jdbc catalog) Optimize the acquisition of indentity type in SQLServer (#51659)
pick #51285
2025-06-16 16:50:37 +08:00
eaa6556721 branch-2.1: [fix](nereids) fix cast ipv4 to string #51546 (#51738)
cherry pick from #51546
2025-06-16 15:45:39 +08:00
c6ff4994f3 branch-2.1: [fix](hudi) check requiredFields exists in splitHudiColumnNames in HudiJniScanner #51430 (#51504)
Cherry-picked from #51430

Co-authored-by: Socrates <suyiteng@selectdb.com>
2025-06-16 14:54:40 +08:00
56d87c7f4d [cherry-pick](branch-21) fix array_map cause coredump as NULL (#51618) (#51742) 2025-06-16 14:53:43 +08:00
c9623c32f0 branch-2.1: [Bug](sort) fix wrong result coz push down sort with null last #51472 (#51507)
Cherry-picked from #51472

Co-authored-by: Pxl <xl@selectdb.com>
2025-06-16 14:51:12 +08:00
1ee58b216b [fix](test) fix fe UT failed because of timeout (#51699)
fix fe UT failed because of timeout
2025-06-16 09:50:51 +08:00
8734c3fb3b branch-2.1: [improvement](statistics)Agg table set preagg on when doing sample analyzing. (#49918) (#51675)
backport: https://github.com/apache/doris/pull/49918
2025-06-16 09:50:16 +08:00
e8615e1329 branch-2.1: [fix](test)Fix the unstable test. #50691 (#50760)
Cherry-picked from #50691

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2025-06-14 21:48:06 +08:00
1a1649376f branch-2.1:[improvement](statistics)Eliminate null values while sample analyzing ndv. (#50574) (#51648)
backport: https://github.com/apache/doris/pull/50574
2025-06-13 15:38:11 +08:00
d4a5039375 branch-2.1: [chore](dep)bump up parquet to 1.15.2 #51372 (#51602)
Cherry-picked from #51372

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
2025-06-13 14:04:55 +08:00
3c85740a1e branch-2.1: [Opt](metric) Add metrics for invalid delete bitmap key count (#51654)
### What problem does this PR solve?

```
# TYPE doris_be_invalid_delete_bitmap_key_count gauge
doris_be_invalid_delete_bitmap_key_count 0
# TYPE doris_be_valid_delete_bitmap_key_count gauge
doris_be_valid_delete_bitmap_key_count 409
```
https://github.com/apache/doris/pull/50080
2025-06-13 11:24:54 +08:00
18d2f93120 branch-2.1: [fix](function) JSON_EXTRACT_STRING should return NULL instead of the string 'null' when encountering a NULL value #51516 (#51566)
Cherry-picked from #51516

---------

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
2025-06-13 11:07:31 +08:00
ec0af70215 [fix](regression) fix global vars in cases (#51636)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-13 10:39:35 +08:00
0f053789fc branch-2.1: [fix](memory-leak) skip libzip and libjvm memory leak #51628 (#51632)
Cherry-picked from #51628

Co-authored-by: shuke <shuke@selectdb.com>
2025-06-12 09:12:25 +08:00
a836df5d53 branch-2.1: [fix](decimal)Fix the issue where decimal multiplication produces incorrect results due to mul_overflow error #51533 (#51563)
Cherry-picked from #51533

Co-authored-by: Mryange <2319153948@qq.com>
2025-06-07 20:28:29 +08:00
c8daf2e4fb branch-2.1: [fix](cache prune) Fix _stale_sweep_time_s not working when its value less than 0 #42281 (#51189)
Cherry-picked from #42281

Co-authored-by: zhiqiang <seuhezhiqiang@163.com>
2025-06-05 12:14:24 +08:00
831d2c148a branch-2.1:[enhance](mtmv)cache table snapshot in refresh context (#50855) (#51493)
pick: https://github.com/apache/doris/pull/50855
2025-06-05 12:07:10 +08:00
14cb4c90ad [Fix](Load) fix load hang when the instance cancel with memory tracker before exe… (#51428)
…cution

when the load task cancelled before execution as memory limitation, the
load task will hang as the coordinator is waiting the report from BE.

solution:
Let BE report the task status when task cancelled before execution .


Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-04 20:47:29 +08:00
2eee0ebdaf [regression-test](fix) global var (#51474) 2025-06-04 18:58:19 +08:00
47a714e8c2 branch-2.1:[case](auth)fix case test_dml_select_udf_auth (#51449) 2025-06-04 13:58:02 +08:00
2b9d854241 [regression-test](fix) fix global vars (#51424)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-03 15:33:21 +08:00
ffb6fd44b5 branch-2.1: [bugfix](fold) Skip constant folding in from_base64 function to fix binary data handling #50453 (#51413)
Cherry-picked from #50453

Co-authored-by: lw112 <131352377+felixwluo@users.noreply.github.com>
2025-06-03 14:05:27 +08:00
8cb499ec7c branch-2.1: [opt](audit) add new variable audit_plugin_max_insert_stmt_length to limit the length of insert stmt #51314 (#51391)
Cherry-picked from #51314

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2025-06-02 09:32:36 +08:00
c22db94c3a [opt](mtmv) optimize mtmv rewrite performance (#49514) (#51309) 2025-06-02 09:21:10 +08:00
ee74a4062c branch-2.1: [Fix] (nereids) Fix incorrect hive references in LogicalIcebergTableSink and update PlanType #49306 (#51287)
Cherry-picked from #49306

Co-authored-by: nivane <1185807945@qq.com>
Co-authored-by: zhaolipan <zhaolipan@learnable.ai>
2025-06-02 00:12:15 +08:00
92fa037e5a branch-2.1: [enhancement](memoryfailed) throw exception if block.serialize meet error status #51335 (#51365)
Cherry-picked from #51335

Co-authored-by: Pxl <xl@selectdb.com>
2025-05-30 09:35:28 +08:00
42f4498c9d branch-2.1: [fix](iceberg) fix the iceberg eq-delete filter resize-fill bug. #51253 (#51316)
Cherry-picked from #51253

Co-authored-by: kang <35803862+ghkang98@users.noreply.github.com>
2025-05-28 22:38:00 +08:00
06a6d0c5e9 branch-2.1: [fix](agent) cancel agent task when it is rejected by agent-task-pool #51138 (#51212)
Cherry-picked from #51138

Co-authored-by: walter <maochuan@selectdb.com>
2025-05-28 17:24:15 +08:00
25f5d5fb1e [fix](nereids) fix colocate agg + join compute wrong result (#48934) (#51313)
cherry pick from #48934
2025-05-28 15:30:58 +08:00
91abfe38cd [Optimize](orc-reader) Optimize stripe footer multiple reads in orc reader. (#51276)
### What problem does this PR solve?

Problem Summary:
2025-05-28 14:30:27 +08:00
4e3700eccf [branch-2.1: [Fix](Catalog)Ensure preExecutionAuthenticator is properly initialized (#51279)
[branch-2.1: [Fix](Catalog)Ensure preExecutionAuthenticator is properly
initialized


cherry pick https://github.com/apache/doris/pull/50839
https://github.com/apache/doris/pull/50623

---------

Co-authored-by: kang <35803862+ghkang98@users.noreply.github.com>
Co-authored-by: lik40 <lik40@chinatelecom.cn>
2025-05-28 14:28:41 +08:00
bbb63ee20d [regression-test](improvement) show line number when global var defined (#51256)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
pick #50482
2025-05-28 14:27:54 +08:00
7d2134dade branch-2.1: [fix](arrow) Rollback Arrow version 19.0.1 -> 17.0.0, Fix MacOS compile error and decimal type error when convert to Parquet (#51291)
pick #51217

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-05-27 21:26:11 +08:00
dd89a78d30 branch-2.1:[fix](parquet/orc) Disable string dictionary filtering when predicate express is not binary pred and in pred (#50749) (#51266)
cherry-pick: #50749
2025-05-27 18:12:56 +08:00
c838678b18 [bugfix](nerids) complete the implementation of the concat method. (#51141) #51259 (#51273)
cherry-pick #51141

---------

Co-authored-by: weiwh1 <weiwh1@chinatelecom.cn>
2025-05-27 18:12:00 +08:00
9713c7a1e5 [cherry-pick](branch-2.1) Pick "[Fix](case) Fix cold data compaction fault injection case (#49699)" (#51249) 2025-05-27 17:50:33 +08:00
c22fc7d8e5 branch-2.1: [test](mtmv)fix master-slave consistency after schema change #51191 (#51252)
Cherry-picked from #51191

Co-authored-by: zfr95 <zhangfurong@selectdb.com>
2025-05-27 17:43:13 +08:00
73ee4c9090 branch-2.1: [chore](cataglog) Unlimit db data size quota (#51108) (#51235)
we should not limit db data size for the db especially for the log
scenarios
doc https://github.com/apache/doris-website/pull/2403

pick #51108
2025-05-27 13:13:45 +08:00
67e400483d [branch-2.1 fix](expr) fix expr set result column id even when state is not ok #50938 (#51225)
…(#50938)
https://github.com/apache/doris/pull/50938
if cast return st not ok
```
report error status: [E-254] std::bad_typeid
	0#  doris::get_stack_trace(int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) at /mnt/disk12/yanxuecheng/tmp-doris/be/src/util/stack_util.cpp:59
	1#  doris::Exception::Exception(int, std::basic_string_view<char, std::char_traits<char> > const&) at /mnt/disk12/yanxuecheng/tmp-doris/be/src/common/exception.cpp:30
	2#  doris::vectorized::ColumnStr<unsigned int> const* typeid_cast<doris::vectorized::ColumnStr<unsigned int> const*, doris::vectorized::IColumn const>(doris::vectorized::IColumn const*) at /mnt/disk12/yanxuecheng/tmp-doris/be/src/vec/common/typeid_cast.h:42
	3#  doris::vectorized::ColumnStr<unsigned int> const* doris::vectorized::check_and_get_column<doris::vectorized::ColumnStr<unsigned int> >(doris::vectorized::IColumn const*) at /mnt/disk12/yanxuecheng/tmp-doris/be/src/vec/columns/column.h:725
	4#  doris::vectorized::VExprContext::execute(doris::vectorized::Block*, int*) at /mnt/disk12/yanxuecheng/tmp-doris/be/src/vec/exprs/vexpr_context.cpp:61

```

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-05-26 18:05:39 +08:00
ac65fed0ed branch-2.1: [fix](jdbc test) Add more connections to mysql docker #50970 (#51210)
Cherry-picked from #50970

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
2025-05-24 17:46:23 +08:00
701fc5fa2c [fix](export) remove task from map finally (#51171) (#51207)
bp #51171
2025-05-24 17:45:47 +08:00
6513f9e01f [cherry-pick](branch-21)add some check for udf when result is null (#51084) (#51196) 2025-05-23 20:43:31 +08:00
16521017ad [fix](iceberg)Table operations are not supported for catalogs of the dlf type for 2.1 #50696 (#51112)
bp: #50696
2025-05-23 13:33:10 +08:00
fc9beac468 branch-2.1: [fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysql connection (#51110) 2025-05-22 20:39:48 +08:00
df464f84b1 branch-2.1: [fix](load) fix the error msg of task submission failure for memory back pressure #51078 (#51131)
Cherry-picked from #51078

Co-authored-by: hui lai <laihui@selectdb.com>
2025-05-22 20:37:39 +08:00
8cca998ce6 branch-2.1:[fix](case)fix mark_join and right_semi_mark_join has same table name… (#51158)
… (#51124)

pick: https://github.com/apache/doris/pull/51124
2025-05-22 20:29:49 +08:00
3bc24da9c2 branch-2.1: [fix](meta) fix timeout for syncing image when FE scales out #51120 (#51149)
Cherry-picked from #51120

Co-authored-by: yagagagaga <zhangminke@selectdb.com>
2025-05-22 20:21:49 +08:00