Commit Graph

21026 Commits

Author SHA1 Message Date
f733aa5dcf branch-2.1: [fix](fold) fixed an issue with be computing constants #43410 (#45712)
Cherry-picked from #43410
2024-12-20 20:26:27 +08:00
2a5f4c7979 [fix](ranger) make RangerDorisAccessController as singleton to avoid more and more ranger policy refresher (#45645)
Issue Number: close #45641
Problem Summary:
doris create new RangerDorisAccessController twice when do every
checkpoint, and the new RangerDorisAccessController instance create a
new ranger policy refresher. Too many policy refreshers will cause
ranger admin overload
2024-12-20 17:13:23 +08:00
17cc76e589 branch-2.1: [fix](variable) force update variable not work as expected #45648 (#45696)
Cherry-picked from #45648

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2024-12-20 14:44:07 +08:00
37c4de3cbf branch-2.1: [improve](variant) only sanitize in debug mode #45689 (#45698)
Cherry-picked from #45689

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2024-12-20 14:25:49 +08:00
7e5d880431 branch-2.1: [fix](iceberg) Fill in the detailed error information #45415 (#45688)
Cherry-picked from #45415

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-12-20 13:32:02 +08:00
b39358fd0a [Fix](branch-2.1) Fix arrow-flight-sql to use pipeline (#45661)
### What problem does this PR solve?

Fix arrow-flight-sql to use pipeline
2024-12-20 11:22:15 +08:00
afb59f5f0d [opt](Nereids) lock table in ascending order of table IDs (#45045) (#45679)
pick from master #45045
2024-12-20 11:02:03 +08:00
2f62954525 branch-2.1: [fix](create table) fix create table fail msg #45623 (#45651)
cherry pick from #45623
2024-12-20 10:58:54 +08:00
19c0e89da7 [enchement](iceberg)support read iceberg partition evolution table. (#45367) (#45569)
cherry-pick #45367

Co-authored-by: daidai <changyuwei@selectdb.com>
2024-12-20 08:56:51 +08:00
c459ad7382 [fix](binlog) Avoid clear binlog dir #45581 (#45620)
cherry pick from #45581
2024-12-19 23:42:54 +08:00
cc691b6e01 branch-2.1: [Fix](Job)Fix redundant job scheduling by preventing same state transitions (e.g., RUNNING → RUNNING) #45495 (#45647)
Cherry-picked from #45495

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
2024-12-19 23:28:37 +08:00
9272c650b4 [Refactor](query) refactor lock in fragment mgr and change std::unorder_map to phmap (#45069)
### What problem does this PR solve?

Related PR: #44821
2024-12-19 22:27:33 +08:00
e91a810df8 branch-2.1: [fix](sql cache) fix prepare statement with sql cache throw NullPointerException #45640 (#45650)
fix prepare statement with sql cache throw NullPointerException:
```shell
java.lang.NullPointerException: Cannot read field "originStmt" because the return value of "org.apache.doris.analysis.StatementBase.getOrigStmt()" is null
```
2024-12-19 20:01:40 +08:00
4b7c2eaa7d [branch-2.1](fix) fix incorrect result of hash join with const column (#45630) 2024-12-19 19:14:38 +08:00
f966088fd0 branch-2.1: [fix](nereids) fix ExtractAndNormalizeWindowExpression bug #45553 (#45635)
Cherry-picked from #45553

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-12-19 19:13:03 +08:00
299bb8735c [opt](test) Make the case stable. #44195 (#45638) 2024-12-19 17:44:45 +08:00
55e5e69a81 [branch-2.1]Fix test_audit_log_behavior failed (#45636) 2024-12-19 17:43:11 +08:00
d6c629d293 branch-2.1: [fix](tvf) Tvf supports to parse the enclose character in csv files #45407 (#45570)
Cherry-picked from #45407

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2024-12-19 16:23:44 +08:00
9b80695e31 [fix](suites) Enable common expr pushdown in the restore inverted idx case #45547 (#45622)
cherry pick from #45547
2024-12-19 14:09:23 +08:00
7f8ec3e679 branch-2.1: [fix](export) Make enable_outfile_to_local available for export command #45241 (#45515)
Cherry-picked from #45241

Co-authored-by: Siyang Tang <tangsiyang@selectdb.com>
2024-12-19 14:08:33 +08:00
7957e6fe0f branch-2.1: [Fix] Add column with default value string throw exception #45000 (#45316)
Cherry-picked from #45000

Co-authored-by: Uniqueyou <134280716+wyxxxcat@users.noreply.github.com>
2024-12-19 14:07:43 +08:00
90ca889f84 branch-2.1: [fix](external)fix split and get the schema #45408 (#45566)
Cherry-picked from #45408

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-12-19 14:06:36 +08:00
7d32e4f71f branch-2.1: [Fix](ORC) Not push down fixed char type in orc reader #45484 (#45525)
cherry-pick #45484
2024-12-19 14:06:00 +08:00
55ef1a60b3 branch-2.1: [fix](sql) Fix error result for column tosql #44997 (#45582)
Cherry-picked from https://github.com/apache/doris/pull/44997
2024-12-19 10:00:07 +08:00
eb67db3d25 branch-2.1: [feat](docker)Add a BE ENV item 'SKIP_CHECK_ULIMIT' for Docker to start quickly #45267 (#45468)
Cherry-picked from #45267

Co-authored-by: FreeOnePlus <54164178+FreeOnePlus@users.noreply.github.com>
2024-12-19 09:31:41 +08:00
afeb5863ad branch-2.1: [fix](nereids) fix compare with date like literal #45382 (#45595)
cherry pick from #45382
2024-12-18 22:59:27 +08:00
44e60a93c5 branch-2.1: [fix] (property) Filter table property storage_policy for db sync #44756 (#45578)
Cherry-picked from #44756

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2024-12-18 22:53:41 +08:00
ab427f60a2 branch-2.1: [feat](binlog) Add Support recover binlog #44818 (#45294)
Cherry-picked from #44818

Co-authored-by: Vallish Pai <vallishpai@gmail.com>
2024-12-18 22:53:04 +08:00
Pxl
fe0cc289de [Bug](function) fix wrong result on group_concat with distinct+order_… (#45513) 2024-12-18 22:49:18 +08:00
fca9c91193 [fix](restore) Add restore_reset_index_id config #45283 (#45574)
cherry pick from #45283
2024-12-18 22:45:53 +08:00
1980e098bc branch-2.1: [Test](binlog) Check correctly for show create database #45472 (#45551)
Cherry-picked from #45472

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2024-12-18 22:43:15 +08:00
59b3760fdd branch-2.1: [opt](join) Check the property of nullable from intermediate row #45017 (#45476)
Cherry-picked from #45017

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
2024-12-18 22:40:17 +08:00
02feb16530 branch-2.1: [bug](s3) fix S3 file system gets absolute path #44965 (#45529)
Cherry-picked from https://github.com/apache/doris/pull/44965
2024-12-18 22:29:24 +08:00
bc048a3e36 [bugfix](fe) should use equals not == to get failed to select replica message (#45602)
### What problem does this PR solve?

The original code use == to filter tag, it is wrong.
2024-12-18 22:26:26 +08:00
ca24cd1cd9 branch-2.1 [Fix](Insert-Job)Resolving Task Status Discrepancies in Query Execution Records (#45342) (#45451)
bp #45342
2024-12-18 16:49:21 +08:00
855e9a508c [fix](catalog) opt the count pushdown rule for iceberg/paimon/hive scan node (#44038) (#45564)
bp #44038
2024-12-18 09:54:56 +08:00
416f3cf2ba branch-2.1: [fix](iceberg)Fill in the detailed error information #45285 (#45338)
Cherry-picked from #45285

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-12-18 07:58:09 +08:00
fb31042327 branch-2.1: [fix](hive)Clear processed tasks #45309 (#45339)
Cherry-picked from #45309

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-12-17 22:00:57 +08:00
5517045598 branch-2.1: [chore](checkpoint) add enable_checkpoint config #45301 (#45328)
Cherry-picked from #45301

Co-authored-by: walter <maochuan@selectdb.com>
2024-12-17 20:11:51 +08:00
748648ef1e branch-2.1: [fix](nereids) fix bug when sum0 distinct appear in cte #45447 (#45511)
Cherry-picked from #45447

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-12-17 20:10:43 +08:00
a8e172ea5d branch-2.1: [Fix](show-stmt) Raise an error when show partitions with complex predicate #45257 (#45519)
Cherry-picked from #45257

Co-authored-by: zclllyybb <zhaochangle@selectdb.com>
2024-12-17 18:03:47 +08:00
01684ce3b1 branch-2.1: [fix](mysql-buffer) fix special buffer size with nested type #45126 (#45458)
Cherry-picked from #45126

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-12-17 17:48:10 +08:00
Pxl
900086667f [Chore](pipeline) catch exception on task::prepare to avoid exception make backend coredump #45479 (#45516)
…dump

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2024-12-17 17:22:05 +08:00
Pxl
7856662ecf [Bug](pipeline) make sink operator process eos signals after wake_up_early #45207 (#45400)
make sink operator process eos signals after wake_up_early #45207  (#45400)
2024-12-17 17:21:42 +08:00
191ef9b8b0 branch-2.1: [fix](schema-change) fix array/map/struct in schema-change not-null to null will make core #45305 (#45482)
Cherry-picked from #45305

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-12-17 17:05:17 +08:00
8dc845671f [test](load) injection cases should check Exception is thrown (#44713) (#45321)
backport #44713
2024-12-17 14:37:27 +08:00
b6a1803127 [improve](backup) Add config ignore_backup_tmp_partitions #45240 (#45331)
cherry pick from #45240
2024-12-17 14:31:06 +08:00
8faf010c64 branch-2.1: [fix](function) The parameters after the first of the mask function need to be restricted to constants #45348 (#45498)
Cherry-picked from #45348

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
2024-12-17 14:25:05 +08:00
79662fcc94 [branch-2.1](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT (#45358)
pick https://github.com/apache/doris/pull/35239


add special logic to deal smooth upgrade

The origin PR is https://github.com/apache/doris/pull/35239. for
branch-3.0 it was merged in 3.0.0 but forgot to register old version.
now in branch-3.0 we fix it in
https://github.com/apache/doris/pull/45428 which must be merged in
3.0.4. and do same thing in this PR which must be merged in 2.1.8.
then:
```
FROM    TO    result
217-    218+    
217-    303-    💥
218+    303-    
218+    304+    
303-    304+    
```
this is our best result.
2024-12-17 11:51:07 +08:00
c561bdb906 [cherry-pick](branch-21) fix first/last value return error with ignore null (#44996) (#45486)
cherry-pick from master https://github.com/apache/doris/pull/44996
2024-12-17 10:04:02 +08:00