Commit Graph

9452 Commits

Author SHA1 Message Date
797a31bbb8 [fix](statistics)Change column statistics table varchar length to 1024. (#43244) (#43760)
backport: https://github.com/apache/doris/pull/43244/
2024-11-12 19:13:23 +08:00
3e098e14f1 [fix](ngram bloomfilter) fix narrow conversion for ngram bf_size #43480 (#43654)
cherry pick from #43480
2024-11-12 16:54:43 +08:00
6ae2106cd9 branch-2.1: [improvement](statistics)Remove useless stats validation check. (#43499)
Cherry-picked from #43279

Co-authored-by: Jibing-Li <64681310+Jibing-Li@users.noreply.github.com>
2024-11-12 16:00:35 +08:00
821c0d1380 branch-2.1: [improvement](paimon)Using table serialization on the jni side (#43475)
Cherry-picked from #43167

Co-authored-by: wuwenchi <wuwenchihdu@hotmail.com>
Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-11-12 14:43:32 +08:00
f1a8ac7f81 [fix](group commit) fix NPE in group commit select backend (#43629) (#43651)
pick https://github.com/apache/doris/pull/43629

Co-authored-by: meiyi <meiyi@selectdb.com>
2024-11-12 14:01:50 +08:00
4c224bb1dd [improvement](build index)Optimize failed task check on same tablet (#42295) (#43589)
bp #42295

Co-authored-by: qidaye <luen@selectdb.com>
2024-11-12 09:56:55 +08:00
14caaf33cb branch-2.1: [fix](Export) fix issue that Export can not specify the columns which have capital letters (#43572)
Cherry-picked from #42994

Co-authored-by: Tiewei Fang <43782773+BePPPower@users.noreply.github.com>
2024-11-12 00:17:21 +08:00
a1ff02288f branch-2.1: [fix](hive) support query hive view created by spark (#43553)
Cherry-picked from #43530

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
Co-authored-by: morningman <yunyou@selectdb.com>
2024-11-11 23:28:53 +08:00
97e9d4d9c0 [enhancement](log) logout tablename with temp partitions in backup (#… (#43139)
…42143)
2024-11-11 23:14:53 +08:00
97ca90075c [chore](agent) log the binary message size of agent tasks #43239 (#43598)
cherry pick from #43239
2024-11-11 19:39:13 +08:00
14d511fe3a [feat](restore) Support compressed snapshot meta and job info #43516 (#43569)
cherry pick from #43516
2024-11-11 19:29:27 +08:00
4ffa84e143 [chore](restore) reduce logged unfinished snapshoting task #43076 (#43607)
cherry pick from #43076
2024-11-11 19:28:48 +08:00
5939200076 [Impl](Nereids) add propagateNullLiteral trait for special functions (#42256) (#43491)
pick: #42256

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [x] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
2024-11-11 16:22:41 +08:00
5dda61b410 [fix](backup) Load backup meta and job info bytes from disk #43276 (#43519)
cherry pick from #43276
2024-11-11 14:08:35 +08:00
72b1e2a346 [fix](Outfile) forbid parallel outfile if pipeline engine enabled. (#43437)
Because pipeline engine doesn't implement parallel outfile, we should
forbid the parallel outfile if pipeline engine enabled.
2024-11-10 18:29:08 +08:00
4c7e495392 [cherry-pick](branch-2.1) fix wrong property of S3 resource (#43413) 2024-11-10 18:17:51 +08:00
5ac3aee460 branch-2.1: [opt](max-compute) avoid repeated location path creation (#43383)
Cherry-picked from #43355

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2024-11-10 10:11:37 +08:00
182f37f837 [fix](planner) NullLiteral should always having a correct Type and set to be analyzed (#43371) 2024-11-10 10:10:40 +08:00
1d740ff825 [fix](auditlog) set isQuery to true when query is short circuited (#42647) (#43345)
(#42647)
2024-11-10 10:08:56 +08:00
ea67e3a6b4 branch-2.1: [enhance](mtmv)MTMV interface optimization (#43329)
Cherry-picked from #43086

Co-authored-by: zhangdong <493738387@qq.com>
2024-11-10 10:07:35 +08:00
80fd76677e branch-2.1: [Improvement](LDAP Auth)Enhance LDAP authentication with a configurable group filter (#43293)
Cherry-picked from #42038

Co-authored-by: nsivarajan <117266407+nsivarajan@users.noreply.github.com>
Co-authored-by: Sivarajan Narayanan <narayanan_sivarajan@apple.com>
2024-11-10 10:06:13 +08:00
fe1b8d44fd branch-2.1: [fix](mtmv)Fix the problem where the job does not exist, which prevents the deletion of MTMV (#43325)
Cherry-picked from #43080

Co-authored-by: zhangdong <493738387@qq.com>
2024-11-10 01:11:26 +08:00
fba06b33b9 [cherry-pick](branch-2.1)add SessionVariable for enableCooldownReplicaAffinity (#42675)
pick from master:https://github.com/apache/doris/pull/41741
2024-11-10 00:46:26 +08:00
486dfe9f42 branch-2.1: [fix](auth)Fix concurrency issue during role manager upgrade (#43194)
Cherry-picked from #42419

Co-authored-by: zhangdong <493738387@qq.com>
2024-11-10 00:45:07 +08:00
2ba88ed2a8 [improve](report) split agent batch tasks automaticlly #43257 (#43365)
cherry pick from #43257
2024-11-08 18:59:53 +08:00
8f2f4e9394 [feature](binlog) Wrap rename table/column binlog in BarrierLog #43033 (#43168)
cherry pick from #43033
2024-11-08 18:59:25 +08:00
57c794ba77 [fix](backup) Fix compressed backup job #43197 (#43484)
cherry pick from #43197
2024-11-08 16:16:09 +08:00
2e8753b0cd [fix](restore) Add synchronized to avoid concurrent modification #43172 (#43486)
cherry pick from #43172
2024-11-08 15:51:17 +08:00
31480d11d7 [improve](task) Support splitting agent batch tasks automatically #42703 (#43483)
cherry pick from #42703
2024-11-08 15:51:04 +08:00
80de533b7c [improve](backup) Only compress the running backup/restore job #43177 #43278 (#43487)
cherry pick from #43278
2024-11-08 14:10:53 +08:00
69eb02b96f [chore](restore) Save restore stmt to the resp if RestoreSnapshot failed #42933 (#42985)
cherry pick from #42933
2024-11-08 14:05:50 +08:00
031ee992e7 [feature](binlog) Allow BarrierLog to wrap another binlog #42993 (#43485)
cherry pick from #42993
2024-11-08 14:04:54 +08:00
1b6d47d351 [fix](task) Abort creating replica task if sending RPC failed #42276 (#42963)
cherry pick from #42276
2024-11-08 10:44:27 +08:00
6006907c79 [improve](restore) Compress backup/restore job log size by compress (#42463)
ref #42459
2024-11-08 10:43:14 +08:00
f6ddd818cd [tests](inverted index)Add and improve add/drop index cases (#36811) (#43463)
bp #36811
2024-11-08 09:38:54 +08:00
7de7541ec6 branch-2.1: [fix](ES Catalog)Only like on keyword can be applied to wildcard query (#43400)
Cherry-picked from #41176

Co-authored-by: qiye <jianliang5669@gmail.com>
2024-11-07 22:43:42 +08:00
12bb38eab3 [fix](build index)Fix build index failed on renamed column (#42882)(#43246)(#43336) (#43266)
bp #42882 #43246 #43336
We pick these PRs together because they all fix one problem and if not
do so, the regression test won't be passed.

---------

Co-authored-by: Sun Chenyang <csun5285@gmail.com>
Co-authored-by: qidaye <luen@selectdb.com>
2024-11-07 21:32:02 +08:00
bbfed507da [fix](schema-change) Make sc job state updated after the table state is changed (#42670) (#43186)
pick: #42670
2024-11-07 14:07:24 +08:00
8fedb03fdc branch-2.1: [fix](auth)Fix after fe restarting, external permissions are lost (#43307)
Cherry-picked from #43275

Co-authored-by: zhangdong <493738387@qq.com>
2024-11-06 14:54:59 +08:00
9d5ebd6f34 [fix](export) make sure the export task being executed after writing "create export job" edit log #43250 (#43291)
cherry-pick #43250
2024-11-06 09:47:14 +08:00
71e33d9208 [feat](nereids)disable join reorder if any table row count is not available #43000 (branch-2.1) (#43247)
### What problem does this PR solve?
pick #43000 

<!--
You need to clearly describe your PR in this part:

1. What problem was fixed (it's best to include specific error reporting
information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what
is it now, why was it modified, and what possible impacts might there
be.
3. What features were added. Why this function was added.
4. Which codes were refactored and why this part of the code was
refactored.
5. Which functions were optimized and what is the difference before and
after the optimization.

The description of the PR needs to enable reviewers to quickly and
clearly understand the logic of the code modification.
-->

<!--
If there are related issues, please fill in the issue number.
- If you want the issue to be closed after the PR is merged, please use
"close #12345". Otherwise, use "ref #12345"
-->
Issue Number: close #xxx

<!--
If this PR is followup a preivous PR, for example, fix the bug that
introduced by a related PR,
link the PR here
-->
Related PR: #xxx

Problem Summary:

### Check List (For Committer)

- Test <!-- At least one of them must be included. -->

    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No colde files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:

    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?

    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

- Release note

    <!-- bugfix, feat, behavior changed need a release note -->
    <!-- Add one line release note for this PR. -->
    None

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2024-11-05 18:29:50 +08:00
2e00fa475b [fix](persist) Fix the generated dropping tmp partition sql #43079 (#43170)
cherry pick from #43079
2024-11-05 17:44:31 +08:00
8eb6a2a7c1 [enhancement](Nereids) boost characterLiteralTypeCoercion (#42941) (#43092)
cherry pick from #42941
2024-11-04 11:50:44 +08:00
d1e63c5201 [improvement](external)add some improvements for external scan (#38946) (#43156)
bp #38946

Co-authored-by: wuwenchi <wuwenchihdu@hotmail.com>
2024-11-04 09:40:08 +08:00
e3170d6319 [bugfix](hive)fix after insert overwrite hive table, data error for 2.1 (#43049) (#43127)
bp: #43049
2024-11-03 23:38:47 +08:00
9e7a1c9ae8 [fix](export) fix potential export concurrency issue #43109 (#43117)
bp #43109
2024-11-02 08:53:43 +08:00
c5374be1bc [cherry-pick](branch-2.1) Pick "[Feature](schema change) Support add column bitmap with default value bitmap_empty (#42331)" (#42702)
Pick #42331
2024-11-01 21:46:38 +08:00
03a614f945 [fix](Export) fix dead lock of parallel Exporting (#43084)
### What problem does this PR solve?
bp: #43083
2024-11-01 21:27:25 +08:00
6c3a273d46 [fix](Nereids) replay create function npe since connect context not exists (#43075)
nereids will parse function statement when replay create alias function,
when do parse, need to get sql mode and other variable. because replay
thread do not have connect context, NPE be thrown when parsing
2024-11-01 21:01:24 +08:00
47fa76e0f6 [2.1][fix](jdbc catalog) Optimize JDBC Connection Closing to Ensure Proper Resource Release (#43074)
bp #43059
2024-11-01 20:34:18 +08:00