Commit Graph

20855 Commits

Author SHA1 Message Date
4d023cf0b2 [fix](nereids) fix UnknownValue's reference in simplify range rule #44637 (#44771)
cherry pick from #44637
2024-11-29 20:58:40 +08:00
e03517e4e5 [enhance](mtmv)External partition prune #44415 #44567 #44673 (#44767)
pick: https://github.com/apache/doris/pull/44673 
https://github.com/apache/doris/pull/44415
https://github.com/apache/doris/pull/44567
2024-11-29 20:53:01 +08:00
c3707dbdee branch-2.1: [Enhancement](function) Print exact column name when execute non_nullable failed #44679 (#44742)
Cherry-picked from #44679

Co-authored-by: zclllhhjj <zhaochangle@selectdb.com>
2024-11-29 20:52:19 +08:00
9533bd3e8b branch-2.1: (fix)[db] Fix create database and create table data race #44600 (#44683)
Cherry-picked from #44600

Co-authored-by: deardeng <dengxin@selectdb.com>
2024-11-29 20:50:10 +08:00
22b7c4ca21 [feature](nereids)support show view command in nereids (#44698) 2024-11-29 20:48:30 +08:00
412cec5bad branch-2.1: [fix](clone) Fix wrong clone file path #44746 (#44773)
Cherry-picked from #44746

Co-authored-by: walter <maochuan@selectdb.com>
2024-11-29 14:09:16 +08:00
6f868e4f1e branch-2.1: [fix](planner) FunctionCallExpr clone should be deep copy #44678 (#44711)
Cherry-picked from #44678

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2024-11-29 14:06:30 +08:00
fc942c435f [feat](binlog) Support drop rollup binlog #44677 (#44743)
cherry pick from #44677
2024-11-29 11:30:37 +08:00
82c7a9d15a [Fix](Variant) create table should not automatically add variant to key (#44736)
#36609
2024-11-29 09:34:43 +08:00
Pxl
bfd51f07e6 revert #44408 on branch-2.1 (#44757) 2024-11-29 08:28:46 +08:00
68e6cbf033 branch-2.1: [feat](backup) Add config backup_handler_update_interval_millis #44628 (#44640)
Cherry-picked from #44628

Co-authored-by: walter <maochuan@selectdb.com>
2024-11-28 18:43:48 +08:00
Pxl
846fe83152 [Chore](runtime-filter) add rpc error msg to RuntimeFilterContext (#43517) (#44622) (#44719)
pick from #43517
2024-11-28 16:46:27 +08:00
2120115e84 [fix](nereids) fix ptopN push down under multi winexprs with partial forbidden type (#44655)
pick from https://github.com/apache/doris/pull/44617
2024-11-28 16:04:38 +08:00
e7520ae6cf branch-2.1: [fix](hyperscan) Fix hyper scan fall back to re2 #44547 (#44653)
Cherry-picked from #44547

Co-authored-by: zhiqiang <hezhiqiang@selectdb.com>
2024-11-28 16:00:43 +08:00
bcefab1de3 fix testcase (#44729) 2024-11-28 15:58:06 +08:00
c1437ea192 branch-2.1: [improve](backup) Limit the output size of show backup/restore job progress #44681 (#44707)
Cherry-picked from #44681

Co-authored-by: walter <maochuan@selectdb.com>
2024-11-28 14:27:34 +08:00
dd4708af47 branch-2.1: [fix](backup) Automatic adapt upload/download snapshot batch size #44560 (#44641)
Cherry-picked from #44560

Co-authored-by: walter <maochuan@selectdb.com>
2024-11-28 13:43:33 +08:00
Pxl
ddaaac5b44 [Bug](runtime-filter) pick #44408 #43078 (#44686)
pick #44408 #43078
2024-11-28 12:23:38 +08:00
f2689ccba1 [feat](binlog) Support rename rollup & partition binlogs #44526 (#44662)
cherry pick from #44526
2024-11-28 10:12:17 +08:00
1a2a91a03a [fix](index) Fix CREATE/DROP INDEX stmt toSql #44494 (#44661)
cherry pick from #44494
2024-11-28 10:10:12 +08:00
05b5a3738c branch-2.1: [fix](build index)Fix non-master nodes cannot see the latest build index job status #44544 (#44630)
Cherry-picked from #44544

Co-authored-by: qiye <luen@selectdb.com>
2024-11-27 22:51:10 +08:00
88cfaedb16 [opt](paimon)Optimize the storage location of the serialized paimon table for 2.1 (#44274) (#44660)
bp: #44274
2024-11-27 20:35:35 +08:00
713b9e1661 [chore](regression-test) Remove some flaky profile test. #42396 (#44667)
cherry pick from #42396
2024-11-27 20:12:26 +08:00
b07ea89aae branch-2.1: [Fix](nereids) fix create view and alter view using old parser checking #43263 (#44456)
Cherry-picked from #43263

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-11-27 20:12:12 +08:00
0ffab4b4da Fix missing partitionRecord in regression framework (#44658)
Introduced by #44587
2024-11-27 19:45:26 +08:00
66cb95ffed branch-2.1: [fix](inverted index) Content Check for Tokenize Function Parser #44465 (#44555)
Cherry-picked from #44465

Co-authored-by: zzzxl <yangsiyu@selectdb.com>
2024-11-27 11:53:36 +08:00
Pxl
7464f461bc [Bug](runtime-filter) avoid ignore rf multiple times (#44408) (#44625)
avoid ignore rf multiple times

When an instance is wake_up_by_downstream, it will destroy the logic of
`first closing the instance that should build hash table and then
closing other instances`, instance that should build hash table during
the process of inserting data into rf, this instance may find that rf is
ignored, causing dcheck to fail.

```cpp
 F20241121 12:01:02.245405 9832 runtime_filter.cpp:395] Check failed: !is_ignored()

3# raise at ../sysdeps/posix/raise.c:27
4# abort at ./stdlib/abort.c:81
5# 0x00005603CFDF778D in /mnt/ssd01/doris-branch40preview/NEREIDS_ASAN/be/lib/doris_be
6# 0x00005603CFDE9DCA in /mnt/ssd01/doris-branch40preview/NEREIDS_ASAN/be/lib/doris_be
7# google::LogMessage::SendToLog() in /mnt/ssd01/doris-branch40preview/NEREIDS_ASAN/be/lib/doris_be
8# google::LogMessage::Flush() in /mnt/ssd01/doris-branch40preview/NEREIDS_ASAN/be/lib/doris_be
9# google::LogMessageFatal::~LogMessageFatal() in /mnt/ssd01/doris-branch40preview/NEREIDS_ASAN/be/lib/doris_be
10# doris::RuntimePredicateWrapper::insert_fixed_len(COW<doris::vectorized::IColumn>::immutable_ptr<doris::vectorized::IColumn> const&, unsigned long) at /home/zcp/repo_center/doris_branch-3.0/doris/be/src/exprs/runtime_filter.cpp:395
11# doris::RuntimePredicateWrapper::insert_batch(COW<doris::vectorized::IColumn>::immutable_ptr<doris::vectorized::IColumn> const&, unsigned long) at /home/zcp/repo_center/doris_branch-3.0/doris/be/src/exprs/runtime_filter.cpp:431
12# doris::IRuntimeFilter::insert_batch(COW<doris::vectorized::IColumn>::immutable_ptr<doris::vectorized::IColumn>, unsigned long) at /home/zcp/repo_center/doris_branch-3.0/doris/be/src/exprs/runtime_filter.cpp:992
13# doris::VRuntimeFilterSlots::insert(doris::vectorized::Block const*) at /home/zcp/repo_center/doris_branch-3.0/doris/be/src/exprs/runtime_filter_slots.h:146
14# doris::pipeline::HashJoinBuildSinkLocalState::close(doris::RuntimeState*, doris::Status) in /mnt/ssd01/doris-branch40preview/NEREIDS_ASAN/be/lib/doris_be
15# doris::pipeline::DataSinkOperatorXBase::close(doris::RuntimeState*, doris::Status) in /mnt/ssd01/doris-branch40preview/NEREIDS_ASAN/be/lib/doris_be
16# doris::pipeline::PipelineTask::close(doris::Status) at /home/zcp/repo_center/doris_branch-3.0/doris/be/src/pipeline/pipeline_task.cpp:487
```

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2024-11-27 10:51:02 +08:00
43ebfa9031 [branch-2.1] pick some workload group pr (#44634)
pick #42053 #43942
2024-11-27 09:42:41 +08:00
0af123f75f [fix](suites) Fix syncer ingest binlog with multiple replicas #44444 (#44587)
cherry pick from #44444
2024-11-26 23:25:00 +08:00
7de190fe11 [feat](binlog) Support add/build/drop inverted index binlog #44418 (#44620)
cherry pick from #44418
2024-11-26 23:17:49 +08:00
59e11fd797 branch-2.1: [fix](table) Disable create, alter auto bucket table with colocate #44396 (#44510)
Cherry-picked from #44396

Co-authored-by: deardeng <dengxin@selectdb.com>
2024-11-26 19:33:22 +08:00
3846f49359 [Opt](ShortCircuit) opt some serialization and fix error when prepare… (#44582)
cherry pick from #43974
2024-11-26 19:31:47 +08:00
c66802f036 [branch-2.1](insert) Fix ENABLE_AUTO_CREATE_WHEN_OVERWRITE forward to Master (#44570) (#44596)
pick https://github.com/apache/doris/pull/44570
2024-11-26 19:31:16 +08:00
4113c11c73 [Improve](auditlog) audit log print real sql in prepared statement (#44588)
cherry-pick from #43038

Co-authored-by: He xueyu <112704062+HexyinUESTC@users.noreply.github.com>
2024-11-26 19:30:36 +08:00
f88a8169dc [opt](Variant) avoid unnecessary mem for variant extracted columns (#… (#44585)
cherry-pick from #43567
2024-11-26 19:30:06 +08:00
41056c5312 branch-2.1: [regression-test](fix) fix case failed due to global variable #44564 (#44607)
Cherry-picked from #44564

Co-authored-by: shuke <shuke@selectdb.com>
2024-11-26 19:28:45 +08:00
071a2106a3 branch-2.1: [opt](brpc) Make the timeout of brpc checking configurable #44481 (#44602)
Cherry-picked from #44481

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
2024-11-26 19:26:39 +08:00
9bc547578c [opt](scan) Release instances of Segment to avoid consuming a large amount of memory in ParallelScannerBuilder (#44189) (#44608) 2024-11-26 19:25:58 +08:00
e677e77085 branch-2.1: [enhance](table)Remove unnecessary locks #44416 (#44468)
Cherry-picked from #44416

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2024-11-26 19:25:18 +08:00
688ef8fe23 [fix](index) Fix create index/index def to sql #44392 (#44581)
cherry pick from #44392
2024-11-26 17:44:53 +08:00
fa3d6f0ffd [feat](binlog) Add replace table binlog #44263 (#44589)
cherry pick from #44263

Co-authored-by: Dongyang Li <lidongyang@selectdb.com>
2024-11-26 17:38:17 +08:00
bdca9cce3e [branch-2.1]add internal workload group (#42006) (#44592)
Add an internal workload group when Doris started, currently it mainly
used to manage compaction workload cpu usage.
pick #42006
2024-11-26 17:09:55 +08:00
e9f4615ddc branch-2.1: [Bug](function)window funnel function should support datetimev2 type get scale info #44420 (#44524)
Cherry-picked from #44420

Co-authored-by: zhangstar333 <zhangsida@selectdb.com>
2024-11-26 12:24:30 +08:00
550aa9c3ae [cherry-pick](branch-2.1) Pick "[Fix](full compaction) Full compaction should not do ordered data compaction (#44359)" (#44529) 2024-11-26 12:21:30 +08:00
07c81a6362 branch-2.1: [fix](nereids)lag and lead function's nullability is wrong #44050 (#44558)
Cherry-picked from #44050

Co-authored-by: starocean999 <lichi@selectdb.com>
2024-11-26 12:19:11 +08:00
cf2ee23e68 Revert "[fix] (compaction) fix compaction score in time series policy (#40242)" (#44527)
revert #40242
2024-11-26 12:18:59 +08:00
37f4bf865f branch-2.1: [fix](mtmv)When compatibility fails, null pointers should not be reported #44464 (#44542)
Cherry-picked from #44464

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2024-11-26 11:59:29 +08:00
b1393150a4 [opt] (binlog) Support Modify ViewDef binlog #41167 (#44519)
cherry pick from #41167

---------

Co-authored-by: yanmingfu <133083714+xiaoming12306@users.noreply.github.com>
Co-authored-by: yanmingfu <yanmingfu@baidu.com>
2024-11-26 10:34:12 +08:00
5eb433e7aa [branch-2.1] pick some pr from master (#44556)
pick #40468 #40535  #40763 #40855
2024-11-25 20:43:07 +08:00
c720e59763 branch-2.1: [fix](readme) remove contributor graph and change to contributor wall #44534 (#44536)
Cherry-picked from #44534

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2024-11-25 14:37:50 +08:00