database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,125 Commits 1 Branch 0 Tags
d5b145ab075ddb420b9e22bebc165cd76e4affc3
Commit Graph

8640 Commits

Author SHA1 Message Date
Gabriel
7040abfb04 [fix](correctness) Fix operator initialization (#45728) (#46150) 
Now we plan for local exchange depends on operator initialization. This
PR fixed a wrong order between those two steps.

pick #45728
 2024-12-30 17:01:33 +08:00
abmdocrt
1d742b5f7d [Cherry-pick](branch-2.1) Pick "[Enhancement](compaction) Do not set failure time when cumulative compaction dealing with delete rowset (#43466)" (#46117) 
Before this PR, in cases where there is an alternating distribution of
data rowset -> delete rowset -> data rowset -> delete rowset, cumulative
compaction would only move the cumulative point forward to allow base
compaction to handle the delete rowset. Cumulative compaction itself
would not process the data and would return be marked as failure. This
would cause the compaction submission task process to pause for 5
seconds, impacting efficiency.

This PR modifies the return status to OK for such cases, which improves
the efficiency of the compaction submission task.
 2024-12-30 10:18:57 +08:00
daidai
a380f5d222 [enchement](utf8)import enable_text_validate_utf8 session var (#45537) (#46070) 
bp #45537
 2024-12-28 10:05:03 +08:00
qiye
4746e9e3a2 [opt](inverted index)Optimize code to get rid of heap use after free (#45745) (#46075) 
bp #45745
 2024-12-27 16:46:58 +08:00
zhiqiang
a5f27c5b28 branch-2.1: [fix](scan) Fix scan with limit #46035 (#46091) 
cherry pick from #46035
 2024-12-27 16:41:58 +08:00
github-actions[bot]
d2aa890887 branch-2.1: [fix](clone) Fix the skipped link file due to the stale value #46009 (#46068) 
Cherry-picked from #46009

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-27 16:30:16 +08:00
zzzxl
fcc4d0d451 [fix](inverted index) Modify Error Handling for File Open Failure (#45773) 
https://github.com/apache/doris/pull/44551
 2024-12-27 14:09:57 +08:00
airborne12
d2c108726d [opt](bloomfilter index) optimize memory usage for bloom filter index writer #45833 (#46047) 
cherry pick from #45833
 2024-12-27 12:10:56 +08:00
github-actions[bot]
df8bc8f23d branch-2.1: [fix](parquet) impl has_dict_page to replace old logic and fix write empty parquet row group bug #45740 (#45954) 
Cherry-picked from #45740

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2024-12-26 15:17:49 +08:00
James
289d621faa [improvement](information_schema)Show view definition in information_schema.views. (#45857) (#45930) 
backport: https://github.com/apache/doris/pull/45857
 2024-12-26 10:11:13 +08:00
Xinyi Zou
1cf6986cea [pick](branch-2.1) pick #44092 (#45836) 2024-12-25 23:11:19 +08:00
Socrates
c94ac6c9f8 [branch-2.1](ORC) fix predicate filter failed when use hive 1.x version (#45809) 
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #43185 

Pick the pr to branch-2.1 to fix predicate filter failed when use hive
1.x version

Co-authored-by: fantasy12345zsq <1575033031@qq.com>
 2024-12-25 18:56:57 +08:00
zzzxl
a6e4497811 [opt](inverted index) Add troubleshooting logs (#44182) (#45777) 
https://github.com/apache/doris/pull/44182
 2024-12-25 13:58:01 +08:00
github-actions[bot]
547e88b1ee branch-2.1: [fix](csv reader) fix core dump when parsing csv with enclose #45485 (#45889) 
Cherry-picked from #45485

Co-authored-by: hui lai <laihui@selectdb.com>
 2024-12-25 12:09:20 +08:00
zhiqiang
64195d79ee [refactor](metrics) Remove IntAtomicCounter & CoreLocal #45742 (#45870) 
cherry pick from #45742
 2024-12-24 23:13:48 +08:00
github-actions[bot]
6d6473efae branch-2.1: [fix](tabletScheduler) Fix addTablet dead lock in tabletScheduler #45298 (#45769) 
Cherry-picked from #45298

Co-authored-by: deardeng <dengxin@selectdb.com>
 2024-12-24 21:44:30 +08:00
zhangstar333
f0031d9954 [cherry-pick](branch-21)support posexplode table function (#43221) (#45783) 
cherry-pick from master #43221
 2024-12-24 21:42:30 +08:00
zzzxl
02f15a8ef0 [fix](inverted index) Fix Null Pointer Exception in function match(#45456)(#45774) 
pick: https://github.com/apache/doris/pull/45456
 2024-12-24 11:27:13 +08:00
Pxl
d70c17bdc0 [Improvement](scan) use loop to instead recursion on Level1Iterator::_normal_next #38005 (#45767) 
pick from  #38005
 2024-12-23 13:54:12 +08:00
Mryange
367ecc3292 [fix](expr)Remove the _can_fast_execute flag from VExpr. (#45542) (#45662) 2024-12-22 21:26:32 +08:00
lihangyu
39c69c766e [Optimize](Variant) optimize schema update performance (#45480) (#45731) 
(#45480)
 2024-12-21 23:41:03 +08:00
lihangyu
06efd5b4af [Opt](SegmentIterator) clear and release iterators memory footprint in advance when EOF (#44768) (#45734) 
(#44768)
 2024-12-20 20:38:56 +08:00
github-actions[bot]
37c4de3cbf branch-2.1: [improve](variant) only sanitize in debug mode #45689 (#45698) 
Cherry-picked from #45689

Co-authored-by: lihangyu <lihangyu@selectdb.com>
 2024-12-20 14:25:49 +08:00
Mingyu Chen (Rayner)
19c0e89da7 [enchement](iceberg)support read iceberg partition evolution table. (#45367) (#45569) 
cherry-pick #45367

Co-authored-by: daidai <changyuwei@selectdb.com>
 2024-12-20 08:56:51 +08:00
walter
c459ad7382 [fix](binlog) Avoid clear binlog dir #45581 (#45620) 
cherry pick from #45581
 2024-12-19 23:42:54 +08:00
HappenLee
9272c650b4 [Refactor](query) refactor lock in fragment mgr and change std::unorder_map to phmap (#45069) 
### What problem does this PR solve?

Related PR: #44821
 2024-12-19 22:27:33 +08:00
Xujian Duan
4b7c2eaa7d [branch-2.1](fix) fix incorrect result of hash join with const column (#45630) 2024-12-19 19:14:38 +08:00
github-actions[bot]
d6c629d293 branch-2.1: [fix](tvf) Tvf supports to parse the enclose character in csv files #45407 (#45570) 
Cherry-picked from #45407

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-19 16:23:44 +08:00
Socrates
7d32e4f71f branch-2.1: [Fix](ORC) Not push down fixed char type in orc reader #45484 (#45525) 
cherry-pick #45484
 2024-12-19 14:06:00 +08:00
github-actions[bot]
eb67db3d25 branch-2.1: [feat](docker)Add a BE ENV item 'SKIP_CHECK_ULIMIT' for Docker to start quickly #45267 (#45468) 
Cherry-picked from #45267

Co-authored-by: FreeOnePlus <54164178+FreeOnePlus@users.noreply.github.com>
 2024-12-19 09:31:41 +08:00
Pxl
fe0cc289de [Bug](function) fix wrong result on group_concat with distinct+order_… (#45513) 2024-12-18 22:49:18 +08:00
github-actions[bot]
59b3760fdd branch-2.1: [opt](join) Check the property of nullable from intermediate row #45017 (#45476) 
Cherry-picked from #45017

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
 2024-12-18 22:40:17 +08:00
Xujian Duan
02feb16530 branch-2.1: [bug](s3) fix S3 file system gets absolute path #44965 (#45529) 
Cherry-picked from https://github.com/apache/doris/pull/44965
 2024-12-18 22:29:24 +08:00
Mingyu Chen (Rayner)
855e9a508c [fix](catalog) opt the count pushdown rule for iceberg/paimon/hive scan node (#44038) (#45564) 
bp #44038
 2024-12-18 09:54:56 +08:00
github-actions[bot]
01684ce3b1 branch-2.1: [fix](mysql-buffer) fix special buffer size with nested type #45126 (#45458) 
Cherry-picked from #45126

Co-authored-by: amory <wangqiannan@selectdb.com>
 2024-12-17 17:48:10 +08:00
Pxl
900086667f [Chore](pipeline) catch exception on task::prepare to avoid exception make backend coredump #45479 (#45516) 
…dump

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
 2024-12-17 17:22:05 +08:00
Pxl
7856662ecf [Bug](pipeline) make sink operator process eos signals after wake_up_early #45207 (#45400) 
make sink operator process eos signals after wake_up_early #45207  (#45400)
 2024-12-17 17:21:42 +08:00
github-actions[bot]
191ef9b8b0 branch-2.1: [fix](schema-change) fix array/map/struct in schema-change not-null to null will make core #45305 (#45482) 
Cherry-picked from #45305

Co-authored-by: amory <wangqiannan@selectdb.com>
 2024-12-17 17:05:17 +08:00
Kaijie Chen
8dc845671f [test](load) injection cases should check Exception is thrown (#44713) (#45321) 
backport #44713
 2024-12-17 14:37:27 +08:00
github-actions[bot]
8faf010c64 branch-2.1: [fix](function) The parameters after the first of the mask function need to be restricted to constants #45348 (#45498) 
Cherry-picked from #45348

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
 2024-12-17 14:25:05 +08:00
zclllyybb
79662fcc94 [branch-2.1](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT (#45358) 
pick https://github.com/apache/doris/pull/35239


add special logic to deal smooth upgrade

The origin PR is https://github.com/apache/doris/pull/35239. for
branch-3.0 it was merged in 3.0.0 but forgot to register old version.
now in branch-3.0 we fix it in
https://github.com/apache/doris/pull/45428 which must be merged in
3.0.4. and do same thing in this PR which must be merged in 2.1.8.
then:
```
FROM    TO    result
217-    218+    ✅
217-    303-    💥
218+    303-    ✅
218+    304+    ✅
303-    304+    ✅
```
this is our best result.
 2024-12-17 11:51:07 +08:00
zhangstar333
c561bdb906 [cherry-pick](branch-21) fix first/last value return error with ignore null (#44996) (#45486) 
cherry-pick from master https://github.com/apache/doris/pull/44996
 2024-12-17 10:04:02 +08:00
github-actions[bot]
23c5d52b04 branch-2.1: [fix](s3) improve error msg #45360 (#45432) 
Cherry-picked from #45360

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2024-12-16 14:59:08 +08:00
github-actions[bot]
1db78d4496 branch-2.1: [fix](hive) fix block decompressor bug #45289 (#45379) 
Cherry-picked from #45289

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2024-12-14 19:20:55 -08:00
meiyi
6dabdd6a8c branch-2.1: [fix](txn insert) txn insert show error url #45254 (#45381) 
Cherry-picked from https://github.com/apache/doris/pull/45254
 2024-12-13 17:36:02 +08:00
wangbo
384a1a4bd7 [branch-2.1]log more detail when query hits policy (#44685) (#45366) 
pick #44685
 2024-12-13 10:24:53 +08:00
wuwenchi
667f5e6e6a [feat](iceberg)Supports using rest type catalog to read tables in unity catalog for 2.1 (#43525) (#45217) 
bp: #43525
 2024-12-12 00:49:36 -08:00
bobhan1
0c55edd3bf branch-2.1: [opt](compaction) Don't check missed rows in cumu compaction if input rowsets are not in tablet (#45279) (#45304) 
pick https://github.com/apache/doris/pull/45279
 2024-12-12 11:14:30 +08:00
github-actions[bot]
da885691ca branch-2.1: [fix](column_array)fix filter_generic in column_array func #41990 (#44983) 
Cherry-picked from #41990

Co-authored-by: amory <wangqiannan@selectdb.com>
 2024-12-12 09:52:26 +08:00
github-actions[bot]
9a4f63f180 branch-2.1: [fix](Outfile) fix the unclear error code #45119 (#45277) 
Cherry-picked from #45119

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-12 09:32:26 +08:00