database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,753 Commits 1 Branch 0 Tags
048537cd036bc692b49ad22dfc5730d2ddef22bc
Commit Graph

21753 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
James
048537cd03 branch-2.1:[fix](nereids)Use utf-8 when convert string like literal to double. (#50085) (#50155) 
backport: https://github.com/apache/doris/pull/50085
 2025-04-19 17:16:20 +08:00
github-actions[bot]
967d0a59b9 branch-2.1: [fix](load) reset routine load task EOF sign correctly #50048 (#50179) 
Cherry-picked from #50048

Co-authored-by: hui lai <laihui@selectdb.com>
 2025-04-19 17:15:18 +08:00
Qi Chen
94f5fd7728 [chore] Updated submodule orc to orc-for-doris-21 branch. (#50189) 2025-04-19 08:31:56 +08:00
github-actions[bot]
64815c6403 branch-2.1: [fix](dialect)fix starrocks dialect #50099 (#50165) 
Cherry-picked from #50099

Co-authored-by: Jiwen liu <61498169+liujiwen-up@users.noreply.github.com>
 2025-04-18 20:25:38 +08:00
Wen Zhenghu
89862856fe print error info when parse_conf_cache_paths failed, so that user know how to correct it (#50131) 2025-04-18 15:37:40 +08:00
bobhan1
4146cbbbbb branch-2.1-pick: [Opt](mow) Forbid time_series compaction policy on unique table (#49905) (#50132) 
pick https://github.com/apache/doris/pull/49905
 2025-04-18 11:34:18 +08:00
github-actions[bot]
77ea907b54 branch-2.1: [Bug](materialized-view) Fixed the problem of using drop table force and create mv stmt at the… #41580 (#50133) 
Cherry-picked from #41580

Co-authored-by: Pxl <pxl290@qq.com>
 2025-04-18 11:30:47 +08:00
lw112
c3a201dcbf branch-2.1: [fix](agg) prevent core dump in ColumnArray::size_at when handling type mismatch in streaming_agg_serialize_to_column #50001 (#50095) 
### What problem does this PR solve?

Cherry-picked from: #50001
 2025-04-17 09:30:06 +08:00
yagagagaga
41b5866c3e [fix](regression) fix the failed of cold_heat_separation_p2 (#49625) (#50090) 
(cherry picked from #49625 commit
5f000e63fde699d52e63e41d710462603b80c9b2)
 2025-04-17 09:27:54 +08:00
linrrarity
ea29bc523e branch-2.1: [Enhancement](GEO) Support Multipolygon and some spatial functions (#50073) 
pick: https://github.com/apache/doris/pull/37003,
https://github.com/apache/doris/pull/48695 and
https://github.com/apache/doris/pull/49665

---------

Co-authored-by: Mryange <59914473+Mryange@users.noreply.github.com>
Co-authored-by: koi <koi20000@163.com>
 2025-04-17 09:25:29 +08:00
github-actions[bot]
2aa9cb2276 branch-2.1: [fix](lzo) fix lzo decompression failed #49538 (#49634) 
Cherry-picked from #49538

---------

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
Co-authored-by: morningman <yunyou@selectdb.com>
 2025-04-17 09:19:35 +08:00
Sun Chenyang
2ef136cad6 [fix](variant) building index on the variant column is prohibited (#49159) (#50028) 
pick from master #49159
 2025-04-16 17:52:56 +08:00
github-actions[bot]
c38ca0cd46 branch-2.1: [test]add test for restore schema not consist #49849 (#50070) 
Cherry-picked from #49849

Co-authored-by: koarz <lihao@selectdb.com>
 2025-04-16 16:47:22 +08:00
bobhan1
afaab7ff98 branch-2.1-pick: [Opt](log) Add and fix logs for delete bitmaps (#50060) 
pick https://github.com/apache/doris/pull/48523,
https://github.com/apache/doris/pull/48930
 2025-04-16 16:45:11 +08:00
github-actions[bot]
da8722f703 branch-2.1: chore: disable download md5sum check by default #50012 (#50047) 
Cherry-picked from #50012

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-16 16:43:50 +08:00
github-actions[bot]
aa4b54952c branch-2.1: [enhancement]Optimize GeoFunctions for const columns #34396 (#50067) 
Cherry-picked from #34396

Co-authored-by: koarz <66543806+koarz@users.noreply.github.com>
 2025-04-16 14:05:46 +08:00
amory
fe634555bd [fix](variant)fix core in column_object when sort from empty block (#50035) 2025-04-16 14:03:04 +08:00
github-actions[bot]
bbdb057e2c branch-2.1: [fix](nereids) EliminateGroupByConstant should replace agg's group by after removing constant group by keys #49473 (#50044) 
Cherry-picked from #49473

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2025-04-16 13:02:39 +08:00
github-actions[bot]
06ab763efb branch-2.1: [fix](parquet)fix when hive_parquet_use_column_names=false && read partition tb cause be core. #49966 (#50008) 
Cherry-picked from #49966

Co-authored-by: daidai <changyuwei@selectdb.com>
 2025-04-16 12:44:48 +08:00
Mryange
d87409c5ca [fix](inverted index) Downgrade ICU version to support lower OS versions #47664 (#50005) 2025-04-16 12:43:20 +08:00
Uniqueyou
7ba2f87087 branch-2.1: [fix](binlog) Replaced partition should be record to Dropped Resources #48686 (#49789) 
pick: https://github.com/apache/doris/pull/48686/files
 2025-04-16 12:41:12 +08:00
daidai
6e448d3a56 [feat](test)add some be ut for orc/parquet reader (#49418) (#49948) 
bp #49418
 2025-04-16 12:38:45 +08:00
Mingyu Chen (Rayner)
b9d447741e Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" (#49986) 
Reverts apache/doris#49831
 2025-04-11 16:08:02 +08:00
xy720
9960b0960e branch-2.1: [bug](auto partition) Fix be crash with single replica insert (#48929) 
Something may be wrong in #48536, and it reverts at #48926.

We need to re-run the pipeline and see what was wrong.
 2025-04-11 15:23:51 +08:00
github-actions[bot]
ba1ad12a21 branch-2.1: [Fix](Serde) Support hive compatible output format #49036 (#49831) 
Cherry-picked from #49036

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2025-04-11 15:13:02 +08:00
Xin Liao
e70a3ab8b1 branch-2.1: [fix] (streamload) fixed the issue of data loss due to concurrency wh… #48948 (#49937) 
cherry pick from #48948

Co-authored-by: kang <35803862+ghkang98@users.noreply.github.com>
Co-authored-by: lik40 <lik40@chinatelecom.cn>
 2025-04-11 15:10:42 +08:00
Mryange
d8a274251e branch-2.1: [feature](function) support utf8 input in initcap #49846 (#49977) 2025-04-11 15:06:23 +08:00
github-actions[bot]
40a62c3b82 branch-2.1: [feat](dialect) add starrocks dialect #49951 (#49974) 
Cherry-picked from #49951

Co-authored-by: Jiwen liu <61498169+liujiwen-up@users.noreply.github.com>
 2025-04-11 09:23:06 +08:00
James
530bad3d14 Set isQuery audit log correctly when fallback to old planner. (#49959) 2025-04-10 23:27:54 +08:00
bobhan1
308ede0657 branch-2.1-pick: [Fix](full compaction) Fix problems for full compaction #49825 (#49919) 
pick https://github.com/apache/doris/pull/49825
 2025-04-10 23:26:39 +08:00
Calvin Kirs
78b8f31895 branch-2.1 [Fix](Catalog) Close system resources when dropping catalog ( #49621) (#49935) 
https://github.com/apache/doris/pull/49621
(cherry picked from commit
902b95b1bf)
 2025-04-10 23:23:51 +08:00
924060929
e4d0c672a3 branch-2.1: [fix](Nereids) cse extract wrong expression from lambda expressions (#49166) (#49942) 
cherry pick from #49166

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2025-04-10 23:22:55 +08:00
924060929
c83c2e18bc [fix](planner) fix fallback to legacy planner compute wrong result (#49913) 
### What problem does this PR solve?

doris 3.x not need this fix because the legacy planner already be
deleted

what's wrong:
1. when nereids planner can not parse the sql, doris will fallback to
legacy planner and maybe handle this case, but we not set the
`enable_nereids_planner` to `false` for legacy planner
2. the `ignore_storage_data_distribution` only support when
`enable_nereids_planner` is `true`
3. the legacy planner will use one phase aggregation when input fragment
only has one instance
4. the legacy planner maybe compute one instance by invoke
`OlapScanNode#getNumInstances()` if `enable_nereids_planner == true &&
ignore_storage_data_distribution == true`, even the data place at
multiple backends, then the aggregation will compute wrong result

so when fallback to legacy planner, the legacy planner should set
`enable_nereids_planner` to `false`, then the input OlapScanNode will
not compute one instance, and the AggregationNode will use two phases to
compute the right result.


### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
 2025-04-10 23:22:18 +08:00
Mingyu Chen (Rayner)
bfe7469560 branch-2.1: [fix](oss) the write to hive table on oss-hdfs may fail (#49754) (#49911) 
bp #49754
 2025-04-10 22:01:42 +08:00
Mingyu Chen (Rayner)
4ae9451b63 branch-2.1: [opt](connection) add connection num in error msg (#49471) (#49910) 
bp #49471
 2025-04-10 22:00:51 +08:00
Mingyu Chen (Rayner)
826cbfdb63 [deps](jindofs) add jindofs for 2.1 (#49259)(#49371)(#49374)(#49502)(#49503)(#49886)(#49903) (#49908) 
bp (#49259)(#49371)(#49374)(#49502)(#49503)(#49886)(#49903)
 2025-04-10 21:58:36 +08:00
Qi Chen
a512edc7e2 [fix](multi-catalog) Fix multi-thread issue in hive/iceberg writer commit meta-info to fe. (#49920) 2025-04-10 21:57:54 +08:00
Qi Chen
8199febcdb [Test][Fix](parquet-reader) Add parquet decoder unit tests and fix bugs by these tests. (#49922) 2025-04-10 21:56:53 +08:00
lihangyu
7ce420c194 [chore](log) change PointQueryExecutor log to VLOG_DEBUG (#49860) (#49900) 
cherry-pick from https://github.com/apache/doris/pull/49860
 2025-04-09 21:11:28 +08:00
github-actions[bot]
18dc82010b branch-2.1: [enhancement](memoryfailed) throw exception instead of log fatal during memory allocate failed #49876 (#49897) 
Cherry-picked from #49876

Co-authored-by: yiguolei <guolei@selectdb.com>
 2025-04-09 16:03:14 +08:00
github-actions[bot]
81ea088c96 branch-2.1: [fix](backup) Save snapshot meta during replay #49550 (#49606) 
Cherry-picked from #49550

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-09 14:19:19 +08:00
seawinde
55974f7fb9 [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large (#48887) (#49850) 2025-04-08 15:18:26 +08:00
github-actions[bot]
8356141e03 branch-2.1: [enhancement](case) add cases for mow table load empty file #49843 (#49858) 
Cherry-picked from #49843

Co-authored-by: MoanasDaddyXu <xujianxu@selectdb.com>
 2025-04-08 14:04:30 +08:00
github-actions[bot]
7c23af5b00 branch-2.1: [fix](opt)fix create expr tree to avoid the dangling reference #49082 (#49834) 
Cherry-picked from #49082

Co-authored-by: zhangm365 <mzhang2048@gmail.com>
 2025-04-08 12:01:50 +08:00
github-actions[bot]
11fecd123d branch-2.1: [fix](gson) Missing the serialization of the partition's storage policy #49721 (#49841) 
Cherry-picked from #49721

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2025-04-08 11:02:13 +08:00
Mryange
aad189cf40 [feature](function) upper lower support utf8 input (#49756) 
### What problem does this PR solve?
https://github.com/apache/doris/pull/49231
 2025-04-07 12:00:31 +08:00
github-actions[bot]
08fc9eea0d branch-2.1: [feat](thirdparty) Add aws dentity-management and sts library for be and ry #49565 (#49684) 
Cherry-picked from #49565

Co-authored-by: Lei Zhang <zhanglei@selectdb.com>
 2025-04-06 21:22:52 +08:00
github-actions[bot]
0ea87fba6f branch-2.1: [Bug][function] fix the string cast jsonb cause null map have not init value #49810 (#49817) 
Cherry-picked from #49810

Co-authored-by: HappenLee <happenlee@selectdb.com>
 2025-04-06 10:16:11 +08:00
Jerry Hu
c0bc16d88f [fix](function) wrong result of arrays_overlap (#49403) (#49707) 
Pick #49403
If the two arrays have the same non-null elements, they are considered
overlapping, and the result is 1.
If the two arrays have no common non-null elements and either array
contains a null element, the result is null.
Otherwise, the result is 0.

```
select arrays_overlap([1, 2, 3], [1, null]);  -- result should be 1

select arrays_overlap([2, 3], [1, null]);  -- result should be null

select arrays_overlap([2, 3], [1]);   -- result should be 0
```

### What problem does this PR solve?
 2025-04-04 20:58:01 +08:00
minghong
6974a8fc4a branch-2.1: [opt](nereids)do not apply CSE(Common Sub Expression) upon multiDataSink #33746 (#49797) 2025-04-04 20:49:07 +08:00