database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,713 Commits 1 Branch 0 Tags
81ea088c962fa401bcde3c52ff2e5d64b7e40df3
Commit Graph

21713 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
github-actions[bot]
81ea088c96 branch-2.1: [fix](backup) Save snapshot meta during replay #49550 (#49606) 
Cherry-picked from #49550

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-09 14:19:19 +08:00
seawinde
55974f7fb9 [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large (#48887) (#49850) 2025-04-08 15:18:26 +08:00
github-actions[bot]
8356141e03 branch-2.1: [enhancement](case) add cases for mow table load empty file #49843 (#49858) 
Cherry-picked from #49843

Co-authored-by: MoanasDaddyXu <xujianxu@selectdb.com>
 2025-04-08 14:04:30 +08:00
github-actions[bot]
7c23af5b00 branch-2.1: [fix](opt)fix create expr tree to avoid the dangling reference #49082 (#49834) 
Cherry-picked from #49082

Co-authored-by: zhangm365 <mzhang2048@gmail.com>
 2025-04-08 12:01:50 +08:00
github-actions[bot]
11fecd123d branch-2.1: [fix](gson) Missing the serialization of the partition's storage policy #49721 (#49841) 
Cherry-picked from #49721

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2025-04-08 11:02:13 +08:00
Mryange
aad189cf40 [feature](function) upper lower support utf8 input (#49756) 
### What problem does this PR solve?
https://github.com/apache/doris/pull/49231
 2025-04-07 12:00:31 +08:00
github-actions[bot]
08fc9eea0d branch-2.1: [feat](thirdparty) Add aws dentity-management and sts library for be and ry #49565 (#49684) 
Cherry-picked from #49565

Co-authored-by: Lei Zhang <zhanglei@selectdb.com>
 2025-04-06 21:22:52 +08:00
github-actions[bot]
0ea87fba6f branch-2.1: [Bug][function] fix the string cast jsonb cause null map have not init value #49810 (#49817) 
Cherry-picked from #49810

Co-authored-by: HappenLee <happenlee@selectdb.com>
 2025-04-06 10:16:11 +08:00
Jerry Hu
c0bc16d88f [fix](function) wrong result of arrays_overlap (#49403) (#49707) 
Pick #49403
If the two arrays have the same non-null elements, they are considered
overlapping, and the result is 1.
If the two arrays have no common non-null elements and either array
contains a null element, the result is null.
Otherwise, the result is 0.

```
select arrays_overlap([1, 2, 3], [1, null]);  -- result should be 1

select arrays_overlap([2, 3], [1, null]);  -- result should be null

select arrays_overlap([2, 3], [1]);   -- result should be 0
```

### What problem does this PR solve?
 2025-04-04 20:58:01 +08:00
minghong
6974a8fc4a branch-2.1: [opt](nereids)do not apply CSE(Common Sub Expression) upon multiDataSink #33746 (#49797) 2025-04-04 20:49:07 +08:00
github-actions[bot]
486e458618 branch-2.1: [case](mtmv)add case for insert overwrite of mtmv force drop partition #48946 (#49800) 
Cherry-picked from #48946

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-04-04 20:48:17 +08:00
github-actions[bot]
342b55afc2 branch-2.1: [fix](binlog) get table with db lock if the table not exists #49566 (#49648) 
Cherry-picked from #49566

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-04 20:46:58 +08:00
zhangdong
3a282bd307 branch-2.1:[fix](auth)Delete from should not check select_priv (#49794) 
pick: https://github.com/apache/doris/pull/49239
 2025-04-04 20:46:43 +08:00
github-actions[bot]
15662c06e6 branch-2.1: [fix](auth)Ignore replay edit log error of auth #49348 (#49787) 
Cherry-picked from #49348

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-04-04 20:44:54 +08:00
yiguolei
672829096e [chore](enhancement) remove atomic load shared ptr usage (#49781) 2025-04-03 17:57:12 +08:00
github-actions[bot]
2b08429577 branch-2.1: [fix](meta) do not check replica allocation when replay #49569 (#49604) 
Cherry-picked from #49569

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
 2025-04-03 09:50:24 +08:00
minghong
3d10db4786 branch-2.1 [opt](nereids) set column stats unkown by default when derive Not expressoin #48864 (#49742) 2025-04-03 09:48:46 +08:00
github-actions[bot]
0735c19cdd branch-2.1: [fix](paimon) Covert Paimon DeletionFile Path to StoragePath in fe #49645 (#49751) 
Cherry-picked from #49645

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2025-04-02 20:25:10 +08:00
Mryange
145e393d3d branch-2.1: [fix](function) check return type is nullptr in FunctionBasePtr::build #49737 (#49761) 2025-04-02 20:23:41 +08:00
Kaijie Chen
cf847b8c71 [fix](load) return DataQualityError when filtered rows exceeds limit (#47617) (#49289) 
backport #47617
 2025-04-02 19:09:21 +08:00
starocean999
f7f230dd34 branch-2.1: [fix](nereids)canInferNotNullForMarkSlot method get wrong result if fold constant rule is disabled (#49695) 2025-04-02 10:24:34 +08:00
github-actions[bot]
997db43dda branch-2.1: [improve](thrift) Config thrift_max_message_size for THREAD_POOL and … #49677 (#49724) 
Cherry-picked from #49677

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-01 17:16:58 +08:00
github-actions[bot]
e898dbbba0 branch-2.1: [fix](mc)Fixed the issue that maxcompute catalog can only read part of the timestamp data #49600 (#49706) 
Cherry-picked from #49600

Co-authored-by: daidai <changyuwei@selectdb.com>
 2025-04-01 17:09:15 +08:00
github-actions[bot]
a9939c09c1 branch-2.1: [improve](thrift) Config thrift_max_message_size for FE SIMPLE and TH… #49678 (#49725) 
Cherry-picked from #49678

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-01 17:03:48 +08:00
feiniaofeiafei
f2dac1f876 branch-2.1: [fix](test) fix unstable test infer_intersect_except #49000 (#49709) 2025-04-01 16:00:59 +08:00
Pxl
e5fe002805 [Bug](materialized-view) check duplicate expr when create mv stmt not have groupby exprs (#49595) (#49696) 
pick from #49595
 2025-04-01 15:51:41 +08:00
abmdocrt
badd6f6e18 [Fix](case) Fix test base compaction case (#49693) 2025-04-01 15:49:13 +08:00
yujun
ed8531b99a branch-2.1: [feat](regression) inject debug points need run in nonConcurrent or docker suites #49581 (#49618) 
Cherry-picked from #49581, #40259
 2025-03-30 15:43:58 +08:00
github-actions[bot]
ec25f7573e branch-2.1: [fix](nereids) project child output to union output in correct order after eliminate empty relation #49257 (#49464) 
Cherry-picked from #49257

Co-authored-by: minghong <zhouminghong@selectdb.com>
 2025-03-29 20:33:42 +08:00
github-actions[bot]
82064902c0 branch-2.1: [Bug] Fix accidental table deletion during restore job #48820 (#49498) 
Cherry-picked from #48820

Co-authored-by: wubiao <biao.wu@aliyun.com>
Co-authored-by: wubiao02 <wubiao02@meituan.com>
 2025-03-29 20:26:12 +08:00
github-actions[bot]
e932094a05 branch-2.1: [fix](jdbc catalog) ensure initialization before fetching row count #49442 (#49476) 
Cherry-picked from #49442

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
 2025-03-29 20:25:09 +08:00
github-actions[bot]
ed1db08a17 branch-2.1: [fix](thrift) Pick THRIFT-5492: Add readEnd to TBufferedTransport #49649 (#49656) 
Cherry-picked from #49649

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-29 20:22:09 +08:00
Gabriel
cc0b2585ac branch-2.1: [function](date) Support date trunc function #49540 (#49661) 2025-03-29 20:21:33 +08:00
github-actions[bot]
1259ee5088 branch-2.1: [Feature](function) support year of week #48870 (#49012) 2025-03-29 11:24:45 +08:00
github-actions[bot]
2ab34bfd86 branch-2.1: [fix](catalog)when checkpoint,use cacheThreadPool #49097 (#49518) 
Cherry-picked from #49097

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-03-29 10:33:40 +08:00
github-actions[bot]
22b8dc2289 branch-2.1: [Opt](bvar) Add bvar for txn tablet map #49567 (#49627) 
Cherry-picked from #49567

Co-authored-by: bobhan1 <baohan@selectdb.com>
 2025-03-29 10:27:07 +08:00
Socrates
94986fc574 branch-2.1: [fix](multi-catalog) Fix bug: "Can not create a Path from an empty string" (#49382) (#49641) 
### What problem does this PR solve?
Problem Summary:
In HiveMetaStoreCache, the function FileInputFormat.setInputPaths is
used to set input paths. However, this function splits paths using
commas, which is not the expected behavior. As a result, when partition
values contain commas, it leads to incorrect path parsing and potential
errors.
```java
  public static void setInputPaths(JobConf conf, String org.apache.hadoop.shaded.com.aSeparatedPaths) {
    setInputPaths(conf, StringUtils.stringToPath(
                        getPathStrings(org.apache.hadoop.shaded.com.aSeparatedPaths)));
  }
```
To prevent FileInputFormat.setInputPaths from splitting paths by commas,
we use another overloaded version of the method. Instead of passing a
comma-separated string, we explicitly pass a Path object, ensuring that
partition values containing commas are handled correctly.
```java
  public static void setInputPaths(JobConf conf, Path... inputPaths) {
    Path path = new Path(conf.getWorkingDirectory(), inputPaths[0]);
    StringBuffer str = new StringBuffer(StringUtils.escapeString(path.toString()));
    for(int i = 1; i < inputPaths.length;i++) {
      str.append(StringUtils.COMMA_STR);
      path = new Path(conf.getWorkingDirectory(), inputPaths[i]);
      str.append(StringUtils.escapeString(path.toString()));
    }
    conf.set(org.apache.hadoop.shaded.org.apache.hadoop.mapreduce.lib.input.
      FileInputFormat.INPUT_DIR, str.toString());
  }
```

### Release note

None
 2025-03-29 09:13:43 +08:00
github-actions[bot]
05ffc62594 branch-2.1: [Fix](compaction) Fix full compaction error when compaction size is too large #48958 (#49493) 
Cherry-picked from #48958

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
 2025-03-29 09:01:36 +08:00
github-actions[bot]
e8c91dcd73 branch-2.1: [fix](restore) correct the storage_medium of atomic restore #49330 (#49451) 
Cherry-picked from #49330

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-29 09:00:26 +08:00
walter
f55055096b branch-2.1: [improve](binlog) Allow commit txn without waiting txn publish #48961 (#49266) 
cherry pick from #48961
 2025-03-29 08:59:23 +08:00
github-actions[bot]
646f49fb93 branch-2.1: [fix](Nereids) use StringLikeLiteral as parameter type in constant folding #49413 (#49447) 
Cherry-picked from #49413

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2025-03-29 08:58:39 +08:00
HappenLee
4a31fc4e09 [Bug](fix) fix the percentile func result do not equal the percentile array rewrite result (#49379) 
cherry pick https://github.com/apache/doris/pull/49351
 2025-03-29 08:56:24 +08:00
github-actions[bot]
8f15e62de5 branch-2.1: [fix](fe) Using try-with-resource for auto close RemoteFileSystem #49637 (#49652) 
Cherry-picked from #49637

Co-authored-by: Lei Zhang <zhanglei@selectdb.com>
 2025-03-29 08:54:50 +08:00
amory
89f4c90a44 [fix](named_struct) fix named_struct signature which deduce wrong for nested decimal precision (#49355) 2025-03-28 11:56:15 +08:00
924060929
cf1938dd59 branch-2.1: [opt](nereids) skip run PruneOlapScanTablet when exists lots of InPredicate (#49387) 
cherry pick some parts from #47608 and #49386
 2025-03-28 11:51:20 +08:00
bobhan1
7d64a80959 branch-2.1-pick: [Fix](log) correct tablet diff log in TabletInvertedIndex.tabletReport (#49390) (#49445) 
pick https://github.com/apache/doris/pull/49390
 2025-03-28 11:50:31 +08:00
github-actions[bot]
57f04a7b9b branch-2.1: [fix](Nereids) fix double literal to string literal cast problem #49416 (#49523) 
Cherry-picked from #49416

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
 2025-03-28 11:49:02 +08:00
Calvin Kirs
4645084ab1 branch-2.1: [Fix](GA)Remove extra blank lines to avoid parsing failures #49615 (#49616) 2025-03-28 11:45:48 +08:00
github-actions[bot]
92176c46bf branch-2.1: [feat](binlog) filter the async mv binlogs #49028 (#49099) 
Cherry-picked from #49028

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-28 10:01:00 +08:00
github-actions[bot]
2fb8e00907 branch-2.1: [chore](task) log the thrift message size if the broken pipe is occurred #49492 (#49509) 
Cherry-picked from #49492

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-28 09:57:53 +08:00