Commit Graph

21691 Commits

Author SHA1 Message Date
e898dbbba0 branch-2.1: [fix](mc)Fixed the issue that maxcompute catalog can only read part of the timestamp data #49600 (#49706)
Cherry-picked from #49600

Co-authored-by: daidai <changyuwei@selectdb.com>
2025-04-01 17:09:15 +08:00
a9939c09c1 branch-2.1: [improve](thrift) Config thrift_max_message_size for FE SIMPLE and TH… #49678 (#49725)
Cherry-picked from #49678

Co-authored-by: walter <maochuan@selectdb.com>
2025-04-01 17:03:48 +08:00
f2dac1f876 branch-2.1: [fix](test) fix unstable test infer_intersect_except #49000 (#49709) 2025-04-01 16:00:59 +08:00
Pxl
e5fe002805 [Bug](materialized-view) check duplicate expr when create mv stmt not have groupby exprs (#49595) (#49696)
pick from #49595
2025-04-01 15:51:41 +08:00
badd6f6e18 [Fix](case) Fix test base compaction case (#49693) 2025-04-01 15:49:13 +08:00
ed8531b99a branch-2.1: [feat](regression) inject debug points need run in nonConcurrent or docker suites #49581 (#49618)
Cherry-picked from #49581, #40259
2025-03-30 15:43:58 +08:00
ec25f7573e branch-2.1: [fix](nereids) project child output to union output in correct order after eliminate empty relation #49257 (#49464)
Cherry-picked from #49257

Co-authored-by: minghong <zhouminghong@selectdb.com>
2025-03-29 20:33:42 +08:00
82064902c0 branch-2.1: [Bug] Fix accidental table deletion during restore job #48820 (#49498)
Cherry-picked from #48820

Co-authored-by: wubiao <biao.wu@aliyun.com>
Co-authored-by: wubiao02 <wubiao02@meituan.com>
2025-03-29 20:26:12 +08:00
e932094a05 branch-2.1: [fix](jdbc catalog) ensure initialization before fetching row count #49442 (#49476)
Cherry-picked from #49442

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
2025-03-29 20:25:09 +08:00
ed1db08a17 branch-2.1: [fix](thrift) Pick THRIFT-5492: Add readEnd to TBufferedTransport #49649 (#49656)
Cherry-picked from #49649

Co-authored-by: walter <maochuan@selectdb.com>
2025-03-29 20:22:09 +08:00
cc0b2585ac branch-2.1: [function](date) Support date trunc function #49540 (#49661) 2025-03-29 20:21:33 +08:00
1259ee5088 branch-2.1: [Feature](function) support year of week #48870 (#49012) 2025-03-29 11:24:45 +08:00
2ab34bfd86 branch-2.1: [fix](catalog)when checkpoint,use cacheThreadPool #49097 (#49518)
Cherry-picked from #49097

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-03-29 10:33:40 +08:00
22b8dc2289 branch-2.1: [Opt](bvar) Add bvar for txn tablet map #49567 (#49627)
Cherry-picked from #49567

Co-authored-by: bobhan1 <baohan@selectdb.com>
2025-03-29 10:27:07 +08:00
94986fc574 branch-2.1: [fix](multi-catalog) Fix bug: "Can not create a Path from an empty string" (#49382) (#49641)
### What problem does this PR solve?
Problem Summary:
In HiveMetaStoreCache, the function FileInputFormat.setInputPaths is
used to set input paths. However, this function splits paths using
commas, which is not the expected behavior. As a result, when partition
values contain commas, it leads to incorrect path parsing and potential
errors.
```java
  public static void setInputPaths(JobConf conf, String org.apache.hadoop.shaded.com.aSeparatedPaths) {
    setInputPaths(conf, StringUtils.stringToPath(
                        getPathStrings(org.apache.hadoop.shaded.com.aSeparatedPaths)));
  }
```
To prevent FileInputFormat.setInputPaths from splitting paths by commas,
we use another overloaded version of the method. Instead of passing a
comma-separated string, we explicitly pass a Path object, ensuring that
partition values containing commas are handled correctly.
```java
  public static void setInputPaths(JobConf conf, Path... inputPaths) {
    Path path = new Path(conf.getWorkingDirectory(), inputPaths[0]);
    StringBuffer str = new StringBuffer(StringUtils.escapeString(path.toString()));
    for(int i = 1; i < inputPaths.length;i++) {
      str.append(StringUtils.COMMA_STR);
      path = new Path(conf.getWorkingDirectory(), inputPaths[i]);
      str.append(StringUtils.escapeString(path.toString()));
    }
    conf.set(org.apache.hadoop.shaded.org.apache.hadoop.mapreduce.lib.input.
      FileInputFormat.INPUT_DIR, str.toString());
  }
```

### Release note

None
2025-03-29 09:13:43 +08:00
05ffc62594 branch-2.1: [Fix](compaction) Fix full compaction error when compaction size is too large #48958 (#49493)
Cherry-picked from #48958

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
2025-03-29 09:01:36 +08:00
e8c91dcd73 branch-2.1: [fix](restore) correct the storage_medium of atomic restore #49330 (#49451)
Cherry-picked from #49330

Co-authored-by: walter <maochuan@selectdb.com>
2025-03-29 09:00:26 +08:00
f55055096b branch-2.1: [improve](binlog) Allow commit txn without waiting txn publish #48961 (#49266)
cherry pick from #48961
2025-03-29 08:59:23 +08:00
646f49fb93 branch-2.1: [fix](Nereids) use StringLikeLiteral as parameter type in constant folding #49413 (#49447)
Cherry-picked from #49413

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2025-03-29 08:58:39 +08:00
4a31fc4e09 [Bug](fix) fix the percentile func result do not equal the percentile array rewrite result (#49379)
cherry pick https://github.com/apache/doris/pull/49351
2025-03-29 08:56:24 +08:00
8f15e62de5 branch-2.1: [fix](fe) Using try-with-resource for auto close RemoteFileSystem #49637 (#49652)
Cherry-picked from #49637

Co-authored-by: Lei Zhang <zhanglei@selectdb.com>
2025-03-29 08:54:50 +08:00
89f4c90a44 [fix](named_struct) fix named_struct signature which deduce wrong for nested decimal precision (#49355) 2025-03-28 11:56:15 +08:00
cf1938dd59 branch-2.1: [opt](nereids) skip run PruneOlapScanTablet when exists lots of InPredicate (#49387)
cherry pick some parts from #47608 and #49386
2025-03-28 11:51:20 +08:00
7d64a80959 branch-2.1-pick: [Fix](log) correct tablet diff log in TabletInvertedIndex.tabletReport (#49390) (#49445)
pick https://github.com/apache/doris/pull/49390
2025-03-28 11:50:31 +08:00
57f04a7b9b branch-2.1: [fix](Nereids) fix double literal to string literal cast problem #49416 (#49523)
Cherry-picked from #49416

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
2025-03-28 11:49:02 +08:00
4645084ab1 branch-2.1: [Fix](GA)Remove extra blank lines to avoid parsing failures #49615 (#49616) 2025-03-28 11:45:48 +08:00
92176c46bf branch-2.1: [feat](binlog) filter the async mv binlogs #49028 (#49099)
Cherry-picked from #49028

Co-authored-by: walter <maochuan@selectdb.com>
2025-03-28 10:01:00 +08:00
2fb8e00907 branch-2.1: [chore](task) log the thrift message size if the broken pipe is occurred #49492 (#49509)
Cherry-picked from #49492

Co-authored-by: walter <maochuan@selectdb.com>
2025-03-28 09:57:53 +08:00
63fb74b480 branch-2.1: [Bug](udf) should delete local ref when return error msg #48609 (#49528)
Problem Summary:
cherry-pick from master (#48609)
2025-03-28 09:57:18 +08:00
60f6975850 branch-2.1-pick: [Fix](txn) Remove TabletTxnInfo if version exists when publish version (#49564) (#49590)
pick https://github.com/apache/doris/pull/49564
2025-03-28 09:56:41 +08:00
b16821f018 branch-2.1: [fix](auth)Prohibit other users from modifying the root #48752 (#49585)
Cherry-picked from #48752

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-03-28 09:54:32 +08:00
1ff0f70460 branch-2.1: [case](restore) Rename repo name of backup-restore regression cases with suite name (#49535)
### What problem does this PR solve?

pick:https://github.com/apache/doris/pull/49237

1、Rename the repo of backup restore regression cases with a suite name
prefix.
2、Change the maximum length of repo names from 63 to 255

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-03-27 20:13:30 +08:00
11f8b53016 [fix](runtime) Avoid merging results into one large result in BufferControlBlock (#49571) 2025-03-27 19:49:58 +08:00
ed56e84b31 branch-2.1: [fix](system) fix alter system modify hostname with valid ip exception #49551 (#49561)
cherry pick from #49551
2025-03-27 19:49:27 +08:00
374b901717 branch-2.1 [fix](nereids)avoid generate Runtime filter whose target is not a base table column #48804 (#49314) 2025-03-27 19:48:37 +08:00
088edffded [fix](column) remove string64 in check_chars_length (#49537) 2025-03-27 19:47:58 +08:00
aa43f84e72 [fix](case)rename case dir to prevent db name too long (#49580)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-03-27 17:02:48 +08:00
3390475e02 2.1.9-rc02 (#49500) 2025-03-26 11:42:49 +08:00
0a6bb54e47 branch-2.1: [opt](metrics) optimize performance of metrics endpoint #49380 (#49455)
Cherry-picked from #49380

Co-authored-by: 924060929 <lanhuajian@selectdb.com>
2025-03-26 11:31:06 +08:00
e2ab9ef46c [regression-test](cases) mv some cases nonConcurrent (#49460) 2025-03-26 11:22:44 +08:00
017e5a42fb [branch-2.1] pick 49325 fix query statistics leak in BE (#49397)
pick #49325
2025-03-24 19:59:15 +08:00
1fb771d526 branch-2.1: [fix](statistics)Fix replace table doesn't remove table stat meta memory leak bug. (#49345) (#49367)
Cherry-picked from https://github.com/apache/doris/pull/49345
2025-03-23 09:55:47 +08:00
c3fad29a4f [fix](webui) add connection context to avoid NPE (#49213) (#49353)
bp #49213
2025-03-22 08:00:49 +08:00
a40a4bbc67 branch-2.1: [fix](Nereids) fold constant for string function process emoji character by mistake #49087 (#49344)
pick: #49087 
Related PR: #40441

Problem Summary:

wrong calculation of emoji character length in some String function when
do constant folding in FE. For example:

select STRLEFT('😊😉👍', 2);

should return 😊😉, but fe return 😊 only when folding constant

fixed functions:
- left
- strleft
- right
- strright
- locate
- character_length
- split_by_string
- overlay
- replace_empty
2025-03-22 07:44:55 +08:00
2eed4f3a65 branch-2.1: [opt](paimon)Add suppressed information display #48947 (#48997)
Cherry-picked from #48947

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2025-03-22 07:42:45 +08:00
abc535a9e7 branch-2.1: [fix](hudi) Fix Memory Leak in BitCaskDiskMap Due to Circular Reference #48955 (#49115)
Cherry-picked from #48955

Co-authored-by: Socrates <suyiteng@selectdb.com>
2025-03-21 22:44:35 +08:00
5aa715db03 branch-2.1: [fix](regression) Avoid defined global variables in backup-restore case script (#49331) 2025-03-21 20:13:07 +08:00
71824569a9 [fix](Index)Make column unique ids in index dynamically computed (#48988) (#49300)
bp #48988
2025-03-21 19:51:00 +08:00
3e894994d4 [Fix](branch-2.1) Fix unstable case "test_base_compaction" (#49349) 2025-03-21 18:06:43 +08:00
7b28e33815 [improvement](statistics)Remove read lock when doing db analyze. (#49250) (#49320)
backport: https://github.com/apache/doris/pull/49250
2025-03-21 18:04:38 +08:00