database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,713 Commits 1 Branch 0 Tags
81ea088c962fa401bcde3c52ff2e5d64b7e40df3
Commit Graph

9972 Commits

Author SHA1 Message Date
github-actions[bot]
81ea088c96 branch-2.1: [fix](backup) Save snapshot meta during replay #49550 (#49606) 
Cherry-picked from #49550

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-09 14:19:19 +08:00
seawinde
55974f7fb9 [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large (#48887) (#49850) 2025-04-08 15:18:26 +08:00
github-actions[bot]
11fecd123d branch-2.1: [fix](gson) Missing the serialization of the partition's storage policy #49721 (#49841) 
Cherry-picked from #49721

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2025-04-08 11:02:13 +08:00
minghong
6974a8fc4a branch-2.1: [opt](nereids)do not apply CSE(Common Sub Expression) upon multiDataSink #33746 (#49797) 2025-04-04 20:49:07 +08:00
github-actions[bot]
342b55afc2 branch-2.1: [fix](binlog) get table with db lock if the table not exists #49566 (#49648) 
Cherry-picked from #49566

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-04 20:46:58 +08:00
zhangdong
3a282bd307 branch-2.1:[fix](auth)Delete from should not check select_priv (#49794) 
pick: https://github.com/apache/doris/pull/49239
 2025-04-04 20:46:43 +08:00
github-actions[bot]
15662c06e6 branch-2.1: [fix](auth)Ignore replay edit log error of auth #49348 (#49787) 
Cherry-picked from #49348

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-04-04 20:44:54 +08:00
github-actions[bot]
2b08429577 branch-2.1: [fix](meta) do not check replica allocation when replay #49569 (#49604) 
Cherry-picked from #49569

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
 2025-04-03 09:50:24 +08:00
minghong
3d10db4786 branch-2.1 [opt](nereids) set column stats unkown by default when derive Not expressoin #48864 (#49742) 2025-04-03 09:48:46 +08:00
github-actions[bot]
0735c19cdd branch-2.1: [fix](paimon) Covert Paimon DeletionFile Path to StoragePath in fe #49645 (#49751) 
Cherry-picked from #49645

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2025-04-02 20:25:10 +08:00
starocean999
f7f230dd34 branch-2.1: [fix](nereids)canInferNotNullForMarkSlot method get wrong result if fold constant rule is disabled (#49695) 2025-04-02 10:24:34 +08:00
github-actions[bot]
e898dbbba0 branch-2.1: [fix](mc)Fixed the issue that maxcompute catalog can only read part of the timestamp data #49600 (#49706) 
Cherry-picked from #49600

Co-authored-by: daidai <changyuwei@selectdb.com>
 2025-04-01 17:09:15 +08:00
github-actions[bot]
a9939c09c1 branch-2.1: [improve](thrift) Config thrift_max_message_size for FE SIMPLE and TH… #49678 (#49725) 
Cherry-picked from #49678

Co-authored-by: walter <maochuan@selectdb.com>
 2025-04-01 17:03:48 +08:00
Pxl
e5fe002805 [Bug](materialized-view) check duplicate expr when create mv stmt not have groupby exprs (#49595) (#49696) 
pick from #49595
 2025-04-01 15:51:41 +08:00
github-actions[bot]
ec25f7573e branch-2.1: [fix](nereids) project child output to union output in correct order after eliminate empty relation #49257 (#49464) 
Cherry-picked from #49257

Co-authored-by: minghong <zhouminghong@selectdb.com>
 2025-03-29 20:33:42 +08:00
github-actions[bot]
82064902c0 branch-2.1: [Bug] Fix accidental table deletion during restore job #48820 (#49498) 
Cherry-picked from #48820

Co-authored-by: wubiao <biao.wu@aliyun.com>
Co-authored-by: wubiao02 <wubiao02@meituan.com>
 2025-03-29 20:26:12 +08:00
github-actions[bot]
e932094a05 branch-2.1: [fix](jdbc catalog) ensure initialization before fetching row count #49442 (#49476) 
Cherry-picked from #49442

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
 2025-03-29 20:25:09 +08:00
Gabriel
cc0b2585ac branch-2.1: [function](date) Support date trunc function #49540 (#49661) 2025-03-29 20:21:33 +08:00
github-actions[bot]
1259ee5088 branch-2.1: [Feature](function) support year of week #48870 (#49012) 2025-03-29 11:24:45 +08:00
github-actions[bot]
2ab34bfd86 branch-2.1: [fix](catalog)when checkpoint,use cacheThreadPool #49097 (#49518) 
Cherry-picked from #49097

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-03-29 10:33:40 +08:00
Socrates
94986fc574 branch-2.1: [fix](multi-catalog) Fix bug: "Can not create a Path from an empty string" (#49382) (#49641) 
### What problem does this PR solve?
Problem Summary:
In HiveMetaStoreCache, the function FileInputFormat.setInputPaths is
used to set input paths. However, this function splits paths using
commas, which is not the expected behavior. As a result, when partition
values contain commas, it leads to incorrect path parsing and potential
errors.
```java
  public static void setInputPaths(JobConf conf, String org.apache.hadoop.shaded.com.aSeparatedPaths) {
    setInputPaths(conf, StringUtils.stringToPath(
                        getPathStrings(org.apache.hadoop.shaded.com.aSeparatedPaths)));
  }
```
To prevent FileInputFormat.setInputPaths from splitting paths by commas,
we use another overloaded version of the method. Instead of passing a
comma-separated string, we explicitly pass a Path object, ensuring that
partition values containing commas are handled correctly.
```java
  public static void setInputPaths(JobConf conf, Path... inputPaths) {
    Path path = new Path(conf.getWorkingDirectory(), inputPaths[0]);
    StringBuffer str = new StringBuffer(StringUtils.escapeString(path.toString()));
    for(int i = 1; i < inputPaths.length;i++) {
      str.append(StringUtils.COMMA_STR);
      path = new Path(conf.getWorkingDirectory(), inputPaths[i]);
      str.append(StringUtils.escapeString(path.toString()));
    }
    conf.set(org.apache.hadoop.shaded.org.apache.hadoop.mapreduce.lib.input.
      FileInputFormat.INPUT_DIR, str.toString());
  }
```

### Release note

None
 2025-03-29 09:13:43 +08:00
github-actions[bot]
e8c91dcd73 branch-2.1: [fix](restore) correct the storage_medium of atomic restore #49330 (#49451) 
Cherry-picked from #49330

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-29 09:00:26 +08:00
walter
f55055096b branch-2.1: [improve](binlog) Allow commit txn without waiting txn publish #48961 (#49266) 
cherry pick from #48961
 2025-03-29 08:59:23 +08:00
github-actions[bot]
646f49fb93 branch-2.1: [fix](Nereids) use StringLikeLiteral as parameter type in constant folding #49413 (#49447) 
Cherry-picked from #49413

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2025-03-29 08:58:39 +08:00
HappenLee
4a31fc4e09 [Bug](fix) fix the percentile func result do not equal the percentile array rewrite result (#49379) 
cherry pick https://github.com/apache/doris/pull/49351
 2025-03-29 08:56:24 +08:00
github-actions[bot]
8f15e62de5 branch-2.1: [fix](fe) Using try-with-resource for auto close RemoteFileSystem #49637 (#49652) 
Cherry-picked from #49637

Co-authored-by: Lei Zhang <zhanglei@selectdb.com>
 2025-03-29 08:54:50 +08:00
amory
89f4c90a44 [fix](named_struct) fix named_struct signature which deduce wrong for nested decimal precision (#49355) 2025-03-28 11:56:15 +08:00
924060929
cf1938dd59 branch-2.1: [opt](nereids) skip run PruneOlapScanTablet when exists lots of InPredicate (#49387) 
cherry pick some parts from #47608 and #49386
 2025-03-28 11:51:20 +08:00
bobhan1
7d64a80959 branch-2.1-pick: [Fix](log) correct tablet diff log in TabletInvertedIndex.tabletReport (#49390) (#49445) 
pick https://github.com/apache/doris/pull/49390
 2025-03-28 11:50:31 +08:00
github-actions[bot]
57f04a7b9b branch-2.1: [fix](Nereids) fix double literal to string literal cast problem #49416 (#49523) 
Cherry-picked from #49416

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
 2025-03-28 11:49:02 +08:00
github-actions[bot]
92176c46bf branch-2.1: [feat](binlog) filter the async mv binlogs #49028 (#49099) 
Cherry-picked from #49028

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-28 10:01:00 +08:00
github-actions[bot]
2fb8e00907 branch-2.1: [chore](task) log the thrift message size if the broken pipe is occurred #49492 (#49509) 
Cherry-picked from #49492

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-28 09:57:53 +08:00
github-actions[bot]
b16821f018 branch-2.1: [fix](auth)Prohibit other users from modifying the root #48752 (#49585) 
Cherry-picked from #48752

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-03-28 09:54:32 +08:00
xy720
1ff0f70460 branch-2.1: [case](restore) Rename repo name of backup-restore regression cases with suite name (#49535) 
### What problem does this PR solve?

pick:https://github.com/apache/doris/pull/49237

1、Rename the repo of backup restore regression cases with a suite name
prefix.
2、Change the maximum length of repo names from 63 to 255

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
 2025-03-27 20:13:30 +08:00
yujun
ed56e84b31 branch-2.1: [fix](system) fix alter system modify hostname with valid ip exception #49551 (#49561) 
cherry pick from #49551
 2025-03-27 19:49:27 +08:00
minghong
374b901717 branch-2.1 [fix](nereids)avoid generate Runtime filter whose target is not a base table column #48804 (#49314) 2025-03-27 19:48:37 +08:00
github-actions[bot]
0a6bb54e47 branch-2.1: [opt](metrics) optimize performance of metrics endpoint #49380 (#49455) 
Cherry-picked from #49380

Co-authored-by: 924060929 <lanhuajian@selectdb.com>
 2025-03-26 11:31:06 +08:00
James
1fb771d526 branch-2.1: [fix](statistics)Fix replace table doesn't remove table stat meta memory leak bug. (#49345) (#49367) 
Cherry-picked from https://github.com/apache/doris/pull/49345
 2025-03-23 09:55:47 +08:00
Mingyu Chen (Rayner)
c3fad29a4f [fix](webui) add connection context to avoid NPE (#49213) (#49353) 
bp #49213
 2025-03-22 08:00:49 +08:00
LiBinfeng
a40a4bbc67 branch-2.1: [fix](Nereids) fold constant for string function process emoji character by mistake #49087 (#49344) 
pick: #49087 
Related PR: #40441

Problem Summary:

wrong calculation of emoji character length in some String function when
do constant folding in FE. For example:

select STRLEFT('😊😉👍', 2);

should return 😊😉, but fe return 😊 only when folding constant

fixed functions:
- left
- strleft
- right
- strright
- locate
- character_length
- split_by_string
- overlay
- replace_empty
 2025-03-22 07:44:55 +08:00
github-actions[bot]
2eed4f3a65 branch-2.1: [opt](paimon)Add suppressed information display #48947 (#48997) 
Cherry-picked from #48947

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
 2025-03-22 07:42:45 +08:00
github-actions[bot]
abc535a9e7 branch-2.1: [fix](hudi) Fix Memory Leak in BitCaskDiskMap Due to Circular Reference #48955 (#49115) 
Cherry-picked from #48955

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2025-03-21 22:44:35 +08:00
qiye
71824569a9 [fix](Index)Make column unique ids in index dynamically computed (#48988) (#49300) 
bp #48988
 2025-03-21 19:51:00 +08:00
James
7b28e33815 [improvement](statistics)Remove read lock when doing db analyze. (#49250) (#49320) 
backport: https://github.com/apache/doris/pull/49250
 2025-03-21 18:04:38 +08:00
LiBinfeng
b130500203 [fix](Nereids) initcap constant folding should upper first character in all words (#49061) (#49342) 2025-03-21 18:03:28 +08:00
zhangdong
54b3000de5 [fix](auth)create view check select_priv of table instead of column (#49268) 2025-03-20 23:08:58 +08:00
seawinde
17ffd301fb [fix](mtmv) Fix collecting mv candidates when dml controlled by enable_dml_materialized_view_rewrite switch #48374 (#49263) 
### What problem does this PR solve?
pr: https://github.com/apache/doris/pull/48374
commitId: 0c9ce720
 2025-03-20 10:01:04 +08:00
seawinde
c67bbe77ef [test](mtmv) Fix regression test not stable and add log for debug (#48483) (#49234) 2025-03-19 17:42:00 +08:00
James
cc41d61eec [fix](nereids)Fix dlog1, trim, extract_url_parameter and parse_url FE constant calculate bug. (#49074) (#49224) 
backport: https://github.com/apache/doris/pull/49074
 2025-03-19 10:05:01 +08:00
github-actions[bot]
a32a7ba5eb branch-2.1: [fix](Nereids) deep copy for LogicalWindow is wrong #48861 (#49014) 
Cherry-picked from #48861

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2025-03-19 09:57:15 +08:00