Commit Graph

6243 Commits

Author SHA1 Message Date
3dde6775a9 [Fix](case) Fix wg regression test (#52895) 2025-07-09 09:56:43 +08:00
820971a384 branch-2.1: [regression-test](Variant) add escaped chars cases #52657 (#52699)
Cherry-picked from #52657

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2025-07-04 11:18:26 +08:00
b0e83ca7d1 branch-2.1: [fix](fe) multi statements different behavior in master and follower (#52144) (#52632)
pick https://github.com/apache/doris/pull/52144
2025-07-03 14:53:19 +08:00
6404277795 [fix](json) Add . after in JSON path to support correct token parsing (#52543) (#52544)
Boost tokenizer requires explicit "." after "$" to correctly extract
JSON path tokens. Without this, expressions like "$[0].key" cannot be
properly split, causing issues in downstream logic. This commit ensures
a "." is automatically added after "$" to maintain consistent token
parsing behavior.
2025-07-03 14:36:53 +08:00
cabd664c7a [fix](case) Fix case test_index_like_select (#52674)
1. Numeric types can use LIKE
2025-07-03 08:29:03 +08:00
cf3fe579ad [fix](regression-test) fix variant_p2 case to show load failure #52652 (#52686) 2025-07-03 08:27:35 +08:00
06bbfd1eea branch-2.1: [fix](nereids) fix tanh cosntant folding #52100 (#52527)
Cherry-picked from #52100

Co-authored-by: admiring_xm <86338598+wumeibanfa@users.noreply.github.com>
2025-07-02 10:21:10 +08:00
dc8102bbf4 branch-2.1: [Bug](distinct) fix distinct function with over return error result #51875 (#52313)
Cherry-picked from #51875

Co-authored-by: zhangstar333 <zhangsida@selectdb.com>
2025-06-30 09:45:50 +08:00
fecc6ac802 branch-2.1: [fix](nereids) exceed expr limit error not fallback to legacy planner (#52431)
### What problem does this PR solve?

Legacy planner check expr limit is not reliable. When planner expr
change, it need explict call expr.analyse to check the limit.

Nereids planner check expr limit at expr's construct function, it's
reliable.

So nereids don't fallback to legacy planner when met exceed expr limit
error, this can avoid legacy planner forget to check the expr limit and
use a lot of memory.


### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-29 08:34:50 +08:00
e923acef1b branch-2.1: [Fix](JsonReader) Fix the issue where the null bitmap of the JSON reader was not initialized when the JSON path is specified as '$.’ #52211 (#52268)
Cherry-picked from #52211

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2025-06-28 14:21:38 +08:00
4999816ae6 branch-2.1: [fix](map) fix createMap function #52231 (#52401)
Cherry-picked from #52231

Co-authored-by: amory <wangqiannan@selectdb.com>
2025-06-28 14:19:48 +08:00
93e5431bb9 branch-2.1: [test](mv) Fix mv regression test is not chosen stable by CBO #50690 (#52353)
Cherry-picked #50690
2025-06-28 14:19:14 +08:00
95f10aa8a1 branch-2.1:[fix](mtmv) fix when compatible fail, will throw NPE (#49875) (#52273)
pick: https://github.com/apache/doris/pull/49875
2025-06-28 10:54:44 +08:00
af070ac853 [branch-2.1](timezone) Fix incorrect DST handling (#51454) (#52418)
pick https://github.com/apache/doris/pull/51454
2025-06-28 10:48:58 +08:00
e029e420ae branch-2.1: [fix](nereids) fix calc repeat property stack overflow #52159 (#52188)
cherry pick from #52159
2025-06-28 10:22:48 +08:00
5d20a04b32 branch-2.1: [fix](auth)Only treat admin@% and root@% as system users. #50904 (#52283)
Cherry-picked from #50904

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-06-28 10:11:13 +08:00
74a409d74e [test](mv)forbid create mv test case (#52350)
pick from #51777 
[test](mv)forbid create mv test case
2025-06-28 10:08:19 +08:00
307c047377 branch-2.1: [fix](Prepared Statment) Fix exec prepared insert stmt in non master error (#48689) (#52265)
backport: https://github.com/apache/doris/pull/48689

Co-authored-by: Lijia Liu <liutang123@yeah.net>
2025-06-28 09:57:53 +08:00
f0ce208e68 [fix](test) Create mv but not check finished (#52167) 2025-06-28 09:48:44 +08:00
b3588b01c0 branch-2.1: [improvement](nereids)Support GROUP BY ... WITH ROLLUP syntax #51948 (#51978)
Cherry-picked from #51948

Co-authored-by: James <lijibing@selectdb.com>
2025-06-25 09:59:02 +08:00
042e18068a [chore](test) fix regression-test/suites/fault_injection_p0/test_variant_bloom_filter.groovy (#52201) 2025-06-24 18:23:49 +08:00
347c1e1e63 [branch-2.1]refactor workload group cpu hard limit (#51278) (#51382)
pick #51278
2025-06-23 14:45:45 +08:00
d194014914 [fix](ip) fix ip type in IndexDef support (#50637)
### What problem does this PR solve?
only in branch-2.1  we do not support old indexDef to support Ip type 
and fix array_contains && arrays_overlap for with type array<ip> which
backport: https://github.com/apache/doris/pull/50637
Issue Number: close #xxx
2025-06-20 19:51:38 +08:00
a42fe9f6e8 branch-2.1: [fix](metadata) replace view will break view's metadata #51058 (#52043)
cherry-pick from #51058
2025-06-20 19:49:03 +08:00
f58b3204ca branch-2.1: [Fix](Iceberg-hadoop-catalog)Fix Kerberos-authenticated HadoopCatalog insert failures due to missing kerberos credentials #51245 (#51337)
Cherry-picked from #51245

---------

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
2025-06-20 14:12:25 +08:00
614c7f8579 [fix](restore) Analyze idx meta in Olap Table after restore commit (#51883)
reproduce: backup and restore Table or restart fe, then insert


before:
```
desc tbl all
*************************** 26. row ***************************
    IndexName: idx
IndexKeysType: AGG_KEYS
        Field: mv_date_format(hours_add(happen_time, 1), '%Y-%m-%d %H:00:00')
         Type: varchar(65533)
 InternalType: varchar(65533)
         Null: Yes
          Key: true
      Default: NULL
        Extra: 
      Visible: true
   DefineExpr:
  WhereClause:

insert into wrong
[ANALYSIS_ERROR]TStatus: errCode = 2, detailMessage = column has no source field, column=mva_SUM__CASE WHEN 1 IS NULL THEN 0 ELSE 1 END
```

now
```
desc tbl all
*************************** 26. row ***************************
    IndexName: idx
IndexKeysType: AGG_KEYS
        Field: mv_date_format(hours_add(happen_time, 1), '%Y-%m-%d %H:00:00')
         Type: varchar(65533)
 InternalType: varchar(65533)
         Null: Yes
          Key: true
      Default: NULL
        Extra: 
      Visible: true
   DefineExpr: date_format(hours_add(`happen_time`, 1), '%Y-%m-%d %H:00:00')
  WhereClause: (`k1` > '2025-06-12 00:00:00')

insert into ok
```
2025-06-20 14:04:47 +08:00
956fb96dcd branch-2.1: [bugfix](query) Fix for incorrect query results of variant type #51651 (#51707)
### What problem does this PR solve?

Cherry-picked from #51651

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-20 14:03:04 +08:00
a75760d18f brach-2.1 cherry-pick [Fix](Variant) fix serialize with json key contains . as name (#51864)
cherry-pick from #51857
2025-06-20 14:00:00 +08:00
8c2713b2e5 [fix](alter) alter partition without storage_policy property will also cancel storage_policy (#51662) (#51910)
### What problem does this PR solve?

pick #51662 to branch-2.1

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-20 12:18:36 +08:00
523879ed0e branch-2.1: [Bug](function) fix wrong result of hll_to_base64 #51831 (#51855)
Cherry-picked from #51831

Co-authored-by: Pxl <xl@selectdb.com>
2025-06-20 12:04:27 +08:00
ab48d63d1e [fix](cold hot separation) Fix the issue of root_path not working in HDFS resource (#48441)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

before:
```sql
CREATE RESOURCE "remote_hdfs" PROPERTIES (
  "type"="hdfs",
  "fs.defaultFS"="192.168.0.1:8020",
  "hadoop.username"="hdfs",
  "root_path"="/user/hdfs" -- not working 👎
 );
```

after:

be.conf
```properties
enable_root_path_of_hdfs_resource=true
```

and then

```sql
CREATE RESOURCE "remote_hdfs" PROPERTIES (
  "type"="hdfs",
  "fs.defaultFS"="192.168.0.1:8020",
  "hadoop.username"="hdfs",
  "root_path"="/user/hdfs" -- working 👍
 );
```

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [x] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->


also pick #48452
2025-06-20 09:15:58 +08:00
3a1e95c6c2 branch-2.1: [improvement](jdbc catalog) Optimize the acquisition of indentity type in SQLServer (#51659)
pick #51285
2025-06-16 16:50:37 +08:00
eaa6556721 branch-2.1: [fix](nereids) fix cast ipv4 to string #51546 (#51738)
cherry pick from #51546
2025-06-16 15:45:39 +08:00
56d87c7f4d [cherry-pick](branch-21) fix array_map cause coredump as NULL (#51618) (#51742) 2025-06-16 14:53:43 +08:00
c9623c32f0 branch-2.1: [Bug](sort) fix wrong result coz push down sort with null last #51472 (#51507)
Cherry-picked from #51472

Co-authored-by: Pxl <xl@selectdb.com>
2025-06-16 14:51:12 +08:00
8734c3fb3b branch-2.1: [improvement](statistics)Agg table set preagg on when doing sample analyzing. (#49918) (#51675)
backport: https://github.com/apache/doris/pull/49918
2025-06-16 09:50:16 +08:00
e8615e1329 branch-2.1: [fix](test)Fix the unstable test. #50691 (#50760)
Cherry-picked from #50691

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2025-06-14 21:48:06 +08:00
1a1649376f branch-2.1:[improvement](statistics)Eliminate null values while sample analyzing ndv. (#50574) (#51648)
backport: https://github.com/apache/doris/pull/50574
2025-06-13 15:38:11 +08:00
18d2f93120 branch-2.1: [fix](function) JSON_EXTRACT_STRING should return NULL instead of the string 'null' when encountering a NULL value #51516 (#51566)
Cherry-picked from #51516

---------

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
2025-06-13 11:07:31 +08:00
ec0af70215 [fix](regression) fix global vars in cases (#51636)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-13 10:39:35 +08:00
a836df5d53 branch-2.1: [fix](decimal)Fix the issue where decimal multiplication produces incorrect results due to mul_overflow error #51533 (#51563)
Cherry-picked from #51533

Co-authored-by: Mryange <2319153948@qq.com>
2025-06-07 20:28:29 +08:00
2eee0ebdaf [regression-test](fix) global var (#51474) 2025-06-04 18:58:19 +08:00
47a714e8c2 branch-2.1:[case](auth)fix case test_dml_select_udf_auth (#51449) 2025-06-04 13:58:02 +08:00
2b9d854241 [regression-test](fix) fix global vars (#51424)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [x] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
2025-06-03 15:33:21 +08:00
8cb499ec7c branch-2.1: [opt](audit) add new variable audit_plugin_max_insert_stmt_length to limit the length of insert stmt #51314 (#51391)
Cherry-picked from #51314

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2025-06-02 09:32:36 +08:00
c22db94c3a [opt](mtmv) optimize mtmv rewrite performance (#49514) (#51309) 2025-06-02 09:21:10 +08:00
25f5d5fb1e [fix](nereids) fix colocate agg + join compute wrong result (#48934) (#51313)
cherry pick from #48934
2025-05-28 15:30:58 +08:00
bbb63ee20d [regression-test](improvement) show line number when global var defined (#51256)
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
pick #50482
2025-05-28 14:27:54 +08:00
dd89a78d30 branch-2.1:[fix](parquet/orc) Disable string dictionary filtering when predicate express is not binary pred and in pred (#50749) (#51266)
cherry-pick: #50749
2025-05-27 18:12:56 +08:00
c22fc7d8e5 branch-2.1: [test](mtmv)fix master-slave consistency after schema change #51191 (#51252)
Cherry-picked from #51191

Co-authored-by: zfr95 <zhangfurong@selectdb.com>
2025-05-27 17:43:13 +08:00