Commit Graph

9797 Commits

Author SHA1 Message Date
2f7e0f0b76 Revert "[branch-2.1]downgrade resource tag when there is not queryabl… (#47746)
revert #45387
2025-02-11 16:51:07 +08:00
6ceb010195 branch-2.1: [fix](mv)Fix direct select mv pre agg bug. #47658 (#47700)
Cherry-picked from #47658

Co-authored-by: James <lijibing@selectdb.com>
2025-02-10 21:45:00 +08:00
f4e92d75f5 [branch-2.1] fix select * from variables system table (#34529) (#47660)
pick #34529

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
Co-authored-by: xueweizhang <zxw520blue1@163.com>
2025-02-09 14:14:06 +08:00
8ff4ae879e branch-2.1: [fix](nereids) fix compare ipv4 / ipv6 always equals (#47514)
### What problem does this PR solve?

fix compare ipv4 and ipv6 always equals.

for example, `select cast('127.0.0.1' as ipv4) = cast('192.168.10.10' as
ipv4)'` will return 1, but it should return 0;

Issue Number: close #xxx
2025-02-09 04:43:07 +08:00
800288b7fe [branch-2.1](FoldFE) pick special date arithmetics of #37376 and #37766 (#47616)
pick https://github.com/apache/doris/pull/37376 and
https://github.com/apache/doris/pull/37766
2025-02-08 11:29:52 +08:00
2334b2a513 [fix](hive) Incorrect location conversion for target path for 2.1 (#47162) (#47343)
bp: #47162
2025-01-26 23:56:04 +08:00
803d3a1545 Revert "[fix](date_function) fix str_to_date function return wrong microsecond issue" (#47441) 2025-01-26 12:53:11 +08:00
0e13ee3db6 branch-2.1: [fix](restore) Release snapshots after the FINISHED state is persisted #47277 (#47286)
Cherry-picked from #47277

Co-authored-by: walter <maochuan@selectdb.com>
2025-01-25 11:53:48 +08:00
92db307697 branch-2.1: [fix](edit_log) throw exception when replay alter constraint on catalog table #47151 (#47233)
Cherry-picked from #47151

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2025-01-25 08:32:01 +08:00
ad6737796f branch-2.1: [fix](binlog) Fix table not gc binlog meta/records #46981 (#47257)
Cherry-picked from #46981

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2025-01-24 17:32:58 +08:00
8925a390d6 [fix](date_function) fix str_to_date function return wrong microsecond issue (#47252) 2025-01-24 17:32:23 +08:00
ffb9c863d9 branch-2.1: [fix](mtmv)Release snapshots to avoid keeping references in MTMVTask #47149 (#47259)
Cherry-picked from #47149

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2025-01-24 17:31:25 +08:00
2c476753d8 branch-2.1: [fix](cache) fix sql cache throw npe in cloud mode #47221 (#47267)
Cherry-picked from #47221

Co-authored-by: 924060929 <lanhuajian@selectdb.com>
2025-01-24 17:30:37 +08:00
13964bb1ee branch-2.1: [fix](sql) Wrong result of tosql for drop column with rollup #47153 (#47206)
pick: https://github.com/apache/doris/pull/47153
2025-01-24 17:28:27 +08:00
4c0f3d7631 branch-2.1: [fix](ccr) Wrong tosql for alt tbl enable feature #46620 (#47212)
pick: https://github.com/apache/doris/pull/46620
2025-01-24 17:18:34 +08:00
fe182c7148 branch-2.1: [fix](bug) Fix dead lock in Tablet Stat Mgr (#47242) 2025-01-21 20:45:37 +08:00
32ad2d930c [fix](coldheat) fix missing partition's storage policy in create_table_like stmt (#47133)
bp: #47009
2025-01-20 09:28:06 +08:00
700d9aed44 branch-2.1: [fix](test) add debug info (#47170)
And some debug info to trace the issue when creating catalog with use_meta_cache=false
and sometimes the database list can not be fetched.
2025-01-19 10:53:13 +08:00
257e07ae16 branch-2.1: [fix](Nereids) insert lock all target tables #47033 (#47172)
pick from master #47033
2025-01-17 20:36:26 +08:00
490e04a88a branch-2.1: [fix](Nereids) bind schema table qualified column failed #46960 (#47156)
Cherry-picked from #46960

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2025-01-17 17:30:10 +08:00
70079feaa8 branch-2.1: [Bug](mtmv) update mapping relation when mtmv occur alter #46983 (#47063)
Cherry-picked from #46983

Co-authored-by: shee <13843187+qzsee@users.noreply.github.com>
Co-authored-by: garenshi <garenshi@tencent.com>
2025-01-16 17:07:15 +08:00
c6ffa1f4eb [Fix](PreparedStatement) fix incorrect query result with prepared statment (#47012)
cherry-pick from #46994
2025-01-15 14:42:04 +08:00
14c822716a branch-2.1: [fix](export) fix error in show export outfile info column #46850 (#46954)
Cherry-picked from #46850

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2025-01-15 13:50:57 +08:00
c60627250d branch-2.1: [Fix](schema change) Fix NPE when rename column on table which has sequence type column #46906 (#46942)
pick https://github.com/apache/doris/pull/46906
2025-01-14 19:25:22 +08:00
Pxl
989f189486 [test](join) Fuzzy disable runtime filters in BE #45654 (#46931)
pick from  #45654

---------

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
2025-01-14 12:46:56 +08:00
f4515727d3 branch-2.1: [fix](session var) add need forward for disable_inverted_index_v1_for_variant #46845 (#46869)
Cherry-picked from #46845

Co-authored-by: airborne12 <jiangkai@selectdb.com>
2025-01-14 12:46:39 +08:00
f4b5327ec7 branch-2.1: [fix](session var) add need forward for batch_size #46871 (#46894)
Cherry-picked from #46871

Co-authored-by: qiye <luen@selectdb.com>
2025-01-13 21:41:42 +08:00
cd37e98a93 [opt](nereids) cache hash code for expression (#46763) (#46883)
cherry pick from #46763
2025-01-13 17:48:57 +08:00
09411c050b branch-2.1: [Fix](partial update) Forbid partial update when table is in SCHEMA_CHANGE/ROLLUP in FE (#46866)
### What problem does this PR solve?

Related PR: https://github.com/apache/doris/pull/22133

Problem Summary:

https://github.com/apache/doris/pull/22133 forbid doing partial update
during schema change on BE, but this may failed to work when some of
replicas finished alter process on BE and some of them don't. This PR
forbids partial update during schema change on FE to avoid this
situation.

### Release note
2025-01-13 16:00:00 +08:00
7260638c2b branch-2.1: [Fix](session variable) Forward use_fix_replica to master #46836 (#46857)
Cherry-picked from #46836

Co-authored-by: zclllyybb <zhaochangle@selectdb.com>
2025-01-13 14:04:44 +08:00
7f9ea1a231 [fix](parser) Syntax error in column with agg_state (#46829)
### What problem does this PR solve?

the problem only exists in the old optimizer

```
mysql> CREATE TABLE t (
    ->   `k1` int NULL,
    ->   `k2` agg_state<sum(int null)> GENERIC NOT NULL,
    ->   `k3` agg_state<group_concat(text null)> GENERIC NOT NULL
    -> ) ENGINE=OLAP
    -> AGGREGATE KEY(`k1`)
    -> DISTRIBUTED BY HASH(`k1`) BUCKETS 3
    -> PROPERTIES (
    -> "replication_allocation" = "tag.location.default: 1"
    -> );
ERROR 1105 (HY000): errCode = 2, detailMessage = Syntax error in line 3:
  `k2` agg_state<sum(int null)> GENERIC NOT NULL,
                 ^
Encountered: SUM
Expected: SUM is keyword, maybe `SUM`
```
2025-01-13 11:36:49 +08:00
94856b19a2 [fix](hive)fix select count(*) hive full acid tb opt error. (#46732) (#46804)
bp #46732
2025-01-12 08:55:10 +08:00
ed3727b352 branch-2.1:[Fix](insert-job)Fix Issue with Missing StatementContext in StmtExecutor, Leading to Incorrect SQL_BLOCK Handling (#46715) (#46757)
#46715
2025-01-10 20:15:50 +08:00
53f5845c5a branch-2.1: [fix](iceberg)Different catalogs should use different client pools #46694 (#46756)
Cherry-picked from #46694

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2025-01-10 18:58:00 +08:00
eb312d7160 branch-2.1: [chore](persist) Save old index schema map in TableAddOrDropColumnsInfo #46606 (#46741)
Cherry-picked from #46606

Co-authored-by: walter <maochuan@selectdb.com>
2025-01-10 17:06:59 +08:00
6c47898a6e [fix](hive) Incorrect location conversion for 2.1 (#46362) (#46754)
bp: #46362
2025-01-10 16:14:37 +08:00
1a3eb051f5 branch-2.1: [improve](routine load) improve routine load observability #46238 (#46568)
Cherry-picked from #46238

Co-authored-by: hui lai <laihui@selectdb.com>
2025-01-10 13:46:28 +08:00
c016eb49c5 [enhance](mtmv)When obtaining the partition list fails, treat the pai… (#46708)
…mon table as an unpartitioned table  (#46641)

pick: https://github.com/apache/doris/pull/46641
2025-01-10 10:46:09 +08:00
26bdd23e05 branch-2.1: [fix](nereids) analyzing job should not be blocked by enable_stats=false #46630 (#46691)
Cherry-picked from #46630

Co-authored-by: minghong <zhouminghong@selectdb.com>
2025-01-09 22:21:02 +08:00
04b840713b branch-2.1: [fix](jdbc catalog) Use factory methods to return mapped types instead (#46698)
cherry-pick #46623
2025-01-09 18:12:03 +08:00
912e4ca010 branch-2.1: [fix](Nereids) fix fe folding constant of string functions and add more cases #45233 (#46523)
pick: #45233
Issue Number: #44666
Related PR: #40441

Problem Summary:
- select substring_index('哈哈哈AAA','A', 1); String.split function has
second parameter 'limit', which is default zero. When 'limit' is zero,
it means it would remove trailing empty strings split of '哈哈哈AAA', which
would be '哈哈哈' only. But what we expect is '哈哈哈', '','','' when part
function is used by substring index. So we should change splitpart limit
to -1 to enable trailing empty character in splitpart list
- reorganize fold constant of string functions in fe and add more cases

---------

Co-authored-by: Mryange <59914473+Mryange@users.noreply.github.com>
2025-01-09 17:05:13 +08:00
4f41bad283 branch-2.1: [fix](Nereids) fix cast string to date #46065 (#46526)
pick: #46065

Related PR: #35637

Problem Summary:
When cast("201-01-01" as datetimev2(0)), The result is "2020-01-01" but
it is wrong. It should be result in "0201-01-01".
201 would be regarded as 20xy-0z as related pr show, it was a bug. But
actually it should not have this trasformation and result in
2025-01-09 17:03:36 +08:00
afeff5daee branch-2.1: [fix](nereids) fix bug in PhysicalTopN.equals() #46547 (#46633)
Cherry-picked from #46547

Co-authored-by: minghong <zhouminghong@selectdb.com>
2025-01-09 10:28:40 +08:00
ca5a4f6d35 [Fix](Variant) variant should not implicit be short key column when create mv (#46539)
cherry-pick from #46444
2025-01-09 08:15:22 +08:00
ebb425dd84 branch-2.1: [fix](planner) fix core when select and filter by slot in old planner #46541 (#46638)
Cherry-picked from #46541

Co-authored-by: Lijia Liu <liutang123@yeah.net>
Co-authored-by: liutang123 <liulijia@gmail.com>
2025-01-08 22:32:35 +08:00
b99ef07a3b branch-2.1: [fix](Nereids) fix log and power #46077 (#46635)
Cherry-picked from #46077

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
2025-01-08 22:31:22 +08:00
f2419c49a7 branch-2.1: [opt](jni) Modify Exception Cause Formatting in JniUtil for Better Readability #46437 (#46602)
Cherry-picked from #46437

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
2025-01-08 22:30:19 +08:00
6a68b09100 branch-2.1: [fix](cache) fix mtmv cache can not use test #46537 (#46607)
Cherry-picked from #46537

Co-authored-by: 924060929 <lanhuajian@selectdb.com>
2025-01-08 21:09:53 +08:00
2687dedabf [fix](nereids) fix sql cache bug and some tests (#46443) (#46505)
cherry pick from #46443
2025-01-08 14:45:06 +08:00
f6ea71ab61 branch-2.1: [chore](MTMV) catch all exception when get mtmvs to avoid plan failed #46474 (#46536)
Cherry-picked from #46474

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2025-01-08 13:56:18 +08:00