8fedb03fdc
branch-2.1: [fix](auth)Fix after fe restarting, external permissions are lost ( #43307 )
...
Cherry-picked from #43275
Co-authored-by: zhangdong <493738387@qq.com >
2024-11-06 14:54:59 +08:00
876fae6f71
[fix](regression) test_primary_key_partial_update fail due to the U.S. change from DST to standard time ( #43288 ) ( #43300 )
...
cherry-pick #43288
2024-11-06 14:10:29 +08:00
46afbfca01
branch-2.1: [fix](ip) fix datatype serde for ipv6 with rowstore ( #43252 )
...
Cherry-picked from #43065
Co-authored-by: amory <wangqiannan@selectdb.com >
2024-11-05 20:09:14 +08:00
a365965c55
[fix](regression-test) Revome "UNIQUE KEY (k1)" case for test_dynamic_partition_mod_distribution_key ( #41002 ) ( #43179 )
...
pick: #4100
1. Remove "UNIQUE KEY (k1)" case, because for unique table hash column
must be key column, but for that historical bugs, this case will fail if
adding k2 unique key.
2. Seperate a p0 suite from docker suite because docker suite will not
be triggered in community doris p0 CI.
2024-11-05 00:39:21 +08:00
09f2516c7c
[fix](test) fix some test cases #43217 ( #43216 )
...
bp #43217
2024-11-04 22:15:30 +08:00
2863bf8aaa
[fix](regression) fix flaky partial update cases ( #42072 ) ( #43198 )
...
cherry-pick #42072 and #42908
2024-11-04 21:38:05 +08:00
ac7d9f61f8
[fix](case) adjust error msg checking to real msg ( #42000 ) ( #43138 )
2024-11-03 00:41:47 +08:00
c5374be1bc
[cherry-pick](branch-2.1) Pick "[Feature](schema change) Support add column bitmap with default value bitmap_empty ( #42331 )" ( #42702 )
...
Pick #42331
2024-11-01 21:46:38 +08:00
3dcaa949e9
[fix](case)Fix multiple case tables with the same name causing case failure ( #42203 ) ( #43042 )
...
pick: from master #42203
2024-11-01 19:22:55 +08:00
355170a921
[cherry-pick](branch2.1) impl scalar functions trim_in、ltrim_in and rtrim_in ( #42641 )
...
pick https://github.com/apache/doris/pull/41681
2024-11-01 09:55:50 +08:00
e85e6c89ba
[fix](auditlog) add missing audit log fields and duplicate audit log error #42262 ( #43015 )
...
bp #42262
2024-11-01 08:24:55 +08:00
c573351e4e
[fix](tvf) fix FE cannot start when replay alter view from tvf ( #42866 )
...
bp: #40872
2024-10-31 14:15:48 +08:00
6c3d42e09a
[cherry-pick](branch-21) cherry-pick pr about ( #42488 ) ( #42099 ) ( #42055 ) ( #42916 )
...
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-31 14:14:19 +08:00
0b640b938c
[Test](bloom filter) add retry query for bloom filter test case #42937 ( #42975 )
...
cherry pick from #42937
2024-10-31 14:02:50 +08:00
cc30a7e78e
[fix](test) fix some unstable external p0 test cases ( #42685 ) ( #42943 )
...
cherry-pick #42685
Co-authored-by: daidai <2017501503@qq.com >
2024-10-31 12:36:03 +08:00
597bcb112b
[fix](Nerieds) fix FoldConstantRuleOnFE too slow when CaseWhen clause nesting multiple layers ( #42897 ) ( #42907 )
...
cherry pick from master #42897
2024-10-31 11:15:34 +08:00
cdd32d9582
[enhance](hive) support reading hive table with OpenCSVSerde #42257 ( #42940 )
...
cherry pick from #42257
Co-authored-by: Socrates <suxiaogang223@icloud.com >
2024-10-31 11:12:07 +08:00
fce4695f37
[Configuration](transactional-hive) Add skip_checking_acid_version_file session var to skip checking acid version file in some hive envs. ( #42111 )( #42225 ) ( #42939 )
...
cherry-pick (#42111 )(#42225 )
---------
Co-authored-by: Qi Chen <kaka11.chen@gmail.com >
2024-10-31 09:52:20 +08:00
0d008b5a43
[feat](nereids)disable join reorder if column stats is invalid #41790 (branch-2.1) ( #42902 )
...
## Proposed changes
pick #41790
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-30 23:47:03 +08:00
6d23020cb8
[fix](regression) do not test "set global sessionVar" on multi-fe cluster ( #42922 )
...
## Proposed changes
fix unstable rt case: test_statistic_global_variable
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-30 21:35:32 +08:00
e43d255815
[fix](array) fix add_array_null_value for inverted index_builder ( #42899 )
...
## Proposed changes
Pick #42638 to doris branch 2.1
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-30 19:16:59 +08:00
53cccfb08c
[test](move memtable) fix move memtable injection case fail ( #42639 ) ( #42891 )
...
Fix move memtable injection case fail.
pick (#42639 )
2024-10-30 16:29:40 +08:00
5c6e5fa486
[cherry-pick](branch-2.1)fix the mutil threads tests ( #42669 )
...
pick from master:
https://github.com/apache/doris/pull/39617
2024-10-30 10:30:08 +08:00
057d733328
[fix](cases) fix alias conflict case problem of driver url error ( #42676 ) ( #42859 )
...
pick: #42676
change driver url to doris internal one to get driver process more
robust
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-30 09:57:26 +08:00
2042726ceb
[Fix](regression case) fix some unstable regression cases ( #42601 )
...
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-29 18:12:40 +08:00
1538b82221
[Impl](Nereids) add nereids gc cost time and be fold const cost time to profile ( #42007 ) ( #42516 )
...
pick:#42007
add Nereids GarbageCollect Time and Nereids BeFoldConst Time to profile
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-29 15:16:40 +08:00
d0e7371077
[Test](bloom filter) add retry and retry timeout for bloom filter test case #42609 ( #42672 )
...
cherry pick from #42609
2024-10-29 13:33:02 +08:00
78a8d12f9d
[Test](build index) enhance build index case for finished state #42630 ( #42651 )
...
cherry pick from #42630
2024-10-29 06:53:10 +08:00
f80c3d827a
[Fix](Branch-2.1) fix not null variant will lost null bitmap ( #42559 )
...
part of #39022
2024-10-28 20:59:47 +08:00
0baca54200
[fix](Nereids) offset do more than once when have shuffle after limit ( #42576 ) ( #42577 )
...
pick from master #42576
intro by #39316 . it want to fix a problem intro by #36699 . but forgot to
remove all wrong code in #36699 .
after #39316 , we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
2024-10-28 19:48:13 +08:00
dfb5a6fdc7
[regression-test](prepared_stmt_p0) use master ip for prepared url ( #42521 ) ( #42567 )
...
(#42521 )
2024-10-28 17:47:55 +08:00
85674814eb
[fix](query-forward) Fix forward query exception or stuck or potential query result loss ( #41303 ) ( #42369 )
...
## Proposed changes
1. Fix forward query exception if no status code is set in master
execution. EOF may result in this status.
2. Fix forward query stuck due to no result packet sent to mysql
channel. Should use result packets from master.
3. Fix potential forward query result loss if follower can read status
change during query process. Should judge by the status once before
execution.
4. Add assertion for regression test.
2024-10-28 17:39:57 +08:00
59b6d7d472
[fix](cases)fix ip case2.1 with sync after streamload ( #42543 )
...
## Proposed changes
fix ip case2.1 with sync after streamload
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-28 14:54:36 +08:00
2c79d65433
[fix](case) fix jsonb case ( #42536 )
...
## Proposed changes
fix case for jsonb
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-28 14:02:56 +08:00
4b5155453d
[fix](regression) fix unstable regression case: test_cte_filter_pushdown ( #42510 )
...
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-27 20:59:31 +08:00
2bb29d7f36
[fix](test) fix move memtable injection test may cause other case stuck #40356 ( #42508 )
...
cherry pick from #40356
---------
Co-authored-by: hui lai <1353307710@qq.com >
2024-10-26 23:11:45 +08:00
1c9a798b68
[fix](case) fix insert_group_commit_into ( #42397 )
2024-10-25 22:15:38 +08:00
4a62d9e44b
Revert "[2.1][improvement](jdbc catalog) Add catalog property to enable jdbc connection pool" ( #42481 )
...
Reverts apache/doris#42255
We have found that after closing the connection pool, there will be
class loading problems and connection release problems for some data
sources. We will remove this function first and re-add it after solving
and testing it completely.
2024-10-25 19:37:36 +08:00
b88d4db6e7
[fix](auth)Fix use encryptkey should check auth ( #41791 ) ( #42105 )
...
pick from master #41791
2024-10-25 14:32:42 +08:00
0700449e8b
[fix](schema change) fix delete predicate incorrect comparisons result with empty strings during schema change ( #41064 ) ( #42427 )
...
```
insert into t1 (k1, k2, v1) value(1, '', 2);
delete form t1 where k1 = 1 and k2 = '';
alter table modify column v1 string
select * from t1 // expect 0 rows in return, but get 1 row.
```
2024-10-25 01:05:55 +08:00
2984a1b6c8
[improve](stream load) set NumberLoadedRows to zero when stream load transaction failed ( #41946 ) ( #42265 )
...
pick (#41946 )
Set NumberLoadedRows to zero when stream load failed.
before:
```
stream load result: {
"TxnId": 8589,
"Label": "c8e7c4fe-56b2-4e3b-b4cc-4f2a94cdd003",
"Comment": "",
"TwoPhaseCommit": "false",
"Status": "Fail",
"Message": "[DATA_QUALITY_ERROR]too many filtered rows",
"NumberTotalRows": 3,
"NumberLoadedRows": 1,
"NumberFilteredRows": 2,
"NumberUnselectedRows": 0,
"LoadBytes": 77,
"LoadTimeMs": 78,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 4,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 72,
"ReceiveDataTimeMs": 7,
"CommitAndPublishTimeMs": 0,
"ErrorURL": "XXX"
}
```
now:
```
stream load result: {
"TxnId": 8589,
"Label": "c8e7c4fe-56b2-4e3b-b4cc-4f2a94cdd003",
"Comment": "",
"TwoPhaseCommit": "false",
"Status": "Fail",
"Message": "[DATA_QUALITY_ERROR]too many filtered rows",
"NumberTotalRows": 3,
"NumberLoadedRows": 0,
"NumberFilteredRows": 2,
"NumberUnselectedRows": 0,
"LoadBytes": 77,
"LoadTimeMs": 78,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 4,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 72,
"ReceiveDataTimeMs": 7,
"CommitAndPublishTimeMs": 0,
"ErrorURL": "XXX"
}
```
2024-10-25 01:01:46 +08:00
db9c74c38f
[improvement](statistics)Drop expired external stats only when the catalog is dropped. ( #42244 ) ( #42410 )
...
backport: https://github.com/apache/doris/pull/42244
2024-10-24 23:47:53 +08:00
d209c16d81
[fix](schema-change) fix the bug of alter column nullable when double writing ( #41737 ) ( #42352 )
...
pick master #41737
## problem
CREATE TABLE t (
`k1` VARCHAR(30) NOT NULL,
`v1` INT NOT NULL
)
alter table t modify column `v1` INT NULL
insert into value ('1', 2), ('1', 3);
core dump
## reason
Schema change leads to double writing, during double writing, the two
schemas and slots are as follows
```
old tablet schema
k1 varchar not null
v1 int not null
```
```
new tablet scheam
k1 varchar not null
v1 int null
```
```
slot
k1 varchar not null
v1 int not null
v1 int null
```
During the double writing process, when selecting slots through the
schema, only the column names and types were compared, without comparing
the nullable attributes, which led to the selection of the wrong slot.
Since the slot determines the nullable attribute of the block, the
nullable attribute of the columns in the block is different from that of
the columns in the schema, resulting in a core dump.
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-24 16:49:46 +08:00
c0b2970c20
[Test](build index) enhance build index with clone test case with retry logic #42348 ( #42363 )
...
cherry pick from #42348
2024-10-24 14:06:40 +08:00
aa0fe8ccf4
[fix] (inverted index) fix the error result in the query when using count on index ( #42346 ) ( #42347 )
...
## Proposed changes
pick from master #42346
2024-10-24 12:11:59 +08:00
cbdaaa62b2
[feature](function) hour/minute/second functions support time as an a… 41008 ( #42232 )
...
…rgument. (#41008 )
## Proposed changes
```
mysql> select cast(4562632 as time),hour(cast(4562632 as time)), minute(cast(4562632 as time)),second(cast(4562632 as time));
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
| cast(4562632 as TIME) | hour(cast(4562632 as TIME)) | minute(cast(4562632 as TIME)) | second(cast(4562632 as TIME)) |
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
| 456:26:32 | 456 | 26 | 32 |
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
```
<!--Describe your changes.-->
---------
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
Co-authored-by: Dongyang Li <hello_stephen@qq.com >
2024-10-24 11:09:36 +08:00
a3510d3b73
[cherry-pick](branch-21)fix the exchange not skip offset rows ( #42190 ) ( #42330 )
...
cherry-pick from master (#42190 )
2024-10-24 11:08:17 +08:00
73fc5c734e
[fix](mtmv)fix in the scenario of recreating a table, the materialize… ( #42339 )
...
…d view may assume that the data has not changed (#41762 )
pick: https://github.com/apache/doris/pull/41762
2024-10-24 11:07:29 +08:00
64d0c55e1d
[fix](decimal256) support decimal256 for many functions ( #42136 ) ( #42353 )
...
BP #42136
2024-10-24 10:52:28 +08:00
e3b059e339
[fix](nereids) Fix not check column name when create or alter view ( #42206 ) ( #42323 )
...
pr: https://github.com/apache/doris/pull/42206
commitId: 2bcaa5b4
2024-10-24 10:11:32 +08:00
