Commit Graph

20619 Commits

Author SHA1 Message Date
95c0a7a8e3 [chore](planner) change decimal literal toSql as plainString (#41809) (#41976)
pick from master #41809

for example, 0 with decimal(38,4) will return 0.0000
2024-10-17 12:16:10 +08:00
5521a25392 [enhance](insertoverwrite)insert overwrite not fallback (#41799)
- Insert overwrite on NEREIDS can automatically clean up garbage
temporary partitions after restart, which is not available on old
optimizers
- When insert fails, no longer throw nereids exceptions
2024-10-17 12:14:17 +08:00
7daf423e98 [opt](profile) Move ExecutedByFrontend to execution summary profile #41761 (#41831)
cherry pick from #41761
2024-10-17 11:37:48 +08:00
19784d420c [opt](inverted index) Improved top-N optimization by refining the sorting column check. (#39496) (#41954)
https://github.com/apache/doris/pull/39496
2024-10-17 11:31:11 +08:00
cf2ec26bc2 [fix](catalog) should return error if try using a unknown database (#40479) (#41971)
bp #40479
2024-10-17 11:13:56 +08:00
169a12058b [chore](Variant) forbid variant type as hash join key (#41673) (#41974)
pick from master #41673
2024-10-17 11:06:37 +08:00
f98aa1d08b [Fix](Branch-2.1) fix fallback to legacy planner when set group commit in session variable (#41984) 2024-10-17 10:40:33 +08:00
0b6447faeb [Fix](SchemaChange) refactor variant root column iterator to make row… (#41941)
pick #41700
2024-10-17 10:39:07 +08:00
d04082f685 [improvement](statistics)Use min row count of all replicas as tablet/table row count. (#41894) (#41978)
backport: https://github.com/apache/doris/pull/41894
2024-10-16 21:45:37 +08:00
7d99d5fcc4 [fix](analytic) Fix data distribution after analytic operator (#41902) (#41949)
Fix data distribution after analytic operator

pick #41902
2024-10-16 18:41:56 +08:00
5bd33fc88c [pick](branch-2.1) pick #41292 #41350 #41589 #41628 #41743 #41601 #41667 #41751 (#41927)
## Proposed changes

pick #41292 #41350 #41589 #41628 #41743 #41601 #41667 #41751

<!--Describe your changes.-->

---------

Co-authored-by: Pxl <pxl290@qq.com>
2024-10-16 15:41:28 +08:00
e56216211e [pick](branch-2.1) pick #40667 #40714 (#41905)
pick
#40667
#40714

---------

Co-authored-by: wangbo <wangbo@apache.org>
2024-10-16 14:09:03 +08:00
95d429b7de [pick](branch-2.1) pick #41891 (#41929)
pick #41891
2024-10-16 13:59:46 +08:00
e6545a36a3 [improvement](iceberg)Parallelize splits for count(*) for 2.1 (#41169) (#41880)
bp: #41169
2024-10-16 10:52:06 +08:00
e62e47700d [fix](Nereids) fixed the limit offset error pick 39316 (#41878) 2024-10-16 10:38:05 +08:00
b185dfcbf6 [pick](branch-2.1) pick #41676 #41740 #41857 (#41904)
pick #41676 #41740 #41857
2024-10-15 22:41:17 +08:00
a4b7d93ded [bugfix](iceberg)add prefix for endpoint with s3 client for 2.1 (#41336) (#41877)
bp: #41336
2024-10-15 19:59:10 +08:00
b91d8e2327 [Improvement](minor) Reduce locking scope (#41845) (#41844)
pick #41845
2024-10-15 18:39:53 +08:00
78b6157aa9 [fix](ip/variant) fix information meta (#41871)
fix datatype information meta  for ip/variant (#41666)

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-15 18:01:14 +08:00
5fbefa084c [opt](hive) make supported hive table error msg clearer (#41616) (#41851)
bp #41616
2024-10-15 17:36:27 +08:00
f3389973e0 [fix](heartbeat) fill default value for required field in TFrontendPingFrontendResult (#41609) (#41854)
bp #41609
2024-10-15 17:33:46 +08:00
24ceb60ac7 [fix](glue) support glue on aws (#41084) (#41855)
bp #41084
2024-10-15 17:33:25 +08:00
abcba778ff [fix](cancel) Fix cancel msg on branch-2.1 (#41798)
Make sure we can tell cancel reason from:
1. user cancel
2. timeout
3. others

```text
mysql [demo]>set query_timeout=1;
--------------
set query_timeout=1
--------------

Query OK, 0 rows affected (0.00 sec)

mysql [demo]>select sleep(5);
--------------
select sleep(5)
--------------

ERROR 1105 (HY000): errCode = 2, detailMessage = Timeout

mysql [demo]>select sleep(5);
--------------
select sleep(5)
--------------

^C^C -- sending "KILL QUERY 0" to server ...
^C -- query aborted
ERROR 1105 (HY000): errCode = 2, detailMessage = cancel query by user from 127.0.0.1:64208
```
2024-10-15 17:15:05 +08:00
77fbe6397a [fix](http) Remove file if downloading faile is failed #41778 (#41827)
cherry pick from #41778
2024-10-15 15:30:29 +08:00
736bb161b1 [ci](ga) skip scope-label (#41612) (#41848)
bp #41612
2024-10-15 14:02:21 +08:00
7aec6fc42b [fix](auto bucket) fix auto buckets calc using the first k partition #41675 (#41820)
cherry pick from #41675
2024-10-15 10:26:46 +08:00
94687a2f3c [fix](array/map) fix resize impl in array/map (#41595) (#41699)
backport: https://github.com/apache/doris/pull/41595
2024-10-15 09:50:11 +08:00
d97642e9b5 [cherry-pick](branch-21) fix tablet sink shuffle without project not match the output tuple (#40299)(#41293) (#41327)
## Proposed changes

cherry-pick from master  (#40299)(#41293)

<!--Describe your changes.-->
2024-10-15 00:12:23 +08:00
afdc6800d8 [fix](Nerieds) column prune should retain at least one column for union all (#41613) (#41771)
cherry-pick #41613 to branch-2.1
2024-10-15 00:09:02 +08:00
4888c632f4 [cherry-pick](branch2.1) support escape.delim and serialization.null.format for hive text (#41684)
## Proposed changes
pick from master:
https://github.com/apache/doris/pull/40291
2024-10-15 00:08:23 +08:00
19be696120 [Refactor](statistics)Refactor of statistics buildConnectContext. (#41553) (#41814)
backport: https://github.com/apache/doris/pull/41553
2024-10-14 22:09:57 +08:00
b84e128974 [fix](statistics)Fix clear stale mv row count bug. (#41653) (#41807)
backport: https://github.com/apache/doris/pull/41653
2024-10-14 21:14:05 +08:00
345cc9172f [improvement](statistics)Drop table stats in unprotectDropTable so that dropDB could call it as well. (#39685) (#41801)
backport: https://github.com/apache/doris/pull/39685
2024-10-14 19:30:49 +08:00
ff52e73a07 [Fix](inverted index) fix match null for inverted index #41746 (#41787)
cherry pick from #41746
2024-10-14 14:45:36 +08:00
f112af0fd2 [pick](branch-2.1) pick #41555 #41592 #38204 (#41781)
pick #41555 #41592 #38204
2024-10-14 14:05:08 +08:00
ec0c008317 [feature](paimon)support paimon with dlf for 2.1 (#41247) (#41694)
bp: #41247
2024-10-13 20:04:01 +08:00
629f500646 [cherry-pick](branch-2.1) Pick "[Fix](delete) Fix some delete p2 case (#37689) (#41678)" (#41757)
Pick #37689 #41678
2024-10-12 22:43:21 +08:00
87005aa5b2 [fix](delete) Fix potential delete job stuck util timeout if exception happend in FE DeleteJob execution (#41672) (#41765)
pick: #41672

Fail task should also count down for the count down latch to prevent job
stuck.
2024-10-12 22:29:10 +08:00
68ae6d025e [branch-2.1][improvement](jdbc catalog) Print more errors when Jdbc Catalog fails to obtain a connection on FE (#41769) 2024-10-12 21:21:54 +08:00
e10458baad [enhancement](err-msg) Output column info when size invalid in block data convertor (#41535) (#41764)
## Proposed changes

pick: #41535

As title.
2024-10-12 21:08:04 +08:00
60ac3e71ba [case](mtmv) fix test_base_mtmv failed (#39794) (#41745)
pick: https://github.com/apache/doris/pull/39794
2024-10-12 21:07:19 +08:00
cfe7a8302b [enhance](mtmv) mtmv query sql expand star (#36543) (#41744)
pick: https://github.com/apache/doris/pull/36543
2024-10-12 17:23:13 +08:00
cb5a5a5c9b [enhance](catalog)Allow parallel running of insert overwrite on the e… (#41742)
…xternal table (#41575)

pick: https://github.com/apache/doris/pull/41575
2024-10-12 17:19:23 +08:00
203f00ef1d [fix](bloom filter)Fix drop column with bloom filter (#41369) (#41711)
bp #41369
2024-10-12 17:14:31 +08:00
2ae37626bb [opt](index compaction)Use RAM dir to create tmp index_writer (#41371) (#41705)
## Proposed changes

bp #41371
2024-10-12 17:13:55 +08:00
171258cc31 [deps](hadoop) update hadoop to 3.3.6.3 #39376 (#41748)
bp #39376
2024-10-12 16:34:59 +08:00
ae56739f88 [enhancement](sequence col) add session variable to skip sequence column check while INSERT INTO (#41655) (#41720)
cp #41655
2024-10-12 15:30:20 +08:00
90d6985f91 [Fix](bug) Is null predicate get error query result (#41704)
cherry-pick #41668
2024-10-12 13:18:14 +08:00
b2bac26c17 [fix](jdbc catalog) Disable oracle scan null operator pushdown (#41563) (#41712)
Because Oracle versions below Oracle21 do not support null as an
operator, and considering that most users' Oracle versions are below
Oracle21, we disable Oracle's null operator pushdown by default.
pick (#41563)
2024-10-11 21:01:05 +08:00
379e00f421 [improve](group commit) set internal group commit timeout (#41404) (#41688)
pick https://github.com/apache/doris/pull/41404
2024-10-11 17:55:43 +08:00