b185dfcbf6
[pick](branch-2.1) pick #41676 #41740 #41857 ( #41904 )
...
pick #41676 #41740 #41857
2024-10-15 22:41:17 +08:00
a4b7d93ded
[bugfix](iceberg)add prefix for endpoint with s3 client for 2.1 ( #41336 ) ( #41877 )
...
bp: #41336
2024-10-15 19:59:10 +08:00
b91d8e2327
[Improvement](minor) Reduce locking scope ( #41845 ) ( #41844 )
...
pick #41845
2024-10-15 18:39:53 +08:00
78b6157aa9
[fix](ip/variant) fix information meta ( #41871 )
...
fix datatype information meta for ip/variant (#41666 )
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-15 18:01:14 +08:00
5fbefa084c
[opt](hive) make supported hive table error msg clearer ( #41616 ) ( #41851 )
...
bp #41616
2024-10-15 17:36:27 +08:00
f3389973e0
[fix](heartbeat) fill default value for required field in TFrontendPingFrontendResult ( #41609 ) ( #41854 )
...
bp #41609
2024-10-15 17:33:46 +08:00
24ceb60ac7
[fix](glue) support glue on aws ( #41084 ) ( #41855 )
...
bp #41084
2024-10-15 17:33:25 +08:00
abcba778ff
[fix](cancel) Fix cancel msg on branch-2.1 ( #41798 )
...
Make sure we can tell cancel reason from:
1. user cancel
2. timeout
3. others
```text
mysql [demo]>set query_timeout=1;
--------------
set query_timeout=1
--------------
Query OK, 0 rows affected (0.00 sec)
mysql [demo]>select sleep(5);
--------------
select sleep(5)
--------------
ERROR 1105 (HY000): errCode = 2, detailMessage = Timeout
mysql [demo]>select sleep(5);
--------------
select sleep(5)
--------------
^C^C -- sending "KILL QUERY 0" to server ...
^C -- query aborted
ERROR 1105 (HY000): errCode = 2, detailMessage = cancel query by user from 127.0.0.1:64208
```
2024-10-15 17:15:05 +08:00
77fbe6397a
[fix](http) Remove file if downloading faile is failed #41778 ( #41827 )
...
cherry pick from #41778
2024-10-15 15:30:29 +08:00
736bb161b1
[ci](ga) skip scope-label ( #41612 ) ( #41848 )
...
bp #41612
2024-10-15 14:02:21 +08:00
7aec6fc42b
[fix](auto bucket) fix auto buckets calc using the first k partition #41675 ( #41820 )
...
cherry pick from #41675
2024-10-15 10:26:46 +08:00
94687a2f3c
[fix](array/map) fix resize impl in array/map ( #41595 ) ( #41699 )
...
backport: https://github.com/apache/doris/pull/41595
2024-10-15 09:50:11 +08:00
d97642e9b5
[cherry-pick](branch-21) fix tablet sink shuffle without project not match the output tuple ( #40299 )( #41293 ) ( #41327 )
...
## Proposed changes
cherry-pick from master (#40299 )(#41293 )
<!--Describe your changes.-->
2024-10-15 00:12:23 +08:00
afdc6800d8
[fix](Nerieds) column prune should retain at least one column for union all ( #41613 ) ( #41771 )
...
cherry-pick #41613 to branch-2.1
2024-10-15 00:09:02 +08:00
4888c632f4
[cherry-pick](branch2.1) support escape.delim and serialization.null.format for hive text ( #41684 )
...
## Proposed changes
pick from master:
https://github.com/apache/doris/pull/40291
2024-10-15 00:08:23 +08:00
19be696120
[Refactor](statistics)Refactor of statistics buildConnectContext. ( #41553 ) ( #41814 )
...
backport: https://github.com/apache/doris/pull/41553
2024-10-14 22:09:57 +08:00
b84e128974
[fix](statistics)Fix clear stale mv row count bug. ( #41653 ) ( #41807 )
...
backport: https://github.com/apache/doris/pull/41653
2024-10-14 21:14:05 +08:00
345cc9172f
[improvement](statistics)Drop table stats in unprotectDropTable so that dropDB could call it as well. ( #39685 ) ( #41801 )
...
backport: https://github.com/apache/doris/pull/39685
2024-10-14 19:30:49 +08:00
ff52e73a07
[Fix](inverted index) fix match null for inverted index #41746 ( #41787 )
...
cherry pick from #41746
2024-10-14 14:45:36 +08:00
f112af0fd2
[pick](branch-2.1) pick #41555 #41592 #38204 ( #41781 )
...
pick #41555 #41592 #38204
2024-10-14 14:05:08 +08:00
ec0c008317
[feature](paimon)support paimon with dlf for 2.1 ( #41247 ) ( #41694 )
...
bp: #41247
2024-10-13 20:04:01 +08:00
629f500646
[cherry-pick](branch-2.1) Pick "[Fix](delete) Fix some delete p2 case ( #37689 ) ( #41678 )" ( #41757 )
...
Pick #37689 #41678
2024-10-12 22:43:21 +08:00
87005aa5b2
[fix](delete) Fix potential delete job stuck util timeout if exception happend in FE DeleteJob execution ( #41672 ) ( #41765 )
...
pick: #41672
Fail task should also count down for the count down latch to prevent job
stuck.
2024-10-12 22:29:10 +08:00
68ae6d025e
[branch-2.1][improvement](jdbc catalog) Print more errors when Jdbc Catalog fails to obtain a connection on FE ( #41769 )
2024-10-12 21:21:54 +08:00
e10458baad
[enhancement](err-msg) Output column info when size invalid in block data convertor ( #41535 ) ( #41764 )
...
## Proposed changes
pick: #41535
As title.
2024-10-12 21:08:04 +08:00
60ac3e71ba
[case](mtmv) fix test_base_mtmv failed ( #39794 ) ( #41745 )
...
pick: https://github.com/apache/doris/pull/39794
2024-10-12 21:07:19 +08:00
cfe7a8302b
[enhance](mtmv) mtmv query sql expand star ( #36543 ) ( #41744 )
...
pick: https://github.com/apache/doris/pull/36543
2024-10-12 17:23:13 +08:00
cb5a5a5c9b
[enhance](catalog)Allow parallel running of insert overwrite on the e… ( #41742 )
...
…xternal table (#41575 )
pick: https://github.com/apache/doris/pull/41575
2024-10-12 17:19:23 +08:00
203f00ef1d
[fix](bloom filter)Fix drop column with bloom filter ( #41369 ) ( #41711 )
...
bp #41369
2024-10-12 17:14:31 +08:00
2ae37626bb
[opt](index compaction)Use RAM dir to create tmp index_writer ( #41371 ) ( #41705 )
...
## Proposed changes
bp #41371
2024-10-12 17:13:55 +08:00
171258cc31
[deps](hadoop) update hadoop to 3.3.6.3 #39376 ( #41748 )
...
bp #39376
2024-10-12 16:34:59 +08:00
ae56739f88
[enhancement](sequence col) add session variable to skip sequence column check while INSERT INTO ( #41655 ) ( #41720 )
...
cp #41655
2024-10-12 15:30:20 +08:00
90d6985f91
[Fix](bug) Is null predicate get error query result ( #41704 )
...
cherry-pick #41668
2024-10-12 13:18:14 +08:00
b2bac26c17
[fix](jdbc catalog) Disable oracle scan null operator pushdown ( #41563 ) ( #41712 )
...
Because Oracle versions below Oracle21 do not support null as an
operator, and considering that most users' Oracle versions are below
Oracle21, we disable Oracle's null operator pushdown by default.
pick (#41563 )
2024-10-11 21:01:05 +08:00
379e00f421
[improve](group commit) set internal group commit timeout ( #41404 ) ( #41688 )
...
pick https://github.com/apache/doris/pull/41404
2024-10-11 17:55:43 +08:00
18cb395496
[fix] (inverted index) fix the error result in the query when using count on index ( #41375 ) ( #41690 )
...
## Proposed changes
pick from master #41375
<!--Describe your changes.-->
2024-10-11 17:15:14 +08:00
4ac07fe918
[Feature](json) Support json_search function in 2.1 ( #41590 )
...
cherry-pick #40948
Like mysql, json_search returns the path which point to a json string
witch match the pattern.
`SELECT JSON_SEARCH('["A",[{"B":"1"}],{"C":"AB"},{"D":"BC"}]', 'one',
'A_') as res;`
```
+----------+
| res |
+----------+
| "$[2].C" |
+----------+
```
Co-authored-by: liutang123 <liulijia@gmail.com >
2024-10-11 16:33:07 +08:00
e9cfbb56b3
[bugfix](becore) use after free problem when the segment is pop ( #41685 ) ( #41697 )
...
## Proposed changes
pick #41685
Issue Number: close #xxx
introduced by #41608
<!--Describe your changes.-->
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-10-11 14:07:46 +08:00
8c0f73cb90
[Enhancement](MaxCompute)Refactoring maxCompute catalog using Storage API.( #40225 , #40888 ,#41386 ) ( #41610 )
...
bp #40225 , #40888 ,#41386
## Proposed changes
Among them, #40225 is the new api of mc,
#40888 is used to fix the bug when reading null between the new and old
apis,
#41386 is used for compatibility between the new and old versions
2024-10-11 11:55:41 +08:00
b489cdf840
[opt](merge-on-write) avoid to check delete bitmap while lookup rowkey in some situation to reduce CPU cost ( #41480 ) ( #41439 )
...
## Proposed changes
Issue Number: close #xxx
cherry-pick #41480
2024-10-11 10:15:39 +08:00
01acd60e2b
[Pick][Improment]Add workload group query detail ( #40050 ) ( #41594 )
...
pick #40050
2024-10-11 09:32:33 +08:00
6dddd4c499
[function](cast)Make string casting to integers more like MySQL's beh… ( #41541 )
...
…avior (#38847 )
https://github.com/apache/doris/pull/38847
## Proposed changes
There are two issues here. First, the results of casting are
inconsistent between FE and BE .
```
FE
mysql [(none)]>select cast('3.000' as int);
+----------------------+
| cast('3.000' as INT) |
+----------------------+
| 3 |
+----------------------+
mysql [(none)]>set debug_skip_fold_constant = true;
BE
mysql [(none)]>select cast('3.000' as int);
+----------------------+
| cast('3.000' as INT) |
+----------------------+
| NULL |
+----------------------+
```
The second issue is that casting on BE converts '3.0' to null. Here, the
casting logic for FE and BE has been unified
<!--Describe your changes.-->
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
---------
Co-authored-by: Xinyi Zou <zouxinyi02@gmail.com >
2024-10-11 09:32:00 +08:00
4c9ebbb3b9
[fix](cloud) cloud group commit should skip repaly wal if label is already used and the txn state is committed or visible ( #41262 ) ( #41461 )
...
pick https://github.com/apache/doris/pull/41262
2024-10-10 22:27:04 +08:00
f2ba1f2fb3
[bugfix](segmentload) should remove segment from segment cache if load segment failed ( #41608 ) ( #41660 )
2024-10-10 19:40:22 +08:00
0fb42d3a48
[Enhancement](tvf)catalog tvf implements user permission checks and hides sensitive information ( #41497 ) ( #41604 )
...
bp #41497
before #21790
## Proposed changes
This PR unifies the duplicate parts of `catalog tvf` and `show
catalogs`, adds permission check when querying `catalog tvf`, and hides
sensitive information.
2024-10-10 17:55:40 +08:00
1db0aef9b7
[feature](array_agg) support array_agg with param is array/map/struct… ( #41651 )
...
… (#40697 )
this pr we support array_agg function support param with array map
struct type
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-10 17:54:54 +08:00
3120bfb6e3
[fix](pipelinex) fix fragment instance progress reports (part 2) ( #40694 ) ( #41641 )
...
backport #40694
2024-10-10 17:49:41 +08:00
30492a2438
[opt](load) print more detailed log when stream load finished #41398 ( #41639 )
...
cherry pick from #41398
2024-10-10 17:47:48 +08:00
d32688e091
[Enhancement](multi-catalog) Set hdfs native client logger to glog and redirect jvm stdout/stderr logger to jni.log. ( #41633 )
...
Backport #39540 .
Co-authored-by: Mingyu Chen <morningman@163.com >
2024-10-10 17:47:21 +08:00
070bd6cf99
[fix](jdbc) fix Unknown command(27) ( #41621 ) ( #41637 )
...
pick https://github.com/apache/doris/pull/41621
2024-10-10 17:46:45 +08:00
