87005aa5b2
[fix](delete) Fix potential delete job stuck util timeout if exception happend in FE DeleteJob execution ( #41672 ) ( #41765 )
...
pick: #41672
Fail task should also count down for the count down latch to prevent job
stuck.
2024-10-12 22:29:10 +08:00
68ae6d025e
[branch-2.1][improvement](jdbc catalog) Print more errors when Jdbc Catalog fails to obtain a connection on FE ( #41769 )
2024-10-12 21:21:54 +08:00
e10458baad
[enhancement](err-msg) Output column info when size invalid in block data convertor ( #41535 ) ( #41764 )
...
## Proposed changes
pick: #41535
As title.
2024-10-12 21:08:04 +08:00
60ac3e71ba
[case](mtmv) fix test_base_mtmv failed ( #39794 ) ( #41745 )
...
pick: https://github.com/apache/doris/pull/39794
2024-10-12 21:07:19 +08:00
cfe7a8302b
[enhance](mtmv) mtmv query sql expand star ( #36543 ) ( #41744 )
...
pick: https://github.com/apache/doris/pull/36543
2024-10-12 17:23:13 +08:00
cb5a5a5c9b
[enhance](catalog)Allow parallel running of insert overwrite on the e… ( #41742 )
...
…xternal table (#41575 )
pick: https://github.com/apache/doris/pull/41575
2024-10-12 17:19:23 +08:00
203f00ef1d
[fix](bloom filter)Fix drop column with bloom filter ( #41369 ) ( #41711 )
...
bp #41369
2024-10-12 17:14:31 +08:00
2ae37626bb
[opt](index compaction)Use RAM dir to create tmp index_writer ( #41371 ) ( #41705 )
...
## Proposed changes
bp #41371
2024-10-12 17:13:55 +08:00
171258cc31
[deps](hadoop) update hadoop to 3.3.6.3 #39376 ( #41748 )
...
bp #39376
2024-10-12 16:34:59 +08:00
ae56739f88
[enhancement](sequence col) add session variable to skip sequence column check while INSERT INTO ( #41655 ) ( #41720 )
...
cp #41655
2024-10-12 15:30:20 +08:00
90d6985f91
[Fix](bug) Is null predicate get error query result ( #41704 )
...
cherry-pick #41668
2024-10-12 13:18:14 +08:00
b2bac26c17
[fix](jdbc catalog) Disable oracle scan null operator pushdown ( #41563 ) ( #41712 )
...
Because Oracle versions below Oracle21 do not support null as an
operator, and considering that most users' Oracle versions are below
Oracle21, we disable Oracle's null operator pushdown by default.
pick (#41563 )
2024-10-11 21:01:05 +08:00
379e00f421
[improve](group commit) set internal group commit timeout ( #41404 ) ( #41688 )
...
pick https://github.com/apache/doris/pull/41404
2024-10-11 17:55:43 +08:00
18cb395496
[fix] (inverted index) fix the error result in the query when using count on index ( #41375 ) ( #41690 )
...
## Proposed changes
pick from master #41375
<!--Describe your changes.-->
2024-10-11 17:15:14 +08:00
4ac07fe918
[Feature](json) Support json_search function in 2.1 ( #41590 )
...
cherry-pick #40948
Like mysql, json_search returns the path which point to a json string
witch match the pattern.
`SELECT JSON_SEARCH('["A",[{"B":"1"}],{"C":"AB"},{"D":"BC"}]', 'one',
'A_') as res;`
```
+----------+
| res |
+----------+
| "$[2].C" |
+----------+
```
Co-authored-by: liutang123 <liulijia@gmail.com >
2024-10-11 16:33:07 +08:00
e9cfbb56b3
[bugfix](becore) use after free problem when the segment is pop ( #41685 ) ( #41697 )
...
## Proposed changes
pick #41685
Issue Number: close #xxx
introduced by #41608
<!--Describe your changes.-->
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-10-11 14:07:46 +08:00
8c0f73cb90
[Enhancement](MaxCompute)Refactoring maxCompute catalog using Storage API.( #40225 , #40888 ,#41386 ) ( #41610 )
...
bp #40225 , #40888 ,#41386
## Proposed changes
Among them, #40225 is the new api of mc,
#40888 is used to fix the bug when reading null between the new and old
apis,
#41386 is used for compatibility between the new and old versions
2024-10-11 11:55:41 +08:00
b489cdf840
[opt](merge-on-write) avoid to check delete bitmap while lookup rowkey in some situation to reduce CPU cost ( #41480 ) ( #41439 )
...
## Proposed changes
Issue Number: close #xxx
cherry-pick #41480
2024-10-11 10:15:39 +08:00
01acd60e2b
[Pick][Improment]Add workload group query detail ( #40050 ) ( #41594 )
...
pick #40050
2024-10-11 09:32:33 +08:00
6dddd4c499
[function](cast)Make string casting to integers more like MySQL's beh… ( #41541 )
...
…avior (#38847 )
https://github.com/apache/doris/pull/38847
## Proposed changes
There are two issues here. First, the results of casting are
inconsistent between FE and BE .
```
FE
mysql [(none)]>select cast('3.000' as int);
+----------------------+
| cast('3.000' as INT) |
+----------------------+
| 3 |
+----------------------+
mysql [(none)]>set debug_skip_fold_constant = true;
BE
mysql [(none)]>select cast('3.000' as int);
+----------------------+
| cast('3.000' as INT) |
+----------------------+
| NULL |
+----------------------+
```
The second issue is that casting on BE converts '3.0' to null. Here, the
casting logic for FE and BE has been unified
<!--Describe your changes.-->
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
---------
Co-authored-by: Xinyi Zou <zouxinyi02@gmail.com >
2024-10-11 09:32:00 +08:00
4c9ebbb3b9
[fix](cloud) cloud group commit should skip repaly wal if label is already used and the txn state is committed or visible ( #41262 ) ( #41461 )
...
pick https://github.com/apache/doris/pull/41262
2024-10-10 22:27:04 +08:00
f2ba1f2fb3
[bugfix](segmentload) should remove segment from segment cache if load segment failed ( #41608 ) ( #41660 )
2024-10-10 19:40:22 +08:00
0fb42d3a48
[Enhancement](tvf)catalog tvf implements user permission checks and hides sensitive information ( #41497 ) ( #41604 )
...
bp #41497
before #21790
## Proposed changes
This PR unifies the duplicate parts of `catalog tvf` and `show
catalogs`, adds permission check when querying `catalog tvf`, and hides
sensitive information.
2024-10-10 17:55:40 +08:00
1db0aef9b7
[feature](array_agg) support array_agg with param is array/map/struct… ( #41651 )
...
… (#40697 )
this pr we support array_agg function support param with array map
struct type
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-10-10 17:54:54 +08:00
3120bfb6e3
[fix](pipelinex) fix fragment instance progress reports (part 2) ( #40694 ) ( #41641 )
...
backport #40694
2024-10-10 17:49:41 +08:00
30492a2438
[opt](load) print more detailed log when stream load finished #41398 ( #41639 )
...
cherry pick from #41398
2024-10-10 17:47:48 +08:00
d32688e091
[Enhancement](multi-catalog) Set hdfs native client logger to glog and redirect jvm stdout/stderr logger to jni.log. ( #41633 )
...
Backport #39540 .
Co-authored-by: Mingyu Chen <morningman@163.com >
2024-10-10 17:47:21 +08:00
070bd6cf99
[fix](jdbc) fix Unknown command(27) ( #41621 ) ( #41637 )
...
pick https://github.com/apache/doris/pull/41621
2024-10-10 17:46:45 +08:00
a26079c09d
[Opt](load) Optimize the error messages of -235 and -238 for loading #41048 ( #41638 )
...
cherry pick from #41048
2024-10-10 14:20:52 +08:00
cd26713c26
[fix](Nereids) could not parse date/datetime with blank + zone ( #41394 ) ( #41620 )
...
pick from master #41394
for example:
2008-08-08 20:08:08 +08:00 parse failed because the blank before +08:00
2024-10-10 14:03:41 +08:00
33fad04341
[opt](Nereids) use 1 instead narrowest column when do column pruning ( #41548 ) ( #41627 )
...
pick from master #41548
2024-10-10 14:02:23 +08:00
eb348ec10e
[improve](binlog) Filter the truncated partitions #41611 ( #41630 )
...
cherry pick from #41611
2024-10-10 11:59:27 +08:00
aa541fddf9
[fix](load) disable num segments check in compatibility mode ( #41053 ) ( #41552 )
...
backport #41053
2024-10-10 11:20:16 +08:00
6a3dc98361
[fix](Nereids) merge request properties map of group should compare cost ( #40819 ) ( #41615 )
...
pick from master #40819
when do merge, we should update target requestPropertiesMap ONLY IF the
cost of source's request property lower than target one. Otherwise, the
requestPropertiesMap will not sync with lowestCostTable. Then, we will
get wrong output property when get the final plan.
2024-10-10 11:16:00 +08:00
032c00e3c9
[branch-2.1](create table) show failed detail msg #41463 ( #41544 )
...
cherry-pick: #41463
2024-10-10 11:15:02 +08:00
15bdfa446c
[case](mtmv)fix alter job case ( #41326 ) ( #41500 )
...
pick: https://github.com/apache/doris/pull/41326
2024-10-10 00:11:50 +08:00
a45dc8796a
[fix](Nereids) simplify decimal comparison wrong when cast to smaller scale ( #41151 ) ( #41618 )
...
pick from master #41151
2024-10-09 23:03:01 +08:00
649cefd70f
[opt](Nereids) forbid distribute under project and filter ( #39812 ) ( #41622 )
...
pick from master #39812
2024-10-09 23:02:06 +08:00
1d2e2adb74
[fix](parser) should not use selectHint in any place ( #41260 ) ( #41619 )
...
pick from master #41260
because all comment has been redirect to channel 2, we should not use
hint in any place. selectHint only use to parse hint.
2024-10-09 23:00:04 +08:00
ade86c0600
Revert "[branch-2.1][improvement](jdbc catalog) Optimize JdbcCatalog case mapping stability" ( #41588 )
...
Reverts apache/doris#41330
2024-10-09 20:51:58 +08:00
e218fd2314
[Fix](inverted index) add DATEV2 and DATETIMEV2 for inverted index reader #41565 ( #41579 )
...
cherry pick from #41565
2024-10-09 15:32:41 +08:00
31b506c8cc
[Enhancement](inverted index) return OK instead of not supported in expr evaluate_inverted_index #41567 ( #41578 )
...
cherry pick from #41567
2024-10-09 15:14:38 +08:00
0185f8069f
[fix](crash) fix be crash because of int overflow ( #41554 ) ( #41568 )
2024-10-09 14:20:55 +08:00
9fe77b335c
[Enhancement](inverted index) apply inverted index when has any #41547 ( #41584 )
...
cherry pick from #41547
2024-10-09 14:13:38 +08:00
5a6517ba45
[test](inverted index) fix test case for no need read data #41564 ( #41583 )
...
cherry pick from #41564
2024-10-09 14:03:02 +08:00
b6c0603e0d
[fix](mtmv)Fix show mtmv time should wrapped in double quotation mark… ( #41501 )
...
pick: https://github.com/apache/doris/pull/41419
2024-10-09 12:19:28 +08:00
308700f0ca
[fix](test) fix unstable test_export_external_table cases ( #41523 ) ( #41570 )
...
bp #41523
2024-10-09 11:53:22 +08:00
25684f487b
[2.1][improvement](jdbc catalog) Improve JdbcClientException to accommodate various identifier formats ( #41530 )
...
pick (#40931 )
In some cases, JDBC returns exceptions with various identifiers that
cannot be formatted correctly, such as `%`. This PR optimizes this.
2024-10-09 10:32:41 +08:00
a0aed77218
[cherry-pick](branch2.1) fix hudi jni scanner ( #41566 )
...
pick from https://github.com/apache/doris/pull/41316
2024-10-09 10:31:50 +08:00
afb477c66d
[Fix](inverted index) Fix wrong need read data opt when enable_common_expr_pushdown is disabled #40689 ( #41562 )
...
cherry pick from #40689
2024-10-08 22:12:10 +08:00
