5736dc537c
[fix](mtmv) Fix duplicate column name not check when create materialized view #40658 ( #41822 )
...
## Proposed changes
pr: https://github.com/apache/doris/pull/40658
commitId: 252aeeb6
2024-10-17 12:19:15 +08:00
95c0a7a8e3
[chore](planner) change decimal literal toSql as plainString ( #41809 ) ( #41976 )
...
pick from master #41809
for example, 0 with decimal(38,4) will return 0.0000
2024-10-17 12:16:10 +08:00
5521a25392
[enhance](insertoverwrite)insert overwrite not fallback ( #41799 )
...
- Insert overwrite on NEREIDS can automatically clean up garbage
temporary partitions after restart, which is not available on old
optimizers
- When insert fails, no longer throw nereids exceptions
2024-10-17 12:14:17 +08:00
7daf423e98
[opt](profile) Move ExecutedByFrontend to execution summary profile #41761 ( #41831 )
...
cherry pick from #41761
2024-10-17 11:37:48 +08:00
cf2ec26bc2
[fix](catalog) should return error if try using a unknown database ( #40479 ) ( #41971 )
...
bp #40479
2024-10-17 11:13:56 +08:00
169a12058b
[chore](Variant) forbid variant type as hash join key ( #41673 ) ( #41974 )
...
pick from master #41673
2024-10-17 11:06:37 +08:00
f98aa1d08b
[Fix](Branch-2.1) fix fallback to legacy planner when set group commit in session variable ( #41984 )
2024-10-17 10:40:33 +08:00
d04082f685
[improvement](statistics)Use min row count of all replicas as tablet/table row count. ( #41894 ) ( #41978 )
...
backport: https://github.com/apache/doris/pull/41894
2024-10-16 21:45:37 +08:00
e6545a36a3
[improvement](iceberg)Parallelize splits for count(*) for 2.1 ( #41169 ) ( #41880 )
...
bp: #41169
2024-10-16 10:52:06 +08:00
e62e47700d
[fix](Nereids) fixed the limit offset error pick 39316 ( #41878 )
2024-10-16 10:38:05 +08:00
a4b7d93ded
[bugfix](iceberg)add prefix for endpoint with s3 client for 2.1 ( #41336 ) ( #41877 )
...
bp: #41336
2024-10-15 19:59:10 +08:00
5fbefa084c
[opt](hive) make supported hive table error msg clearer ( #41616 ) ( #41851 )
...
bp #41616
2024-10-15 17:36:27 +08:00
f3389973e0
[fix](heartbeat) fill default value for required field in TFrontendPingFrontendResult ( #41609 ) ( #41854 )
...
bp #41609
2024-10-15 17:33:46 +08:00
24ceb60ac7
[fix](glue) support glue on aws ( #41084 ) ( #41855 )
...
bp #41084
2024-10-15 17:33:25 +08:00
abcba778ff
[fix](cancel) Fix cancel msg on branch-2.1 ( #41798 )
...
Make sure we can tell cancel reason from:
1. user cancel
2. timeout
3. others
```text
mysql [demo]>set query_timeout=1;
--------------
set query_timeout=1
--------------
Query OK, 0 rows affected (0.00 sec)
mysql [demo]>select sleep(5);
--------------
select sleep(5)
--------------
ERROR 1105 (HY000): errCode = 2, detailMessage = Timeout
mysql [demo]>select sleep(5);
--------------
select sleep(5)
--------------
^C^C -- sending "KILL QUERY 0" to server ...
^C -- query aborted
ERROR 1105 (HY000): errCode = 2, detailMessage = cancel query by user from 127.0.0.1:64208
```
2024-10-15 17:15:05 +08:00
7aec6fc42b
[fix](auto bucket) fix auto buckets calc using the first k partition #41675 ( #41820 )
...
cherry pick from #41675
2024-10-15 10:26:46 +08:00
d97642e9b5
[cherry-pick](branch-21) fix tablet sink shuffle without project not match the output tuple ( #40299 )( #41293 ) ( #41327 )
...
## Proposed changes
cherry-pick from master (#40299 )(#41293 )
<!--Describe your changes.-->
2024-10-15 00:12:23 +08:00
afdc6800d8
[fix](Nerieds) column prune should retain at least one column for union all ( #41613 ) ( #41771 )
...
cherry-pick #41613 to branch-2.1
2024-10-15 00:09:02 +08:00
4888c632f4
[cherry-pick](branch2.1) support escape.delim and serialization.null.format for hive text ( #41684 )
...
## Proposed changes
pick from master:
https://github.com/apache/doris/pull/40291
2024-10-15 00:08:23 +08:00
19be696120
[Refactor](statistics)Refactor of statistics buildConnectContext. ( #41553 ) ( #41814 )
...
backport: https://github.com/apache/doris/pull/41553
2024-10-14 22:09:57 +08:00
b84e128974
[fix](statistics)Fix clear stale mv row count bug. ( #41653 ) ( #41807 )
...
backport: https://github.com/apache/doris/pull/41653
2024-10-14 21:14:05 +08:00
345cc9172f
[improvement](statistics)Drop table stats in unprotectDropTable so that dropDB could call it as well. ( #39685 ) ( #41801 )
...
backport: https://github.com/apache/doris/pull/39685
2024-10-14 19:30:49 +08:00
f112af0fd2
[pick](branch-2.1) pick #41555 #41592 #38204 ( #41781 )
...
pick #41555 #41592 #38204
2024-10-14 14:05:08 +08:00
ec0c008317
[feature](paimon)support paimon with dlf for 2.1 ( #41247 ) ( #41694 )
...
bp: #41247
2024-10-13 20:04:01 +08:00
87005aa5b2
[fix](delete) Fix potential delete job stuck util timeout if exception happend in FE DeleteJob execution ( #41672 ) ( #41765 )
...
pick: #41672
Fail task should also count down for the count down latch to prevent job
stuck.
2024-10-12 22:29:10 +08:00
68ae6d025e
[branch-2.1][improvement](jdbc catalog) Print more errors when Jdbc Catalog fails to obtain a connection on FE ( #41769 )
2024-10-12 21:21:54 +08:00
cfe7a8302b
[enhance](mtmv) mtmv query sql expand star ( #36543 ) ( #41744 )
...
pick: https://github.com/apache/doris/pull/36543
2024-10-12 17:23:13 +08:00
cb5a5a5c9b
[enhance](catalog)Allow parallel running of insert overwrite on the e… ( #41742 )
...
…xternal table (#41575 )
pick: https://github.com/apache/doris/pull/41575
2024-10-12 17:19:23 +08:00
203f00ef1d
[fix](bloom filter)Fix drop column with bloom filter ( #41369 ) ( #41711 )
...
bp #41369
2024-10-12 17:14:31 +08:00
ae56739f88
[enhancement](sequence col) add session variable to skip sequence column check while INSERT INTO ( #41655 ) ( #41720 )
...
cp #41655
2024-10-12 15:30:20 +08:00
b2bac26c17
[fix](jdbc catalog) Disable oracle scan null operator pushdown ( #41563 ) ( #41712 )
...
Because Oracle versions below Oracle21 do not support null as an
operator, and considering that most users' Oracle versions are below
Oracle21, we disable Oracle's null operator pushdown by default.
pick (#41563 )
2024-10-11 21:01:05 +08:00
379e00f421
[improve](group commit) set internal group commit timeout ( #41404 ) ( #41688 )
...
pick https://github.com/apache/doris/pull/41404
2024-10-11 17:55:43 +08:00
18cb395496
[fix] (inverted index) fix the error result in the query when using count on index ( #41375 ) ( #41690 )
...
## Proposed changes
pick from master #41375
<!--Describe your changes.-->
2024-10-11 17:15:14 +08:00
4ac07fe918
[Feature](json) Support json_search function in 2.1 ( #41590 )
...
cherry-pick #40948
Like mysql, json_search returns the path which point to a json string
witch match the pattern.
`SELECT JSON_SEARCH('["A",[{"B":"1"}],{"C":"AB"},{"D":"BC"}]', 'one',
'A_') as res;`
```
+----------+
| res |
+----------+
| "$[2].C" |
+----------+
```
Co-authored-by: liutang123 <liulijia@gmail.com >
2024-10-11 16:33:07 +08:00
8c0f73cb90
[Enhancement](MaxCompute)Refactoring maxCompute catalog using Storage API.( #40225 , #40888 ,#41386 ) ( #41610 )
...
bp #40225 , #40888 ,#41386
## Proposed changes
Among them, #40225 is the new api of mc,
#40888 is used to fix the bug when reading null between the new and old
apis,
#41386 is used for compatibility between the new and old versions
2024-10-11 11:55:41 +08:00
01acd60e2b
[Pick][Improment]Add workload group query detail ( #40050 ) ( #41594 )
...
pick #40050
2024-10-11 09:32:33 +08:00
0fb42d3a48
[Enhancement](tvf)catalog tvf implements user permission checks and hides sensitive information ( #41497 ) ( #41604 )
...
bp #41497
before #21790
## Proposed changes
This PR unifies the duplicate parts of `catalog tvf` and `show
catalogs`, adds permission check when querying `catalog tvf`, and hides
sensitive information.
2024-10-10 17:55:40 +08:00
3120bfb6e3
[fix](pipelinex) fix fragment instance progress reports (part 2) ( #40694 ) ( #41641 )
...
backport #40694
2024-10-10 17:49:41 +08:00
d32688e091
[Enhancement](multi-catalog) Set hdfs native client logger to glog and redirect jvm stdout/stderr logger to jni.log. ( #41633 )
...
Backport #39540 .
Co-authored-by: Mingyu Chen <morningman@163.com >
2024-10-10 17:47:21 +08:00
070bd6cf99
[fix](jdbc) fix Unknown command(27) ( #41621 ) ( #41637 )
...
pick https://github.com/apache/doris/pull/41621
2024-10-10 17:46:45 +08:00
cd26713c26
[fix](Nereids) could not parse date/datetime with blank + zone ( #41394 ) ( #41620 )
...
pick from master #41394
for example:
2008-08-08 20:08:08 +08:00 parse failed because the blank before +08:00
2024-10-10 14:03:41 +08:00
33fad04341
[opt](Nereids) use 1 instead narrowest column when do column pruning ( #41548 ) ( #41627 )
...
pick from master #41548
2024-10-10 14:02:23 +08:00
eb348ec10e
[improve](binlog) Filter the truncated partitions #41611 ( #41630 )
...
cherry pick from #41611
2024-10-10 11:59:27 +08:00
6a3dc98361
[fix](Nereids) merge request properties map of group should compare cost ( #40819 ) ( #41615 )
...
pick from master #40819
when do merge, we should update target requestPropertiesMap ONLY IF the
cost of source's request property lower than target one. Otherwise, the
requestPropertiesMap will not sync with lowestCostTable. Then, we will
get wrong output property when get the final plan.
2024-10-10 11:16:00 +08:00
032c00e3c9
[branch-2.1](create table) show failed detail msg #41463 ( #41544 )
...
cherry-pick: #41463
2024-10-10 11:15:02 +08:00
a45dc8796a
[fix](Nereids) simplify decimal comparison wrong when cast to smaller scale ( #41151 ) ( #41618 )
...
pick from master #41151
2024-10-09 23:03:01 +08:00
649cefd70f
[opt](Nereids) forbid distribute under project and filter ( #39812 ) ( #41622 )
...
pick from master #39812
2024-10-09 23:02:06 +08:00
1d2e2adb74
[fix](parser) should not use selectHint in any place ( #41260 ) ( #41619 )
...
pick from master #41260
because all comment has been redirect to channel 2, we should not use
hint in any place. selectHint only use to parse hint.
2024-10-09 23:00:04 +08:00
ade86c0600
Revert "[branch-2.1][improvement](jdbc catalog) Optimize JdbcCatalog case mapping stability" ( #41588 )
...
Reverts apache/doris#41330
2024-10-09 20:51:58 +08:00
b6c0603e0d
[fix](mtmv)Fix show mtmv time should wrapped in double quotation mark… ( #41501 )
...
pick: https://github.com/apache/doris/pull/41419
2024-10-09 12:19:28 +08:00
