Commit Graph

19416 Commits

Author SHA1 Message Date
2edb9501b5 [Pick]Fix show role stmt missing grouo info (#37920)
## Proposed changes

pick #36032
2024-07-16 20:41:59 +08:00
cc85f7b94c [fix](build index)Remove index_meta in tablet schema when the index is dropped. (#37646) (#37897) 2024-07-16 20:32:30 +08:00
adf11737f0 [fix](catalog)Fix internal program error causing client to get stuck … (#37821)
…(#37551)

pick: https://github.com/apache/doris/pull/37551
2024-07-16 20:22:47 +08:00
9ff129b630 [fix](stream_load) fix stream load may failed caused by column name with keyword (#35822) (#37890)
#35938 #35822 
let 
KW_SQL,
KW_CACHE,
KW_COLOCATE,
KW_COMPRESS_TYPE,
KW_DORIS_INTERNAL_TABLE_ID,
KW_HOTSPOT,
KW_PRIVILEGES,
KW_RECENT,
KW_STAGES,
KW_WARM,
KW_UP,
KW_CONVERT_LSC
be as non-reserved

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

---------

Co-authored-by: caiconghui1 <caiconghui1@jd.com>
2024-07-16 20:20:34 +08:00
36337c8bd9 [fix](multicast) should not ignore Status of block::merge #35886 (#37869)
## Proposed changes

BP #35886
2024-07-16 19:03:24 +08:00
faa425bee5 [fix](colocate) fix colocate join while multi tables (#37729) (#37859)
cherry-pick #37729 to branch-2.1
2024-07-16 19:02:36 +08:00
8440303b91 [fix](delete) Incorrect precision detection for the decimal type in condition.​ (#37801) (#37904)
## Proposed changes

pick #37801

For precision like Decimal(7,7), the value "0.1234567" should be
valid(the integer part is 0).

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-07-16 19:02:02 +08:00
9861f81630 [branch-2.1](memory) Fix Jemalloc Cache Memory Tracker (#37905)
pick #37464
2024-07-16 19:01:31 +08:00
81a7542cae [pick]Add audit log event queue size limit (#37914)
## Proposed changes
pick #37786
2024-07-16 19:00:22 +08:00
cc6ff12097 [opt](function) Optimize the trim function for single-char inputs (#3… (#37799)
https://github.com/apache/doris/pull/36497

before
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
|               64000000 |
+------------------------+
1 row in set (7.79 sec)
```

now
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
|               64000000 |
+------------------------+
1 row in set (0.73 sec)
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-07-16 17:52:52 +08:00
638ee2607e [fix](regression test) fix test_schema_change_fail due to set force_olap_table_replication_num #34343 (#37860)
cherry pick from #34343
2024-07-16 17:40:42 +08:00
638d4b6f27 [Bug](function) Fix function for cast string as date/datetime (#35637) (#37891)
## Proposed changes

Issue Number: close #35635
cherry-pick https://github.com/apache/doris/pull/35637 from master to
branch-2.1

<!--Describe your changes.-->
Cast rules:Consistent with mysql.
String:Date
The first part is 1-digit x: 000x-month-day
The first part is 2-digit xy: 20xy-month-day / 19xy-month-day The first
part is 3-digit xyz: 20xy-0z-day / 19xy-0z-day The first part is 4-digit
xyzw: xyzw-month-day

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-07-16 17:22:03 +08:00
46c06b3d97 [enhancement](regression-test) sync unique case to 2.1 (#37272)
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
2024-07-16 16:59:33 +08:00
1f779ba9de [branch-2.1](arrow-flight-sql) Open regression-test/pipeline/p0/arrow_flight_sql (#37727)
pick #36854
2024-07-16 16:23:43 +08:00
9fd4795080 [opt](iceberg)Add a new appearance to display the pushDown count for 2.1 (#37046) (#34928) (#37810)
## Proposed changes

bp: #37046 #34928
2024-07-16 16:03:44 +08:00
cb2f95ee2e [fix](Nereids) fix fe fold constant failed when using like function (#37864)
cherry-pick: #37616
2024-07-16 16:02:29 +08:00
Pxl
c1b1437fc3 [Bug](bitmap) clear set when bitmap fastunion (#37816) (#37875)
pick from #37816
2024-07-16 16:01:32 +08:00
80ea98b371 [fix](nereids)subquery unnesting get wrong result if correlated conjuncts is not slot_a = slot_b (#37683)
pick from master https://github.com/apache/doris/pull/37644

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-07-16 15:06:40 +08:00
02716598d4 [Fix](sql function) memory overflow to the left of string address when do_money_format has small negative value #36226 (#37870)
cherry pick from #36226

Co-authored-by: sparrow <38098988+biohazard4321@users.noreply.github.com>
2024-07-16 15:04:42 +08:00
2c80259f66 [fix](mtmv) use isManagedTable instead of check table type (#34287) (#37822)
pick: https://github.com/apache/doris/pull/34287
2024-07-16 15:01:28 +08:00
2c4b5519e9 [cherry-pick](branch-2.1) let insert statement support CTE (#36150) (#36265)
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

cherry-pick: #36150
2024-07-16 14:50:53 +08:00
Pxl
9bb37e3616 [Bug](runtime-filter) try to fix DCHECK fail on _acquire_runtime_filter (#37805)
## Proposed changes
pick from https://github.com/apache/doris/pull/35422
2024-07-16 14:37:54 +08:00
8e42871228 [fix](in expr) fix error result when in expr has null value and lef… (#37800)
https://github.com/apache/doris/pull/36024

## Proposed changes

```
create table t2 (id int, c1 int);
insert into t2 values(1, null);
 select 0 in (c1, null) from t2; -- should return null,but 1
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-07-16 14:04:35 +08:00
253f929234 [cherry-pick](branch-2.1) fix inverted index file size (#37836)
## Proposed changes

pick from master #37232
pick from master #37564
2024-07-16 11:28:47 +08:00
e84b9a0eaa [fix](auth)fix fe can not restart when replay create row policy log (… (#37820)
pick: https://github.com/apache/doris/pull/37342
2024-07-16 11:28:19 +08:00
Pxl
d7e84b7ee3 [Enchancement](bitmap) optimize bitmap deserialize and remove some unused code (#37623)
## Proposed changes
pick from #35789
2024-07-16 11:21:54 +08:00
2957fdc039 [branch2.1] pick [fix](show) show create table show index comment err… (#37034)
## Proposed changes
pick https://github.com/apache/doris/pull/36306
2024-07-16 11:19:27 +08:00
47096f2083 [test](regression) add cases for data quality error url (#34987) (#37777)
cherry-pick #34987
2024-07-16 11:12:52 +08:00
7951090283 [minor](dependencies)upgrade aircompressor to 0.27 (#36106) (#37572)
(cherry picked from commit e4aaa3294213191e3ed04703861a8307c6fb850b)

## Proposed changes

Issue Number: #36106
2024-07-16 11:11:58 +08:00
f1d22a9610 [fix](mtmv) fix mtmv task nereids cost too much time (#37589) (#37819)
pick: https://github.com/apache/doris/pull/37589
2024-07-16 11:08:18 +08:00
3cb1d4e842 [feature](json)support explode_json_object func #36887 (#37378) 2024-07-16 10:59:11 +08:00
e64f2997e9 [fix](function) fix core when input not null array in foreach functio… (#37798)
## Proposed changes
https://github.com/apache/doris/pull/37349
error code
```C++
return creator_without_type::create<AggregateFunctionForEach>(transform_arguments, true,
                                                                      nested_function);
```
"transform_arguments is an internal type of array. All internal types of
the array are null, so an array that is not null was mistakenly treated
as a null array."

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-07-16 10:57:11 +08:00
6932eef65e [opt](serde)Optimize the filling of fixed values ​​into block columns without repeated deserialization. (#37377) (#37530)
bp #37377
2024-07-16 10:56:13 +08:00
0080815d11 [cherry-pick](branch-2.1)fix be metric doris_be_process_thread_num is zero (#36719)
## Proposed changes

Issue Number: close #xxx

cherry-pick #35511

<!--Describe your changes.-->
2024-07-16 10:43:06 +08:00
e7a001c420 [enhance](mtmv)support partition tvf (#37795)
pick from: https://github.com/apache/doris/pull/36479 and
https://github.com/apache/doris/pull/37201
2024-07-16 09:27:44 +08:00
aa2b902633 [cherry-pick](branch-21) fix broadcast join running when hash table build not finished (#37844)
cherry-pick from master https://github.com/apache/doris/pull/37792

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-07-16 09:20:06 +08:00
bdf3e3a17e [test](docker) change the default region for docker compose (#37768) (#37813)
bp #37768
2024-07-15 22:18:33 +08:00
1d49d386aa [cherry-pick](branch-21) remove the useless code in column vector (#34432) (#37827)
cherry-pick from master https://github.com/apache/doris/pull/34432

Co-authored-by: HappenLee <happenlee@hotmail.com>
2024-07-15 22:10:58 +08:00
Pxl
010d9d88f8 [Feature](rpc) support set brpc_idle_timeout_sec and enable thrift so… (#37808)
pick from #37333
2024-07-15 21:12:25 +08:00
091725e915 [case](paimon/iceberg)move cases from p2 to p0 for 2.1 (#37276) (#37818)
move cases from p2 to p0

bp: #37276
2024-07-15 21:08:52 +08:00
78eb9d8e33 [case](restart_fe) add demo case for restart_fe test (#37091) (#37313)
pick from master #37091

Co-authored-by: stephen <hello-stephen@qq.com>
2024-07-15 19:42:20 +08:00
63c2d22513 [cherry-pick](branch-2.1) Pick "[Fix](delete command) Mark delete sign when do delete command in MoW table (#35917)" (#37594)
Pick #35917 and #37151
2024-07-15 18:54:01 +08:00
03e21dddff [cherry-pick](branch-21) fix cast string to int return wrong result (#36788) (#37803)
## Proposed changes
cherry-pick from master:
https://github.com/apache/doris/pull/36788
https://github.com/apache/doris/pull/36505

<!--Describe your changes.-->
2024-07-15 18:48:49 +08:00
Pxl
e5219467dd [Bug](join) avoid overflow on bucket_size+1 (#37807)
## Proposed changes
pick from #37493
2024-07-15 18:47:36 +08:00
b7dbd5c186 [feature](inverted index) add ordered functionality to match_phrase query (#37751)
## Proposed changes

1. select count() from tbl where b match_phrase 'the brown ~2+';
2024-07-15 18:42:48 +08:00
Pxl
d1fc4e2e60 [Bug](query) fix meet invalid column when direct scan on mow mv (#37806)
pick from #36483
2024-07-15 18:29:30 +08:00
ce4983eaf2 [datalake](hudi) add hudi docker compose to run hudi examples (#37774)
bp: #37451
2024-07-15 17:16:59 +08:00
967173d7d0 [cherry-pick-2.1](table-function) pick some table functions exec performance (#34090) (#37778)
## Proposed changes

pick from master:
https://github.com/apache/doris/pull/33904
https://github.com/apache/doris/pull/34090

Co-authored-by: HappenLee <happenlee@hotmail.com>
2024-07-15 17:15:56 +08:00
a4d37d96ca [opt](file-scanner) add not found file number in profile (#37042) (#37764)
bp #37042
2024-07-15 17:11:06 +08:00
57301920e3 [fix](colocate join) fix wrong use of colocate join (#37361) (#37714)
cherry-pick from master #37361
2024-07-15 16:47:17 +08:00