database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
19,429 Commits 1 Branch 0 Tags
db0a43bad2ecf46974f90d2c3906d258abab5f43
Commit Graph

19429 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Pxl
db0a43bad2 [Chore](exchange) change LocalExchangeSharedState:mem_usage signed ty… (#37981) 
pick from #36682
 2024-07-17 13:46:51 +08:00
Mingyu Chen
f2cf8b7d6f [Fix](InternalSchema) Compute nodes should not be used for Internal schema three replica (#36130) (#37961) 
bp #36130

Co-authored-by: HB <137497191@qq.com>
Co-authored-by: camby <104178625@qq.com>
 2024-07-17 13:45:32 +08:00
daidai
cf5c555223 [fix](case)Fix unusual case in manager_interface.(#37930) (#37967) 
bp #37930 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-17 12:27:07 +08:00
zhangstar333
33b379a51d [bug](join) remove broadcast join check about shared hashtable signal (#37969) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-17 12:26:19 +08:00
Mingyu Chen
ba66ff5768 [fix](multi-catalog)fix paimon meta properties convert (#37249) (#37958) 
bp #37249

Co-authored-by: slothever <18522955+wsjz@users.noreply.github.com>
 2024-07-17 01:04:33 +08:00
HappenLee
b6e5281a1c [Fix](bug) fix the divide zero in local shuffle: (#37948) 
## Proposed changes

cherry pick #37906 

<!--Describe your changes.-->
 2024-07-17 01:03:53 +08:00
amory
21c6b854f7 [fix](explode-json-object)fix explode json object (#37956) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-17 01:03:07 +08:00
zhangdong
3d095c737d [fix](case)partition num will be 3 in daily pipeline (#37954) 
pick:https://github.com/apache/doris/pull/37945
 2024-07-17 00:59:15 +08:00
seawinde
dbd2b0abf7 [improvement](mtmv) improve mv rewrite performance by reuse the shuttled expression (#37197) (#37935) 
## Proposed changes

chrry-pick 2.1
pr: https://github.com/apache/doris/pull/37197
commitId: 701c7db4
 2024-07-17 00:52:58 +08:00
Kaijie Chen
359e50fc58 [fix](load) change tablet schema pointer to shared_ptr in memtable (#37927) (#37939) 
backport #37927
 2024-07-16 22:32:03 +08:00
苏小刚
f7068b5658 [cherry-pick](branch-2.1) Make doris read hive text table parameters and behavior consistent with hive (#37840) 
## Proposed changes

pick from master https://github.com/apache/doris/pull/37638

<!--Describe your changes.-->
 2024-07-16 22:24:50 +08:00
924060929
49faccbf50 [enhancement](nereids) speedup sql cache with use variable as partition predicate (#37943) 
follow up #37090

support reuse sql cache when use variable as partition predicate and variable change:
```sql
set @dt='2024-07-16';
-- create cache 1
select * from tbl where dt = @dt;

set @dt='2024-07-17';
-- create cache 2, will not invalidate cache 1
select * from tbl where dt = @dt;

set @dt='2024-07-16';
-- reuse cache 1
select * from tbl where dt = @dt;
```
 2024-07-16 22:11:18 +08:00
lihangyu
b15ccdbe98 [Pick](Variant) pick some fix (#37922) 
#37674
#37839
#37883 
#37857 
#37794
 2024-07-16 21:38:47 +08:00
wangbo
2edb9501b5 [Pick]Fix show role stmt missing grouo info (#37920) 
## Proposed changes

pick #36032
 2024-07-16 20:41:59 +08:00
qiye
cc85f7b94c [fix](build index)Remove index_meta in tablet schema when the index is dropped. (#37646) (#37897) 2024-07-16 20:32:30 +08:00
zhangdong
adf11737f0 [fix](catalog)Fix internal program error causing client to get stuck … (#37821) 
…(#37551)

pick: https://github.com/apache/doris/pull/37551
 2024-07-16 20:22:47 +08:00
caiconghui
9ff129b630 [fix](stream_load) fix stream load may failed caused by column name with keyword (#35822) (#37890) 
#35938 #35822 
let 
KW_SQL,
KW_CACHE,
KW_COLOCATE,
KW_COMPRESS_TYPE,
KW_DORIS_INTERNAL_TABLE_ID,
KW_HOTSPOT,
KW_PRIVILEGES,
KW_RECENT,
KW_STAGES,
KW_WARM,
KW_UP,
KW_CONVERT_LSC
be as non-reserved

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

---------

Co-authored-by: caiconghui1 <caiconghui1@jd.com>
 2024-07-16 20:20:34 +08:00
TengJianPing
36337c8bd9 [fix](multicast) should not ignore Status of block::merge #35886 (#37869) 
## Proposed changes

BP #35886
 2024-07-16 19:03:24 +08:00
camby
faa425bee5 [fix](colocate) fix colocate join while multi tables (#37729) (#37859) 
cherry-pick #37729 to branch-2.1
 2024-07-16 19:02:36 +08:00
Jerry Hu
8440303b91 [fix](delete) Incorrect precision detection for the decimal type in condition.​ (#37801) (#37904) 
## Proposed changes

pick #37801

For precision like Decimal(7,7), the value "0.1234567" should be
valid(the integer part is 0).

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 19:02:02 +08:00
Xinyi Zou
9861f81630 [branch-2.1](memory) Fix Jemalloc Cache Memory Tracker (#37905) 
pick #37464
 2024-07-16 19:01:31 +08:00
wangbo
81a7542cae [pick]Add audit log event queue size limit (#37914) 
## Proposed changes
pick #37786
 2024-07-16 19:00:22 +08:00
Mryange
cc6ff12097 [opt](function) Optimize the trim function for single-char inputs (#3… (#37799) 
https://github.com/apache/doris/pull/36497

before
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
|               64000000 |
+------------------------+
1 row in set (7.79 sec)
```

now
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
|               64000000 |
+------------------------+
1 row in set (0.73 sec)
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 17:52:52 +08:00
yujun
638ee2607e [fix](regression test) fix test_schema_change_fail due to set force_olap_table_replication_num #34343 (#37860) 
cherry pick from #34343
 2024-07-16 17:40:42 +08:00
yongjinhou
638d4b6f27 [Bug](function) Fix function for cast string as date/datetime (#35637) (#37891) 
## Proposed changes

Issue Number: close #35635
cherry-pick https://github.com/apache/doris/pull/35637 from master to
branch-2.1

<!--Describe your changes.-->
Cast rules：Consistent with mysql.
String：Date
The first part is 1-digit x: 000x-month-day
The first part is 2-digit xy: 20xy-month-day / 19xy-month-day The first
part is 3-digit xyz: 20xy-0z-day / 19xy-0z-day The first part is 4-digit
xyzw: xyzw-month-day

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 17:22:03 +08:00
kkop
46c06b3d97 [enhancement](regression-test) sync unique case to 2.1 (#37272) 
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
 2024-07-16 16:59:33 +08:00
Xinyi Zou
1f779ba9de [branch-2.1](arrow-flight-sql) Open regression-test/pipeline/p0/arrow_flight_sql (#37727) 
pick #36854
 2024-07-16 16:23:43 +08:00
wuwenchi
9fd4795080 [opt](iceberg)Add a new appearance to display the pushDown count for 2.1 (#37046) (#34928) (#37810) 
## Proposed changes

bp: #37046 #34928
 2024-07-16 16:03:44 +08:00
LiBinfeng
cb2f95ee2e [fix](Nereids) fix fe fold constant failed when using like function (#37864) 
cherry-pick: #37616
 2024-07-16 16:02:29 +08:00
Pxl
c1b1437fc3 [Bug](bitmap) clear set when bitmap fastunion (#37816) (#37875) 
pick from #37816
 2024-07-16 16:01:32 +08:00
starocean999
80ea98b371 [fix](nereids)subquery unnesting get wrong result if correlated conjuncts is not slot_a = slot_b (#37683) 
pick from master https://github.com/apache/doris/pull/37644

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 15:06:40 +08:00
zhiqiang
02716598d4 [Fix](sql function) memory overflow to the left of string address when do_money_format has small negative value #36226 (#37870) 
cherry pick from #36226

Co-authored-by: sparrow <38098988+biohazard4321@users.noreply.github.com>
 2024-07-16 15:04:42 +08:00
zhangdong
2c80259f66 [fix](mtmv) use isManagedTable instead of check table type (#34287) (#37822) 
pick: https://github.com/apache/doris/pull/34287
 2024-07-16 15:01:28 +08:00
Liu Zhenlong
2c4b5519e9 [cherry-pick](branch-2.1) let insert statement support CTE (#36150) (#36265) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

cherry-pick: #36150
 2024-07-16 14:50:53 +08:00
Pxl
9bb37e3616 [Bug](runtime-filter) try to fix DCHECK fail on _acquire_runtime_filter (#37805) 
## Proposed changes
pick from https://github.com/apache/doris/pull/35422
 2024-07-16 14:37:54 +08:00
Mryange
8e42871228 [fix](in expr) fix error result when in expr has null value and lef… (#37800) 
https://github.com/apache/doris/pull/36024

## Proposed changes

```
create table t2 (id int, c1 int);
insert into t2 values(1, null);
 select 0 in (c1, null) from t2; -- should return null，but 1
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 14:04:35 +08:00
Sun Chenyang
253f929234 [cherry-pick](branch-2.1) fix inverted index file size (#37836) 
## Proposed changes

pick from master #37232
pick from master #37564
 2024-07-16 11:28:47 +08:00
zhangdong
e84b9a0eaa [fix](auth)fix fe can not restart when replay create row policy log (… (#37820) 
pick: https://github.com/apache/doris/pull/37342
 2024-07-16 11:28:19 +08:00
Pxl
d7e84b7ee3 [Enchancement](bitmap) optimize bitmap deserialize and remove some unused code (#37623) 
## Proposed changes
pick from #35789
 2024-07-16 11:21:54 +08:00
zgxme
2957fdc039 [branch2.1] pick [fix](show) show create table show index comment err… (#37034) 
## Proposed changes
pick https://github.com/apache/doris/pull/36306
 2024-07-16 11:19:27 +08:00
Kaijie Chen
47096f2083 [test](regression) add cases for data quality error url (#34987) (#37777) 
cherry-pick #34987
 2024-07-16 11:12:52 +08:00
Calvin Kirs
7951090283 [minor](dependencies)upgrade aircompressor to 0.27 (#36106) (#37572) 
(cherry picked from commit e4aaa3294213191e3ed04703861a8307c6fb850b)

## Proposed changes

Issue Number: #36106
 2024-07-16 11:11:58 +08:00
zhangdong
f1d22a9610 [fix](mtmv) fix mtmv task nereids cost too much time (#37589) (#37819) 
pick: https://github.com/apache/doris/pull/37589
 2024-07-16 11:08:18 +08:00
amory
3cb1d4e842 [feature](json)support explode_json_object func #36887 (#37378) 2024-07-16 10:59:11 +08:00
Mryange
e64f2997e9 [fix](function) fix core when input not null array in foreach functio… (#37798) 
## Proposed changes
https://github.com/apache/doris/pull/37349
error code
```C++
return creator_without_type::create<AggregateFunctionForEach>(transform_arguments, true,
                                                                      nested_function);
```
"transform_arguments is an internal type of array. All internal types of
the array are null, so an array that is not null was mistakenly treated
as a null array."

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 10:57:11 +08:00
daidai
6932eef65e [opt](serde)Optimize the filling of fixed values ​​into block columns without repeated deserialization. (#37377) (#37530) 
bp #37377
 2024-07-16 10:56:13 +08:00
Xujian Duan
0080815d11 [cherry-pick](branch-2.1)fix be metric doris_be_process_thread_num is zero (#36719) 
## Proposed changes

Issue Number: close #xxx

cherry-pick #35511

<!--Describe your changes.-->
 2024-07-16 10:43:06 +08:00
zhangdong
e7a001c420 [enhance](mtmv)support partition tvf (#37795) 
pick from: https://github.com/apache/doris/pull/36479 and
https://github.com/apache/doris/pull/37201
 2024-07-16 09:27:44 +08:00
zhangstar333
aa2b902633 [cherry-pick](branch-21) fix broadcast join running when hash table build not finished (#37844) 
cherry-pick from master https://github.com/apache/doris/pull/37792

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 09:20:06 +08:00
Mingyu Chen
bdf3e3a17e [test](docker) change the default region for docker compose (#37768) (#37813) 
bp #37768
 2024-07-15 22:18:33 +08:00