database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
19,982 Commits 1 Branch 0 Tags
4909c34555ebe0b75093e60deedced6f830f8149
Commit Graph

266 Commits

Author SHA1 Message Date
zclllhhjj
db0724dfe0 [Fix-2.1](function) fix function covar core for not null input (#39943) 
## Proposed changes

Issue Number: close #xxx

add testcases like:
```groovy
    qt_notnull1 "select covar_samp(non_nullable(x), non_nullable(y)) from test_covar_samp"
    qt_notnull2 "select covar_samp(x, non_nullable(y)) from test_covar_samp"
    qt_notnull3 "select covar_samp(non_nullable(x), y) from test_covar_samp"
```

before they will all coredump in 2.1
 2024-08-27 08:39:47 +08:00
zclllhhjj
460605ae3c [branch-2.1] pick some prs (#39860) 
## Proposed changes

Issue Number: close #xxx

https://github.com/apache/doris/pull/38385 optimize parsing datetime
https://github.com/apache/doris/pull/38978 make stream load failure
message more clear and disable some error's stacktrace by default
https://github.com/apache/doris/pull/39255 fix random function coredump
https://github.com/apache/doris/pull/39324 fix function corr
inconsistency with doc
https://github.com/apache/doris/pull/39449 check auto partitoin nullity
when creating partition
https://github.com/apache/doris/pull/39695 make
DynamicPartitionScheduler immediately know interval's change
https://github.com/apache/doris/pull/39754 Add some partition expr check
on creating table
 2024-08-24 17:26:42 +08:00
Jerry Hu
8cf6c6a2b5 [fix](agg function) incorrect result of map agg(#39743) (#39854) 
## Proposed changes

pick #39743
 2024-08-24 09:19:52 +08:00
TengJianPing
ba7baa7e6b [fix](window_funnel) fix upgrading problem caused by behaviour change of window_funnel (#39766) 
## Proposed changes

Issue Number: close #xxx

For the latest published 2.1 version `2.1.5`:
```
max_be_exec_version=4;
AGG_FUNCTION_NEW=2;
```
and `branch-2.1`:
```
max_be_exec_version=5;
AGG_FUNCTION_NEW=2;
```
It will cause problem when upgrading.
This PR fix the problem, set `AGG_FUNCTION_NEW` to `5`.
 2024-08-22 17:26:51 +08:00
zhangstar333
1e30d4ebaf Revert "[Bug](compatibility) fix window funnel function coredump when upgrade" (#39681) 
Reverts apache/doris#39646
 2024-08-21 14:47:27 +08:00
zhangstar333
75eded04d7 [Bug](compatibility) fix window funnel function coredump when upgrade (#39646) 
## Proposed changes
this PR https://github.com/apache/doris/pull/39270 have change the agg
of window funnel
and max_be_exec_version is update to 5, in order to compatibility of the
agg function when upgrade.

<!--Describe your changes.-->
 2024-08-21 08:46:50 +08:00
TengJianPing
021678c7c3 [fix](window_funnel) fix wrong result of window_funnel #38954 (#39270) 
## Proposed changes

BP #38954
 2024-08-16 09:59:31 +08:00
Mryange
b26af32934 [fix](function) fix error return type in corr(float32,float32) (#39251) (#39350) 
https://github.com/apache/doris/pull/39251
```
mysql [test11]>select corr(cast(x as float),cast(y as float)) from test_corr;
ERROR 1105 (HY000): errCode = 2, detailMessage = (127.0.0.1)[INTERNAL_ERROR]column_type not match data_types in agg node, column_type=Nullable(Float64), data_types=Nullable(Float32),column name=

```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-14 18:47:14 +08:00
Mryange
efdd75f286 [fix](function) stddev with DecimalV2 type will result in an error (#… (#39072) 
…38731)

https://github.com/apache/doris/pull/38731
The stddev function has a separate implementation for the DecimalV2
type, but there are issues with the implementation. Given that there is
almost no existing data for DecimalV2, it will be removed here. For be,
upgrading to this situation will result in an error directly.
```
SELECT STDDEV(data) FROM DECIMALV2_10_0_DATA;
ERROR 1105 (HY000): errCode = 2, detailMessage = (127.0.0.1)[INTERNAL_ERROR]Agg Function stddev(decimal(10,0)) is not implemented
```
After removing DecimalV2, parameters of type DecimalV2 will be converted
to double for calculations.

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-08 17:53:17 +08:00
zhiqiang
c7b59b38ef [fix](hist) Fix unstable result of aggregrate function hist #38608 (#38893) 
cherry pick from #38608
 2024-08-06 08:52:03 +08:00
Pxl
86ef0069ea [Feature](function) support group concat with distinct and order by (#38851) 
pick from #38744 and #38776
 2024-08-05 15:44:51 +08:00
Pxl
d7e84b7ee3 [Enchancement](bitmap) optimize bitmap deserialize and remove some unused code (#37623) 
## Proposed changes
pick from #35789
 2024-07-16 11:21:54 +08:00
Mryange
e64f2997e9 [fix](function) fix core when input not null array in foreach functio… (#37798) 
## Proposed changes
https://github.com/apache/doris/pull/37349
error code
```C++
return creator_without_type::create<AggregateFunctionForEach>(transform_arguments, true,
                                                                      nested_function);
```
"transform_arguments is an internal type of array. All internal types of
the array are null, so an array that is not null was mistakenly treated
as a null array."

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 10:57:11 +08:00
HappenLee
90a4dd09f3 [Fix](func) CoreDump and Result Error in percentile function (#36647) 
cherry pick #36643
 2024-06-21 23:42:45 +08:00
slothever
c794ea18c8 [fix](multi-catalog)put java udf to custom lib (#35984) 
bp #34990
 2024-06-06 22:54:24 +08:00
zhangstar333
596fb6f327 [improve](ub) fix some runtime error of ubsan when downcast (#35343) 
those code could work well, but it will be report some runtime error under UBSAN,
so refactor it to let's ubsan could running happy.
 2024-05-27 15:27:43 +08:00
yiguolei
8fdfbcb3c4 Revert "[Opt](func) opt the percentile func performance (#34373) (#34416)" 
This reverts commit 509ae425e416b4779ae94eab9c2b21f9850e03c3.
 2024-05-07 07:23:48 +08:00
HappenLee
509ae425e4 [Opt](func) opt the percentile func performance (#34373) (#34416) 2024-05-06 20:10:35 +08:00
Gabriel
970d0c80df [Improvement](agg) Improve count distinct distribute keys (#33167) 2024-04-27 02:29:33 +08:00
camby
10e098845d [fix](compile) fix two compile errors on MacOS (#33834) (#34149) 2024-04-26 17:02:44 +08:00
yiguolei
47ded2c6a0 Revert "[fix](compile) fix two compile errors on MacOS (#33834) (#34005)" 
This reverts commit 743fb62a2c42cc5cc662583c235f7336d5e6ddef.
 2024-04-26 00:55:21 +08:00
camby
743fb62a2c [fix](compile) fix two compile errors on MacOS (#33834) (#34005) 2024-04-25 19:39:35 +08:00
zclllyybb
25358564ca [Fix](compile) Fix gcc compile on master (#33864) 
This is imported by #33511. wrongly used

ColumnStr<T> ();

which violate C++20 standard(see https://wg21.cmeerw.net/cwg/issue2237) but still supported by clang up until now(see llvm/llvm-project#58112)
 2024-04-19 23:41:37 +08:00
HappenLee
1300317723 [Exec](join) Support column string64 to avoid join failed in string size overflow the uint32 (#33511) (#33850) 2024-04-18 19:43:08 +08:00
Chester
3096150d1b [feature](agg) support aggregate function group_array_intersect (#33265) 2024-04-17 23:42:13 +08:00
Pxl
8fd6d4c41b [Chore](build) add -Wconversion and remove some unused code (#33127) 
add -Wconversion and remove some unused code
 2024-04-10 15:26:08 +08:00
Jensen
bb8bc75af4 [feature](agg) add aggregate function sum0 (#32541) 2024-04-10 11:34:29 +08:00
HappenLee
e3bd2311b1 [Performance](exec) replace SipHash in function by XXHash (#32919) 2024-04-10 11:34:29 +08:00
HappenLee
0a447273f0 [Bug](pipelineX) fix memleak in stream agg (#32862) 
* [Bug](pipelineX) fix memleak in stream agg

* change by review
 2024-03-27 09:21:21 +08:00
zhangstar333
a55b5ea9ca [bug](udaf) fix memory leak in the java udaf (#32630) 
fix memory leak in the java udaf
 2024-03-24 08:06:13 +08:00
amory
2cb652a7fa [FIX](compile)fix for gcc compile (#32508) 
* fix for gcc compile
 2024-03-22 08:52:16 +08:00
Mryange
b92a764665 [feature](function) Support for aggregate function foreach combiner for some error function (#31913) 
Support for aggregate function foreach combiner for some error function
 2024-03-21 14:07:49 +08:00
amory
7a0b591b8f [FIX](array_agg) fix array agg with other agg function (#32387) 
fix array agg with other agg function
 2024-03-21 14:07:23 +08:00
Jerry Hu
5ceccb5ba5 [fix](compatibility) should enable windown funnel mode from 2.0 (#32284) 2024-03-16 20:56:16 +08:00
zy-kkk
bbdce3eb5e [fix](jdbc catalog) fix jdbc-connector coredump as get env return nullptr (#32217) 2024-03-14 16:05:08 +08:00
zclllyybb
847ec368be [Fix](smooth-upgrade) Fix incompatibility when upgrade from 2.0 to 2.1 (#32220) 2024-03-14 11:23:05 +08:00
Jerry Hu
93d298d34a [fix](agg) wrong result of two or more map_agg functions in query (#31928) 2024-03-09 19:45:03 +08:00
Mryange
4f174c4fb9 [feature](function) Support for aggregate function foreach combiner (#31526) 2024-03-06 13:08:30 +08:00
vhwzIs
d70776af55 [feature](agg-func) support covar and covar_samp function (#30983) 2024-02-18 11:50:17 +08:00
nanfeng
e68019c10a [Function](Exec) Support windows function cume_dist (#30997) 2024-02-16 10:16:40 +08:00
yangshijie
40e1326bc9 [feature](window-func) support percent_rank window function (#30926) 2024-02-16 10:12:25 +08:00
nanfeng
2bb477bae7 [feature](agg-func) support corr function #30822 2024-02-16 10:12:24 +08:00
yangshijie
221308f78a [fix](datatype) fix bugs for IPv4/v6 datatype and add some basic regression test cases (#30261) 2024-01-31 23:53:39 +08:00
Pxl
3cf95d0fdf [Improvement](execute) optimize for ColumnNullable's serialize_vec/deserialize_vec (#28788) 
optimize for ColumnNullable's serialize_vec/deserialize_vec
 2024-01-12 11:59:52 +08:00
HappenLee
463a7ab212 [Performance](exec) opt the exchange performance (#29579) 2024-01-12 11:46:29 +08:00
TengJianPing
a525d5c5a3 [refactor](decimal) change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion (#29265) 
change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion
 2023-12-29 10:11:44 +08:00
Jerry Hu
5739167142 [feature](window_function) support to secondary argument to ignore null values in first_value/last_value (#27623) 2023-11-30 09:56:43 +08:00
ShowCode
f565f60bc3 [refactor](standard)BE:Initialize pointer variables in the class to nullptr by default (#27587) 2023-11-28 13:02:30 +08:00
Jerry Hu
b42828cf69 [fix](window_function) min/max/sum/avg should be always nullable (#27104) 
Co-authored-by: starocean999 <40539150+starocean999@users.noreply.github.com>
 2023-11-18 18:41:42 +08:00
TengJianPing
00896d8954 [fix](agg) fix coredump of multi distinct of decimal128I (#27014) 
* [fix](agg) fix coredump of multi distinct of decimal128

* fix
 2023-11-15 17:37:20 +08:00