f9df3bae61
[Enhancement](functions) change some nullable mode and clear some smooth upgrade ( #25334 )
2023-10-16 19:50:17 +08:00
9649e09aaa
[feature](function) support bitmap type in min/max_by agg function ( #25430 )
...
support bitmap type in min/max_by agg function
2023-10-16 11:05:32 +08:00
08f305dd79
[chore](build) Fix compilation errors reported by GCC-13 ( #25439 )
...
1. Fix lots of compilation errors reported by GCC-13.
2. Fix the workflow BE UT (macOS).
2023-10-15 07:57:36 -05:00
26f50f4f0f
fix heap-use-after-free on map_agg ( #25380 )
...
fix heap-use-after-free on map_agg
2023-10-13 00:19:25 +08:00
1a0344df16
[Improvement](hash) refactor of hash map context ( #24966 )
...
refactor of hash map context
2023-10-12 18:10:21 +08:00
7ca63665b4
[fix](agg) garbled characters in result of map_agg ( #25318 )
2023-10-12 10:10:55 +08:00
a9d12f7b82
[Debug](float) Add clang debug tune float accuracy ( #25041 )
2023-10-07 09:34:50 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
7fd72351f9
[fix](agg) windown_funnel compatibility issue with multi backends ( #24385 )
2023-09-15 17:22:47 +08:00
b4d446055a
[fix](agg) need to call 'set_version' in nested functions ( #24381 )
...
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-15 17:20:20 +08:00
539a7c2975
[fix](agg) Add the unimplemented functions in 'AggregateFunctionCountNotNullUnaryOld' ( #24310 )
...
Similar to #24211
2023-09-14 09:19:02 +08:00
3f7a612e76
[fix](agg) Add the unimplemented functions in AggregateFunctionOldSum. ( #24211 )
2023-09-12 18:21:33 +08:00
0143ae8266
[fix]Add logging before _builtin_unreachable() ( #24101 )
...
Co-authored-by: 宋光璠 <songguangfan@sf.com >
2023-09-09 00:30:11 +08:00
45dfbeb8b3
[feature](agg) add the aggregation function 'array_agg' #23474
...
This function requires one arguments just as ARRAY_AGG(col) and col means the column whose values you want to aggregate.
This function Aggregates the values including NULL in a column into an array and returns a value of the ARRAY data type.
2023-09-07 10:21:55 +08:00
a96adc01aa
[Chore](function) refactor of quantile_state ( #23862 )
...
refactor of quantile_state
2023-09-06 15:39:19 +08:00
68aa4867b0
[fix](map_agg) lost scale information for decimal type ( #23776 )
2023-09-02 08:03:33 +08:00
62c075bf7e
[improvement](Block) Replace Block(const PBlock&) with deserialize because it has heavy operations in ctor ( #23672 )
2023-08-31 14:44:17 +08:00
c05319b8eb
[fix](agg) incorrect result of bitmap_agg and bitmap_union ( #23558 )
2023-08-28 14:22:19 +08:00
ab7b45a9e2
[Bug](map) support replicate for column map and remove some unused code #23356
2023-08-23 15:06:04 +08:00
8ed4045df9
[Chore](primitive-type) remove VecPrimitiveTypeTraits ( #22842 )
2023-08-23 08:37:40 +08:00
d4694167a8
[Enhancement](chore) Some Status relevant enhancement ( #23072 )
2023-08-21 14:14:38 +08:00
0967d7ec04
[improvement](agg) Do not serialize bitmap to string ( #23172 )
2023-08-21 10:10:15 +08:00
a11e0e3bc4
[Bug](agg) fix QUANTILE_UNION many problems ( #23181 )
...
fix QUANTILE_UNION many problems
2023-08-21 10:04:27 +08:00
477961dc21
[Chore](agg) refactor of hash map ( #22958 )
...
refactor of hash map
2023-08-18 17:59:30 +08:00
57568ba472
[fix](be)shouldn't use arena to alloc memory for SingleValueDataString ( #23075 )
...
* [fix](be)shouldn't use arena to alloc memory for SingleValueDataString
* format code
2023-08-17 22:18:09 +08:00
c5c984b79b
[refactor](bitmap) using template to reduce duplicate code ( #23060 )
...
* [refactor](bitmap) support for batch value insertion
* fix values was not filled for int8 and int16
2023-08-17 18:14:29 +08:00
9b42093742
[feature](agg) Make 'map_agg' support array type as value ( #22945 )
2023-08-15 14:44:50 +08:00
b5ea3454a6
[Bug](aggregation)fix for map_agg when columns[1] is nullable ( #22932 )
...
In the map_agg handler function, added the judgment on columns[1]->is_nullable()
2023-08-15 11:26:03 +08:00
57fb9799b5
[feature](agg) add aggregation function 'bitmap_agg' ( #22768 )
...
This function can be used to replace bitmap_union(to_bitmap(expr))， because bitmap_union(to_bitmap(expr)) need create many many small bitmaps firstly and then merge them into a single bitmap.
bitmap_agg will convert the column value into a bitmap directly. Its performance is better than bitmap_union(to_bitmap(expr)) . In our test , there is about 30% improvement.
2023-08-10 12:18:25 +08:00
768088c95e
[refactor](udaf) refactor call udaf function and support map type in return ( #22508 )
2023-08-09 22:44:07 +08:00
2019bb3870
[fix](bitmap) fix wrong result of bitmap intersect functions ( #22735 )
...
* [fix](bitmap) fix wrong result of bitmap intersect functions
* fix test case
2023-08-09 18:31:24 +08:00
1a8a1e5b16
[Feature](count_by_enum) support count_by_enum function ( #22071 )
...
count_by_enum(expr1, expr2, ... , exprN);
Treats the data in a column as an enumeration and counts the number of values in each enumeration. Returns the number of enumerated values for each column, and the number of non-null values versus the number of null values.
2023-08-06 16:05:14 +08:00
9d3f1dcf44
[improvement](vectorized) Deserialized elements of count distinct aggregation directly inserted into target hashset ( #21888 )
...
The original logic is to first deserialize the ColumnString into a HashSet (insert the deserialized elements into the hashset), and then traverse all the HashSet elements into the target HashSet during the merge phase.
After optimization, when deserializing, elements are directly inserted into the target HashSet, thereby reducing unnecessary hashset insert overhead.
In one of our internal query tests, 30 hashsets were merged in second phase aggregation(the average cardinality is 1,400,000), and the cardinality after merging is 42,000,000. After optimization, the MergeTime dropped from 5s965ms to 3s375ms.
2023-08-02 21:19:56 +08:00
ddd90855a9
[vectorized](udaf) java udaf support with map type ( #22397 )
...
[vectorized](udaf) java udaf support with map type (#22397 )
* test
* remove some unused
* update
* add case
2023-08-02 15:03:44 +08:00
f5e3cd2737
[Improvement](aggregation) optimization for aggregation hash_table_lazy_emplace ( #22327 )
...
optimization for aggregation hash_table_lazy_emplace
2023-08-02 11:50:21 +08:00
a371e1d4c5
[fix](window_funnel_function) fix upgrade compatibility due to the added field in WindowFunnelState ( #22416 )
2023-08-01 12:08:55 +08:00
b41fcbb783
[feature](agg) add the aggregation function 'mag_agg' ( #22043 )
...
New aggregation function: map_agg.
This function requires two arguments: a key and a value, which are used to build a map.
select map_agg(column1, column2) from t group by column3;
2023-07-25 11:21:03 +08:00
732e0d14ff
[Enhancement](window-funnel)add different modes for window_funnel() function ( #20563 )
2023-07-21 13:57:27 +08:00
c07e2ada43
[imporve](udaf) refactor java-udaf executor by using for loop ( #21713 )
...
refactor java-udaf executor by using for loop
2023-07-14 11:37:19 +08:00
81ee4d7402
[performance](group_concat) avoid extra copy in group_concat ( #21432 )
...
avoid extra copy in group_concat
2023-07-04 20:21:44 +08:00
45f1909bc3
[Bug](lateral-view) make lateral view function's nullable mode work ( #21242 )
...
make lateral view function's nullable mode work
2023-06-29 10:50:07 +08:00
b1e973b721
[Improve](func)support array to window-func first-last-value arg type ( #21201 )
...
* support array to windown-func first-last-value arg type
* add regress test for first-last-value of array type
* update
* format be:
2023-06-28 10:02:00 +08:00
5f0bb49d46
[Feature](materialized-view) support create mv contain aggstate column ( #20812 )
...
support create mv contain aggstate column
2023-06-21 13:06:52 +08:00
0a59580aa4
[Enhancement](function) fix compatibility issues of sum/count during upgrade process ( #20890 )
...
in order to solve agg of sum/count is not compatibility during the upgrade process.
in PR [refactor](agg_state) refactor agg_state type to support fixed length object type #20370 have changed the serialize type and serialize column of sum/count
before is ColumnVector, now sum/count change to use ColumnFixedLengthObject
so during the upgrade process, will be not compatible if exist Old BE and Newer BE
2023-06-17 12:51:01 +08:00
2151f5d04d
[fix](bitmap) fix bug: incorrect orthogonal bitmap result in some cases ( #20819 ) ( #20822 )
...
Issue Number: close #20819
If there is only one aggregation (update finalize) phase, result field will not be updated.
This pr is aim to resolve it.
2023-06-15 14:05:24 +08:00
feb21fc9e9
[fix](group_concat) use default seperator ',' instead of ', ' for group_concat, to be consistant with mysql ( #20741 )
2023-06-13 17:20:29 +08:00
d03bd73795
[bug](udaf) fix java-udaf can't exectue add function ( #20554 )
...
In some case of agg function, maybe running as streaming agg firstly,
this will call the add function when serialize, so need implement add function also.
2023-06-09 08:44:12 +08:00
35a2be1074
[refactor](agg_state) refactor agg_state type to support fixed length object type ( #20370 )
...
before the agg_state type only support with datatype string,
But with some agg functions, eg: avg,sum,mix...
those functions need serialize type is fixed length object type
2023-06-07 10:05:00 +08:00
7dc7ed97eb
[Chore](build) remove some unused code and remove some wno ( #20326 )
...
remove some unused code about spinlock
remove some wno and fix warning
remove varadic macro usage
2023-06-05 10:48:07 +08:00
bbb3af6ce6
[Feature](agg_state) support agg_state combinators ( #19969 )
...
support agg_state combinators state/merge/union
2023-05-29 13:07:29 +08:00
