database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
16,163 Commits 1 Branch 0 Tags
cbcb81f3813934e72f4fe949f3d026429a216821
Commit Graph

221 Commits

Author SHA1 Message Date
TengJianPing
a525d5c5a3 [refactor](decimal) change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion (#29265) 
change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion
 2023-12-29 10:11:44 +08:00
Jerry Hu
5739167142 [feature](window_function) support to secondary argument to ignore null values in first_value/last_value (#27623) 2023-11-30 09:56:43 +08:00
ShowCode
f565f60bc3 [refactor](standard)BE:Initialize pointer variables in the class to nullptr by default (#27587) 2023-11-28 13:02:30 +08:00
Jerry Hu
b42828cf69 [fix](window_function) min/max/sum/avg should be always nullable (#27104) 
Co-authored-by: starocean999 <40539150+starocean999@users.noreply.github.com>
 2023-11-18 18:41:42 +08:00
TengJianPing
00896d8954 [fix](agg) fix coredump of multi distinct of decimal128I (#27014) 
* [fix](agg) fix coredump of multi distinct of decimal128

* fix
 2023-11-15 17:37:20 +08:00
zhiqiang
a5565f68b2 [Refactor](opentelemetry) Remove opentelemetry (#26605) 2023-11-09 18:05:34 +08:00
zhangstar333
74e452f19c [bug](bitmap) fix bitmap value copy operator not call reset (#26451) 
when a empty bitmap assign to other bitmap
the other bitmap should reset self firstly, and then set empty type.
 2023-11-09 10:05:09 +08:00
lihangyu
44b51bf0b9 [Feature](Variant) support variant load (#26572) 2023-11-08 00:37:57 -06:00
Pxl
3cdbb6e637 [Bug](materialized-view) fix some bugs on create mv with percentile_approx (#26528) 
1. percentile_approx have wrong symbol
2. fnCall.getParams() get obsolete childrens
 2023-11-08 10:09:37 +08:00
zhangstar333
509723c1d6 [bug](bitmap) fix bitmap value not clear get wrong data (#26321) 2023-11-03 10:25:13 +08:00
zhangstar333
8f15f9adf6 [test](case) add test case to improve code coverage (#25516) 
[test](case) add test case to improve code coverage (#25516)
 2023-11-01 12:51:12 +08:00
plat1ko
6dd60c6ebb [Enhance](BE) Add -Wshadow-field compile option to avoid unexpected shadowing behavior (#25698) 
* Fix `Tablet::_meta_lock` shadows member inherited from `BaseTablet`

* Add -Wshadow-field compile option to avoid unexpected shadowing behavior
 2023-10-26 10:00:28 +08:00
TengJianPing
693982fd1a [feature](decimal) support decimal256 (#25386) 2023-10-25 15:47:51 +08:00
Pxl
6714966df2 [Chore](function) remove bit_cast/bit_helper (#25700) 
remove bit_cast/bit_helper
 2023-10-23 11:54:14 +08:00
Pxl
642c149e6a remove datetime_value and move vecdatetime_value to doris namespace (#25695) 
remove datetime_value and move vecdatetime_value to doris namespace
 2023-10-20 22:08:17 +08:00
Ashin Gau
a2ceea5951 [refactor](jni) unified jni framework for java udaf (#25591) 
Follow https://github.com/apache/doris/pull/25302, and use the unified jni framework to refactor java udaf.
This PR has removed the old interfaces to run java udf/udaf. Thanks to the ease of use of the new framework, the core code for modifying UDAF does not exceed 100 lines, and the logic is similar to that of UDF.
 2023-10-20 16:13:40 +08:00
morrySnow
26f8c7e352 [fix](Nereids) collect_list and collect_set should always not null (#25592) 2023-10-20 01:54:00 -05:00
zclllyybb
f9df3bae61 [Enhancement](functions) change some nullable mode and clear some smooth upgrade (#25334) 2023-10-16 19:50:17 +08:00
zhangstar333
9649e09aaa [feature](function) support bitmap type in min/max_by agg function (#25430) 
support bitmap type in min/max_by agg function
 2023-10-16 11:05:32 +08:00
Adonis Ling
08f305dd79 [chore](build) Fix compilation errors reported by GCC-13 (#25439) 
1. Fix lots of compilation errors reported by GCC-13.
2. Fix the workflow BE UT (macOS).
 2023-10-15 07:57:36 -05:00
Pxl
26f50f4f0f fix heap-use-after-free on map_agg (#25380) 
fix heap-use-after-free on map_agg
 2023-10-13 00:19:25 +08:00
Pxl
1a0344df16 [Improvement](hash) refactor of hash map context (#24966) 
refactor of hash map context
 2023-10-12 18:10:21 +08:00
Jerry Hu
7ca63665b4 [fix](agg) garbled characters in result of map_agg (#25318) 2023-10-12 10:10:55 +08:00
HappenLee
a9d12f7b82 [Debug](float) Add clang debug tune float accuracy (#25041) 2023-10-07 09:34:50 +08:00
bobhan1
642e5cdb69 [Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly (#23395) 2023-09-29 22:38:52 +08:00
Jerry Hu
7fd72351f9 [fix](agg) windown_funnel compatibility issue with multi backends (#24385) 2023-09-15 17:22:47 +08:00
Jerry Hu
b4d446055a [fix](agg) need to call 'set_version' in nested functions (#24381) 
Co-authored-by: yiguolei <676222867@qq.com>
 2023-09-15 17:20:20 +08:00
Jerry Hu
539a7c2975 [fix](agg) Add the unimplemented functions in 'AggregateFunctionCountNotNullUnaryOld' (#24310) 
Similar to #24211
 2023-09-14 09:19:02 +08:00
Jerry Hu
3f7a612e76 [fix](agg) Add the unimplemented functions in AggregateFunctionOldSum. (#24211) 2023-09-12 18:21:33 +08:00
神技圈子
0143ae8266 [fix]Add logging before _builtin_unreachable() (#24101) 
Co-authored-by: 宋光璠 <songguangfan@sf.com>
 2023-09-09 00:30:11 +08:00
xy
45dfbeb8b3 [feature](agg) add the aggregation function 'array_agg' #23474 
This function requires one arguments just as ARRAY_AGG(col) and col means the column whose values you want to aggregate.
This function Aggregates the values including NULL in a column into an array and returns a value of the ARRAY data type.
 2023-09-07 10:21:55 +08:00
Pxl
a96adc01aa [Chore](function) refactor of quantile_state (#23862) 
refactor of quantile_state
 2023-09-06 15:39:19 +08:00
Jerry Hu
68aa4867b0 [fix](map_agg) lost scale information for decimal type (#23776) 2023-09-02 08:03:33 +08:00
TengJianPing
62c075bf7e [improvement](Block) Replace Block(const PBlock&) with deserialize because it has heavy operations in ctor (#23672) 2023-08-31 14:44:17 +08:00
Jerry Hu
c05319b8eb [fix](agg) incorrect result of bitmap_agg and bitmap_union (#23558) 2023-08-28 14:22:19 +08:00
Pxl
ab7b45a9e2 [Bug](map) support replicate for column map and remove some unused code #23356 2023-08-23 15:06:04 +08:00
Pxl
8ed4045df9 [Chore](primitive-type) remove VecPrimitiveTypeTraits (#22842) 2023-08-23 08:37:40 +08:00
plat1ko
d4694167a8 [Enhancement](chore) Some Status relevant enhancement (#23072) 2023-08-21 14:14:38 +08:00
Jerry Hu
0967d7ec04 [improvement](agg) Do not serialize bitmap to string (#23172) 2023-08-21 10:10:15 +08:00
Pxl
a11e0e3bc4 [Bug](agg) fix QUANTILE_UNION many problems (#23181) 
fix QUANTILE_UNION many problems
 2023-08-21 10:04:27 +08:00
Pxl
477961dc21 [Chore](agg) refactor of hash map (#22958) 
refactor of hash map
 2023-08-18 17:59:30 +08:00
starocean999
57568ba472 [fix](be)shouldn't use arena to alloc memory for SingleValueDataString (#23075) 
* [fix](be)shouldn't use arena to alloc memory for SingleValueDataString

* format code
 2023-08-17 22:18:09 +08:00
Jerry Hu
c5c984b79b [refactor](bitmap) using template to reduce duplicate code (#23060) 
* [refactor](bitmap) support for batch value insertion

* fix values was not filled for int8 and int16
 2023-08-17 18:14:29 +08:00
Jerry Hu
9b42093742 [feature](agg) Make 'map_agg' support array type as value (#22945) 2023-08-15 14:44:50 +08:00
xy
b5ea3454a6 [Bug](aggregation)fix for map_agg when columns[1] is nullable (#22932) 
In the map_agg handler function, added the judgment on columns[1]->is_nullable()
 2023-08-15 11:26:03 +08:00
Jerry Hu
57fb9799b5 [feature](agg) add aggregation function 'bitmap_agg' (#22768) 
This function can be used to replace bitmap_union(to_bitmap(expr))， because bitmap_union(to_bitmap(expr)) need create many many small bitmaps firstly and then merge them into a single bitmap.
bitmap_agg will convert the column value into a bitmap directly. Its performance is better than bitmap_union(to_bitmap(expr)) . In our test , there is about 30% improvement.
 2023-08-10 12:18:25 +08:00
Mryange
768088c95e [refactor](udaf) refactor call udaf function and support map type in return (#22508) 2023-08-09 22:44:07 +08:00
TengJianPing
2019bb3870 [fix](bitmap) fix wrong result of bitmap intersect functions (#22735) 
* [fix](bitmap) fix wrong result of bitmap intersect functions

* fix test case
 2023-08-09 18:31:24 +08:00
czzmmc
1a8a1e5b16 [Feature](count_by_enum) support count_by_enum function (#22071) 
count_by_enum(expr1, expr2, ... , exprN);

Treats the data in a column as an enumeration and counts the number of values in each enumeration. Returns the number of enumerated values for each column, and the number of non-null values versus the number of null values.
 2023-08-06 16:05:14 +08:00
ZenoYang
9d3f1dcf44 [improvement](vectorized) Deserialized elements of count distinct aggregation directly inserted into target hashset (#21888) 
The original logic is to first deserialize the ColumnString into a HashSet (insert the deserialized elements into the hashset), and then traverse all the HashSet elements into the target HashSet during the merge phase.
After optimization, when deserializing, elements are directly inserted into the target HashSet, thereby reducing unnecessary hashset insert overhead.

In one of our internal query tests, 30 hashsets were merged in second phase aggregation(the average cardinality is 1,400,000), and the cardinality after merging is 42,000,000. After optimization, the MergeTime dropped from 5s965ms to 3s375ms.
 2023-08-02 21:19:56 +08:00