database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
13,080 Commits 1 Branch 0 Tags
b31acee856cec52e45eb8a9550efb2fd39bf4cfc
Commit Graph

81 Commits

Author SHA1 Message Date
amory
6c5072ffc5 [FIX](array-func) fix array index func with decimal (#23399) 
fix array index func with decimal
in old analyzer when sql with array_position or array_contains with decimal , may loss precision to which will make result wrong
 2023-08-24 17:58:20 +08:00
camby
22e373a799 [feature](vector-search) add 4 distance functions to support vector search (#23129) 2023-08-23 15:51:15 +08:00
morrySnow
b670dd0db7 [feature](Nereids) support array type (#22851) 
FEATURE:
1. enable array type in Nereids
2. support generice on function signature
3. support array and map type in type coercion and type check
4. add element_at and element_slice syntax in Nereids parser

REFACTOR:
1. remove AbstractDataType

BUG FIX:
1. remove FROM from nonReserved keyword list

TODO:
1. support lambda expression
2. use Nereids' way do function type coercion
3. use castIfnotSame when do implict cast on BoundFunction
4. let AnyDataType type coercion do same thing as function type coercion
5. add below array function
- array_apply
- array_concat
- array_filter
- array_sortby
- array_exists
- array_first_index
- array_last_index
- array_count
- array_shuffle shuffle
- array_pushfront
- array_pushback
- array_repeat
- array_zip
- reverse
- concat_ws
- split_by_string
- explode
- bitmap_from_array
- bitmap_to_array
- multi_search_all_positions
- multi_match_any
- tokenize
 2023-08-22 09:47:55 +08:00
amory
2d96d19030 [FIX](array-func) fix array() with decimal type (#23117) 
if we write sql with : select array(1.0,2.0,null, null,2.0)
here will pass arg type with uint8 to be which does not match array() func sign with deicmal, and make be core. so here should cast from be and make null tag to cast decimal type
 2023-08-18 12:12:50 +08:00
Jerry Hu
c1f36639fd [fix](sort) VSortedRunMerger does not return any rows with a large offset value (#22191) 2023-07-31 22:28:13 +08:00
amory
7261845b3d [FIX](complex-type)fix complex type nested col_const (#22375) 
for array/map/struct in mysql_writer unpack_if_const only unpack self column not nested , so col_const should not used in nested column.
 2023-07-31 14:53:18 +08:00
Jerry Hu
b5fa29e138 [fix](bitmap) incorrect result of function 'bitmap_from_array' (#22305) 2023-07-27 22:44:06 +08:00
amory
18beb822a3 [FIX](array-type) fix array string output with fe const expr (#21042) 
fe foldconstRule make array() function expr with const literal , and would not pass this array literal to be . but we should make fe array string output format is same with be array string output
 2023-06-21 11:52:02 +08:00
Pxl
a0d4f11667 [Bug](function) catch error state in function cast to avoid core dump (#20751) 
catch error state in function cast to avoid core dump
 2023-06-14 17:34:34 +08:00
jiawei liang
99c0592157 [Feature](array-function) Support array_pushback function #17417 (#19988) 
Implement array_pushback.

mysql> select array_pushback([1, 2], 3);
+--------------------------------+
| array_pushback(ARRAY(1, 2), 3) |
+--------------------------------+
| [1, 2, 3]                      |
+--------------------------------+
1 row in set (0.01 sec)
 2023-06-12 16:51:12 +08:00
amory
1f032a551d [Improve](array-functions) support array first function (#20397) 
add array_first(lambda, [1,2,3,null]) function for doris
 2023-06-06 12:08:46 +08:00
amory
59a0f80233 [Improve](array-function)Improve array function intersect (#20085) 
now we just support array function with 2 arrays , but intersect operator can support more than 2 arrays
 2023-06-05 10:38:48 +08:00
amory
d68f3f3b3d [Feature](array-functions)improve array functions for array_last_index (#20294) 
Now we just support array_first_index for lambda input , but no array_last_index
 2023-06-02 13:54:03 +08:00
Mryange
519f01133a [feature](decimal)support cast rounding half up and div precision increment in decimalv3. (#19811) 2023-06-01 13:09:58 +08:00
Gabriel
ff05217a1e [regression](p0) fix test for array_enumerate_uniq (#20231) 2023-05-30 22:14:19 +08:00
bobhan1
bb12a1cb49 [Enhance](array function) add support for DecimalV3 for array_enumerate_uniq() (#17724) 2023-05-30 13:09:19 +08:00
Gabriel
55ccddb62c [Conf](decimalv3) enable decimalv3 by default 2023-05-29 15:38:31 +08:00
amory
ee34b6de2d [Refact] (serde) refact mysql serde with data type (#19543) 
refact mysql output (de)serialize with data type serde , avoid accoriding switch case Primitive type writed in mysqlWriter
 2023-05-26 14:11:17 +08:00
amory
67dc68630b [Improve](complex-type)improve array/map/struct creating and function with decimalv3 (#19830) 2023-05-19 17:43:36 +08:00
Ziyu Wang
325a1d4b28 [vectorized](function) support array_count function (#18557) 
support array_count function.
array_count：Returns the number of non-zero and non-null elements in the given array.
 2023-05-16 17:00:01 +08:00
xy720
39ec8aa64c [refactor](complex-type) refactor array/map/struct literal to not invoke execute() function in prepare state (#19068) 2023-05-11 18:44:37 +08:00
herry2038
834bf2eab7 [feature](array) Add array_last lambda function (#18388) 
Add array_last lambda function
 2023-05-11 13:15:54 +08:00
brody715
20395ce501 [feature](array_function): add support for array_cum_sum function (#18231) 2023-04-27 09:57:13 +08:00
herry2038
17b59df8dd [fix](function) Array_map compared offset rows one by one (#18406) 
Array_map 's multi columns compare not only nested data rows to be equal,but also the offsets data must equal each other.
 2023-04-25 19:12:19 +08:00
zhangstar333
6b351a2818 [vectorzied](function) fix array_map function analyzed failed with order by clause (#18676) 
* [vectorzied](function) fix array_map function analyzed failed with order by clause

* add test
 2023-04-18 12:01:44 +08:00
Gabriel
5300b21db7 [Bug](DECIMALV3) report failure if a decimal value is overflow (#18336) 2023-04-17 13:18:14 +08:00
xy720
1238f6de97 [bug](array) fix be core in array_with_constant/array_repeat function when the first argument is nullable (#18404) 
fix be core in array_with_constant/array_repeat function when the first argument is nullable
 2023-04-11 19:46:41 +08:00
ZhangYu0123
0517616242 [vectorized](function) support array_repeat function to be compatible with hive syntax (#18028) 
---------

Co-authored-by: zhangyu209 <zhangyu209@meituan.com>
 2023-04-08 15:50:28 +08:00
ZhangYu0123
8b85c55117 [vectorized](function) Support array_shuffle and shuffle function. (#18116) 
---------

Co-authored-by: zhangyu209 <zhangyu209@meituan.com>
 2023-04-04 08:53:13 +08:00
zhangstar333
94e3472050 [bug](function) fix count equal function return incorrect value (#18200) 
fix count equal function return incorrect value
 2023-04-03 11:20:36 +08:00
gitccl
20b3bdb000 [vectorized](function) support array_first_index function (#18175) 
mysql> select array_first_index(x->x+1>3, [2, 3, 4]);
+-------------------------------------------------------------------+
| array_first_index(array_map([x] -> x(0) + 1 > 3, ARRAY(2, 3, 4))) |
+-------------------------------------------------------------------+
|                                                                 2 |
+-------------------------------------------------------------------+

mysql> select array_first_index(x -> x is null, [null, 1, 2]);
+----------------------------------------------------------------------+
| array_first_index(array_map([x] -> x(0) IS NULL, ARRAY(NULL, 1, 2))) |
+----------------------------------------------------------------------+
|                                                                    1 |
+----------------------------------------------------------------------+

mysql> select array_first_index(x->power(x,2)>10, [1, 2, 3, 4]);
+---------------------------------------------------------------------------------+
| array_first_index(array_map([x] -> power(x(0), 2.0) > 10.0, ARRAY(1, 2, 3, 4))) |
+---------------------------------------------------------------------------------+
|                                                                               4 |
+---------------------------------------------------------------------------------+
 2023-03-31 12:51:29 +08:00
zhangstar333
1b2aaab2f2 [vectorized](bug) fix some case in enable fold constant (#17997) 
fix some case in enable fold constant
 2023-03-31 11:41:31 +08:00
zhangstar333
525f15dddf [vectorized](function) support array_sortby function (#18071) 2023-03-30 11:07:49 +08:00
ZhangYu0123
115e52c16c [Opt](array) optimize_array_sort (#18123) 2023-03-27 22:01:24 +08:00
ZhangYu0123
360d3050bc [Feature](array-function) Support array_reverse_sort function (#17754) 
Co-authored-by: zhangyu209 <zhangyu209@meituan.com>
 2023-03-25 21:58:11 +08:00
Gabriel
5445a86570 [Bug](array_product) Fix array_product for ARRAY<DECIMAL> (#18014) 2023-03-23 20:29:50 +08:00
ZhangYu0123
089a91ecd5 [vectorized](function) support array_exists lambda function (#17931) 
Co-authored-by: zhangyu209 <zhangyu209@meituan.com>
 2023-03-23 11:11:39 +08:00
Mellorsssss
4193884a32 [feature](array_zip) Support array_zip function (#17696) 2023-03-21 18:44:30 +08:00
zhangstar333
dc284b62d9 [vectorized](function) support array_filter function (#17832) 2023-03-20 23:18:10 +08:00
ZhangYu0123
a53d46e317 [Fix](array function) fix array_pushfront function with DecimalV3 #17760 
Support array_pushfront function with DecimalV3

Issue Number: close #xxx
 2023-03-16 09:03:52 +08:00
zhangstar333
85080ee3c3 [vectorized](function) support array_map function (#17581) 2023-03-15 10:51:29 +08:00
gitccl
c302fa2564 [Feature](array-function) Support array_pushfront function (#17584) 2023-03-13 14:26:02 +08:00
abmdocrt
55c42da511 [Feature](array) Support array<decimalv3> data type (#16640) 2023-03-13 10:48:13 +08:00
bobhan1
e1bf9411de [feature](array function) add support for array_enumerate_uniq (#17541) 
add support for array_enumerate_uniq()
 2023-03-10 10:20:49 +08:00
lihangyu
368e6a4f9c [Bug](array filter) Fix bug due to ColumnArray::filter_generic invalid inplace size_at after set_end_ptr (#17554) 
We should make a new PodArray to add items instead of do it inplace
 2023-03-09 10:59:29 +08:00
bobhan1
4ea0d6c5fa [feature](array_function) add support for array_popfront (#17416) 2023-03-08 13:57:38 +08:00
gitccl
b1d65f855d [Feature](array-function) Support array_concat function (#17436) 2023-03-08 13:57:16 +08:00
zhangstar333
06468ba627 [vectorized](bug) fix array constructor function change origin column from block (#17296) 2023-03-07 16:42:23 +08:00
lihangyu
526a66e9fb [Function](array-type) support array_apply (#17020) 
Filter array to match specific binary condition

```
mysql> select array_apply([1000000, 1000001, 1000002], '=', 1000002);
+-------------------------------------------------------------+
| array_apply(ARRAY(1000000, 1000001, 1000002), '=', 1000002) |
+-------------------------------------------------------------+
| [1000002]                                                   |
+-------------------------------------------------------------+
```
 2023-02-23 17:38:16 +08:00
abmdocrt
41947c73eb [Feature](array-function) Support array functions for nested type datev2 and datetimev2 (#16382) 2023-02-08 12:51:07 +08:00