de4315c1c5
[feature](function) support initcap string function ( #13193 )
...
support `initcap` string function
2022-10-13 21:31:44 +08:00
71d2d61d33
[chore](build release) remove doris home and user info from doris_be --version output ( #13344 )
...
There will be personal info in doris_be --version, like this:
doris-0.0.0-trunk RELEASE (build git://hk-dev01/mnt/disk2/ygl/code/github/apache-doris/be/../@8b7d928af26318f71098f1be2ab03ed83b1955fd)
Built on Wed, 12 Oct 2022 18:36:44 CST by ygl@hk-dev01
Since we always not need this info, commit id is enough, I remove these redundant info, the new result is like this:
doris-0.0.0-trunk RELEASE (build git://hk-dev01@8b7d928)
Built on Thu, 13 Oct 2022 15:03:01 CST by hk-dev01
2022-10-13 18:24:04 +08:00
1bd14f1d82
[feature-wip](jsonb) jsonb parse function and load ( #13129 )
...
add function to parse json string to jsonb format and use it to support stream load.
2022-10-12 13:56:37 +08:00
16999ef02d
[Vectorized][Function] support date_trunc and countequal function ( #13039 )
2022-10-12 10:01:09 +08:00
e20921fa87
[function](datev2) Complements for datev2 functions ( #13276 )
2022-10-11 15:52:00 +08:00
3294b18674
[Improvement](datev2) fix some compatible problems for datev2 ( #13079 )
2022-09-30 13:56:01 +08:00
3f99dd5c4b
[function](bitmap) support bitmap_hash64 ( #12992 )
2022-09-27 12:16:02 +08:00
1bb42a7bc0
[function](hash) add support of murmur_hash3_64 ( #12923 )
2022-09-26 14:23:37 +08:00
70ab9cb43e
[feature](http) refactor version info and add new http api for get version info ( #12513 )
...
Refactor version info and add new http api for get version info
2022-09-22 10:53:04 +08:00
0a95ebf602
[feature](Nereids) Add scalar function code generator and some function trait ( #12671 )
...
This pr did these things:
1. Change the nullable mode of 'from_unixtime' and 'parse_url' from DEPEND_ON_ARGUMENT to ALWAYS_NULLABLE, which nullable configuration was missing previously.
2. Add some new interfaces for origin NullableMode. This change inspired by the grammar of scala's mix-in trait, It help us to quickly understand the traits of function without read the lengthy procedural code and save the work to write some template code, like `class Substring extends ScalarFunction implements ImplicitCastInputTypes, PropagateNullable`. These are the interfaces:
- PropagateNullable: equals to NullableMode.DEPEND_ON_ARGUMENT
- AlwaysNullable: equals to NullableMode.ALWAYS_NULLABLE
- AlwaysNotNullable: equals to NullableMode.ALWAYS_NOT_NULLABLE
- others ComputeNullable: equals to NullableMode.CUSTOM
3. Add `GenerateScalarFunction` to generate nereids-style function code from legacy functions, but not actual generate any new function class yet, because the function's trait is not ready for use. I need add some traits for the legacy function's CompareMode and NonDeterministic, this thought is the same as ComputeNullable.
2022-09-16 21:27:30 +08:00
c8e9a32bb2
[Function](cbrt)Add cbrt function for doris ( #12523 )
...
Add cbrt function for doris
2022-09-12 19:58:45 +08:00
09b45f2b71
[Function](ELT)Add elt function ( #12321 )
2022-09-07 15:21:08 +08:00
e7303c12c7
[Enhancement](array-type) Support Floating/Decimal type for array aggregation functions ( #12271 )
2022-09-03 09:55:56 +08:00
3bcab8bbef
[feature](function) support now/current_timestamp functions with precision ( #12219 )
...
* [feature](function) support now/current_timestamp functions with precision
2022-09-01 14:35:12 +08:00
2b3a5b5fdd
[fix](array-type) add ARRAY_BOOLEAN support for lots of array functions #12079
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-08-26 18:00:29 +08:00
4fa53b4cdb
[chore](workflow) Add shellcheck to check shell scripts ( #11744 )
2022-08-18 16:07:28 +08:00
8c8f48c4c2
[feature-wip](array-type) add the array_join function ( #11406 )
...
this pr is used to add the array_join function.
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-15 11:43:17 +08:00
7d97aa194b
[feature-wip](datev2) Support to use datev2 as partition column ( #11618 )
2022-08-12 11:54:01 +08:00
df47b6941d
[feature-wip](array-type) support the array type in reverse function ( #11213 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-09 20:49:09 +08:00
72d2feae99
[feature-wip] Support all date functions for datev2/datetimev2 ( #11265 )
...
* [feature-wip] (datetimev2) support convert_tz function
* [feature-wip] Support all date functions for datev2/datetimev2
2022-07-28 08:18:59 +08:00
5913c7c52c
[feature-wip](array-type) add function array_slice ( #11054 )
...
array_slice function returns a slice of the array.
2022-07-27 18:43:52 +08:00
f46a801b1b
[FIX]string pad function should be always nullable for both string and varchar type ( #11196 )
2022-07-26 17:55:06 +08:00
823088a9eb
[FOLLOW-UP] (datetimev2) complete date function ut and built-in function declaration ( #11154 )
2022-07-26 17:48:57 +08:00
3e3b2d15d4
[bug]string pad functions should always be nullable ( #11140 )
...
* string pad functions should always be nullable
2022-07-26 10:20:11 +08:00
3744321f01
[feature-wip](array-type) add function array_union/array_except/array_intersect ( #10781 )
...
Add array_union/array_except/array_intersect function.
2022-07-22 13:50:13 +08:00
2d5aca18fb
[feature-wip](array) add the array_sort function ( #10598 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-07-18 10:52:42 +08:00
5793cb11d0
[feature-wip] (array-type) function concat_ws support array ( #10749 )
...
Issue #10052
function concat_ws support array
2022-07-17 17:50:39 +08:00
cc84cfcc0e
[feature-wip](array-type) add function array_remove ( #10385 )
...
Description:
array_remove function remove all elements in array which is equal to the target.
2022-07-15 17:57:49 +08:00
eb079950cb
[feature-wip] (array-type) add the array_distinct function ( #10388 )
...
* add the array_distinct function
* add the support for decimal and update variable names
* add docs and regression test for array_distinct function
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-07-12 17:02:42 +08:00
6d092a6d53
set strleft to always_nullable ( #10496 )
2022-07-06 17:56:01 +08:00
ec6620ae3e
[feature-wip](array-type) add function arrays_overlap ( #10233 )
2022-06-30 08:12:29 +08:00
5e47b03595
[feature-wip](array-type) Add array aggregation functions ( #10108 )
2022-06-17 11:07:49 +08:00
6fab1cbf3c
[feature-wip](array-type) Add array functions size and cardinality ( #9921 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-06-09 15:03:03 +08:00
7b98dd438d
[feature](function) Add nvl function ( #9726 )
2022-05-30 09:43:00 +08:00
f33ef32d92
[Bug] [Bitmap] change to_bitmap to always_not_nullable ( #9716 )
2022-05-28 17:33:55 +08:00
650e3a6ba0
[feature-wip](array-type) array_contains support more nested data types ( #9170 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-05-13 12:42:40 +08:00
869fdff2f0
[refactor] add reference path for source file from impala ( #9115 )
...
According to the requirements of the APLv2, the referenced code needs to be marked with the path of the source code.
2022-04-20 12:29:57 +08:00
a2d6724fa7
[fix] change parameter type of hll_cardinality from STRING to HLL ( #9002 )
...
In #8882 , we disabled the conversion from string to hll. So we need to change the parameter type of hll_cardinality() too
2022-04-15 15:17:11 +08:00
7f7172807f
[feature](function)(vectorized) Support all geolocation functions on vectorized engine ( #8846 )
2022-04-11 09:36:53 +08:00
f3c6ddf651
[feature](function) Support geolocation functions on vectorized engine ( #8790 )
2022-04-03 10:50:54 +08:00
4d516bece8
[feature-wip](array-type)Add element_at and subscript functions ( #8597 )
...
Describe the overview of changes.
1. add function element_at;
2. support element_subscript([]) to get element of array, col_array[N] <==> element_at(col_array, N);
3. return error message instead of BE crash while array function execute failed;
element_at(array, index) desc:
> Returns element of array at given **(1-based)** index.
If **index < 0**, accesses elements from the last to the first.
Returns NULL if the index exceeds the length of the array or the array is NULL.
Usage example:
1. create table with ARRAY type column and insert some data:
```
+------+------+--------+
| k1 | k2 | k3 |
+------+------+--------+
| 1 | 2 | [1, 2] |
| 2 | 3 | NULL |
| 4 | NULL | [] |
| 3 | NULL | NULL |
+------+------+--------+
```
2. enable vectorized:
```
set enable_vectorized_engine=true;
```
3. element_subscript([]) usage example:
```
> select k1,k3,k3[1] from array_test;
+------+--------+----------------------------+
| k1 | k3 | %element_extract%(`k3`, 1) |
+------+--------+----------------------------+
| 3 | NULL | NULL |
| 1 | [1, 2] | 1 |
| 2 | NULL | NULL |
| 4 | [] | NULL |
+------+--------+----------------------------+
```
4. element_at function usage example:
```
> select k1,k3 from array_test where element_at(k3, -1) = 2;
+------+--------+
| k1 | k3 |
+------+--------+
| 1 | [1, 2] |
+------+--------+
```
2022-04-02 12:03:56 +08:00
bea9a7ba4f
[feature] Support pre-aggregation for quantile type ( #8234 )
...
Add a new column-type to speed up the approximation of quantiles.
1. The new column-type is named `quantile_state` with fixed aggregation function `quantile_union`, which stores the intermediate results of pre-aggregated approximation calculations for quantiles.
2. support pre-aggregation of new column-type and quantile_state related functions.
2022-03-24 09:11:34 +08:00
71ce3c4a6e
[feature-wip](array-type) Add codes and UT for array_contains and array_position functions ( #8401 ) ( #8589 )
...
array_contains function Usage example:
1. create table with ARRAY column, and insert some data:
```
> select * from array_test;
+------+------+--------+
| k1 | k2 | k3 |
+------+------+--------+
| 1 | 2 | [1, 2] |
| 2 | 3 | NULL |
| 4 | NULL | [] |
| 3 | NULL | NULL |
+------+------+--------+
```
2. enable vectorized:
```
> set enable_vectorized_engine=true;
```
3. select with array_contains:
```
> select k1,array_contains(k3,1) from array_test;
+------+-------------------------+
| k1 | array_contains(`k3`, 1) |
+------+-------------------------+
| 3 | NULL |
| 1 | 1 |
| 2 | NULL |
| 4 | 0 |
+------+-------------------------+
```
4. also we can use array_contains in where condition
```
> select * from array_test where array_contains(k3,1);
+------+------+--------+
| k1 | k2 | k3 |
+------+------+--------+
| 1 | 2 | [1, 2] |
+------+------+--------+
```
5. array_position usage example
```
> select k1,k3,array_position(k3,2) from array_test;
+------+--------+-------------------------+
| k1 | k3 | array_position(`k3`, 2) |
+------+--------+-------------------------+
| 3 | NULL | NULL |
| 1 | [1, 2] | 2 |
| 2 | NULL | NULL |
| 4 | [] | 0 |
+------+--------+-------------------------+
```
2022-03-22 15:42:40 +08:00
e0ef9b8f6c
[refactor](vectorized) to_bitmap(-1) return NULL instead of return parse failed error_message ( #8373 )
2022-03-11 17:21:47 +08:00
454b45bea3
[feature](vectorize)(function) support regexp&&sm4&&aes functions ( #8307 )
2022-03-08 13:14:02 +08:00
668188b91f
[improvement][vectorized] support es node predicate peel ( #8174 )
2022-02-26 17:02:54 +08:00
a6bc9cbe53
[Function] Refactor the function code of log ( #8199 )
...
1. Support return null when input is invalid
2. Del the unless code in vec function
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-02-24 11:06:58 +08:00
90a8ca808a
[Bug][Vectorized] fix bitmap_min(empty) not return null ( #8190 )
2022-02-24 11:06:27 +08:00
31ab569c1d
[Vectorized][Feature] support some bitmap functions ( #8138 )
2022-02-23 11:42:16 +08:00
87e555c27d
[Feature][Vectorized] support function json_array/json_object/json_quote ( #8158 )
2022-02-22 09:29:56 +08:00
