database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
20,193 Commits 1 Branch 0 Tags
b8bc9b699cbfd091172cc75a7bb2ad89e27cdd4e
Commit Graph

83 Commits

Author SHA1 Message Date
zclllhhjj
163193b1d4 [branch-2.1](function) fix random_bytes return same data for multi rows (#39891) (#40137) 
pick https://github.com/apache/doris/pull/39891

Issue Number: close #xxx

before:
```sql
mysql [optest]>SELECT random_bytes(10) a FROM numbers("number" = "10");
+------------------------+
| a                      |
+------------------------+
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
+------------------------+
```

now:
```sql
mysql [optest]>SELECT random_bytes(10) a FROM numbers("number" = "10");
+------------------------+
| a                      |
+------------------------+
| 0xd82cf60825b29ef2a0fd |
| 0x6f8c808415bdbaa6d257 |
| 0x7c26b5214297a151c25c |
| 0x43f02c77293063900437 |
| 0x5e5727569dec5e24f96b |
| 0x434f20bf74d7759640b7 |
| 0x087ed96b739750c733a6 |
| 0xdf05f6d7ede4972eb846 |
| 0xcefab471912264b5c54f |
| 0x1bddc019409d1926aa10 |
+------------------------+
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-30 10:43:42 +08:00
amory
226e01889c [fix](array_apply) pick array apply fix (#39328) 
## Proposed changes
backport: https://github.com/apache/doris/pull/39105
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-14 18:52:29 +08:00
lihangyu
773008d6fa [Fix](Json) fix some cast issue (#38683) (#39025) 
#38683
 2024-08-07 22:05:43 +08:00
Uniqueyou
65154f8abe [branch-2.1] (doris-future) Support auto partition name function (#38853) 
cherry-pick https://github.com/apache/doris/pull/34258 to branch-2.1
 2024-08-05 16:04:24 +08:00
amory
2653087843 [pick](array-funcs)fix array with empty arg in be behavior (#38708) 
## Proposed changes
backport: https://github.com/apache/doris/pull/36845
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-05 09:08:28 +08:00
amory
556f0fc784 [pick](json-keys) support json_keys function (#38631) 
## Proposed changes
backport: https://github.com/apache/doris/pull/36411
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-02 19:10:00 +08:00
starocean999
ebc178af23 [fix](nereids)acos function should return null literal instead of NaN value (#37996) 
pick from master https://github.com/apache/doris/pull/37932

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-18 09:28:56 +08:00
Mingyu Chen
0cff539810 [feature](function) support new function replace_empty (#36283) (#36656) 
#36283
 2024-06-21 16:46:22 +08:00
lihangyu
e3e5f18f26 [Fix](Json type) correct cast result for json type (#34764) 2024-05-18 18:40:17 +08:00
feiniaofeiafei
fe7d2b8159 [Fix](nereids) ignore slot implements SlotNotFromChildren when check the slot from children in NormalizeAggregate (#34171) 2024-05-07 07:48:05 +08:00
Chester
22a6b1d3f5 [feature](function) support hll functions hll_from_base64, hll_to_base64 (#32089) 
Issue Number: #31320 

Support two hll functions:

- hll_from_base64
Convert a base64 string(result of function hll_to_base64) into a hll.
- hll_to_base64
Convert an input hll to a base64 string.
 2024-04-17 23:42:13 +08:00
zy-kkk
1b3e4322e8 [improvement](serde) Handle NaN values in number for MySQL result write (#33227) 2024-04-07 23:24:23 +08:00
Mryange
cca0773261 [feature](function) round function defaults to rounding normally 2024-03-06 13:06:26 +08:00
Guangdong Liu
9c4708ee74 [function](random_bytes)add random_bytes function (#31547) 
SELECT random_bytes(10);

random_bytes(10) |
----------------------+
0x9b8ea00b7d1084bc5b26|
 2024-02-29 16:44:39 +08:00
Chester
f163d56a98 [feature](function) support sequence function(alias of array_range), enhance both to handle datetimev2 (#30823) 2024-02-27 10:12:19 +08:00
Guangdong Liu
1ed24117ac [function](url_decode)add url_decode function (#30667) 2024-02-05 22:23:00 +08:00
Rohit Satardekar
6442663735 [Function](exec) upport atan2 math function (#30672) 
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com>
 2024-02-04 14:28:38 +08:00
Rohit Satardekar
19f57b544e support cosh math function (#30602) 
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com>
 2024-01-31 23:53:39 +08:00
yangshijie
8b61b7c6cd [exec](function) Add tanh func (#30555) 2024-01-31 23:53:39 +08:00
koarz
ca5a314765 [fix](function) make STRLEFT and STRRIGHT and SUBSTR function DEPEND_ON_ARGUMENT (#28352) 
make STRLEFT and STRRIGHT function DEPEND_ON_ARGUMENT
 2024-01-25 13:23:59 +08:00
zclllyybb
baadc14e60 [Enhancement](function) support unix_timestamp with float (#26827) 
---------

Co-authored-by: YangWithU <plzw8@outlook.com>
 2023-11-27 09:58:53 +08:00
morrySnow
2c6d2255c3 [fix](Nereids) nested type literal type coercion and insert values with map (#26669) 2023-11-14 21:13:26 -06:00
谢健
c46fa339d0 [feature](Nereids): make count() avaliable for all data type (#26180) 
make count() avaliable for all data type
 2023-11-02 17:20:24 +08:00
Tiewei Fang
3e10e5af39 [Fix](Serde) Fix content displayed by complex types in MySQL Client (#25946) 
This pr makes three changes to the display of complex types：
1. NULL value in complex types refers to being displayed as `null`, not `NULL`
2. struct type is displayed as "column_name": column_value
3. Time types such as `datetime` and `date`, are displayed with double quotes in complex types. like
    `{1, "2023-10-26 12:12:12"}`

This pr also do a code refactor:
1. nesting_level is set to a member variable of the `DataTypeSerDe`, rather than a parameter in methods.

What's more, this pr fix a bug that fileSize is not correct, introduced by this pr: #25854
 2023-11-01 23:48:55 +08:00
Yulei-Yang
3a954cd1aa [fix](function)return NULL rather than 'null' if path not found (#25880) 
fix json_extract not return NULL but null
 2023-10-30 14:26:44 +08:00
TengJianPing
e77b98be88 [fix](months_diff) fix wrong result of months_diff (#25577) 2023-10-19 14:29:47 +08:00
morrySnow
af8832389f [feature](Nereids) add 4 array functions (#25488) 
- array_concat
- array_pushback
- array_pushfront
- array_zip
 2023-10-17 04:45:15 -05:00
minghong
42f8b253aa [function](nereids) support array_apply/array_repeat/group_uniq_array/ipv4numtostring (#25249) 
nereids support functions: array_apply/array_repeat/group_uniq_array/ipv4numtostring
 2023-10-12 11:08:42 +08:00
morrySnow
b91bce8a62 [feature](Nereids) add array distance functions (#25196) 
- l1_distance
- l2_distance
- cosine_distance
- inner_product
 2023-10-10 21:35:06 -05:00
morrySnow
37247ac449 [opt](Nereids) add two args signature to trim family functions (#25169) 2023-10-09 07:17:52 -05:00
morrySnow
320709b9ff [opt](Nereids) support like and regexp function (#25148) 2023-10-09 02:55:57 -05:00
谢健
3a45001447 [fix](Nerids) fix error when the view has lambda functions (#25067) 
1. To ensure compatibility with the original optimizer, expose the non-lambda signature of highorder function externally.
2. fix some bugs in toSql function in the original optimizer
 2023-10-08 15:45:24 +08:00
morrySnow
12bee54cf7 [fix](Nereids) function implict cast for json is not work well (#24852) 
for sql like:

SELECT JSONB_EXTRACT('{"k1":"v31","k2":300}','$.k1');

the result should be

+------------------------------------------------+
| jsonb_extract('{"k1":"v31","k2":300}', '$.k1') |
+------------------------------------------------+
| "v31"                                          |
+------------------------------------------------+

but curent result is

+------------------------------------------------+
| jsonb_extract('{"k1":"v31","k2":300}', '$.k1') |
+------------------------------------------------+
| <null>                                         |
+------------------------------------------------+
 2023-09-25 21:10:04 +08:00
TengJianPing
22616d125d [function](bitmap) add function alias bitmap_andnot and bitmap_andnot_count (#24771) 2023-09-22 12:18:31 +08:00
谢健
5b590bbfcf [feat](Nereids) add lambda func array_last and array_first (#24682) 2023-09-21 12:23:34 +08:00
LiBinfeng
a3361df7b9 [Feat](Nereids) support json and jsonb datatype (#24156) 
Feature:
support jsonb and json type in nereids

Document:
this feature supports these two datatype in nereids optimizer like original planner, the sql reference is same as before
[JSON - Apache Doris](https://doris.apache.org/zh-CN/docs/dev/sql-manual/sql-reference/Data-Types/JSON)
 2023-09-20 14:32:22 +08:00
amory
e9435c14f8 [Improve](array-func)improve array union support multi params (#24327) 2023-09-20 14:29:48 +08:00
谢健
c3bd2a22d4 [feature](Nereids) add many array functions (#24301) 
Add function array_filter, array_sortby, array_last_index, array_first_index, array_orderby, array_count
 2023-09-19 18:58:49 +08:00
daidai
4b5cea1ef8 [enhancement](fix)change ordinary type null value is \N,complex type null value is null (#24207) 2023-09-16 21:46:42 +08:00
谢健
88adab3114 [fix](Nereids): fix be core when array_map is not nullable (#24488) 
fix be core when array_map is not nullable
 2023-09-16 20:39:15 +08:00
zclllyybb
4fbb25bc55 [Enhancement](function) Support date_trunc(date) and use it in auto partition (#24341) 
Support date_trunc(date) and use it in auto partition
 2023-09-14 16:53:09 +08:00
amory
268c867679 [Improve](serde)replace function_cast from_string to serde (#24087) 
Now we can not support streamload with column which is map/array nested map/array
serde can do this now , so we can replace it
Notice. if item data in complex type data is empty we just return error, instead of makeup default value , because now we can not define right default for complex type
 2023-09-14 13:53:16 +08:00
amory
dc28878f0e [FIX](function) fix size function for array map (#23920) 
Issue Number: close #xxx
now we use select size(map(1, 2)); which will make be core
and we can make size function handle array & map column both
 2023-09-06 14:32:06 +08:00
谢健
a136836770 [feature](Nereids) add two functions: char and covert (#23104) 
add [char](https://doris.apache.org/zh-CN/docs/dev/sql-manual/sql-functions/string-functions/char/?_highlight=char) func
```
mysql> select char(68, 111, 114, 105, 115);
+--------------------------------------+
| char('utf8', 68, 111, 114, 105, 115) |
+--------------------------------------+
| Doris                                |
+--------------------------------------+
```

convert func
```
MySQL root@127.0.0.1:(none)> select convert(1 using gbk);
+-------------------+
| convert(1, 'gbk') |
+-------------------+
| 1                 |
+-------------------+
```
 2023-08-30 17:09:06 +08:00
谢健
f7d2c1faf6 [feature](Nereids) support select key encryptKey (#23257) 
Add select key

```
- CREATE ENCRYPTKEY key_name AS "key_string"
- select key my_key
+-----------------------------+
| encryptKeyRef('', 'my_key') |
+-----------------------------+
| ABCD123456789               |
+-----------------------------+
```
 2023-08-28 14:07:26 +08:00
morrySnow
e84989fb6d [feature](Nereids) support map type (#23493) 2023-08-28 11:31:44 +08:00
谢健
0ccb7262a7 [feature](Nereids) add password func (#23244) 
add password function
```
select password("123");
+-------------------------------------------+
| password('123')                           |
+-------------------------------------------+
| *23AE809DDACAF96AF0FD78ED04B6A265E05AA257 |
+-------------------------------------------+
```
 2023-08-25 14:04:49 +08:00
morrySnow
3786ffec51 [opt](Nereids) add some array functions (#23324) 
1. rename TVFProperties to Properties
2. add generating function explode and explode_outer
3. fix concat_ws could not apply on array
4. check tokenize second argument format on FE
5. add test case for concat_ws, tokenize, explode, explode_outer and split_by_string
 2023-08-25 11:01:50 +08:00
morrySnow
daa4db097e [fix](Nereids) array_difference and array_position get wrong result (#23331) 
1. change array_difference signature to let it return same type as arg
2. do not change precision when signature not use wildcard type
 2023-08-23 20:38:09 +08:00
zclllyybb
51ac92f65c Revert "[fix](function) to_bitmap parameter parsing failure returns null instead of bitmap_empty (#21236)" (#23368) 
This reverts commit 1c3cc77a54938ed948ad8186b8dea8385977d23c.
 2023-08-23 18:27:35 +08:00