database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
20,619 Commits 1 Branch 0 Tags
443e87e20327eaa5577cc10f08a63ec1694de358
Commit Graph

85 Commits

Author SHA1 Message Date
Mryange
cbdaaa62b2 [feature](function) hour/minute/second functions support time as an a… 41008 (#42232) 
…rgument. (#41008)

## Proposed changes

```
mysql> select cast(4562632 as time),hour(cast(4562632 as time)), minute(cast(4562632 as time)),second(cast(4562632 as time));
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
| cast(4562632 as TIME) | hour(cast(4562632 as TIME)) | minute(cast(4562632 as TIME)) | second(cast(4562632 as TIME)) |
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
| 456:26:32             |                         456 |                            26 |                            32 |
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
```

<!--Describe your changes.-->

---------

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

Co-authored-by: Dongyang Li <hello_stephen@qq.com>
 2024-10-24 11:09:36 +08:00
zhangstar333
67d057a711 [cherry-pick](branch-21) fix conv function parser string failure return wrong result (#40530) (#41964) 
## Proposed changes

Issue Number: close #39618
cherry-pick from master (#40530)
 2024-10-17 14:45:46 +08:00
Mryange
6dddd4c499 [function](cast)Make string casting to integers more like MySQL's beh… (#41541) 
…avior (#38847)
https://github.com/apache/doris/pull/38847
## Proposed changes

There are two issues here. First, the results of casting are
inconsistent between FE and BE .
```
FE
mysql [(none)]>select cast('3.000' as int); 
+----------------------+
| cast('3.000' as INT) |
+----------------------+
|                    3 |
+----------------------+

mysql [(none)]>set debug_skip_fold_constant = true;

BE
mysql [(none)]>select cast('3.000' as int);
+----------------------+
| cast('3.000' as INT) |
+----------------------+
|                 NULL |
+----------------------+
```
The second issue is that casting on BE converts '3.0' to null. Here, the
casting logic for FE and BE has been unified

<!--Describe your changes.-->

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

---------

Co-authored-by: Xinyi Zou <zouxinyi02@gmail.com>
 2024-10-11 09:32:00 +08:00
TengJianPing
bf3d4240be [fix](window_func) fix bug of agg function used in window function and add many test cases (#40678) (#41328) 
## Proposed changes

Issue Number: close #xxx

BP #40678
 2024-09-26 22:50:34 +08:00
Mryange
0e5c4281dc [fix](function) fix Substring/SubReplace error result with input utf8… (#40954) 
… string (#40929)
https://github.com/apache/doris/pull/40929
```

mysql [(none)]>select sub_replace("你好世界","a",1);
+-------------------------------------+
| sub_replace('你好世界', 'a', 1)     |
+-------------------------------------+
| �a�好世界                             |
+-------------------------------------+

mysql [(none)]>select SUBSTRING('中文测试',5);
+------------------------------------------+
| substring('中文测试', 5, 2147483647)     |
+------------------------------------------+
| 中文测试                                 |
+------------------------------------------+
1 row in set (0.04 sec)

now
mysql [(none)]>select sub_replace("你好世界","a",1);
+-------------------------------------+
| sub_replace('你好世界', 'a', 1)     |
+-------------------------------------+
| 你a世界                             |
+-------------------------------------+
1 row in set (0.05 sec)

mysql [(none)]>select SUBSTRING('中文测试',5);
+------------------------------------------+
| substring('中文测试', 5, 2147483647)     |
+------------------------------------------+
|                                          |
+------------------------------------------+
1 row in set (0.13 sec)
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-09-23 10:44:03 +08:00
camby
361a59dec8 [feature](aes_encrypt) support GCM mode for aes_encrypt and aes_decrypt (#40004) (#40672) 
pick #40004 to branch-2.1
 2024-09-11 23:28:28 +08:00
zclllhhjj
3246baa451 [branch-2.1](function) Refine crypto functions signature to fix wrong result(#40285) (#40648) 
pick https://github.com/apache/doris/pull/40285
 2024-09-11 15:32:19 +08:00
TengJianPing
d792a62409 [fix](regression) fix regression failure of window_funnel caused by duplicated table name (#40216) 
BP #40217
 2024-08-31 20:58:20 +08:00
Mryange
4127eec9a7 [fix](function) fix error return type in mod(float32,BigInt) (#39358) (#39971) 
## Proposed changes
https://github.com/apache/doris/pull/39358
```
CREATE TABLE testdb (
    K1 BIGINT,
    K2 FLOAT
) properties("replication_num" = "1");
insert into testdb values(1,1.1);
select mod(k1,k2) from testdb;
mysql [test10]>select mod(k1,k2) from testdb;
ERROR 1105 (HY000): errCode = 2, detailMessage = (127.0.0.1)[INTERNAL_ERROR]Function mod get failed, expr is VectorizedFnCall[mod](arguments=K1, K2,return=Nullable(Float32)) and return type is Nullable(Float32).
```

<!--Describe your changes.-->

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-27 18:32:52 +08:00
amory
d70fe130d7 [fix](explode-map) fix explode_map with alias (#39972) 
## Proposed changes
backport: https://github.com/apache/doris/pull/39757
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-27 18:32:10 +08:00
TengJianPing
021678c7c3 [fix](window_funnel) fix wrong result of window_funnel #38954 (#39270) 
## Proposed changes

BP #38954
 2024-08-16 09:59:31 +08:00
zhangstar333
70cde39fe0 [cherry-pick](branch-21) fix conv function get wrong result as parse overflow (#38001) (#38309) 
## Proposed changes

cherry-pick from https://github.com/apache/doris/pull/38001

<!--Describe your changes.-->
 2024-07-25 12:06:46 +08:00
zclllhhjj
21b3fc3d1e [branch-2.1](function) fix coredump for MULTI_MATCH_ANY (#37959) (#38314) 
pick https://github.com/apache/doris/pull/37959

[INVALID_ARGUMENT][E33] Compile regexp expression failed. got Embedded
start anchors not supported.. some expressions may be illegal
 2024-07-25 11:34:22 +08:00
camby
de2272ce48 [fix](round) fix round decimal128 overflow (#37733) (#37963) 
cherry-pick #37733 to branch-2.1
 2024-07-18 23:50:23 +08:00
Mryange
8e42871228 [fix](in expr) fix error result when in expr has null value and lef… (#37800) 
https://github.com/apache/doris/pull/36024

## Proposed changes

```
create table t2 (id int, c1 int);
insert into t2 values(1, null);
 select 0 in (c1, null) from t2; -- should return null，but 1
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 14:04:35 +08:00
zclllyybb
72c20d3ccc [branch-2.1](function) fix date_format and from_unixtime core when meet long format string (#35883) (#36158) 
pick #35883
 2024-07-01 20:35:31 +08:00
morrySnow
98b2bda660 [opt](Nereids) remove restrict for count(*) in window (#35220) 
support count(*) used for window function

CREATE TABLE `t1` (
  `id` INT NULL,
  `dt` TEXT NULL
)
DISTRIBUTED BY HASH(`id`) BUCKETS 10
PROPERTIES (
"replication_allocation" = "tag.location.default: 1"
);

select *, count(*) over() from t1;
 2024-05-24 16:23:58 +08:00
zclllyybb
a6a398d7a4 [Fix](function) remove datev2 signature of microsecond #35017 2024-05-19 19:58:02 +08:00
zhiqiang
eb7eaee386 [fix](function) money format (#34680) 2024-05-18 18:35:29 +08:00
zhangstar333
6bcf24b1f6 [bug](not in) if not in (null) could eos early (#33482) 
* [bug](not in) if not in (null) could eos early
 2024-04-17 23:41:59 +08:00
LiBinfeng
d61b9f7091 [chore](test) nereids support window function but some cases does not open yet (#33098) 2024-04-10 16:00:12 +08:00
starocean999
1f1932c6b7 [enhancement](nereids)add some date functions for constant fold (#32772) 2024-04-10 11:34:30 +08:00
lw112
e91d16854b [fix](function) fix date_format function execution error on fe (#31645) 2024-03-07 16:53:19 +08:00
zhiqiang
21ce85dc14 [fix](money_format) fix money_format #31883 2024-03-07 16:53:19 +08:00
camby
2d6e975d5a [fix](cast) fix wrong result while cast string to float (#31781) 
Issue Number: close #31518
 2024-03-06 13:07:59 +08:00
camby
7998da4691 [fix](cast) wrong result while cast const to double then to string (#31657) 
Issue Number: close #31514
 2024-03-06 13:06:27 +08:00
HappenLee
ff3c7765d6 [Bug](Func) Fix negative number in bitmap return error result (#31563) 2024-02-29 12:38:03 +08:00
yangshijie
8f77e6363a [Feature](function) Support xxhash function like murmur hash function (#31193) 2024-02-23 19:03:28 +08:00
amory
f65876d803 [Feature](explode) support explode map type (#30151) 2024-02-22 20:08:44 +08:00
koarz
6cf7468073 [enhancement](function) change some function nullable mode (#30991) 
change some function nullable mode
 2024-02-18 14:45:25 +08:00
zclllyybb
d60ecdba6f [fix](regex) fix wrong escape of function LIKE (#30557) 
fix wrong escape of function LIKE
 2024-02-16 10:12:25 +08:00
starocean999
62859f38c1 [fix](nereids)cast string to integer type use wrong datatype's valueOf method (#28174) 
select cast('12.31' as tinyint);
select cast('12.31' as smallint);
select cast('12.31' as int);

should return NULL
 2023-12-13 17:53:07 +08:00
zclllyybb
2afbece0b8 [Fix](type) fix wrong type transform for unix_timestamp (#27728) 
fix wrong type transform for unix_timestamp
 2023-12-01 09:58:20 +08:00
zclllyybb
baadc14e60 [Enhancement](function) support unix_timestamp with float (#26827) 
---------

Co-authored-by: YangWithU <plzw8@outlook.com>
 2023-11-27 09:58:53 +08:00
starocean999
1555b11035 [fix](nereids)remove literal partition by and order by expression in window function (#26899) 2023-11-23 18:40:51 +08:00
zclllyybb
02fe71dcd6 [test](serialisation) Serialise some cases and enable str_to_date tests #26651 
1 enable the cases about str_to_date, which have been muted because some parallel config influence.
2 serialise some cases which called admin set config
 2023-11-09 21:53:32 +08:00
zhiqiang
55b2988bfd [Opt](date_add/sub) Throw exception when result of date_add/sub out of range (#26475) 2023-11-09 08:46:51 +08:00
zhangstar333
509723c1d6 [bug](bitmap) fix bitmap value not clear get wrong data (#26321) 2023-11-03 10:25:13 +08:00
zhengyu
36be7dcc13 [enhancement](regression) add normal query before date convert for debug (#25970) 
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
 2023-10-26 21:37:28 +08:00
zclllyybb
31d2a9a4f5 [Enhancement](function) support fractions for convert_tz(datetimev2) (#25915) 
mysql> select convert_tz('2019-08-01 01:01:02.123' , '+00:00', '+07:00');
+----------------------------------------------------------------------------------+
| convert_tz(cast('2019-08-01 01:01:02.123' as DATETIMEV2(3)), '+00:00', '+07:00') |
+----------------------------------------------------------------------------------+
| 2019-08-01 08:01:02.123                                                          |
+----------------------------------------------------------------------------------+
1 row in set (0.18 sec)
 2023-10-26 10:46:47 +08:00
zclllyybb
7ca3f7100f [testcases](datetime) temporarily remove str_to_date related case (#25877) 2023-10-25 12:54:38 +08:00
zclllyybb
dc47087560 [fix](function) fix str_to_date default return type scale for nereids (#24932) 
fix str_to_date default return type scale for nereids
 2023-10-20 12:55:49 +08:00
xfz
1b95ce1d93 [feature](json-function) add json_insert, json_replace, json_set functions (#24384) 
[feature](json-function) add three json funcitons
 2023-09-25 12:52:29 +08:00
jakevin
d4756d3118 [feature](Nereids): fold Cast(s as date/datetime) on FE (#24353) 
cast("20210101" as Date) -> DateLiteral(2021, 1, 1)
 2023-09-14 22:08:26 +08:00
zclllyybb
7cfb3cc0aa [fix](functions) fix function substitute for datetimeV1/V2 (#23344) 
* fix

* function fe
 2023-08-25 09:59:38 +08:00
zclllyybb
51ac92f65c Revert "[fix](function) to_bitmap parameter parsing failure returns null instead of bitmap_empty (#21236)" (#23368) 
This reverts commit 1c3cc77a54938ed948ad8186b8dea8385977d23c.
 2023-08-23 18:27:35 +08:00
ZenoYang
1c3cc77a54 [fix](function) to_bitmap parameter parsing failure returns null instead of bitmap_empty (#21236) 
* [fix](function) to_bitmap parameter parsing failure returns null instead of bitmap_empty

* add ut

* fix nereids

* fix regression-test
 2023-08-18 14:37:49 +08:00
zzzzzzzs
824bc02603 [Function] Support date function: microsecond() (#20044) 2023-06-20 10:32:54 +08:00
Pxl
a0d4f11667 [Bug](function) catch error state in function cast to avoid core dump (#20751) 
catch error state in function cast to avoid core dump
 2023-06-14 17:34:34 +08:00
TengJianPing
feb21fc9e9 [fix](group_concat) use default seperator ',' instead of ', ' for group_concat, to be consistant with mysql (#20741) 2023-06-13 17:20:29 +08:00