database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
19,619 Commits 1 Branch 0 Tags
9b07cd20692d0be8fc17a6d19bdf5e8ea45c62c8
Commit Graph

780 Commits

Author SHA1 Message Date
amory
9b07cd2069 [pick](json-serde)pick jsonb string deserialize with spec char (#38711) 
## Proposed changes
backport: https://github.com/apache/doris/pull/37176
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-02 13:37:41 +08:00
amory
1d982ada45 [pick](array-funcs)pick array func array_enumerate_uniq bugfix (#38721) 
## Proposed changes
backport: https://github.com/apache/doris/pull/38384
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-02 11:25:17 +08:00
amory
f5bc65989c [pick](array-range)improve array_range func for large param (#38707) 
## Proposed changes
backport: https://github.com/apache/doris/pull/38284
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-02 11:22:46 +08:00
amory
184b8cbbe4 [pick](json)fix jsonb deseriaze (#38630) 
## Proposed changes
backport: https://github.com/apache/doris/pull/37251
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-01 10:18:27 +08:00
airborne12
66ebf709ba [Fix](inverted index) fix fast execute for not_in expr #37745 (#38594) 
cherry pick from #37745
 2024-07-31 19:58:12 +08:00
lihangyu
73fc55b203 [Pick](Variant) fix some issue by RQG (#38336) 
#38318 
#38291
 2024-07-25 12:19:07 +08:00
zhangstar333
70cde39fe0 [cherry-pick](branch-21) fix conv function get wrong result as parse overflow (#38001) (#38309) 
## Proposed changes

cherry-pick from https://github.com/apache/doris/pull/38001

<!--Describe your changes.-->
 2024-07-25 12:06:46 +08:00
zhangstar333
e9052e2180 [cherry-pick](branch-21) fix mod function cause core dump (#37999) (#38308) 
## Proposed changes
cherry-pick from master https://github.com/apache/doris/pull/37999

<!--Describe your changes.-->

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-25 12:06:21 +08:00
Jerry Hu
d19b3a5cb6 [fix](function) the bucket number arg of width_bucket should be a positive integer value (#37892) (#38295) 
## Proposed changes

pick #37892
 2024-07-25 11:56:47 +08:00
zclllhhjj
21b3fc3d1e [branch-2.1](function) fix coredump for MULTI_MATCH_ANY (#37959) (#38314) 
pick https://github.com/apache/doris/pull/37959

[INVALID_ARGUMENT][E33] Compile regexp expression failed. got Embedded
start anchors not supported.. some expressions may be illegal
 2024-07-25 11:34:22 +08:00
zclllhhjj
79a6496bb6 [branch-2.1](function) fix wrong result when convert_tz is out of bound (#37358) (#38313) 
## Proposed changes

pick https://github.com/apache/doris/pull/37358

before:
```sql
mysql> select CONVERT_TZ(cast('0000-01-01 00:00:00.00001'  as DATETIMEV1), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533)));
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| convert_tz(cast('0000-01-01 00:00:00.00001' as DATETIME), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533))) |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| q535-12-31 08:01:19                                                                                                                               |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.12 sec)
```
now:
```sql
mysql> select CONVERT_TZ(cast('0000-01-01 00:00:00.00001'  as DATETIMEV1), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533)));
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| convert_tz(cast('0000-01-01 00:00:00.00001' as DATETIME), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533))) |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                              |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.09 sec)
```
 2024-07-25 11:32:44 +08:00
amory
947d7594c8 [fix](func)fix array_with_const with larger than max_array_size (#38152) 
## Proposed changes
backport: https://github.com/apache/doris/pull/37495
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-20 00:19:00 +08:00
camby
de2272ce48 [fix](round) fix round decimal128 overflow (#37733) (#37963) 
cherry-pick #37733 to branch-2.1
 2024-07-18 23:50:23 +08:00
zzzxl
0e248e3594 [fix](inverted index) Corrected the issue of no_index_match failure caused by empty data #37947 (#38002) 2024-07-18 10:04:36 +08:00
Mryange
cc6ff12097 [opt](function) Optimize the trim function for single-char inputs (#3… (#37799) 
https://github.com/apache/doris/pull/36497

before
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
|               64000000 |
+------------------------+
1 row in set (7.79 sec)
```

now
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
|               64000000 |
+------------------------+
1 row in set (0.73 sec)
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 17:52:52 +08:00
zhiqiang
02716598d4 [Fix](sql function) memory overflow to the left of string address when do_money_format has small negative value #36226 (#37870) 
cherry pick from #36226

Co-authored-by: sparrow <38098988+biohazard4321@users.noreply.github.com>
 2024-07-16 15:04:42 +08:00
Mryange
8e42871228 [fix](in expr) fix error result when in expr has null value and lef… (#37800) 
https://github.com/apache/doris/pull/36024

## Proposed changes

```
create table t2 (id int, c1 int);
insert into t2 values(1, null);
 select 0 in (c1, null) from t2; -- should return null，but 1
```

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-16 14:04:35 +08:00
Pxl
d7e84b7ee3 [Enchancement](bitmap) optimize bitmap deserialize and remove some unused code (#37623) 
## Proposed changes
pick from #35789
 2024-07-16 11:21:54 +08:00
amory
3cb1d4e842 [feature](json)support explode_json_object func #36887 (#37378) 2024-07-16 10:59:11 +08:00
zhangstar333
1d49d386aa [cherry-pick](branch-21) remove the useless code in column vector (#34432) (#37827) 
cherry-pick from master https://github.com/apache/doris/pull/34432

Co-authored-by: HappenLee <happenlee@hotmail.com>
 2024-07-15 22:10:58 +08:00
zzzxl
8df2432e94 [fix](inverted index) implementation of match function without index #36471 (#36918) 2024-07-15 16:19:41 +08:00
camby
8360e3f6cf [fix](sleep) sleep with character const make be crash (#37681) (#37775) 
cherry-pick #37681 to branch-2.1
 2024-07-15 14:57:46 +08:00
Mryange
8de13c5cc8 [fix](function) error scale set in unix_timestamp (#36110) (#37619) 
## Proposed changes

```
mysql [test]>set DEBUG_SKIP_FOLD_CONSTANT = true;
Query OK, 0 rows affected (0.00 sec)

mysql [test]>select cast(unix_timestamp("2024-01-01",'yyyy-MM-dd') as bigint);
+------------------------------------------------------------+
| cast(unix_timestamp('2024-01-01', 'yyyy-MM-dd') as BIGINT) |
+------------------------------------------------------------+
|                                           1704038400000000 |
+------------------------------------------------------------+
```
now
```
mysql [test]>select cast(unix_timestamp("2024-01-01",'yyyy-MM-dd') as bigint);
+------------------------------------------------------------+
| cast(unix_timestamp('2024-01-01', 'yyyy-MM-dd') as BIGINT) |
+------------------------------------------------------------+
|                                                 1704038400 |
+------------------------------------------------------------+
1 row in set (0.01 sec)
```

The column does not have a scale set, but the cast uses the scale to
perform the cast.


<!--Describe your changes.-->

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-15 10:00:04 +08:00
lihangyu
217eac790b [pick](Variant) pick some refactor and fix #34925 #36317 #36201 #36793 (#37526) 2024-07-11 21:25:34 +08:00
camby
239bc1a7e0 [fix](compile) fix compile failed on MacOS due to ambiguous std::abs (#37136) 
cherry-pick #35125 to branch-2.1

Co-authored-by: morrySnow <101034200+morrySnow@users.noreply.github.com>
 2024-07-02 17:45:33 +08:00
zclllyybb
72c20d3ccc [branch-2.1](function) fix date_format and from_unixtime core when meet long format string (#35883) (#36158) 
pick #35883
 2024-07-01 20:35:31 +08:00
amory
d237a4d303 [fix](array)fix array_except/union for left const return only one row result #36776 (#36986) 2024-06-30 12:25:17 +08:00
Pxl
c6205783fa [Bug](function) fix wrong output_char_size on hll_to_base64 (#36572) 
## Proposed changes
pick from #36529
 2024-06-24 13:19:28 +08:00
Mingyu Chen
0cff539810 [feature](function) support new function replace_empty (#36283) (#36656) 
#36283
 2024-06-21 16:46:22 +08:00
zhiqiang
c8f2a3f952 [fix](eq_for_null) fix incorrect logic in function eq_for_null #36004 (#36124) 
cherry pick from #36004
cherry pick from #36164
 2024-06-21 14:31:21 +08:00
lihangyu
4a117800ca [Bug](Function) fix json contains with empty value (#36320) (#36418) 2024-06-18 10:20:45 +08:00
Mingyu Chen
8e06f4ad34 [improvement](decimal) improve overflow error message (#34689) (#36078) 
bp #34689

Co-authored-by: TengJianPing <18241664+jacktengg@users.noreply.github.com>
 2024-06-09 20:29:38 +08:00
zclllyybb
f751ca4e04 [branch-2.1](functions) fix be crash for function random_bytes and mark_first/last_n (#36003) 
pick #35884
 2024-06-07 10:30:41 +08:00
slothever
c794ea18c8 [fix](multi-catalog)put java udf to custom lib (#35984) 
bp #34990
 2024-06-06 22:54:24 +08:00
airborne12
c3a4d36036 [Pick 2.1](inverted index) fix tokenize function wrong result when params with space seperator (#35997) 
Pick from (#32671)
 2024-06-06 21:51:15 +08:00
amory
b5a35b9cef [FIX] Pick array inverted index bugfix (#35837) 
here with some array with inverted index bugfix:
see also: 
https://github.com/apache/doris/pull/34766
https://github.com/apache/doris/pull/35086
https://github.com/apache/doris/pull/34683
https://github.com/apache/doris/pull/34076
 2024-06-06 09:54:14 +08:00
zzzxl
bef931de9d [fix](inverted index) add in list to fast execute logic after hit index (#35344) 
resolve the issue where the case fails when
enable_common_expr_pushdown is set to false
 2024-05-29 20:30:43 +08:00
Mryange
97a5f55a37 [fix](function) bitmap to base64 error length check (#35117) 2024-05-28 13:17:16 +08:00
Pxl
b143f0dfe2 [Improvement](date) shortcut for str to date parse (#35288) 
shortcut for str to date parse
 2024-05-25 17:47:20 +08:00
zhangstar333
5872173901 [improve](function) add limit check for lpad/rpad function input big value of length (#34810) 2024-05-21 12:54:25 +08:00
lihangyu
e3e5f18f26 [Fix](Json type) correct cast result for json type (#34764) 2024-05-18 18:40:17 +08:00
zhiqiang
eb7eaee386 [fix](function) money format (#34680) 2024-05-18 18:35:29 +08:00
Mryange
876248aa4e [fix](function) json_object can not input null value (#34591) 2024-05-18 18:00:48 +08:00
zclllyybb
d5ab2787ba [Fix](function) fix pad functions behaviour of empty pad string (#34796) 
fix pad functions behaviour of empty pad string
 2024-05-15 10:28:09 +08:00
Mryange
719e50f353 [fix](json function) fix failed when json_exists_path use not null input (#34289) 2024-05-11 15:04:35 +08:00
zhiqiang
58c19e33b3 [fix](round) Fix incorrect decimal scale inference in round functions (#34471) 
* FIX NEEDED

* FORMAT

* FORMAT

* FIX TEST
 2024-05-11 11:42:12 +08:00
zzzxl
082216496e [opt](inverted index) opt for log output when matching without an index (#34024) 
Generates a large volume of log output when scanning large amounts of data
 2024-05-10 14:45:05 +08:00
yangshijie
9b712b03b4 [FIX]fix is_ip_address_in_range func with const param (#34266) 2024-05-10 14:37:20 +08:00
zhangstar333
520774a24b [fix](serde) fix ipv4/v6 serde functions for arrow, orc, parquet format (#34042) 
this PR is from @sjyango work in #32326,
wants merge #32326 into master branch, but it's draft and not maintain long time. so have this new PR.
Co-authored-by: sjyango <sjyang2022@zju.edu.cn>
 2024-05-10 14:37:04 +08:00
zzzxl
ac56255f82 [opt](inverted index) the "unicode" tokenizer can be configured to disable stop words. (#34467) 2024-05-07 18:23:43 +08:00