65154f8abe
[branch-2.1] (doris-future) Support auto partition name function ( #38853 )
...
cherry-pick https://github.com/apache/doris/pull/34258 to branch-2.1
2024-08-05 16:04:24 +08:00
cc6ff12097
[opt](function) Optimize the trim function for single-char inputs (#3… ( #37799 )
...
https://github.com/apache/doris/pull/36497
before
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
| 64000000 |
+------------------------+
1 row in set (7.79 sec)
```
now
```
mysql [test]>select count(ltrim(str,"1")) from stringDb2;
+------------------------+
| count(ltrim(str, '1')) |
+------------------------+
| 64000000 |
+------------------------+
1 row in set (0.73 sec)
```
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-16 17:52:52 +08:00
0cff539810
[feature](function) support new function replace_empty ( #36283 ) ( #36656 )
...
#36283
2024-06-21 16:46:22 +08:00
26d9082b9a
[Feature](function) Add function strcmp ( #33272 )
2024-04-12 15:09:25 +08:00
31984bb4f0
[feature](function) support quote string function #33055
2024-04-12 15:09:25 +08:00
e3bb499cc6
[fix](function)revert function REPEAT nullable mode #32226
2024-03-15 18:06:28 +08:00
b031c95324
[Opt](exec) use libbase64 to replace base64 code in doris ( #32078 )
...
* [Opt](exec) use libbase64 to replace base64 code in doris
2024-03-14 09:20:50 +08:00
9c4708ee74
[function](random_bytes)add random_bytes function ( #31547 )
...
SELECT random_bytes(10);
random_bytes(10) |
----------------------+
0x9b8ea00b7d1084bc5b26|
2024-02-29 16:44:39 +08:00
6cf7468073
[enhancement](function) change some function nullable mode ( #30991 )
...
change some function nullable mode
2024-02-18 14:45:25 +08:00
1ed24117ac
[function](url_decode)add url_decode function ( #30667 )
2024-02-05 22:23:00 +08:00
48aaaa8005
[Enhancement](fuction) change function REPEAT nullable mode ( #30743 )
2024-02-04 22:21:36 +08:00
94eedd8ea4
[Enhancement](function)make SUBSTRING_INDEX function DEPEND_ON_ARGUMENT ( #30392 )
2024-02-02 13:31:47 +08:00
ca5a314765
[fix](function) make STRLEFT and STRRIGHT and SUBSTR function DEPEND_ON_ARGUMENT ( #28352 )
...
make STRLEFT and STRRIGHT function DEPEND_ON_ARGUMENT
2024-01-25 13:23:59 +08:00
02a27a587a
remove some unused member function of IFunctionBase ( #30260 )
2024-01-24 09:59:45 +08:00
e417128fb9
[bug](bitmap) should return error status when execute failed ( #29841 )
2024-01-16 18:30:23 +08:00
d75300f166
[fix](hash join) fix stack overflow caused by evaluate case expr on huge build block ( #28851 )
2023-12-22 15:45:12 +08:00
f9df3bae61
[Enhancement](functions) change some nullable mode and clear some smooth upgrade ( #25334 )
2023-10-16 19:50:17 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
5d138b6928
[remove](function) make execute_impl const and remove running_difference function ( #24935 )
2023-09-27 18:17:28 +08:00
81e65f4a12
[feature](function) Support SHA family functions ( #24342 )
2023-09-20 17:21:45 +08:00
181dad4181
[fix](executor) make elt / repeat smooth upgrade. ( #21493 )
...
BE : 2.0，FE : 1.2
before
mysql [(none)]>select elt(1, 'aaa', 'bbb');
ERROR 1105 (HY000): errCode = 2, detailMessage = (127.0.0.1)[INTERNAL_ERROR]Function elt get failed, expr is VectorizedFnCall[elt](arguments=,return=String) and return type is String.
mysql [test]> INSERT INTO tbb VALUES (1, repeat("test1111", 8192))(2, repeat("test1111", 131072));
mysql [test]>select k1, md5(v1), length(v1) from tbb;
+------+----------------------------------+--------------+
| k1 | md5(`v1`) | length(`v1`) |
+------+----------------------------------+--------------+
| 1 | d41d8cd98f00b204e9800998ecf8427e | 0 |
| 2 | d41d8cd98f00b204e9800998ecf8427e | 0 |
+------+----------------------------------+--------------+
now
mysql [test]>select elt(1, 'aaa', 'bbb');
+----------------------+
| elt(1, 'aaa', 'bbb') |
+----------------------+
| aaa |
+----------------------+
mysql [test]>select k1, md5(v1), length(v1) from tbb;
+------+----------------------------------+--------------+
| k1 | md5(`v1`) | length(`v1`) |
+------+----------------------------------+--------------+
| 1 | 1f44fb91f47cab16f711973af06294a0 | 65536 |
| 2 | 3c514d3b89e26e2f983b7bd4cbb82055 | 1048576 |
+------+----------------------------------+--------------+
2023-07-06 19:15:06 +08:00
d03bb4ba7b
[Optimize](function) Optimize locate function by compare across strings ( #20290 )
...
Optimize locate function by compare across strings. about 90% speed up test by sum()
2023-06-05 12:43:14 +08:00
d64be9565d
[Bug](function) fix function in get wrong result when input const column ( #19791 )
...
fix function in get wrong result when input const column
2023-05-22 10:58:29 +08:00
6626f26506
[optimize](string) optimize char_length function by SIMD ( #18925 )
...
Optimize char_length function by SIMD
(1) optimize utf8_len compute
(2) 840% up
2023-04-28 17:22:35 +08:00
b75f4c97f3
[function](string) support char function ( #18878 )
...
* [function](string) support char function
* fix
2023-04-22 08:36:48 +08:00
ab9500bfa6
[optimize](string) optimize instr and locate function for constant arguments ( #18692 )
...
Optimize instr and locate function for constant arguments.
instr and locate function constant arguments has 58%~200% performance improvement.
refactor locate(substr, str, pos) as standardized arguments processing.
2023-04-20 10:40:19 +08:00
e412dd12e8
[chore](build) Use include-what-you-use to optimize includes (PART II) ( #18761 )
...
Currently, there are some useless includes in the codebase. We can use a tool named include-what-you-use to optimize these includes. By using a strict include-what-you-use policy, we can get lots of benefits from it.
2023-04-19 23:11:48 +08:00
18898db09d
[feature](function) Add new parameters to 'trim'. ( #18580 )
2023-04-18 14:13:30 +08:00
43392918cd
[Optimization](functions)Optimize function call for const columns. ( #18310 )
2023-04-12 11:11:01 +08:00
fb50626075
[optimize](string) optimize concat function by SIMD memcpy ( #18458 )
...
Optimize concat function 29% up by memcpy_small_allow_read_write_overflow15.
Optimize string functions list: concat, convert_to, mask, initcap, lower, upper.
concat function has 29% up:
2023-04-08 17:05:34 +08:00
4692d6764c
[refactor](remove string val) remove string val structure, it is same with string ref ( #17461 )
...
remove stringval, decimalv2val, bigintval
2023-03-08 10:42:20 +08:00
199d7d3be8
[Refactor]Merged string_value into string_ref ( #15925 )
2023-01-22 16:39:23 +08:00
21c2e485ae
[improvment](function) add new function substring_index ( #15024 )
2022-12-15 09:54:34 +08:00
38570312dd
[feature](split_by_string)support split by string function ( #13741 )
2022-12-12 15:22:30 +08:00
7a08a799e9
[Vectorized](function) support order by convert_to function ( #14555 )
2022-11-29 15:22:27 +08:00
ee934483eb
[Enhancement](function) optimize the upper and lower functions using the simd instruction. ( #13326 )
...
optimize the `upper` and `lower` functions using the simd instruction.
2022-11-03 15:12:25 +08:00
5805011629
[Feature](string-function) Add function mask/mask_first_n/mask_last_n ( #13694 )
...
Implementation of mask function from hive.
2022-10-28 10:43:56 +08:00
43c6428aea
[Function](string) support sub_replace function ( #13736 )
...
* [Function](string) support sub_replace function
* remove conf
2022-10-28 08:40:08 +08:00
2b328eafbb
[function](string_function) add new string function 'extract_url_parameter' ( #13323 )
2022-10-20 11:11:43 +08:00
8a068c8c92
[function](string_function) add new string function 'not_null_or_empty' ( #13418 )
2022-10-19 11:10:37 +08:00
de4315c1c5
[feature](function) support initcap string function ( #13193 )
...
support `initcap` string function
2022-10-13 21:31:44 +08:00
f1539761e8
[Bugfix](string_functions) rearrange code to avoid global buffer overflow in FindInSetOp::execute ( #12677 )
2022-09-21 09:19:38 +08:00
0ead048b93
[Enhancement](column) remove ColumnString terminating zero and add a data_version for pblock ( #12456 )
...
1. remove ColumnString terminating zero
2. add a data_version for pblock
3. change EncryptionMode to enum class
2022-09-14 21:25:22 +08:00
09b45f2b71
[Function](ELT)Add elt function ( #12321 )
2022-09-07 15:21:08 +08:00
df47b6941d
[feature-wip](array-type) support the array type in reverse function ( #11213 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-09 20:49:09 +08:00
e0ef9b8f6c
[refactor](vectorized) to_bitmap(-1) return NULL instead of return parse failed error_message ( #8373 )
2022-03-11 17:21:47 +08:00
cd8694e532
[feature][vectorized] support replace() ( #8384 )
2022-03-08 18:57:12 +08:00
454b45bea3
[feature](vectorize)(function) support regexp&&sm4&&aes functions ( #8307 )
2022-03-08 13:14:02 +08:00
2b9b0fc1ec
[Fix] Function percentile input null return null ( #8238 )
2022-03-01 14:42:48 +08:00
b26e7e3c28
[feature](function)(vec) support locate function ( #7988 )
...
* support function locate in vectorized engine
* add ut and fix some bug
2022-02-12 16:00:37 +08:00
