edecc2e706
[feature-wip](inverted index) API for inverted index reader and syntax for fulltext match ( #14211 )
...
* [feature-wip](inverted index)inverted index api: reader
* [feature-wip](inverted index) Fulltext query syntax with MATCH/MATCH_ALL/MATCH_ALL
* [feature-wip](inverted index) Adapt to index meta
* [enhance] add more metrics
* [enhance] add fulltext match query check for column type and index parser
* [feature-wip](inverted index) Support apply inverted index in compound predicate which except leaf node of and node
2022-12-30 21:48:14 +08:00
520b6d7910
[Improvement](decimalv3) Add a config to check overflow for DECIMALV3 ( #15463 )
2022-12-30 14:02:24 +08:00
edb9a3b58d
[Bug](timediff) Fix wrong result for function timediff ( #15312 )
2022-12-30 00:28:51 +08:00
c22ba8e160
[Bug](Decimalv3) coredump of decimalv3 multiply ( #15452 )
2022-12-29 15:35:17 +08:00
0f3c0b78e3
[Improvement](JSONB) improve performance JSONB initial json parsing using simdjson ( #15219 )
...
test data: https://data.gharchive.org/2020-11-13-18.json.gz , 2GB, 197696 lines
before: String 13s vs. JSONB 28s
after: String 13s vs. JSONB 16s
**NOTICE: simdjson need to be patched since BOOL is conflicted with a macro BOOL defined in odbc sqltypes.h**
2022-12-29 09:29:09 +08:00
305dd15fea
[improvement](index) Support bitmap index can be applied with compound predicate when enable vectorized engine query ( #13035 )
...
Current bitmap index only can apply pushed down predicates which in AND conditions. When predicates in OR conditions and other complex compound conditions, it will not be pushed down to the storage layer, this leads to read more data.
Based on that situation, this pr will do:
1. this pr in order to support bitmap index apply compound predicates, query sql like:
select * from tb where a > 'hello' or b < 100;
select * from tb where a > 'hello' or b < 100 or c > 'ok';
select * from tb where (a > 'hello' or b <100) and (a < 'world' or b > 200);
select * from tb where (not a> 'hello') or b < 100;
...
above sql，column a and b and c has created bitmap_index.
2. this optimization can reduce reading data by index
3. set config enable_index_apply_compound_predicates to use this optimization
2022-12-28 20:08:57 +08:00
a98636a970
[bugfix](from_unixtime) fix timezone not work for from_unixtime ( #15298 )
...
* [bugfix](from_unixtime) fix timezone not work for from_unixtime
2022-12-23 19:05:09 +08:00
6b3721af23
[Bug](function) fix core dump on reverse() when big string input
...
fix core dump on reverse() when big string input
2022-12-23 10:14:09 +08:00
df5969ab58
[Feature] Support function roundBankers ( #15154 )
2022-12-22 22:53:09 +08:00
77c15729d4
[fix](memory) Fix too many repeat cause OOM ( #15217 )
2022-12-22 17:16:18 +08:00
2501198800
[Bug](compile) Fix compiling error ( #15207 )
2022-12-20 20:05:49 +08:00
5cf21fa7d1
[feature](planner) mark join to support subquery in disjunction ( #14579 )
...
Co-authored-by: Gabriel <gabrielleebuaa@gmail.com >
2022-12-20 15:22:43 +08:00
b2438b076d
[Bug](case function) do not crash if prepare failed ( #15113 )
2022-12-16 11:02:05 +08:00
9fb62a23f4
[Bug](function) fix overflow on concat_ws ( #15043 )
...
fix overflow on concat_ws
2022-12-15 19:44:27 +08:00
21c2e485ae
[improvment](function) add new function substring_index ( #15024 )
2022-12-15 09:54:34 +08:00
1200b22fd2
[function](round) compute accurate round value by decimal ( #14946 )
2022-12-13 09:53:43 +08:00
b5c0d4870d
[fix](nereids)fix bug of elt and sub_replace function ( #14971 )
2022-12-12 17:37:36 +08:00
38570312dd
[feature](split_by_string)support split by string function ( #13741 )
2022-12-12 15:22:30 +08:00
33349c3419
[feature](function)Support negative index for function split_part ( #13914 )
2022-12-12 09:56:09 +08:00
f3aea7f0f0
[Enhancement](status) Unify error code and enable customed err msg for BE internal errors ( #14744 )
2022-12-11 23:33:18 +08:00
3286fb48ab
[fix](if) fix coredump of if const ( #14858 )
2022-12-07 09:43:10 +08:00
016e47b857
[refactor](date function) simplify function template arguments ( #14814 )
2022-12-05 17:59:47 +08:00
ba9a777554
[fix](function) StringRef should not be key of timezone cache ( #14719 )
2022-12-01 16:31:47 +08:00
7a1fde379c
[Enhancement](function) optimize for decimal arithmetic calculation ( #14674 )
...
* optimize for decimal arithmetic calculation
* Apply suggestions from code review
Co-authored-by: Gabriel <gabrielleebuaa@gmail.com >
Co-authored-by: Gabriel <gabrielleebuaa@gmail.com >
2022-11-30 10:41:03 +08:00
a60490651f
[improvement](function) add timezone cache for convert_tz ( #14616 )
2022-11-29 17:00:54 +08:00
fe95b84c34
[fix](jsonb)fix CAST String to JSONB nullable problem ( #14626 )
...
fix CAST String to SONB nullable problem in DEBUG mode.
2022-11-29 16:22:22 +08:00
7a08a799e9
[Vectorized](function) support order by convert_to function ( #14555 )
2022-11-29 15:22:27 +08:00
3e8b3658c7
[feature-wip](decimalv3) Support basic agg and arithmetic operations for decimal v3 ( #14513 )
2022-11-29 15:12:41 +08:00
ed92a8f81e
[feature](jsonb function)change jsonb_extract_string behavior and doc ( #14619 )
...
1. change jsonb_extract_string behavior: convert to string instead of NULL if the type of json path is not string
2. move jsonb tutorial doc to JSONB data type
2022-11-28 11:36:54 +08:00
52c6ba051e
[feature](jsonb type)refactor JSONB type using column and add testcase ( #13778 )
...
1. Refactor JSONB type using ColumnString instead making a copy.
2. Add regression testcase for JSONB load and functions.
2022-11-26 10:06:15 +08:00
7ae7830c50
[improvement](function)add size function alias array_size ( #14594 )
...
* add size function alias
* fix
2022-11-25 22:29:48 +08:00
7ba4cd764a
[enhancement](array-function) array_position,array_contains,countequal which in FunctionArrayIndex handle target NULL ( #14564 )
...
in the previous, the result is:
```
mysql> select array_position([1, null], null);
+--------------------------------------+
| array_position(ARRAY(1, NULL), NULL) |
+--------------------------------------+
| NULL |
+--------------------------------------+
1 row in set (0.02 sec)
```
but after this commit, the result become:
```
mysql> select array_position([1, null], null);
+--------------------------------------+
| array_position(ARRAY(1, NULL), NULL) |
+--------------------------------------+
| 2 |
+--------------------------------------+
1 row in set (0.02 sec)
```
2022-11-25 14:19:50 +08:00
d5d356b17f
[vectorized](function) support order by field function ( #14528 )
...
* [vectorized](function) support order by field function
* update
* update test
2022-11-25 14:00:46 +08:00
bc699511d0
[Fix](array-function) fix array_distinct null values ( #14544 )
...
in the previous the result is:
```
mysql> select array_distinct([1,1,3,3,null, null, null]);
+-----------------------------------------------------+
| array_distinct(ARRAY(1, 1, 3, 3, NULL, NULL, NULL)) |
+-----------------------------------------------------+
| [1, 3, NULL, NULL, NULL] |
+-----------------------------------------------------+
1 row in set (0.00 sec)
```
after this fix, the result becomes:
```
mysql> select array_distinct([1,1,3,3,null, null, null]);
+-----------------------------------------------------+
| array_distinct(ARRAY(1, 1, 3, 3, NULL, NULL, NULL)) |
+-----------------------------------------------------+
| [1, 3, NULL] |
+-----------------------------------------------------+
1 row in set (0.00 sec)
```
2022-11-24 19:07:28 +08:00
1ec7f45fb6
[Bug](avg) Fix avg for bigint ( #14433 )
2022-11-22 10:29:59 +08:00
16d8a1853a
[Bug](array-function) array set function not handle all null value ( #14318 )
2022-11-22 09:07:43 +08:00
2c42f0a905
[refactor](decimalv3) Refine code for DecimalV3 ( #14394 )
2022-11-19 16:57:17 +08:00
b4aef889f2
[feature-array](array-function) add array constructor function array() ( #14250 )
...
* [feature-array](array-function) add array constructor function `array()`
```
mysql> select array(qid, creationDate) from nested_c_2 limit 10;
+------------------------------+
| array(`qid`, `creationDate`) |
+------------------------------+
| [1000038, 20090616074056] |
| [1000069, 20090616075005] |
| [1000130, 20090616080918] |
| [1000145, 20090616081545] |
+------------------------------+
10 rows in set (0.01 sec)
```
2022-11-19 10:49:50 +08:00
f86886f8f5
[Feature](function) Support array_compact function ( #14141 )
2022-11-15 14:24:37 +08:00
93e5d8e660
[Vectorized](function) support bitmap_from_array function ( #14259 )
2022-11-15 01:55:51 +08:00
7bb3792d51
[chore](build) Split the compliation units to build them in parallel ( #14232 )
2022-11-14 10:57:10 +08:00
035657c5a1
[typo](comment) Fix a lot of spell errors in be comments ( #14208 )
...
fix typos.
2022-11-12 16:06:15 +08:00
43490a33a5
[feature-array](array-type) Add array function array_with_constant ( #14115 )
...
Return array of constants with length num.
```
mysql> select array_with_constant(4, 1223);
+------------------------------+
| array_with_constant(4, 1223) |
+------------------------------+
| [1223, 1223, 1223, 1223] |
+------------------------------+
1 row in set (0.01 sec)
```
co-authored-by @eldenmoon
2022-11-11 22:08:43 +08:00
0ba13af8ff
[feature](running_difference) support running_difference function ( #13737 )
2022-11-11 21:22:56 +08:00
12652ebb0e
[UDF](java udf) using config to enable java udf instead of macro at compile time ( #14062 )
...
* [UDF](java udf) useing config to enable java udf instead of macro at compile time
2022-11-11 09:03:52 +08:00
0e26f28bf2
[Enhancement](runtime-filter) enlarge runtime filter in predicate threshold ( #13581 )
...
enlarge runtime filter in predicate threshold
2022-11-10 15:48:46 +08:00
90bfd87660
[feature](function) add new function uuid() ( #14092 )
2022-11-10 14:55:41 +08:00
55ca810445
[fix](Vectorized)fix json_object and json_array function return wrong result on vectorized engine ( #13775 )
...
Issue Number: close #13598
2022-11-09 11:26:55 +08:00
291fa499e9
[fix](JSON) Fail to parse JSONPath (libc++) ( #13941 )
2022-11-09 08:58:01 +08:00
ae3c513d74
use extern template to date_time_add ( #13970 )
2022-11-08 22:11:41 +08:00
