4a117800ca
[Bug](Function) fix json contains with empty value ( #36320 ) ( #36418 )
2024-06-18 10:20:45 +08:00
719e50f353
[fix](json function) fix failed when json_exists_path use not null input ( #34289 )
2024-05-11 15:04:35 +08:00
25358564ca
[Fix](compile) Fix gcc compile on master ( #33864 )
...
This is imported by #33511 . wrongly used
ColumnStr<T> ();
which violate C++20 standard(see https://wg21.cmeerw.net/cwg/issue2237 ) but still supported by clang up until now(see llvm/llvm-project#58112 )
2024-04-19 23:41:37 +08:00
aca7328109
[bugfix]json_length() BE crash fix ( #32145 )
...
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com >
2024-03-15 18:04:49 +08:00
a5565f68b2
[Refactor](opentelemetry) Remove opentelemetry ( #26605 )
2023-11-09 18:05:34 +08:00
68087f6c82
[fix](json function) Fix the slow performance of get_json_path when processing JSONB ( #24631 )
...
When processing JSONB, automatically convert to jsonb_extract_string
2023-09-27 21:17:39 +08:00
5d138b6928
[remove](function) make execute_impl const and remove running_difference function ( #24935 )
2023-09-27 18:17:28 +08:00
14bd290aec
[feature](jsonb)support json_length and json_contains function ( #24332 )
2023-09-20 10:40:44 +08:00
981586155c
[Improvement][json] optimize performance of json_extract by reusing json path object ( #23430 )
...
* reuse json path to speed up json function
* fix typo
* clang format
* path reentry safe
* fix compile error
* fix bug of continue
2023-08-27 17:39:10 +08:00
8ef6b4d996
[fix](json) fix json int128 overflow ( #22917 )
...
* support int128 in jsonb
* fix jsonb int128 write
* fix jsonb to json int128
* fix json functions for int128
* add nereids function jsonb_extract_largeint
* add testcase for json int128
* change docs for json int128
* add nereids function jsonb_extract_largeint
* clang format
* fix check style
* using int128_t = __int128_t for all int128
* use fmt::format_to instead of snprintf digit by digit for int128
* clang format
* delete useless check
* add warn log
* clang format
2023-08-25 11:40:30 +08:00
d4694167a8
[Enhancement](chore) Some Status relevant enhancement ( #23072 )
2023-08-21 14:14:38 +08:00
ddd7e9871d
[improvement](Jsonb) optimization Jsonb path parse ( #21495 )
...
The previous logic was to read jsonbvalue while parsing the json path. For complex json paths, there will be a lot of repeated parsing work. The optimization idea is to separate the analysis and value of jsonpath
2023-07-23 18:59:12 +08:00
be55cb8dfc
[Improve](jsonb_extract) support jsonb_extract multi parse path ( #21555 )
...
support jsonb_extract multi parse path
2023-07-12 21:37:36 +08:00
d76fa427a3
[improve](jsonb)Invalid json path prompts an error instead of null ( #19646 )
...
1. Invalid json path prompts an error instead of null：
before：
```sql
mysql> SELECT jsonb_extract('[{"k1":"v41","k2":400},1,"a",3.14]', '$[a]');
+-------------------------------------------------------------+
| jsonb_extract('[{"k1":"v41","k2":400},1,"a",3.14]', '$[a]') |
+-------------------------------------------------------------+
| NULL |
+-------------------------------------------------------------+
1 row in set (0.01 sec)
```
now
```sql
mysql> SELECT jsonb_extract('[{"k1":"v41","k2":400},1,"a",3.14]', '$[a]');
ERROR 1105 (HY000): errCode = 2, detailMessage = (127.0.0.1)[INVALID_ARGUMENT]Json path error: Invalid Json Path for value: $[a]
```
2. fix some problem: https://github.com/apache/doris/pull/19185
a. support negative numbers
```sql
mysql> SELECT jsonb_extract('[{"k1":"v41","k2":400},1,"a",3.14]', '$[-2]');
+--------------------------------------------------------------+
| jsonb_extract('[{"k1":"v41","k2":400},1,"a",3.14]', '$[-2]') |
+--------------------------------------------------------------+
| "a" |
+--------------------------------------------------------------+
1 row in set (0.02 sec)
```
b. Avoid using unnecessary memory
3. Supplementary regression test
2023-06-30 14:29:21 +08:00
a4fdf7324a
[Bug](javaudf) fix BE crash if javaudf is push down ( #21139 )
2023-06-28 15:01:24 +08:00
d64be9565d
[Bug](function) fix function in get wrong result when input const column ( #19791 )
...
fix function in get wrong result when input const column
2023-05-22 10:58:29 +08:00
294599ee45
[feature](jsonb) rename JSONB type name and function name to JSON ( #19774 )
...
To be more compatible with MySQL, rename JSONB type name and function name to JSON.
The old JSONB type name and jsonb_xx function can still be used for backward compatibility.
There is a function jsonb_extract remained since json_extract is used by json string function and more work need to change it. It will be changed further.
2023-05-18 16:16:52 +08:00
c87e78dc35
[bug](jsonb) fix jsonb query bug When the json key value contains "." ( #19185 )
...
Issue Number: close #19173
mysql> SELECT jsonb_extract('{"a.b.c":{"k1":"v31", "k2.a1": 300},"a":"opentelemetry"}', '$."a.b.c".k1');
+-------------------------------------------------------------------------------------------+
| jsonb_extract('{"a.b.c":{"k1":"v31", "k2.a1": 300},"a":"opentelemetry"}', '$."a.b.c".k1') |
+-------------------------------------------------------------------------------------------+
| "v31" |
+-------------------------------------------------------------------------------------------+
1 row in set (0.06 sec)
2023-05-15 15:43:12 +08:00
1dfc5ea34c
[bugfix](jsonb) fix jsonb parser crash on noavx2 host ( #18977 )
...
support avx2 and noavx2 for jsonb parser using __AVX2__ macro.
2023-04-26 15:10:12 +08:00
e412dd12e8
[chore](build) Use include-what-you-use to optimize includes (PART II) ( #18761 )
...
Currently, there are some useless includes in the codebase. We can use a tool named include-what-you-use to optimize these includes. By using a strict include-what-you-use policy, we can get lots of benefits from it.
2023-04-19 23:11:48 +08:00
0b074ade02
[fix](const column) fix coredump caused by const column for some functions ( #18737 )
2023-04-18 13:57:55 +08:00
43392918cd
[Optimization](functions)Optimize function call for const columns. ( #18310 )
2023-04-12 11:11:01 +08:00
17f4990bd3
[enhancement](functioncontext) function context should use shared ptr and simply function context ( #17311 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-03-02 16:23:54 +08:00
0f3c0b78e3
[Improvement](JSONB) improve performance JSONB initial json parsing using simdjson ( #15219 )
...
test data: https://data.gharchive.org/2020-11-13-18.json.gz , 2GB, 197696 lines
before: String 13s vs. JSONB 28s
after: String 13s vs. JSONB 16s
**NOTICE: simdjson need to be patched since BOOL is conflicted with a macro BOOL defined in odbc sqltypes.h**
2022-12-29 09:29:09 +08:00
ed92a8f81e
[feature](jsonb function)change jsonb_extract_string behavior and doc ( #14619 )
...
1. change jsonb_extract_string behavior: convert to string instead of NULL if the type of json path is not string
2. move jsonb tutorial doc to JSONB data type
2022-11-28 11:36:54 +08:00
52c6ba051e
[feature](jsonb type)refactor JSONB type using column and add testcase ( #13778 )
...
1. Refactor JSONB type using ColumnString instead making a copy.
2. Add regression testcase for JSONB load and functions.
2022-11-26 10:06:15 +08:00
755a946516
[feature](jsonb) jsonb functions ( #13366 )
...
Issue Number: Step3 of DSIP-016: Support JSON type
2022-10-19 08:44:08 +08:00
1bd14f1d82
[feature-wip](jsonb) jsonb parse function and load ( #13129 )
...
add function to parse json string to jsonb format and use it to support stream load.
2022-10-12 13:56:37 +08:00
