a8232c67f9
[pipelineX](runtime filter) Fix task timeout caused by runtime filter ( #33332 ) ( #33369 )
2024-04-08 16:30:32 +08:00
05a84bd485
[Bug](runtime-filter) set need_local_merge to false when rf is broadcast ( #33211 )
...
set need_local_merge to false when rf is broadcast
2024-04-03 19:14:09 +08:00
34f5521643
[Bug](min-max) store string data in MinMaxNumFunc to avoid use after free when cancel ( #33152 )
...
* store string data in MinMaxNumFunc to avoid use after free when cancel
* update
2024-04-02 22:35:58 +08:00
b6a35d68b0
[code](Refactor) Del unless filter id in runtime filter func ( #32502 )
...
Del unless filter id in runtime filter func
2024-03-21 14:07:49 +08:00
6ea8e51261
[Performance](join) speed up the colocate and bucket shuffle join by change rf size ( #32421 )
2024-03-21 14:07:24 +08:00
b66840efd7
[Fix](regression test) Fix <=> rf cause regresion test failed ( #32377 )
2024-03-21 14:07:23 +08:00
9c1888e7ec
[RuntimeFilter](exec) support min max runtime filter and do refactor ( #32210 )
2024-03-15 18:06:20 +08:00
c8f3643890
[exec](runtimefilter) support null aware in runtime filter ( #32152 )
...
null aware in runtime filter
2024-03-15 18:05:13 +08:00
847ec368be
[Fix](smooth-upgrade) Fix incompatibility when upgrade from 2.0 to 2.1 ( #32220 )
2024-03-14 11:23:05 +08:00
b0b7161ad0
[feature](rf) add filter info profile when rf run as expr ( #31822 )
2024-03-12 14:17:48 +08:00
2470634859
[RuntimeFilter] fix <=> runtime filter failed bug ( #32003 )
2024-03-12 14:13:13 +08:00
231768db0d
[Performance](exec) Support runtime filter in <=> join ( #31754 )
2024-03-06 13:06:26 +08:00
b248d3a27e
[Refactor](rf) Refactor the rf code interface to remove update filter v1 ( #31643 )
2024-03-02 17:12:49 +08:00
d8b9909675
[Fix](Status) Handle returned Status correctly #31434
2024-03-01 04:25:43 +08:00
52c45e38af
[Refactor](RF) refactor the profile of rf and pipeline-x support local ignore ( #31287 )
...
* [Refactor](RF) refactor the profile of rf and pipeline-x support local ignore
* fix local merge filter
2024-02-23 19:05:06 +08:00
c56cb0ac3e
[Exec](RF) Support merge remote rf local first ( #31067 )
2024-02-22 13:01:48 +08:00
278b232e76
[Bug](json reader) object should stop processing when encounter error ( #31159 )
...
If DATA_QUALITY_ERROR encountered we should stop processing this document any more.Otherwise there will be UB in simdjson.
2024-02-21 13:53:32 +08:00
a3c78dd21a
[chore](refactor) refactor some rf code and delete rpc file ( #31031 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-18 11:50:17 +08:00
45b4189bb6
[Refactor](opt) Opt rf and remove unless code ( #30900 )
...
Opt rf and remove unless code
2024-02-18 11:50:16 +08:00
2573150f6d
[refactor](runtime filter) do not wait runtime filter rpc finished when hash node or pipeline finished ( #30970 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-16 10:16:40 +08:00
02c37b8ead
opt the rf code and remove rf unless code ( #30861 )
2024-02-16 10:12:24 +08:00
0f47f7f389
[Feature](runtime filter) normalize ignore runtime filter ( #30152 )
...
normalize ignore runtime filter
2024-02-03 20:24:39 +08:00
711b156a78
[Refactor][Rf] remove unless code in RF ( #30597 )
2024-01-31 23:53:40 +08:00
e6fbccd3ed
[Feature](Variant) support row store for variant type ( #30052 )
2024-01-31 23:53:39 +08:00
6231300e9e
[Fix](Rf) fix in_or_bloom filter merge error in broadcast join remote target tpcds q78 ( #30492 )
2024-01-29 19:03:47 +08:00
2befa75b9c
[Rf](exec) Support build exactly not cal by ndv ( #30398 )
2024-01-27 09:09:02 +08:00
9aaa6ba351
[Fix](Variant) fix variant lost null info after cast_column ( #30153 )
...
This could result incorrect output in hirachinal cases
```
sql """insert into ${table_name} values (-3, '{"a" : 1, "b" : 1.5, "c" : [1, 2, 3]}')"""
sql """insert into ${table_name} select -2, '{"a": 11245, "b" : [123, {"xx" : 1}], "c" : {"c" : 456, "d" : "null", "e" : 7.111}}' as json_str
union all select -1, '{"a": 1123}' as json_str union all select *, '{"a" : 1234, "xxxx" : "kaana"}' as json_str from numbers("number" = "4096") limit 4096 ;"""
mysql> select v["c"] from var_rs where k = -3 or k = -2;
+----------------------+
| element_at(`v`, 'c') |
+----------------------+
| [1,2,3] |
| [] |
+----------------------+
2 rows in set (0.04 sec)
```
2024-01-27 09:08:29 +08:00
92a9e8265b
[Imporve](RF) Support remote broadcast join build bf exactly ( #30247 )
2024-01-23 14:11:54 +08:00
a4f29193f6
[pipelineX](fix) Fix incorrect runtime filter ( #29860 )
2024-01-12 13:58:19 +08:00
3cf95d0fdf
[Improvement](execute) optimize for ColumnNullable's serialize_vec/deserialize_vec ( #28788 )
...
optimize for ColumnNullable's serialize_vec/deserialize_vec
2024-01-12 11:59:52 +08:00
33b8311d5f
[Improvement](runtime-filter) build runtime filter before build hash table on join build probe ( #29727 )
...
build runtime filter before build hash table on join build probe
2024-01-12 11:59:52 +08:00
4ba4767eef
[improvement](scan) make global runtime filter support in-list filter ( #29394 )
2024-01-04 09:12:30 +08:00
14e7eb7624
[Opt](rf) Opt broadcast join remote runtime filter merge and wait ( #29439 )
2024-01-03 11:21:28 +08:00
280a01b815
[pipelineX](improvement) Support global runtime filter ( #28692 )
2023-12-20 20:06:26 +08:00
c26c0c31a5
[refactor](runtimefilter) do not use QueryContext in runtime filter ( #28559 )
2023-12-20 10:28:55 +08:00
877935442f
[feature](pipelineX)use markFragments instead of markInstances in pipelineX ( #27829 )
2023-12-11 17:59:53 +08:00
e1587537bc
[Fix](status) fix unhandled status in exprs #28218
...
which marked static_cast<void> in https://github.com/apache/doris/pull/23395/files
partially fixed #28160
2023-12-11 11:04:58 +08:00
104a822a2f
[Refacotr](RuntimeFilter) refactor rf code to improve performance ( #28094 )
2023-12-07 20:32:30 +08:00
f65103e2a6
[Chore](runtime-filter) unify interfaces of bloom filter and remove some unused code ( #27822 )
...
* unify interfaces of bloom filter and remove some unused code
2023-12-02 07:42:55 +08:00
d969047b50
[Refactor](join) refactor of hash join ( #27557 )
...
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table
Co-authored-by: HappenLee <happenlee@hotmail.com >
Co-authored-by: BiteTheDDDDt <pxl290@qq.com >
2023-11-28 19:46:00 +08:00
f565f60bc3
[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default ( #27587 )
2023-11-28 13:02:30 +08:00
b457856bd2
[chore](be) remove bthread scanner related codes ( #27417 )
2023-11-23 15:18:49 +08:00
3e1a5b6e29
[profile](rf) make runtime filter profile readable ( #27323 )
2023-11-22 21:13:35 +08:00
3ad865fef9
[refactor](storage) Expressing the types of computation layer and storage layer in PrimitiveTypeTraits ( #26191 )
2023-11-15 21:34:49 +08:00
30d1e6036c
[feature](runtime filter) New session variable runtime_filter_wait_infinitely ( #26888 )
...
New session variable: runtime_filter_wait_infinitely. If set runtime_filter_wait_infinitely = true, consumer of rf will wait on receiving until query is timeout.
2023-11-14 21:05:59 +08:00
504ec324bb
Revert "[refactor](scan) delete bloom_filter_predicate ( #26499 )" ( #26851 )
...
This reverts commit 2bb3ef198144954583aea106591959ee09932cba.
2023-11-13 16:27:23 +08:00
a5565f68b2
[Refactor](opentelemetry) Remove opentelemetry ( #26605 )
2023-11-09 18:05:34 +08:00
44b51bf0b9
[Feature](Variant) support variant load ( #26572 )
2023-11-08 00:37:57 -06:00
2bb3ef1981
[refactor](scan) delete bloom_filter_predicate ( #26499 )
2023-11-07 19:37:31 +08:00
9d83948987
[feature](pipelineX) Use dependency instead of block queue in the runtime filter ( #26078 )
2023-10-31 22:44:18 +08:00
