80dd027ce2
[opt](join) For left semi/anti join without mark join conjunct and without other conjucnts, stop probing after matching one row ( #34703 )
2024-05-18 18:08:50 +08:00
1300317723
[Exec](join) Support column string64 to avoid join failed in string size overflow the uint32 ( #33511 ) ( #33850 )
2024-04-18 19:43:08 +08:00
b07e0a2f06
[FIX](cast)fix full/right out join for cast array ( #33475 )
...
in some case, we has code
```
if (_join_op == TJoinOp::RIGHT_OUTER_JOIN || _join_op == TJoinOp::FULL_OUTER_JOIN) {
_probe_column_convert_to_null = _convert_block_to_null(*input_block);
}
```
then do next function like cast , but in function cast we assume block column is same with from_type.which will make status error
2024-04-17 23:42:13 +08:00
3081fc584d
[Improvement](runtime-filter) support sync join node build side's size to init bloom runtime filter ( #32180 )
...
support sync join node build side's size to init bloom runtime filter
2024-04-11 09:31:50 +08:00
ad2d20348a
[fix](pipeline) fix use error row desc when origin block clear #32803 ( #32849 )
...
* fix
* add case
2024-03-26 20:02:46 +08:00
de3b99be00
[fix](pipeline) fix check failed in StatefulOperator
2024-03-25 22:33:30 +08:00
baf3ae1a93
[refactor](nereids)unify outputTupleDesc and projection be part ( #32439 )
2024-03-22 16:35:43 +08:00
23c12fd68f
[fix](join) core caused by null-safe-equal join ( #32623 )
2024-03-22 08:53:47 +08:00
6871c964af
[fix](nereids)NullSafeEqualToEqual rule only change to equal if both children are not nullable ( #32374 )
...
NullSafeEqualToEqual rule only change to equal if both children are not nullable
2024-03-21 14:07:49 +08:00
c72e55d867
[enhancement](core) throw exception instead of core during insert_range_from method ( #31592 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-29 19:51:18 +08:00
1456785aa1
[fix](join) incorrect result of mark join in nested loop join ( #31280 )
2024-02-23 19:03:28 +08:00
c56cb0ac3e
[Exec](RF) Support merge remote rf local first ( #31067 )
2024-02-22 13:01:48 +08:00
bb4575a392
[Improvement](join) optimization for build_side_output_column ( #30826 )
...
optimization for build_side_output_column
2024-02-19 17:22:03 +08:00
45b4189bb6
[Refactor](opt) Opt rf and remove unless code ( #30900 )
...
Opt rf and remove unless code
2024-02-18 11:50:16 +08:00
2573150f6d
[refactor](runtime filter) do not wait runtime filter rpc finished when hash node or pipeline finished ( #30970 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-16 10:16:40 +08:00
e8f614791e
[fix](pipeline) Set the flag of short circuit only when hash join sink finished ( #30977 )
2024-02-16 10:12:24 +08:00
c9ab243153
[feat-wip](join) support mark join for right semi join(without mark join conjunct) ( #30767 )
2024-02-04 14:28:38 +08:00
77b366fc4b
[fix](join) incorrect result of mark join ( #30543 )
...
incorrect result of mark join
2024-01-31 23:53:40 +08:00
ef8d9ad9a4
[pipelinex](profile) improve memory counter of pipelineX ( #30538 )
2024-01-31 23:53:39 +08:00
22322a3864
[refactor](join) remove unused RowRefListType from join ( #30442 )
2024-01-27 09:10:41 +08:00
713798d549
[feature](nereids)support mark join ( #30133 )
...
Co-authored-by: Jerry Hu <mrhhsg@gmail.com >
2024-01-27 09:09:53 +08:00
2befa75b9c
[Rf](exec) Support build exactly not cal by ndv ( #30398 )
2024-01-27 09:09:02 +08:00
1d7d7ee9b6
[Chore](join) split out join hash map from hash map ( #30280 )
...
split out join hash map from hash map
2024-01-25 13:24:52 +08:00
24ed3e4103
[Fix](Expr&code-style) check prepare&open before every VExpr execute ( #26673 )
2024-01-23 10:09:54 +08:00
eb86872b70
[improve](profile) add init probe side timer in join node ( #30079 )
2024-01-19 15:48:56 +08:00
7e821f3d66
[Performance](Join) Support all match one logic ( #30019 )
...
Support all match one logic
2024-01-18 12:03:07 +08:00
33b8311d5f
[Improvement](runtime-filter) build runtime filter before build hash table on join build probe ( #29727 )
...
build runtime filter before build hash table on join build probe
2024-01-12 11:59:52 +08:00
e556536de1
[Refactor](join) split SetHashTableVariants out from HashTableVariants ( #29519 )
...
split SetHashTableVariants out from HashTableVariants
2024-01-08 10:37:00 +08:00
d8a08dad90
[Bug](mark-join) fix wrong result on mark join + other conjunct ( #29321 )
...
fix wrong result on mark join + other conjunct
2024-01-04 11:58:39 +08:00
1fbbff32b2
[fix](pipelinex) coredump caused by VRuntimeFilterSlots::_is_global was not set ( #29446 )
2024-01-03 12:40:41 +08:00
14e7eb7624
[Opt](rf) Opt broadcast join remote runtime filter merge and wait ( #29439 )
2024-01-03 11:21:28 +08:00
0af9371a96
[fix](hash join) fix column ref DCHECK failure of hash join node block mem reuse ( #28991 )
...
Introduced by #28851 , after evaluating build side expr, some columns in resulting block may be referenced more than once in the same block.
e.g. coalesce(col_a, 'string') if col_a is nullable but actually contains no null values, in this case funcition coalesce will insert a new nullable column which references the original col_a.
2023-12-25 22:19:01 +08:00
7081139bdc
[fix](block) fix be core while mutable block merge may cause different row size between columns in origin block ( #27943 )
2023-12-25 20:35:22 +08:00
d75300f166
[fix](hash join) fix stack overflow caused by evaluate case expr on huge build block ( #28851 )
2023-12-22 15:45:12 +08:00
e53cfa09da
[fix](join) incorrect result of right anti join with nullable ( #28301 )
2023-12-14 14:07:12 +08:00
ac167f493b
[fix](join) fix decimal overflow caused by left outer join ( #28221 )
...
For left outer join or full outer join, when build side data is empty, null data is output for build side, but nested column data of nullable column is not properly initialized, which may cause decimal arithmetic overflow
2023-12-11 11:51:05 +08:00
abc802b5ba
[bugfix](core) child block is shared between operator and node, it should be shared ptr ( #28106 )
...
_child_block in nest loop join , table value function, repeat node will be shared between ExecNode and related operator, but it should not be a unique ptr in operator, it belongs to exec node.
It will double free the block, if operator's close method is not called correctly.
It should be a shared ptr, then it will not core even if the opeartor's close method is not called.
2023-12-09 00:18:14 +08:00
e3d2425d47
[Improvement](join) remove insert_indices_from_join and special judge for -1 ( #27779 )
...
remove insert_indices_from_join and special judge for -1
2023-12-04 11:03:22 +08:00
d969047b50
[Refactor](join) refactor of hash join ( #27557 )
...
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table
Co-authored-by: HappenLee <happenlee@hotmail.com >
Co-authored-by: BiteTheDDDDt <pxl290@qq.com >
2023-11-28 19:46:00 +08:00
91b0edfaa2
[Bug](join) try fix wrong _has_null_in_build_side setted ( #27684 )
...
try fix wrong _has_null_in_build_side setted
2023-11-28 17:42:14 +08:00
f565f60bc3
[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default ( #27587 )
2023-11-28 13:02:30 +08:00
301bfe4d5d
[Bug](mark-join) fix mark join report error when probe block have column do not output ( #27360 )
...
fix mark join report error when probe block have column do not output
2023-11-23 11:16:02 +08:00
febd60c75f
[fix](join) incorrect result of left join with other conjuncts ( #27238 )
2023-11-19 15:36:39 +08:00
a5565f68b2
[Refactor](opentelemetry) Remove opentelemetry ( #26605 )
2023-11-09 18:05:34 +08:00
6761dc4113
[coverage](test) improve test coverage ( #26096 )
...
improve test coverage
2023-10-30 18:01:55 +08:00
b5ee4a9dbb
[enhancement](profilev2) add some fields for profile v2 ( #25611 )
...
Add 3 counters for ExecNode:
ExecTime - Total execution time(excluding the execution time of children).
OutputBytes - The total number of bytes output to parent.
BlockCount - The total count of blocks output to parent.
2023-10-23 15:55:40 +08:00
7385602b19
[bug](rf) fix only min/max rf return error when has remote target ( #25588 )
2023-10-19 19:26:29 +08:00
ef7d8aa99a
[fix](be)confix bug of converting outer join probe block to nullable ( #25492 )
...
_do_evaluate will add temp result column into original table block, so in order to only convert correct columns to be nullable, need call convert_block_to_null before _do_evaluate
2023-10-17 10:10:56 +08:00
d00d029ffb
Separate fixed key hash map context creator ( #25438 )
...
Separate fixed key hash map context creator
2023-10-16 11:20:30 +08:00
37dbda6209
[pipelineX](refactor) Use class template to simplify join ( #25369 )
2023-10-13 16:51:55 +08:00
