7bdc508ac7
[Bug](fix) fix coredump case in (not null, null) execpt (not null, not null) case ( #38756 )
...
## Proposed changes
Issue Number: close #38612
<!--Describe your changes.-->
2024-08-04 10:44:10 +08:00
25fb30c723
[fix](intersect) fix coredump caused by intersect of nullable and not nullable children #36401 ( #36441 )
...
## Proposed changes
Pick #36765
2024-06-26 17:45:21 +08:00
fb9363f042
[fix](set) incorrect result of set operator ( #35607 )
...
If there are duplicated expressions in the select list, the result will
be incorrect.
## Proposed changes
Issue Number: close #28438
<!--Describe your changes.-->
2024-05-30 19:59:37 +08:00
8c237e82a3
[Bug](exec) fix intersections/differences bug ( #34675 )
2024-05-11 11:45:31 +08:00
25358564ca
[Fix](compile) Fix gcc compile on master ( #33864 )
...
This is imported by #33511 . wrongly used
ColumnStr<T> ();
which violate C++20 standard(see https://wg21.cmeerw.net/cwg/issue2237 ) but still supported by clang up until now(see llvm/llvm-project#58112 )
2024-04-19 23:41:37 +08:00
8fd6d4c41b
[Chore](build) add -Wconversion and remove some unused code ( #33127 )
...
add -Wconversion and remove some unused code
2024-04-10 15:26:08 +08:00
f7e01ceffa
[bug](node) add dependency for set operation node ( #30203 )
...
These sinks must be completed one by one in order, eg: child(1) must wait child(0) build finish
2024-01-30 15:30:39 +08:00
1d7d7ee9b6
[Chore](join) split out join hash map from hash map ( #30280 )
...
split out join hash map from hash map
2024-01-25 13:24:52 +08:00
24ed3e4103
[Fix](Expr&code-style) check prepare&open before every VExpr execute ( #26673 )
2024-01-23 10:09:54 +08:00
e556536de1
[Refactor](join) split SetHashTableVariants out from HashTableVariants ( #29519 )
...
split SetHashTableVariants out from HashTableVariants
2024-01-08 10:37:00 +08:00
89d728290d
[Chore](execute) remove some unused code and adjust check_row_nums #28576
2023-12-19 09:55:50 +08:00
d969047b50
[Refactor](join) refactor of hash join ( #27557 )
...
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table
Co-authored-by: HappenLee <happenlee@hotmail.com >
Co-authored-by: BiteTheDDDDt <pxl290@qq.com >
2023-11-28 19:46:00 +08:00
a5565f68b2
[Refactor](opentelemetry) Remove opentelemetry ( #26605 )
2023-11-09 18:05:34 +08:00
47955f9109
[bug](intersect) fix intersect node nullable field should depend on _row_descriptor ( #26038 )
2023-10-28 22:39:36 +08:00
2972daaed9
[Bug](status) process error status on es_scroll_parser and compaction_action ( #25745 )
...
process error status on es_scroll_parser and compaction_action
2023-10-24 15:51:01 +08:00
b5ee4a9dbb
[enhancement](profilev2) add some fields for profile v2 ( #25611 )
...
Add 3 counters for ExecNode:
ExecTime - Total execution time(excluding the execution time of children).
OutputBytes - The total number of bytes output to parent.
BlockCount - The total count of blocks output to parent.
2023-10-23 15:55:40 +08:00
31a5e072e7
[refactor](pipelineX) Simplify set operation ( #25502 )
2023-10-17 15:11:46 +08:00
d00d029ffb
Separate fixed key hash map context creator ( #25438 )
...
Separate fixed key hash map context creator
2023-10-16 11:20:30 +08:00
1a0344df16
[Improvement](hash) refactor of hash map context ( #24966 )
...
refactor of hash map context
2023-10-12 18:10:21 +08:00
3db33207d4
[pipelineX](fix) Fix nullable types for set operator ( #25294 )
2023-10-11 16:50:54 +08:00
7b22ae0c80
[pipelineX](feature) Support set operation operator ( #25251 )
...
---------
Co-authored-by: zhaochangle <zhaochangle@selectdb.com >
2023-10-11 10:22:45 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
5fc04b6aeb
[Improvement](hash) some refactor of process hash table probe impl ( #24461 )
...
some refactor of process hash table probe impl
2023-09-27 16:14:49 +08:00
35c5d71549
[Improvement](join) some improvement of hash join ( #23972 )
...
some improvement of hash join
2023-09-14 17:55:35 +08:00
b73f345479
[fix](intersect) fix wrong result of intersect node ( #24044 )
...
Issue Number: close #24046
2023-09-08 10:27:37 +08:00
d371101bfd
[Improvement](aggregation) make fixed hashmap's bitmap_size flexable ( #22573 )
...
make fixed hashmap's bitmap_size flexable
2023-08-14 10:47:06 +08:00
f7755aa538
[exec](set_operation) Support one child node in set operation ( #22463 )
...
Support one child node in set operation
2023-08-03 10:35:59 +08:00
31a4f96f01
[refactor](exprcontext) move close to expr context's dector method ( #20747 )
...
The close method does nothing. But I am not sure we could remove it. So that I add it to dector method and remove many many calls.
2023-06-14 18:01:07 +08:00
9f8de89659
[refactor](exec) replace the single pointer with an array of 'conjuncts' in ExecNode ( #19758 )
...
Refactoring the filtering conditions in the current ExecNode from an expression tree to an array can simplify the process of adding runtime filters. It eliminates the need for complex merge operations and removes the requirement for the frontend to combine expressions into a single entity.
By representing the filtering conditions as an array, each condition can be treated individually, making it easier to add runtime filters without the need for complex merging logic. The array can store the individual conditions, and the runtime filter logic can iterate through the array to apply the filters as needed.
This refactoring simplifies the codebase, improves readability, and reduces the complexity associated with handling filtering conditions and adding runtime filters. It separates the conditions into discrete entities, enabling more straightforward manipulation and management within the execution node.
2023-05-29 11:47:31 +08:00
14b4c7abf9
[fix](hashtable) Check query cancel status during build hash table #19970
...
should cancel query during hash table build stage if the query is cancelled.
2023-05-24 14:24:03 +08:00
272a7565b8
[improvement](tracing) Remove useless span levels from be side tracing ( #19665 )
...
1. Remove an exec node method corresponding to a span and replace it with an exec node corresponding to a span;
2. Fix some problems with tracing in pipeline.
2023-05-17 19:04:52 +08:00
1d421a26d9
[bugfix](memory) merge block may allocate failed ( #19507 )
2023-05-11 10:42:47 +08:00
e412dd12e8
[chore](build) Use include-what-you-use to optimize includes (PART II) ( #18761 )
...
Currently, there are some useless includes in the codebase. We can use a tool named include-what-you-use to optimize these includes. By using a strict include-what-you-use policy, we can get lots of benefits from it.
2023-04-19 23:11:48 +08:00
dd63897757
[fix](be)the set operation node should accept both nullable and non-nullable data from child node ( #16126 )
2023-02-04 23:08:59 +08:00
151ae71761
[fix](be)fix bug of VSetOperationNode::release_resource ( #15997 )
...
should call "ExecNode::release_resource(state)" if child class override the parent's method
2023-01-17 16:16:25 +08:00
97fcad76f8
[enhancement](memtracker) Improve readability ( #15716 )
2023-01-16 16:30:35 +08:00
b727033906
[Chore](build) enable -Wextra and remove some -Wno ( #15760 )
...
enable -Wextra and remove some -Wno
2023-01-15 10:40:35 +08:00
ca4674ca68
[pipeline](opt) opt the exec performance of pipe exec engine ( #15330 )
...
opt the exec performance of pipe exec engine
2022-12-26 09:58:52 +08:00
388df291af
[pipeline](schedule) Add profile for except node and fix steal task problem ( #15282 )
2022-12-22 22:42:37 +08:00
af54299b26
[Pipeline](projection) Support projection on pipeline engine ( #15220 )
2022-12-21 15:47:29 +08:00
ef21eea2e8
[fix](pipeline) _valid_element_in_hash_tbl was not set correctly ( #15072 )
2022-12-16 18:06:49 +08:00
873b128fde
[feature](pipeline) add inersect/except operators ( #14868 )
2022-12-09 14:13:48 +08:00
8c0e13ab51
[improvement](profile) add detail memory counter for exec nodes ( #14806 )
...
* [improvement](profile) improve accuraccy of memory usage and add detail memory counter
* fix
2022-12-05 11:51:52 +08:00
176f519fa1
[enhancement](memtracker) Optimize exec node memory tracking ( #14711 )
2022-12-01 14:52:21 +08:00
78adecac1b
[enhancemennt](be)optimize mem usage in join and set node ( #14602 )
2022-11-27 13:38:49 +08:00
2c42f0a905
[refactor](decimalv3) Refine code for DecimalV3 ( #14394 )
2022-11-19 16:57:17 +08:00
6d2e6d85d3
[enhancement](be)release memory in Node's close() method ( #14258 )
...
* [enhancement](be)release memory in Node's close() method
* format code
2022-11-15 15:59:23 +08:00
d3f65aa746
[Improvement](join) remove unnecessary state for join ( #13472 )
2022-10-21 09:59:34 +08:00
9a74ad1702
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan ( #11842 )
...
We have added logical project before, but to actually finish the prune to reduce the data IO, we need to add related supports in translator and BE.
This PR:
- add projections on each ExecNode in BE
- translate PhysicalProject into projections on PlanNode in FE
- do column prune on ScanNode in FE
Co-authored-by: HappenLee <happenlee@hotmail.com >
2022-08-30 16:17:10 +08:00
73a3471fbd
[minor](conjuncts) remove row-based conjuncts from vectorized engine ( #12053 )
2022-08-25 10:13:20 +08:00
