06f71f2bca
[pipeline](fix) Fix bugs to pass all regression cases ( #15306 )
...
* [pipeline](fix) Fix bugs to pass all regression cases
* update
* update
2022-12-23 22:17:50 +08:00
b085ff49f0
[refactor](non-vec) delete non-vec data sink ( #15283 )
...
* [refactor](non-vec) delete non-vec data sink
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-12-23 14:10:47 +08:00
8ecf69b09b
[pipeline](regression) nested loop join test get error result in pipeline engine and refactor the code for need more input data ( #15208 )
2022-12-21 19:03:51 +08:00
af54299b26
[Pipeline](projection) Support projection on pipeline engine ( #15220 )
2022-12-21 15:47:29 +08:00
732417258c
[Bug](pipeline) Fix bugs to pass TPCDS cases ( #15194 )
2022-12-20 22:29:55 +08:00
7c67fa8651
[Bug](pipeline) fix bug of right anti join error result in pipeline ( #15165 )
2022-12-19 19:28:44 +08:00
0732f31e5d
[Bug](pipeline) Fix bugs for scan node and join node ( #15164 )
...
* [Bug](pipeline) Fix bugs for scan node and join node
* update
2022-12-19 15:59:29 +08:00
0c817e6b3a
[Pipeline](hashjoin) Support hash join on pipeline engine ( #14898 )
2022-12-08 15:43:02 +08:00
8c0e13ab51
[improvement](profile) add detail memory counter for exec nodes ( #14806 )
...
* [improvement](profile) improve accuraccy of memory usage and add detail memory counter
* fix
2022-12-05 11:51:52 +08:00
176f519fa1
[enhancement](memtracker) Optimize exec node memory tracking ( #14711 )
2022-12-01 14:52:21 +08:00
b4d32a0c44
[fix](join) runtime filter shared from other instance wasn't be published ( #14717 )
2022-12-01 14:17:23 +08:00
7513c82431
[NLJoin](conjuncts) separate join conjuncts and general conjuncts ( #14608 )
2022-11-29 08:55:54 +08:00
78adecac1b
[enhancemennt](be)optimize mem usage in join and set node ( #14602 )
2022-11-27 13:38:49 +08:00
9103ded1dd
[improvement](join)optimize sharing hash table for broadcast join ( #14371 )
...
This PR is to make sharing hash table for broadcast more robust:
Add a session variable to enable/disable this function.
Do not block the hash join node's close function.
Use shared pointer to share hash table and runtime filter in broadcast join nodes.
The Hash join node that doesn't need to build the hash table will close the right child without reading any data(the child will close the corresponding sender).
2022-11-24 21:06:44 +08:00
6c7f758ef7
[improvement](hashjoin) support partitioned hash table in hash join ( #14480 )
2022-11-24 14:16:47 +08:00
2c42f0a905
[refactor](decimalv3) Refine code for DecimalV3 ( #14394 )
2022-11-19 16:57:17 +08:00
50bfd99b59
[feature](join) support nested loop semi/anti join ( #14227 )
2022-11-17 22:20:08 +08:00
6d2e6d85d3
[enhancement](be)release memory in Node's close() method ( #14258 )
...
* [enhancement](be)release memory in Node's close() method
* format code
2022-11-15 15:59:23 +08:00
215a4c6e02
[Bug](BHJ) Fix wrong result when use broadcast hash join for naaj ( #14253 )
2022-11-15 09:40:00 +08:00
7bb3792d51
[chore](build) Split the compliation units to build them in parallel ( #14232 )
2022-11-14 10:57:10 +08:00
139c4a77f1
[enhancement](be)close ExecNode ASAP to release resource earlier ( #14203 )
2022-11-14 09:41:35 +08:00
dd11d5c0a5
[enhancement](memory) Support try catch bad alloc ( #14135 )
2022-11-13 11:22:56 +08:00
035657c5a1
[typo](comment) Fix a lot of spell errors in be comments ( #14208 )
...
fix typos.
2022-11-12 16:06:15 +08:00
fe2944d56d
[Bug](nljoin) Keep compatibility for nljoin ( #14182 )
2022-11-11 15:54:55 +08:00
118a7dff07
[chore](build) Optimize the compilation time ( #14170 )
...
Currently, it takes too much time to build BE from source in workflow environments (P0/P1) which affects the efficiency of daily development.
We can measure the time by executing the following command.
time EXTRA_CXX_FLAGS='-O3' BUILD_TYPE=ASAN ./build.sh --be --fe --clean -j "$(nproc)"
This PR optimizes the compilation time by exploiting the following methods.
Reduce the codegen by removing some useless std::visit.
Disable the optimization for some template functions which are instantiated by std::visit conditionally (except for the RELEASE build).
2022-11-11 12:09:54 +08:00
1ef85ae1f2
[Improvement](join) Support nested loop outer join ( #13965 )
2022-11-10 19:50:46 +08:00
10df61b5bf
[improvement](join) Share hash table in fragments for broadcast join ( #13921 )
2022-11-10 09:48:34 +08:00
a3c5fa8c01
[Compile](join) Boost compiling and linking ( #14081 )
2022-11-09 11:27:46 +08:00
f87be09d69
[fix](load) Fix load channel mgr lock ( #13960 )
...
hot fix load channel mgr lock
2022-11-05 00:48:30 +08:00
bfba058ecf
[Feature](join) Support null aware left anti join ( #13871 )
2022-11-03 12:11:25 +08:00
32a029d9dc
[enhancement](memtracker) Refactor load channel + memtable mem tracker ( #13795 )
2022-11-03 09:47:12 +08:00
738da0b139
[bugfix](join) inner join return wrong result ( #13608 )
...
* bug fix for vhash join
* add regression test
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-10-27 11:48:41 +08:00
c874931ac8
[fix](join)output all value from no-null side of outer join ( #13655 )
...
* [fix](joinoutput all value from no-null side of outer join
* add regression test
2022-10-27 10:48:36 +08:00
40e122e5ef
[fix](join)the build and probe expr should be calculated before converting input block to nullable ( #13436 )
...
* [fix](join)the build and probe expr should be calculated before converting input block to nullable
* remove_nullable can be called on const column
2022-10-24 14:50:06 +08:00
e17c2416f0
[fix](join) fix be core dump when using right join with other join predicates ( #13511 )
2022-10-24 10:35:07 +08:00
3006b258b0
[Improvement](bloomfilter) allocate memory for BF in open phase ( #13494 )
2022-10-21 17:37:26 +08:00
d3f65aa746
[Improvement](join) remove unnecessary state for join ( #13472 )
2022-10-21 09:59:34 +08:00
b5cd167713
[fix](hashjoin) fix coredump of hash join in ubsan build ( #13479 )
...
* [fix](hashjoin) fix coredump of hash join in ubsan build
2022-10-20 10:16:19 +08:00
cd3450bd9d
[Improvement](join) optimize join probing phase ( #13357 )
2022-10-18 12:37:17 +08:00
c114d87d13
[Enhancement](array-type) Tuple is null predicate support array type ( #13307 )
...
Issue Number: #12689
2022-10-17 18:50:56 +08:00
baf2689610
[Improvement](join) compute hash values by vectorized way ( #13335 )
2022-10-13 16:04:58 +08:00
dfe308f501
[Improvement](join) refine prefetch strategy ( #13286 )
2022-10-12 19:02:06 +08:00
9a74ad1702
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan ( #11842 )
...
We have added logical project before, but to actually finish the prune to reduce the data IO, we need to add related supports in translator and BE.
This PR:
- add projections on each ExecNode in BE
- translate PhysicalProject into projections on PlanNode in FE
- do column prune on ScanNode in FE
Co-authored-by: HappenLee <happenlee@hotmail.com >
2022-08-30 16:17:10 +08:00
b1fd701493
[fix](memtracker) Improve memory tracking accuracy for exec nodes ( #11947 )
2022-08-22 08:56:05 +08:00
64dc3b360f
[Bug](function) fix dcheck fail on close vexpr ctx ( #11908 )
2022-08-19 19:11:10 +08:00
3a49156e30
[performance] (vectorization)optimize In Expr ( #11826 )
...
Co-authored-by: Wang Bo <wangbo36@meituan.com >
2022-08-17 10:46:37 +08:00
ecbf87d77b
[bugfix](memtracker)fix exceed memory limit log ( #11485 )
2022-08-04 10:22:20 +08:00
1f30e563a7
[refactor][vectorized] refactor first/last value agg functions ( #10661 )
...
* refactor first and last
[refactor][vectorized] refactor first/last value agg functions
* add some change
* remove first/last about always nullable
* remove always nullable and register it
* refactor value remove bool null flag
* refactor win first last to ptr and pos
2022-07-30 18:38:56 +08:00
18864ab7fe
weak relationship between MemTracker and MemTrackerLimiter ( #11347 )
2022-07-30 18:33:54 +08:00
3fe7b21ac8
[Improvement](vectorized) Remove row-based conjuncts on vectorized nodes ( #11324 )
2022-07-29 15:42:06 +08:00
