Commit Graph

20 Commits

Author SHA1 Message Date
7075bcc526 [tools](refactor) remove unused session variables (#21405) 2023-07-01 16:14:36 +08:00
208d21b01d [tools](tpch) use origin TPCH qurries (#19479) 2023-05-10 14:29:45 +08:00
079e6a3e12 [regression-test](vectorized) remove unused vectorization flag (#17662) 2023-03-15 17:59:22 +08:00
816e12db6a [Bench](mem) some benchmark over the query limit (#15408) 2022-12-28 09:29:53 +08:00
5ca6596ca3 [fix](tpch-tools) disable join reorder for Q12 in TPC-H tools (#14728) 2022-12-01 20:55:17 +08:00
9b50888aaf [feature](Nereids) prune runtime filters which cannot reduce the tuple number of probe table (#13990)
1. add a post processor: runtime filter pruner 
Doris generates RFs (runtime filter) on Join node to reduce the probe table at scan stage. But some RFs have no effect, because its selectivity is 100%. This pr will remove them.
A RF is effective if
a. the build column value range covers part of that of probe column, OR
b. the build column ndv is less than that of probe column, OR
c. the build column's ColumnStats.selectivity < 1, OR
d. the build column is reduced by another RF, which satisfies above criterions.

2. explain graph
a. add RF info in Join and Scan node
b. add predicate count in Scan node

3. Rename session variable
rename `enable_remove_no_conjuncts_runtime_filter_policy` to `enable_runtime_filter_prune` 

4. fix min/max column stats derive bug
`select max(A) as X from T group by B`  
X.min is A.min, not A.max
2022-11-11 13:13:29 +08:00
4bfa95f669 [enhancement](tools) opt tpch q21: change join order (#13699) 2022-10-27 16:55:23 +08:00
bd2b803019 [opt](tpch) opt the q9 of tpch to change instance to 8 (#13656) 2022-10-26 09:28:51 +08:00
038ccab3c4 [benchmark](rewrite) add hints for q20 (#13561) 2022-10-21 22:35:50 +08:00
f0b608018b [config](tpch) Disable jemalloc and change the hint of tpch q22 (#13555) 2022-10-21 21:35:43 +08:00
6ea9a65bb6 [Opt](vec) opt runtime filter for TPCH Q22 (#13339) 2022-10-17 10:30:07 +08:00
Pxl
632670a49c [Enhancement](function) refactor of date function (#13362)
refactor of date function
2022-10-16 14:31:26 +08:00
Pxl
5c68f69362 [improvement](config) set enable_local_exchange default value to true (#13292) 2022-10-12 09:07:24 +08:00
52290fed90 [tools](tpch)update queries for better performance (#11523) 2022-08-05 14:04:26 +08:00
cac0dfcd63 [tools] opt tpch q9 (#11092) 2022-07-22 08:38:43 +08:00
ac2be958b3 [tpch tools]set exec_mem_limit=8G for tpch queries (#10119)
Co-authored-by: Jerry <root@localhost.localdomain>
2022-06-16 18:19:11 +08:00
15e1bb448f [test] tpch q3 rewrite, change join order, make lineitem on left side (#10055)
rewrite the sql in tpch test tools
2022-06-14 17:16:33 +08:00
47ca743957 [tpch] fix q17 rewrite error (#10030)
the current tpch q17 rewrite is not equivalent to original q17. it missed one condition
2022-06-10 09:17:10 +08:00
b15b1a9f07 [tools](tpc-h) Modify tpch tools (#9982)
1. Modify the create table stmt.
2. Modify part of queries.
2022-06-08 11:21:57 +08:00
276792daeb [feature](benchmark) Add TPC-H benchmark tools (#8408) 2022-03-20 23:06:10 +08:00