73722ad1cc
[fix](tools) tpch-tools and tpcds-tools update #24650
...
move analyze from run-query script to load-data script
fix some errors in scripts
2023-09-20 23:59:11 +08:00
eb2db1bfb0
[enhance](Tools) update tpch tools ( #24291 )
...
update tpch tools:
1) extend data scale to sf1/sf100/sf1000/sf10000
2) add table schema, sql, opt config for all different scale.
3) refine result output
2023-09-14 09:47:50 +08:00
c25e1b7d95
[fix](tools)fix perf tools analyze db ( #23370 )
2023-08-23 18:01:40 +08:00
e78afedd0a
[minor](refactor) refine function logics ( #22280 )
2023-07-27 15:09:23 +08:00
24290799c4
[improvement](tpch) run-tpch-query.sh add analyze database with sync and calculate total time ( #21652 )
...
* run-tpch-query shell add analyze database with sync and calculate total time
* run-tpch-query shell add analyze database with sync and calculate total time
2023-07-10 22:04:57 +08:00
7075bcc526
[tools](refactor) remove unused session variables ( #21405 )
2023-07-01 16:14:36 +08:00
033f64de93
[tools](tpch)add analyze in run-tpch-queries.sh ( #20733 )
2023-06-13 14:11:45 +08:00
22eec4148b
[fix](conf) fix fe host in doris-cluster.conf #20422
2023-06-06 09:15:36 +08:00
e32eba8fdf
[refactor](stats) Persist status of analyze task to FE meta data ( #20264 )
...
1. In the past, we use a BE table named `analysis_jobs` to persist the status of analyze jobs/tasks, however there are many flaws such as, if BE crashed analyze job/task would failed however the status of analyze job/task couldn't get updated.
2. Support `DROP ANALYZE JOB [job_id]` to delete analyze job
3. Support `SHOW ANALYZE TASK STATUS [job_id] ` to get the task status of specific job
4. Restrict the execute condition of auto analyze, only when the last execution of auto analyze job finished a while ago could be executed again
5. Support analyze whole DB
2023-06-02 12:33:31 +08:00
631494e05d
[regression](decimalv3) Fix output for P1 regression ( #20213 )
2023-05-30 15:21:29 +08:00
851886cc18
[minor](datev2) remove datev2 because datev2 is used by default ( #19777 )
2023-05-18 13:36:11 +08:00
208d21b01d
[tools](tpch) use origin TPCH qurries ( #19479 )
2023-05-10 14:29:45 +08:00
6c21df6324
[tools](tpch) run mode like clickbench ( #19339 )
2023-05-06 23:33:26 +08:00
ec517a53a8
[Chore](build) upgrade clang-format version to 16 && move thrift to fe-common ( #19155 )
...
upgrade clang-format version to 16
move thrift to fe-common
fix core dump on pipeline engine when operator canceled and not prepared
2023-04-28 14:14:51 +08:00
079e6a3e12
[regression-test](vectorized) remove unused vectorization flag ( #17662 )
2023-03-15 17:59:22 +08:00
1b2f882d24
[fix](terminal) remove echo database passwd ( #15876 )
...
* remove echo passwd
* add timer for data load
2023-01-16 22:00:52 +08:00
816e12db6a
[Bench](mem) some benchmark over the query limit ( #15408 )
2022-12-28 09:29:53 +08:00
5ca6596ca3
[fix](tpch-tools) disable join reorder for Q12 in TPC-H tools ( #14728 )
2022-12-01 20:55:17 +08:00
b12ac90d8f
[tools](tpch) upgrade decimal type to decimalv3 ( #14665 )
2022-11-30 08:41:06 +08:00
1482ab32b6
[tools](tpch)fix invalid download url ( #14329 )
2022-11-19 13:29:33 +08:00
9b50888aaf
[feature](Nereids) prune runtime filters which cannot reduce the tuple number of probe table ( #13990 )
...
1. add a post processor: runtime filter pruner
Doris generates RFs (runtime filter) on Join node to reduce the probe table at scan stage. But some RFs have no effect, because its selectivity is 100%. This pr will remove them.
A RF is effective if
a. the build column value range covers part of that of probe column, OR
b. the build column ndv is less than that of probe column, OR
c. the build column's ColumnStats.selectivity < 1, OR
d. the build column is reduced by another RF, which satisfies above criterions.
2. explain graph
a. add RF info in Join and Scan node
b. add predicate count in Scan node
3. Rename session variable
rename `enable_remove_no_conjuncts_runtime_filter_policy` to `enable_runtime_filter_prune`
4. fix min/max column stats derive bug
`select max(A) as X from T group by B`
X.min is A.min, not A.max
2022-11-11 13:13:29 +08:00
4bfa95f669
[enhancement](tools) opt tpch q21: change join order ( #13699 )
2022-10-27 16:55:23 +08:00
bd2b803019
[opt](tpch) opt the q9 of tpch to change instance to 8 ( #13656 )
2022-10-26 09:28:51 +08:00
038ccab3c4
[benchmark](rewrite) add hints for q20 ( #13561 )
2022-10-21 22:35:50 +08:00
f0b608018b
[config](tpch) Disable jemalloc and change the hint of tpch q22 ( #13555 )
2022-10-21 21:35:43 +08:00
6ea9a65bb6
[Opt](vec) opt runtime filter for TPCH Q22 ( #13339 )
2022-10-17 10:30:07 +08:00
632670a49c
[Enhancement](function) refactor of date function ( #13362 )
...
refactor of date function
2022-10-16 14:31:26 +08:00
5c68f69362
[improvement](config) set enable_local_exchange default value to true ( #13292 )
2022-10-12 09:07:24 +08:00
9c64fde8f5
[tools](banchmark) upgrade date type ( #13197 )
...
upgrade date type to datev2
2022-10-09 14:17:12 +08:00
3cc06820c4
[doc](performance) performance doc and script update ( #12493 )
2022-09-09 09:09:49 +08:00
9d165797c5
[ci](shellcheck)shellcheck include ssb-tools and tpch-tools ( #12039 )
2022-08-25 11:52:13 +08:00
9cceddaeb3
[tools](ssb and tpch)optimize tools ( #11975 )
2022-08-24 14:29:38 +08:00
a98d808080
[Chore](benchmark) Fix benchmark scripts, cover case that $PASSWORD not empty ( #11486 )
...
Fix benchmark scripts, cover case that $PASSWORD not empty
2022-08-19 15:40:18 +08:00
52290fed90
[tools](tpch)update queries for better performance ( #11523 )
2022-08-05 14:04:26 +08:00
cac0dfcd63
[tools] opt tpch q9 ( #11092 )
2022-07-22 08:38:43 +08:00
23dab4cbf9
[enhancement] (SSB & TPC-H) fix test scripts, cover having PASSWORD situation ( #10885 )
2022-07-15 20:07:47 +08:00
61d7724ab3
[tpch] Change all replication_num to 1 ( #10244 )
2022-06-19 10:42:04 +08:00
ac2be958b3
[tpch tools]set exec_mem_limit=8G for tpch queries ( #10119 )
...
Co-authored-by: Jerry <root@localhost.localdomain >
2022-06-16 18:19:11 +08:00
15e1bb448f
[test] tpch q3 rewrite, change join order, make lineitem on left side ( #10055 )
...
rewrite the sql in tpch test tools
2022-06-14 17:16:33 +08:00
47ca743957
[tpch] fix q17 rewrite error ( #10030 )
...
the current tpch q17 rewrite is not equivalent to original q17. it missed one condition
2022-06-10 09:17:10 +08:00
b15b1a9f07
[tools](tpc-h) Modify tpch tools ( #9982 )
...
1. Modify the create table stmt.
2. Modify part of queries.
2022-06-08 11:21:57 +08:00
92c1c82422
[tools]add ssb flat test scripts ( #9796 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2022-05-28 17:28:03 +08:00
d916ba8352
[fix](tools) Access denied when creating tpch tables ( #9003 )
2022-04-14 11:45:53 +08:00
da87e0c4ee
optimize create tpch table statments to achieve higher performance ( #8683 )
...
optimize create tpch table statments to achieve higher performance
2022-03-29 18:19:22 +08:00
276792daeb
[feature](benchmark) Add TPC-H benchmark tools ( #8408 )
2022-03-20 23:06:10 +08:00
