Commit Graph

112 Commits

Author SHA1 Message Date
0d008b5a43 [feat](nereids)disable join reorder if column stats is invalid #41790 (branch-2.1) (#42902)
## Proposed changes
pick #41790
Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-30 23:47:03 +08:00
6d23020cb8 [fix](regression) do not test "set global sessionVar" on multi-fe cluster (#42922)
## Proposed changes
fix unstable rt case: test_statistic_global_variable

Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-30 21:35:32 +08:00
2042726ceb [Fix](regression case) fix some unstable regression cases (#42601)
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-29 18:12:40 +08:00
db9c74c38f [improvement](statistics)Drop expired external stats only when the catalog is dropped. (#42244) (#42410)
backport: https://github.com/apache/doris/pull/42244
2024-10-24 23:47:53 +08:00
b84e128974 [fix](statistics)Fix clear stale mv row count bug. (#41653) (#41807)
backport: https://github.com/apache/doris/pull/41653
2024-10-14 21:14:05 +08:00
c176c9feb0 [fix](statistics)Fix empty table keep auto analyze bug. (#40811) (#40896)
backport: https://github.com/apache/doris/pull/40811
2024-09-18 12:51:44 +08:00
b7103bf00c [fix](statistics)Fix drop stats log editlog bug. Catch drop stats exception while truncate table. (#40738) (#40853)
backport: https://github.com/apache/doris/pull/40738
2024-09-14 23:08:24 +08:00
0b1d517caa [improvement](statistics)Return -1 to neredis if report olap table row count for new table is not done for all tablets. (#40457) (#40838)
backport: https://github.com/apache/doris/pull/40457
2024-09-14 13:19:35 +08:00
6ab8a7e5df [fix](p0)Fix case timeout. (#40788) (#40840)
backport: https://github.com/apache/doris/pull/40788
2024-09-14 12:49:37 +08:00
4e453dc1bb Revert "[improvement](statistics)Return -1 to neredis if report olap table row count for new table is not done for all tablets. (#40457)" (#40616)
Reverts apache/doris#40540
2024-09-10 17:17:13 +08:00
e43e6e2bba [improvement](statistics)Return -1 to neredis if report olap table row count for new table is not done for all tablets. (#40457) (#40540)
backport: https://github.com/apache/doris/pull/40457
2024-09-10 12:55:53 +08:00
6aafc5adb4 [improvement](statistics)Support drop cached stats. (#39367) (#39462)
backport: https://github.com/apache/doris/pull/39367
2024-08-16 14:12:58 +08:00
b3597ea898 [improvement](statistics)Drop column stats after schema change. (#39101) (#39401)
backport: https://github.com/apache/doris/pull/39101
2024-08-15 17:02:42 +08:00
3c535e80dd [fix](compatibility) type toSql should return lowercase string (#38012) (#38517)
pick from master #38012

revert #25951
2024-08-09 11:35:42 +08:00
002232b2da [improvement](statistics)Analyze all columns when partition first loaded. (#38606)
backport: https://github.com/apache/doris/pull/38540
2024-07-31 19:59:41 +08:00
c78e04ac31 [improvement](statistics)Support get index row count and table delta rows. (#38520)
backport: https://github.com/apache/doris/pull/38492
2024-07-31 10:39:21 +08:00
2b82bec406 [fix](statistics)Add row count to AnalysisJob and update tableStats using this row count after analyze. (#38428)
Add row count to AnalysisJob and update tableStats using this row count
after analyze.
Take row count to consideration in stats health calculation.
2024-07-27 11:32:29 +08:00
2dbc996a1b [fix](regression)Fix test_agg_complex_type fail case. Improve analyze_stats time consumption. (#37895) (#38014)
backport: https://github.com/apache/doris/pull/37895
2024-07-17 22:15:21 +08:00
4d359cd946 [improvement](regression)Use createMV to create materialized view. (#37837) (#37992)
backport: https://github.com/apache/doris/pull/37837
2024-07-17 17:16:04 +08:00
8f39143c14 [test](fix) replace hardcode s3BucketName (#37750)
## Proposed changes

pick from master #37739 

<!--Describe your changes.-->

---------

Co-authored-by: stephen <hello-stephen@qq.com>
2024-07-14 18:38:52 +08:00
37583d2d0a [test](statistics)Add test case for set global variables. (#37582) (#37691)
backport: https://github.com/apache/doris/pull/37582
2024-07-12 13:46:53 +08:00
cee3cf8499 [fix](statistics)Fix column cached stats size bug. (#37545) (#37667)
backport: https://github.com/apache/doris/pull/37545
2024-07-11 18:53:12 +08:00
328ef869ac [fix](regression)Disable auto analyze for related cases, do not need to enable it for pipeline test cases. (#36604) (#36946)
For regression test, it doesn't need to enable auto analyze. Disable it
in some test cases.
backport: https://github.com/apache/doris/pull/36604
2024-06-28 11:26:06 +08:00
8149b2b00d [fix](regression)Disable auto analyze before running mtmv test. (#36457)
Disable auto analyze before running mtmv test. Because auto analyze
result may overwrite manual analyze result.
backport: https://github.com/apache/doris/pull/36449
2024-06-18 17:09:17 +08:00
b6aa17ae32 [fix](statistics)Fix stats analyze p0 case. (#36251) (#36364)
Fix stats p0 case. Def a variable before using it.
backport https://github.com/apache/doris/pull/36251
2024-06-17 13:04:51 +08:00
11a5875283 [fix](regression)Remove useless case which may cause preHeat npe. (#35582) (#35685)
backport https://github.com/apache/doris/pull/35582
Remove useless case which may cause preHeat npe.
2024-05-31 10:20:21 +08:00
f52067415b Improve analyze mv/mtmv wait row count report logic. (#33695) 2024-04-17 23:42:13 +08:00
0499d4013e Support identical column name in different index. (#32792) 2024-04-10 11:34:29 +08:00
96b995504c [enhancement](statistics) excluded delta rows num for rollup&mv tablets (#32568)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
Co-authored-by: tsy <tangsiyang2001@foxmail.com>
2024-04-10 11:34:28 +08:00
5e5fffe4e3 Set enable_unique_key_partial_update to false in statistics session variable. (#33220) 2024-04-08 16:49:58 +08:00
735f5213c1 Add log for case to help debug. (#32675) 2024-03-24 08:04:46 +08:00
60eeff8e18 [enhance](mtmv)refresh mtmv must add auto (#32522) 2024-03-22 08:52:16 +08:00
fe1b7a7b0a Improve analyze stats case, avoid cluster delay caused failure. (#32507) 2024-03-22 08:52:16 +08:00
ea2fbfaffa [feature](Nereids) support agg state type in create table (#32171)
this PR introduce a behavior change, syntax of create table with agg_state type is changed.
2024-03-15 18:04:49 +08:00
e9c1638507 Add waiting timeout while creating mv and row count report. (#31944) 2024-03-09 19:44:54 +08:00
de9b5f7b69 [improvement](statistics)Log one bdbje record for one load transaction. #31619 (#31697) 2024-03-02 23:04:26 +08:00
82faa7469b Support analyze rollup. (#31576) 2024-03-01 04:25:43 +08:00
ddb37d7371 Fix analyze mv from follower case bug. (#31523) 2024-02-29 08:42:35 +08:00
3ca412efe3 Return UNKNOWN column stats if ndv is 0. (#31439) 2024-02-29 08:42:35 +08:00
57d604c48a Fix statistics p0 case. (#31330) 2024-02-23 20:44:43 +08:00
04c295c4c2 Improve show column stats performance. (#31298) 2024-02-23 19:03:28 +08:00
18955174e9 Fix analyze mv and mtmv p0 case. (#31191) 2024-02-21 17:01:19 +08:00
4aaab6fb44 [fix](statistics)Refresh follower FE cache after alter column stats. Support alter index column stats (#31108)
1. Refresh follower FE cache after alter column stats. So that follower could update the cached stats too.
2. Support alter index column stats.
2024-02-20 16:23:53 +08:00
edfa5e750b Remove slow auto analyze test case. (#31037) 2024-02-18 14:45:25 +08:00
e086d0d719 [test](statistics)Add analyze mtmv test case (#30847) 2024-02-16 10:12:23 +08:00
042934e545 Add auto analyze mv and show task case. (#30894) 2024-02-16 10:12:23 +08:00
e9f9fdf9af Fix unstable analyze mv case. (#30859) 2024-02-05 22:00:36 +08:00
9e76592297 Support analyze materialized view. (#30540) 2024-02-04 22:21:16 +08:00
afab713048 [fix](Nereids) query mv column directly (#30444) 2024-01-29 19:03:47 +08:00
9174ac921b Fix statistics p0. (#30351) 2024-01-25 21:33:50 +08:00