Commit Graph

462 Commits

Author SHA1 Message Date
8230f4162b *: optimize analyze cluster index table (#21381) 2021-03-01 22:14:54 +08:00
3d4def7eef planner, statistics: allow (auto) analyze single partition in dynamic-only mode (#22625) 2021-03-01 17:23:31 +08:00
550ca8eaeb statistics: enables global-level stats to be generated in fast analyze mode (#22931) 2021-03-01 16:40:50 +08:00
e1004a2ccb *: modify the switch to control global stats (#22866) 2021-03-01 14:18:30 +08:00
b1b7730402 statistics: add more tests to check accurateness of global-stats (#22948) 2021-03-01 12:49:56 +08:00
35534ae752 *: apply golangci-lint to the new code (#22824) 2021-02-24 18:24:03 +08:00
b5c6c9f548 statistics: make dump/load/show-stats be compatible with global-stats (#22911) 2021-02-24 17:33:40 +08:00
270d497848 statistics: introduce new estimation logic when index histogram fails to estimate (#22682)
* statistics: introduce new estimation logic when index histogram fail to estimate

* address comments

* address comments

Co-authored-by: Ti Chi Robot <71242396+ti-chi-bot@users.noreply.github.com>
2021-02-24 16:30:03 +08:00
62354d04b7 statistics: merge partition-level FMSketch to global-level FMSketch and update the column NDV (#22878) 2021-02-23 19:06:23 +08:00
df9e730c16 stats, planner, sessionctx: handle compatibility between feedback and ver2 stats (#22846)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: Yiding Cui <winoros@gmail.com>
Co-authored-by: Ti Chi Robot <71242396+ti-chi-bot@users.noreply.github.com>
2021-02-23 13:46:49 +08:00
f3fe4895cb statistics: support to store FMSketch and add FMSketch to column stats (#22841)
* add FMSketch to mysql.stats_histograms

* statistics: support store FMSketch and add FMSketch to histogram

* FIX UT

* Create Stats_FM_Sketch Table

* fix UT

* add some tests

* FIX ut

* move fmSketch from histogram to column.stats

* remove unused code and comments

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* finish the FMSketch.MemoryUsage function

* add some comments for FMSketch.MemoryUsage function

* fix typo

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: Ti Chi Robot <71242396+ti-chi-bot@users.noreply.github.com>
2021-02-23 10:39:09 +08:00
1cd390b2bc statistics: merge poped topn when generating the global histogram (#22848) 2021-02-22 14:34:53 +08:00
8842bbcde2 statistics: merge partition-level TopN to global-level TopN (#22433) 2021-02-19 19:05:58 +08:00
99d0b22f04 session, util: update session to use new APIs (#22652) 2021-02-19 13:10:30 +08:00
59ccb29508 statistics: merge the partition-level histograms to a global-level histogram (#22603) 2021-02-19 11:08:04 +08:00
27db39b480 *: use CLUSTERED and NONCLUSTERED to control primary key type (#22409) 2021-02-05 20:41:41 +08:00
2d717c12b3 statistics: merge the partition-level stats to global-level stats (#22667) 2021-02-05 11:42:41 +08:00
9a2997facb statistics,executor: fix some unit tests that run twice (#22705) 2021-02-05 11:27:11 +08:00
343c412531 planner, executor, statistics: add tests for version 2 and fix bugs (#22461)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2021-02-04 15:52:30 +08:00
17a65ab98b statistics: refactor the statistics package use the RestrictedSQLExecutor API (#22636) 2021-02-03 13:28:57 +08:00
109ad45303 statistics: fix bug when bootstrap version 2 stats (#22608) 2021-02-01 11:18:44 +08:00
7f53f840fe statistics: add tests for version 2 stats and fix bug (#22564) 2021-01-27 19:42:01 +08:00
f22ec62dd0 statistics: fix panic occurs when stats cache inconsistency (#22465) 2021-01-27 16:41:07 +08:00
05d995d73d statistics: add more tests about ver2-stats (#22457) 2021-01-26 20:59:18 +08:00
0aa476034a go.mod, statistics, planner: replace TIDB_STATS with STATS_EXTENDED (#22492) 2021-01-25 21:18:07 +08:00
8d2ab4ef7a statistics: fix inaccurate row count estimation caused by cross validation using invalid column stats (#22479) 2021-01-22 17:42:37 +08:00
d0ca720a5f *: support ALTER TABLE ADD / DROP TIDB_STATS (#22127) 2021-01-14 15:28:28 +08:00
3dd842f50a statistics: add bucket ndv for index histogram (#20580)
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2021-01-13 18:24:21 +08:00
27a9b3e8f6 statistics: fix stack overflow when use DNF expr immediately after add column (#22169) 2021-01-06 12:08:10 +08:00
4a4acbe5fd statistics: GC index usage information (#21014) 2021-01-05 15:02:19 +08:00
76054200b6 statistics: redesign the schema for mysql.stats_extended (#22033)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2021-01-04 17:57:24 +08:00
0ddf74b19d statistics: no more counting feedback if it is invalid (#21712) 2021-01-04 16:22:45 +08:00
27071f14d7 session/bootstrap: disable clustered index by default (#21777) 2020-12-25 15:44:07 +08:00
092a01a0a4 statistics, executor: refactor statistics on columns (#21817) 2020-12-24 13:56:30 +08:00
3cbfec31d9 *: add a switch for extended stats to disable the feature by default (#21716) 2020-12-15 18:27:23 +08:00
5acff8de7a *: Revert "#19008" and "#18788" (#21599) 2020-12-14 15:06:35 +08:00
b4eee287af *: extract topn out of histogram correctly (#21007)
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
2020-12-10 17:05:39 +08:00
b3f0f3cb74 Revert "statistics: introduce an interface for StatsCache (#20091)" (#21583) 2020-12-09 14:08:47 +08:00
28c9e9290b *: gocritic fixes for commentFormatting (#21578) 2020-12-09 12:03:17 +08:00
fc37586491 *: refactor function ExecRestrictedSQLWithContext to fix a DATA RACE (#21461) 2020-12-04 14:28:38 +08:00
554bae75f0 statistics: introduce an interface for StatsCache (#20091) 2020-12-02 17:18:42 +08:00
5131514ebb statistics: fix a bug which causes panic when using the clustered index and the new collation (#21379)
Signed-off-by: wjhuang2016 <huangwenjun1997@gmail.com>
2020-12-01 14:08:41 +08:00
0cddd8b7fb statistics: fix the panic when analyze with collation enabled (#21262) 2020-11-25 20:10:20 +08:00
583cbd265b statistics: store the topn by slice instead of map (#20818) 2020-11-06 15:39:33 +08:00
152b60ebe4 session: increase cm_sketch column max length to 6291456(6MB) (#20152) 2020-11-02 15:21:25 +08:00
c2e3b0a6ad statistics: decouple TopN from CMSKetch (#20572) 2020-10-28 15:16:42 +08:00
fd84a91895 ddl, tikv: add delay during AddIndex DDL and remove schema check for async commit (#20550) 2020-10-28 11:48:34 +08:00
f41880a4d0 statistics: improve row count estimation of multi-column equal conditions by cross validation (#20264) 2020-10-27 20:10:27 +08:00
99d1163cbc *: use ID instead of NAME in mysql.schema_index_usage (#20589) 2020-10-23 14:42:29 +08:00
bdb6c49600 *: collect index usage information from point get and dump them to KV (#20126) 2020-10-16 16:17:34 +08:00