Commit Graph

67 Commits

Author SHA1 Message Date
7aa86cc96a *: Enable gosec for implicit memory aliasing in for loop (#28996) 2021-11-19 20:07:48 +08:00
55a38a1c76 *: tiny clean up the RecordSet NewChunk() method (#29232) 2021-11-02 20:02:51 +08:00
b1efb13296 *: implement analyze columns c1, ..., cn (#29024) 2021-10-29 11:28:49 +08:00
86b37d45d1 statistics: fix incomplete auto analyze log information (#29189) 2021-10-28 19:54:49 +08:00
04e661095c planner, statistics, sessionctx: add variable to enable/disable the outdated statistics to pseudo logic (#28554) 2021-10-28 11:28:48 +08:00
xhe
94e30df8e2 parser: fix compiling, add unit tests (#28700) 2021-10-11 23:15:25 +08:00
9f094cc865 statistics: fix auto analyze triggered out of specified time (#28703) 2021-10-11 17:53:25 +08:00
490b5c63d1 statistics: skip build statistics for view in auto analyze (#27866) 2021-09-08 21:38:58 +08:00
7755d25aba *: Integrate SkyWalking-eyes to check license headers in CI and fix licenses headers (#27198) 2021-08-16 18:52:00 +08:00
cb65b7a2f7 statistics: improve out-of-range estimation strategy (#26502) 2021-08-02 17:43:08 +08:00
4eeff54d85 statistics: fix the fomula for checking outdated stats (#26728) 2021-07-29 22:34:17 +08:00
50ae2d8266 statistics: trigger auto-analyze based on histogram row count (#24382) 2021-07-28 18:02:17 +08:00
95a40ac3d4 planner: fix the unstable unit test TestAnalyzeIncremental (#26460) 2021-07-23 14:16:14 +08:00
cc5e161ac0 *: use tikv/client-go/v2 (#25359) 2021-06-11 17:24:35 +08:00
11716e7f4a *: use full sampling as default analyze (#25132) 2021-06-06 00:34:27 +08:00
66ad36ee10 planner, executor, statistics: support correlation calc for new sampling method (#24458) 2021-05-25 23:57:34 +08:00
xhe
bfdad7c752 *: milisecond test and infoschema fix (#24820) 2021-05-24 18:27:34 +08:00
3fed33fc17 statistics: dump FMSketch to KV only for partition table with dynamic prune mode (#24453) 2021-05-11 12:47:38 +08:00
xhe
5e9e0e6e37 *: consitent get infoschema (#24230) 2021-05-10 21:00:36 +08:00
42141084fe statistics: fix auto analyze log information incomplete (#23522) 2021-03-25 15:51:23 +08:00
6d258c708a statistics: delete extended stats cache item in current tidb synchronously (#23088) 2021-03-12 12:00:55 +08:00
168ef8878d statistics: test the auto analyze and feedback for the global-level stats (#23181) 2021-03-10 19:36:55 +08:00
b6db4506dc statistics: update the count and modify variables of global-stats as well when dumping delta info (#23228) 2021-03-10 16:24:55 +08:00
579cf90afa statistics: fix a case that auto-analyze is triggered outside its time range (#23214) 2021-03-09 21:44:54 +08:00
3d4def7eef planner, statistics: allow (auto) analyze single partition in dynamic-only mode (#22625) 2021-03-01 17:23:31 +08:00
e1004a2ccb *: modify the switch to control global stats (#22866) 2021-03-01 14:18:30 +08:00
270d497848 statistics: introduce new estimation logic when index histogram fails to estimate (#22682)
* statistics: introduce new estimation logic when index histogram fail to estimate

* address comments

* address comments

Co-authored-by: Ti Chi Robot <71242396+ti-chi-bot@users.noreply.github.com>
2021-02-24 16:30:03 +08:00
df9e730c16 stats, planner, sessionctx: handle compatibility between feedback and ver2 stats (#22846)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: Yiding Cui <winoros@gmail.com>
Co-authored-by: Ti Chi Robot <71242396+ti-chi-bot@users.noreply.github.com>
2021-02-23 13:46:49 +08:00
f3fe4895cb statistics: support to store FMSketch and add FMSketch to column stats (#22841)
* add FMSketch to mysql.stats_histograms

* statistics: support store FMSketch and add FMSketch to histogram

* FIX UT

* Create Stats_FM_Sketch Table

* fix UT

* add some tests

* FIX ut

* move fmSketch from histogram to column.stats

* remove unused code and comments

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* finish the FMSketch.MemoryUsage function

* add some comments for FMSketch.MemoryUsage function

* fix typo

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: Ti Chi Robot <71242396+ti-chi-bot@users.noreply.github.com>
2021-02-23 10:39:09 +08:00
343c412531 planner, executor, statistics: add tests for version 2 and fix bugs (#22461)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2021-02-04 15:52:30 +08:00
17a65ab98b statistics: refactor the statistics package use the RestrictedSQLExecutor API (#22636) 2021-02-03 13:28:57 +08:00
3dd842f50a statistics: add bucket ndv for index histogram (#20580)
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2021-01-13 18:24:21 +08:00
4a4acbe5fd statistics: GC index usage information (#21014) 2021-01-05 15:02:19 +08:00
5acff8de7a *: Revert "#19008" and "#18788" (#21599) 2020-12-14 15:06:35 +08:00
b4eee287af *: extract topn out of histogram correctly (#21007)
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
2020-12-10 17:05:39 +08:00
fc37586491 *: refactor function ExecRestrictedSQLWithContext to fix a DATA RACE (#21461) 2020-12-04 14:28:38 +08:00
583cbd265b statistics: store the topn by slice instead of map (#20818) 2020-11-06 15:39:33 +08:00
c2e3b0a6ad statistics: decouple TopN from CMSKetch (#20572) 2020-10-28 15:16:42 +08:00
99d1163cbc *: use ID instead of NAME in mysql.schema_index_usage (#20589) 2020-10-23 14:42:29 +08:00
bdb6c49600 *: collect index usage information from point get and dump them to KV (#20126) 2020-10-16 16:17:34 +08:00
cd16de894b *: introduce LRUCache with limited memory for statistics (#18788) 2020-10-15 17:36:21 +08:00
dcefa58035 *: use global stats & make ddl/feedback/show/export works(part III) (#20271) 2020-10-14 16:11:33 +08:00
170e2fec92 *: collect multiple partitions and store in tidb (part II) (#19899) 2020-09-29 21:25:56 +08:00
411eba618c statistics: update stats per table in the pipeline (#19370) 2020-09-15 19:53:08 +08:00
716f762d5d statistics: reduce HandleAutoAnalyze memory usage (#19837) 2020-09-12 10:54:27 +08:00
a99fdc098c statistics: ease the impact of stats feedback on cluster (#15503) 2020-07-08 19:53:04 +08:00
a7bdb82402 *: Reduce memory operations by simply passing size hint to make (#14922) 2020-02-25 15:44:36 +08:00
4755a9b9ef util: revert util/mathutil (#14744) 2020-02-13 11:33:04 +08:00
8cbacf0d7c wasm: fix compile error for wasm (#14160)
Signed-off-by: 5kbpers <tangminghua@pingcap.com>
2019-12-23 15:17:46 +08:00
0fe96bc864 stats: remove the lower bound of auto analyze ratio (#13995) 2019-12-10 16:52:25 +08:00