Commit Graph

278 Commits

Author SHA1 Message Date
97e1563a60 metrics: add goroutine schedule latency to grafana panel (#40836)
close pingcap/tidb#40835
2023-01-30 13:33:54 +08:00
b1ecabb559 txn: Optimize pessimistic transaction by supporting locking with conflict (#35588)
close pingcap/tidb#40537
2023-01-13 11:09:46 +08:00
3f223b3ada ttl: make ttl's group in granfana collapse by default (#40444) 2023-01-10 12:06:24 +08:00
f483b39c34 metrics: add metrics for plan replayer and historical stats (#40271) 2023-01-04 10:50:20 +08:00
f7de8beede *: remove the support of the old ddl framework (#39684)
ref pingcap/tidb#39824
2022-12-30 18:30:18 +08:00
ab01065a85 metrics: remove Keep Alive OPM metric (#40142)
close pingcap/tidb#40143
2022-12-27 10:56:17 +08:00
aeccf77637 *: optimize mpp probe (#39932)
close pingcap/tidb#39686
2022-12-22 15:42:55 +08:00
4e43b14db6 metrics: add metrics for ema cpu metrics and GOGC (#40049)
close pingcap/tidb#40092
2022-12-22 10:40:55 +08:00
08f6ea484f metrics: add EMA cpu usage (#39995)
close pingcap/tidb#40029
2022-12-19 14:58:53 +08:00
4a19cae84f ttl: TTL support split scan ranges for some primary key with more than one columns (#39896)
close pingcap/tidb#39895
2022-12-14 11:22:51 +08:00
c4047cc769 ttl: modify default value of tidb_ttl_delete_batch_size to 100 (#39878)
close pingcap/tidb#39877
2022-12-13 19:38:52 +08:00
cb435fe56b ttl: Add metrics for TTL (#39849)
close pingcap/tidb#39848
2022-12-13 15:56:52 +08:00
4b1bb5b511 log-backup: implement subscription of flush (#39445)
ref tikv/tikv#13824
2022-12-01 22:06:02 +08:00
e98e9594bc *: add telemetry support for IndexMerge (#39469)
close pingcap/tidb#39475
2022-11-30 12:23:59 +08:00
1b15732d11 telemetry: add telemetry for alter table compact partition (#39452)
ref pingcap/tidb#36175
2022-11-29 19:07:59 +08:00
84fa999186 txn: support multi-table join in nt-dml (#39139)
ref pingcap/tidb#33485
2022-11-24 14:33:58 +08:00
6a6fc002b6 metrics: add tiflash and cdc into performance overview (#39231)
* initial commit

* fix tiflash memory

* fix cdc collapsed

* add color for tiflash_mpp

* revert the uid change

* fix-bugs

* add tidb sourcesql panel

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-11-23 15:15:42 +08:00
97b0151773 metrics: add metrics for multi-statement (#38931)
close pingcap/tidb#38930
2022-11-08 10:33:50 +08:00
21d6190278 txn: tidb_constraint_check_in_place_pessimistic should not be global scoped (#38767)
close pingcap/tidb#38766
2022-11-07 10:31:50 +08:00
6ab17074b8 telemetry: telemetry supports count flashback cluster (#38901)
close pingcap/tidb#38896
2022-11-04 17:46:03 +08:00
12d9644144 *: support mysql compatible auto_increment, the client side changes (#38809) 2022-11-04 09:36:00 +08:00
f9c7bbccec *: authentication using tidb_auth_token plugin (#38773)
close pingcap/tidb#38504
2022-11-04 02:54:00 +08:00
d7bd49a457 session: support non-transactional insert statements (#38799)
ref pingcap/tidb#33485
2022-11-04 02:28:00 +08:00
4df8d85057 metrics: update active connection promeQL and add metric: miss plan cache (#38873)
close pingcap/tidb#38871
2022-11-03 20:10:01 +08:00
a3d74207cd planner: add monitor for prepared plan cache memory usage (#38507)
ref pingcap/tidb#37632
2022-11-02 14:50:00 +08:00
d70b022b54 metrics: Add IOPs, Disk Throughput to the overview dashboard (#38270)
ref pingcap/tidb#34106
2022-09-30 16:45:45 +08:00
5ac83ce6d1 metrics: Add a metric to diagnose the write-conflict severity caused by RCCheckTS isolaion (#38216)
ref pingcap/tidb#37226
2022-09-28 22:19:47 +08:00
4dfcb27738 metrics: fix region num of transaction (#38140)
close pingcap/tidb#38139
2022-09-26 15:01:44 +08:00
59b4a8e910 table partition: exchange partition telemetry (#37875)
close pingcap/tidb#37874
2022-09-22 01:25:02 +08:00
e87d3aa740 metrics, telemetry: add telemetry for metadata lock (#37915)
ref pingcap/tidb#37275
2022-09-19 16:25:01 +08:00
06a1659521 *: Telemetry for multi-column RANGE COLUMNS partitioning (#37828)
ref pingcap/tidb#36636
2022-09-17 00:16:59 +08:00
b03b5eeaa5 ddl: add telemetry support for add index acceleration (#37849)
* Add telemetry support
* Change AddIndexIngestUsageCounter to DDLUsageCounter to collect all DDL related telemetry counter

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-09-16 15:10:51 +08:00
40e67edcca *: redirect the DML writes to a temp index during creating index (#37709)
ref pingcap/tidb#35983
2022-09-15 11:22:59 +08:00
f0d8d47df5 telemetry: interval partitioning (#36486)
close pingcap/tidb#36525
2022-09-14 18:12:58 +08:00
62480cf19b *: add telemetry support for account lock/unlock (#37344)
close pingcap/tidb#37324
2022-09-07 18:40:56 +08:00
835922a5cd txn: support skipping locking of some INSERT in pessimistic transactions (#36473)
close pingcap/tidb#36579
2022-09-01 18:34:25 +08:00
41b9e26d1e ddl: use the correct schema version when waitSchemaSynced (#37210)
close pingcap/tidb#37209
2022-08-19 17:18:52 +08:00
cd7b3a2b99 ddl, metrics: remove cleanExpirePath (#36863) 2022-08-04 13:34:06 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
eb85efba33 *: add affected rows metrics (#36436)
close pingcap/tidb#36435
2022-07-25 17:33:10 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
8bc002e77c table partition: add telemetry for partition table (#36204)
close pingcap/tidb#34949
2022-07-22 11:53:09 +08:00
8465262ee2 metric: impove concurrency ddl metrics (#36405)
ref pingcap/tidb#32031
2022-07-22 00:05:09 +08:00
23f25af211 executor,metrics: add a metric for observing execution phases (#35906)
ref pingcap/tidb#34106
2022-07-21 21:31:09 +08:00
e3eea88801 telemetry: add telemetry for savepoint (#36354)
close pingcap/tidb#36353
2022-07-21 02:57:08 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
fd6f5dd798 *: GC-aware memory track for analyze (#35248)
close pingcap/tidb#34996
2022-07-20 20:17:09 +08:00
afd71bdefd executor: support dispatch cop request to closest replica adaptively (#35927)
ref pingcap/tidb#35926
2022-07-19 17:59:07 +08:00
98595124b2 log-backup: added more metrics and hint; fixed a bug may cause inf loop (#36228)
ref pingcap/tidb#29501
2022-07-18 22:17:07 +08:00
df31ac65a4 execdetails: output write details in RuntimeStats (#35814)
ref pingcap/tidb#34487
2022-07-18 15:01:07 +08:00