Commit Graph

5013 Commits

Author SHA1 Message Date
6baea73277 *: should replace errors.New(fmt.Sprintf(...)) with fmt.Errorf(...) (#36660) 2022-07-28 19:23:11 +08:00
2c3d4f1ae4 planner/core: change behavior of fine_grained_shffule_stream_count (#36621)
close pingcap/tidb#36622
2022-07-28 17:09:11 +08:00
15009a7c4e *: clean code (#36655) 2022-07-28 15:09:11 +08:00
8e7f97b9ff executor: close recordset in the aggregate_test (#36644) 2022-07-28 11:47:11 +08:00
e39ef4cae8 executor: prevent sending cop request for show columns (#36613)
close pingcap/tidb#36426, ref pingcap/tidb#36496
2022-07-27 20:31:11 +08:00
6c8bb7cf15 executor: avoid log empty binary plan into slow log (#36619)
close pingcap/tidb#36617
2022-07-27 18:37:11 +08:00
9a388e36c1 executor, statistics: directly update count if analyze reads latest data (#36588)
close pingcap/tidb#36552
2022-07-27 18:11:11 +08:00
16f143f875 planner: refactor the execute path when using plan cache (#36587)
ref pingcap/tidb#36598
2022-07-27 12:31:10 +08:00
8af16e815e seqtest: close failpoint when to exit the test case (#36602) 2022-07-27 12:09:11 +08:00
9d0f5f72d3 *: enable pessimistic transaction on unistore (#36578) 2022-07-26 21:07:10 +08:00
6ae88c4309 br: use one shot session to close domain ASAP (#36558)
* br: use one shot session to close domain ASAP



Co-authored-by: Ian <ArGregoryIan@gmail.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-07-26 20:15:53 +08:00
965454fd16 executor: optimize BCE in the memtable_reader (#34663)
ref pingcap/tidb#34669
2022-07-26 11:15:10 +08:00
c80026e61f executor: also collect unchanged unique keys for lock (#36498)
close pingcap/tidb#36438
2022-07-25 21:43:11 +08:00
eef41ccbc4 executor: close recordset in the insert_test (#36507) 2022-07-25 18:01:10 +08:00
1923d33622 planner: fix bindings with ignore_plan_cache_hint cannot work (#36427)
close pingcap/tidb#34596
2022-07-25 16:13:11 +08:00
b90dee785d executor: separate unstable test into package (#36506)
close pingcap/tidb#36504
2022-07-25 14:01:09 +08:00
c4c066554b executor: add syntax 'ADMIN SHOW DDL JOB QUERIES LIMIT m OFFSET n' to retrieve DDL commands within a certain range (#36480)
close pingcap/tidb#36198
2022-07-25 13:07:10 +08:00
48e496afc2 executor: correct the column name shown in show next_row_id (#36471)
close pingcap/tidb#36470
2022-07-25 09:41:09 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
065563a8ea executor: fix aggregating enum zero value gets different results from mysql (#36208)
close pingcap/tidb#26885
2022-07-22 14:05:09 +08:00
8bc002e77c table partition: add telemetry for partition table (#36204)
close pingcap/tidb#34949
2022-07-22 11:53:09 +08:00
23f25af211 executor,metrics: add a metric for observing execution phases (#35906)
ref pingcap/tidb#34106
2022-07-21 21:31:09 +08:00
6afbfa2ffc executor: close result (#36424) 2022-07-21 17:47:09 +08:00
1e391316fc executor: Remove version comment for MySQL 3.23.x syntax (#36342)
ref pingcap/tidb#36270
2022-07-21 13:53:09 +08:00
e3eea88801 telemetry: add telemetry for savepoint (#36354)
close pingcap/tidb#36353
2022-07-21 02:57:08 +08:00
04228632f6 table, meta: fix auto_increment initialization for temporary tables (#36319)
close pingcap/tidb#36224
2022-07-21 00:49:08 +08:00
e9f3980853 table partition: exchange partition with table enhance (#35749)
close pingcap/tidb#35996
2022-07-21 00:13:09 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
fd6f5dd798 *: GC-aware memory track for analyze (#35248)
close pingcap/tidb#34996
2022-07-20 20:17:09 +08:00
a52656fde4 *: add binary plan in stmt summary and slow log/query (#35698)
close pingcap/tidb#35889
2022-07-20 18:21:09 +08:00
a6b3f3d454 compact: Add syntax for COMPACT command without specifying the replica (#36368)
ref pingcap/tidb#34749
2022-07-20 16:53:09 +08:00
d00b984f4c executor, statistics: analyze use MaxUint64 ts to read data (#35232)
close pingcap/tidb#35233
2022-07-20 16:09:08 +08:00
4b50e67452 statistics: separte complex file and forbid embedding (#36318)
close pingcap/tidb#36284
2022-07-20 14:03:08 +08:00
98c27d86b9 ddl: fix data race in the setDDLLabelForDiagnosis (#36207)
close pingcap/tidb#36343
2022-07-20 13:09:08 +08:00
460d57c8ba log-backup: fix error that check whether partitionInfo.Columns is nil while it is [] (#36349)
close pingcap/tidb#36348
2022-07-20 12:15:08 +08:00
a0cced2167 executor: fix show create table with set and enum (#36327)
close pingcap/tidb#36317
2022-07-19 20:07:08 +08:00
afd71bdefd executor: support dispatch cop request to closest replica adaptively (#35927)
ref pingcap/tidb#35926
2022-07-19 17:59:07 +08:00
f84554bd07 expression: fix binary str numeric result type (#36258)
close pingcap/tidb#27698
2022-07-19 16:43:07 +08:00
67be460efe planner: enable the new cost interface by default (#36241)
ref pingcap/tidb#35240
2022-07-18 21:21:08 +08:00
4cade24ed6 *: support the binary plan through EXPLAIN format='binary' and tidb_decode_binary_plan (#36221)
ref pingcap/tidb#35889
2022-07-18 16:27:07 +08:00
c28bac3d72 planner: support rewrite for skew group distinct aggregate to avoid skew execution (#36181)
close pingcap/tidb#36169
2022-07-18 15:29:07 +08:00
8c380e3107 ddl: support alter table options for multi-schema change (#36236)
ref pingcap/tidb#14766, close pingcap/tidb#36234
2022-07-18 10:39:07 +08:00
f675cf619b ddl: ban set tiflash mode under unsupported case (#36211)
ref pingcap/tidb#35850
2022-07-18 09:53:06 +08:00
f47978c3c2 log-backup: add the switch for log backup (#36115)
ref pingcap/tidb#29501
2022-07-15 14:31:06 +08:00
fa00fc5cd5 *: set fine grain timeout and update bazel config (#36220) 2022-07-15 11:11:05 +08:00
9a2ed52119 server, sessionctx: support token-based authentication (#36152)
close pingcap/tidb#35913
2022-07-14 18:29:06 +08:00
7953d60c1b *: switch to flat plan in stmt summary, slow log, etc (#36069)
ref pingcap/tidb#35888
2022-07-14 17:37:06 +08:00
2193bfe3b7 *: remove system var tidb_enable_change_multi_schema (#36167)
ref pingcap/tidb#14766
2022-07-14 10:37:05 +08:00
5eec739f21 executor: optimize cursor read point get by reading through pessimistic lock cache (#36149)
ref pingcap/tidb#36162
2022-07-13 22:49:05 +08:00
0b427e1fd6 *: add tidb_min_paging_size system variable (#36107)
close pingcap/tidb#36106
2022-07-13 22:27:05 +08:00