Commit Graph

953 Commits

Author SHA1 Message Date
e071841317 planner: fix redudent planID for partition table in optimizer trace (#36711)
close pingcap/tidb#36759
2022-08-04 15:50:06 +08:00
5ef18981cc Revert "planner: refactor the IsolationReadEngines variable for plan cache" (#36873) 2022-08-04 10:30:06 +08:00
bd3d138049 planner: remove the useless variable tidb_enable_point_get_cache (#36844)
close pingcap/tidb#36598
2022-08-03 20:20:05 +08:00
3847d9e56f planner: refactor the IsolationReadEngines variable for plan cache (#36770)
ref pingcap/tidb#36598
2022-08-03 19:44:05 +08:00
6a6fa8a882 ddl: Add sql_require_primary_key sysvar (#36146)
close pingcap/tidb#28544
2022-08-03 17:20:06 +08:00
8fdd64ea9e sessionctx/variable: Add tests for instance scoped config uniformity (#36796)
close pingcap/tidb#36795
2022-08-02 17:40:05 +08:00
c060208b2f *: move config file option oom-use-tmp-storage to sysvar (#36679)
ref pingcap/tidb#33769
2022-08-02 16:58:05 +08:00
0b1d3e0da3 *: cleanup sysvar API usage (#36640)
close pingcap/tidb#36639
2022-08-02 07:54:04 +08:00
fc217d432c config, sysvar: add config instance.enable_ddl and sysvar tidb_enable_ddl (#35425)
ref pingcap/tidb#34960
2022-08-01 15:02:06 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
1cd8c31b1a session: fix auto commit variable change effect on transaction commit (#36631)
close pingcap/tidb#36581
2022-08-01 09:36:04 +08:00
8e77ce264c *: introduce @@tidb_max_paging_size system variable for tuning (#36599)
close pingcap/tidb#36328
2022-07-29 15:29:12 +08:00
6b83cdbea2 executor: handle NULL values properly when LOAD DATA INFILE (#36124)
close pingcap/tidb#34358
2022-07-29 13:03:12 +08:00
2c3d4f1ae4 planner/core: change behavior of fine_grained_shffule_stream_count (#36621)
close pingcap/tidb#36622
2022-07-28 17:09:11 +08:00
624171abcc *: decouple planner/core from ddl package (#36608) 2022-07-27 21:15:12 +08:00
5c42aae575 upgrade: add a variable to make insert ddl job force to queue (#36614)
close pingcap/tidb#36601
2022-07-27 17:33:12 +08:00
34628f0f1a *: Spelling, change ture to true (#36520)
closes pingcap/tidb#36519
2022-07-27 14:35:11 +08:00
b0c6c5afa7 *: cleanup default sysvar value usage (#36487)
close pingcap/tidb#36485
2022-07-26 19:51:10 +08:00
c80026e61f executor: also collect unchanged unique keys for lock (#36498)
close pingcap/tidb#36438
2022-07-25 21:43:11 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
f0717dfe07 statistics, sessionctx: introduce topn assisted cardinality estimation for string matching functions (#36210)
close pingcap/tidb#36209
2022-07-20 21:55:09 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
fbbae462f1 planner: expose two variables related to the cost model (#36356)
ref pingcap/tidb#35240
2022-07-20 20:45:09 +08:00
fd6f5dd798 *: GC-aware memory track for analyze (#35248)
close pingcap/tidb#34996
2022-07-20 20:17:09 +08:00
a52656fde4 *: add binary plan in stmt summary and slow log/query (#35698)
close pingcap/tidb#35889
2022-07-20 18:21:09 +08:00
d00b984f4c executor, statistics: analyze use MaxUint64 ts to read data (#35232)
close pingcap/tidb#35233
2022-07-20 16:09:08 +08:00
afd71bdefd executor: support dispatch cop request to closest replica adaptively (#35927)
ref pingcap/tidb#35926
2022-07-19 17:59:07 +08:00
67be460efe planner: enable the new cost interface by default (#36241)
ref pingcap/tidb#35240
2022-07-18 21:21:08 +08:00
c28bac3d72 planner: support rewrite for skew group distinct aggregate to avoid skew execution (#36181)
close pingcap/tidb#36169
2022-07-18 15:29:07 +08:00
fa00fc5cd5 *: set fine grain timeout and update bazel config (#36220) 2022-07-15 11:11:05 +08:00
9a2ed52119 server, sessionctx: support token-based authentication (#36152)
close pingcap/tidb#35913
2022-07-14 18:29:06 +08:00
2193bfe3b7 *: remove system var tidb_enable_change_multi_schema (#36167)
ref pingcap/tidb#14766
2022-07-14 10:37:05 +08:00
0b427e1fd6 *: add tidb_min_paging_size system variable (#36107)
close pingcap/tidb#36106
2022-07-13 22:27:05 +08:00
bdc6397023 executor: support tidb memory debug mode (#35322)
ref pingcap/tidb#33877
2022-07-13 12:33:06 +08:00
dced89a231 planner/core, planner, sessionctx/variable: remove more skipInit (#35992)
ref pingcap/tidb#35051
2022-07-13 11:27:05 +08:00
2eb101abcf sessionctx/variable: remove skipInit from non-session scoped variables (#35801)
ref pingcap/tidb#35051
2022-07-07 00:01:02 +08:00
a5e973ca5a sessionctx/variable: convert TiDBLogFileMaxDays and TiDBConfig to ScopeInstance (#35733)
close pingcap/tidb#35190
2022-07-06 17:11:02 +08:00
b40fc86538 session, sessionctx/variable: ensure sysvars are always in lower case (#35659)
close pingcap/tidb#35658
2022-07-06 16:49:02 +08:00
55aea2787d *: use pdqsort to improve sort performance (#34404)
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
cdde0398fe sessionctx,kv,planner: add system variable for fine_grained_shuffle (#35256)
close pingcap/tidb#35342
2022-07-06 10:27:02 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
323411dda4 *: remove support for hidden sysvars (#35740)
close pingcap/tidb#35735
2022-07-01 14:28:40 +08:00
16df1942d0 *: add timeout for test cases (#35844) 2022-06-30 20:18:38 +08:00
4fc86936ff sessionctx: support encoding and decoding prepared statements (#35808)
close pingcap/tidb#35689
2022-06-30 11:56:38 +08:00
27e7bbdd4e sessionctx/variable: add tests to ensure skipInit can be removed (#35703)
ref pingcap/tidb#35051
2022-06-28 16:40:40 +08:00
31c92c67bc sessionctx: support encoding and decoding statement context (#35688)
close pingcap/tidb#35664
2022-06-27 12:20:39 +08:00
e2b55640c1 config, sysvar: map max-server-connections to max_connections (#35453)
ref pingcap/tidb#34960
2022-06-23 15:12:37 +08:00
e99d82a9b4 *: fix issue of cast string as time is incompatible with MySQL (#35455)
close pingcap/tidb#34539
2022-06-23 13:50:37 +08:00
e44277d8fe sessionctx: support encoding and decoding session contexts (#35648)
close pingcap/tidb#35573
2022-06-23 12:46:36 +08:00
193f04db70 session,sessionctx: enable tidb_enable_paging by default (#35275)
close pingcap/tidb#35273
2022-06-23 08:32:37 +08:00