Commit Graph

219 Commits

Author SHA1 Message Date
8b67cea5e1 *: support check constraint in tidb (#44104)
ref pingcap/tidb#41711
2023-06-07 08:51:42 +00:00
a26691cea8 ddl, I_S: support runaway attribute in resource group (#43877)
ref pingcap/tidb#43691
2023-06-06 12:11:41 +00:00
4c83352678 *: Introduce runaway statement in resource group (#43843)
ref pingcap/tidb#43691
2023-05-31 11:16:42 +00:00
732b483de9 *: show start time of multi-schema change sub-jobs (#44173)
ref pingcap/tidb#14766
2023-05-29 07:58:41 +00:00
557167ebe7 executor: add remain time for showAnalyzeStatus (#43866)
close pingcap/tidb#44033
2023-05-25 13:39:39 +00:00
334d21fda0 ddl: better approach to pause or resume ddl jobs during upgrade (#43907)
close pingcap/tidb#43897
2023-05-18 14:17:36 +00:00
5db4b38f2c planner: support Hypo indexes (#43607)
close pingcap/tidb#43817
2023-05-16 10:43:17 +00:00
4314687305 *: Update bootstrap and support pause user DDL when upgrading TiDB (#43666)
close pingcap/tidb#43665
2023-05-10 17:07:21 +00:00
0d3ad53386 ddl, executor: executor change for pause/resume on ddl jobs (#43171)
close pingcap/tidb#18015, ref pingcap/tidb#40041
2023-05-09 14:32:08 +00:00
cb609bb39c *: add tidb_row_checksum() as a builtin function (#43479)
ref pingcap/tidb#42747
2023-05-05 07:03:56 +00:00
d95ce849f0 ddl, parser, planner: admin Pause/Resume on DDL jobs (#43081)
close pingcap/tidb#18015, ref pingcap/tidb#40041
2023-04-28 03:29:53 +00:00
2e951bc25c ddl: wait schema change before rename table job is done (#43341)
close pingcap/tidb#43338
2023-04-27 04:03:52 +00:00
6122ca307e linter: support lll to avoid too long line (#42718)
close pingcap/tidb#42570
2023-04-12 23:23:01 +08:00
915b39b884 ddl: DDL job add charset and collate when create the index (#42750)
close pingcap/tidb#42748
2023-04-06 17:44:57 +08:00
e942ab6148 kazel: support auto-config shard_count (#42751)
close pingcap/tidb#42827
2023-04-06 15:46:58 +08:00
e6cf1ab854 executor: lock untouched unique keys on update (#42713)
close pingcap/tidb#36438
2023-03-31 21:46:55 +08:00
ecd596af9e parser, ddl: correct the job type of 'REORGANIZE PARTITION' (#42490)
close pingcap/tidb#42442
2023-03-23 01:10:42 +08:00
61de990411 *: Add priority in resource group setting (#42293)
ref pingcap/tidb#38825
2023-03-17 21:02:40 +08:00
7089399891 ttl: fix upgrade from 6.5 to 6.6 configuration default value (#41866)
close pingcap/tidb#41865
2023-03-09 18:49:12 +08:00
87702f8dbc ddl: remove unused field and clean comments (#41757) 2023-02-27 17:23:08 +08:00
a47f8041b5 parser/model: move reorg related types to a new file (#41747) 2023-02-27 15:41:07 +08:00
696d7d06e9 *: REORGANIZE PARTITION (#38535) (#41096)
close pingcap/tidb#38535
2023-02-11 20:28:00 +08:00
8531018f04 ddl: improve backfill more general (#41093)
close pingcap/tidb#41002
2023-02-10 23:52:00 +08:00
a22d690fda ddl, model: support for dist-reorg on partitioned tables (#41145)
close pingcap/tidb#41144
2023-02-09 23:54:08 +08:00
495e225dc7 ddl: fix data race on job.SetWarnings (#41231)
close pingcap/tidb#40751
2023-02-09 21:26:41 +08:00
1140b7c3b1 *: remove ru token in resource group schema and set brust limit (#41174)
ref pingcap/tidb#38825
2023-02-09 06:55:59 +08:00
85c48edbb6 placement: supports survival preferences (#40613)
close pingcap/tidb#38605
2023-02-08 17:51:59 +08:00
ddaf0d7814 ddl, parser: implement the normal flow of distributed processing in DDL reorg phase for adding index (#40542)
close pingcap/tidb#37125
2023-02-06 13:37:57 +08:00
975d177286 *: add resource group name into information_schema.processlist (#40739)
close pingcap/tidb#40724
2023-02-03 22:23:56 +08:00
a4b18ce359 resource_group: supports burstable for resource group (#40925)
close pingcap/tidb#40380
2023-02-02 17:35:57 +08:00
f0575a847b *: unify wru,rru to ru (#40884)
close pingcap/tidb#40883
2023-02-02 11:47:56 +08:00
26dab31068 ttl: support float number and store ttl_job_interval in info schema (#40509)
Signed-off-by: YangKeao <yangkeao@chunibyo.icu>

Signed-off-by: YangKeao <yangkeao@chunibyo.icu>
Co-authored-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2023-01-12 16:42:34 +08:00
eb35c773b5 ddl: avoid commit conflicts when updating/delete from mysql.tidb_ddl_reorg. (#38738)
* Added test case

* ddl fix #38669.

The issue was that mysql.tidb_ddl_reorg table was updated by an
inner transaction after the outer transaction started,
which then made a commit conflict in the outer transaction,
when it deleted the same row.

* Fixed typo in comment

* Added test case for #24427

* Disabled tests for CI testing

* Revert "Disabled tests for CI testing"

This reverts commit 17c28f30ba8802c578fed5653107aa6995e17607.

* Revert "Revert "Disabled tests for CI testing""

This reverts commit 65c84d94f7ab4440c739703312f5329619c6ccdc.

* removed test skips

* Clean up the tidb_ddl_reorg entry after DDL is completed

* Use a cleanup job afterwards instead.

* Fixed test

* Moved cleanup before asyncNotify

* More detailed test failure log

* Refined test error message

* Injecting timoeut to get stack traces from CI

* Updated Debug Dump on timeout

* Delete mulitple entries in tidb_ddl_reorg if needed

* Linting

* Linting

* Added CI debug logs

* Linting + CI debugs

* fixed CI debug

* Try to cleanup also if job.State == synced

* check for non-error of runErr instead of error...

* Use a new session, instead of reusing worker.sess

* Also handle case when job == nil

* Removed CI debug logs

* Misssed change session from w.sess to newly created sess

* Improved TestConcurrentDDLSwitch and added CI debug logs

* Always cleaning up all orphan mysql.tidb_ddl_reorg entries

* linting

* Also cleanup if job is nil

* Updated TestModifyColumnReorgInfo + CI debug logs

* more CI debug

* refactored the cleanupDDLReorgHandle code

* Added missing cleanup in handleDDLJobQueue

* Removed debug panic

* Code cleanup

* Test updates

* Debug cleanup

* Cleaned up test after removal of old non-concurrent DDL code merge

* Linting

* always wrap changes to tidb_ddl_reorg in an own transaction

+ fixed some typos

* Minimum fix

* Always update reorg meta, not only on error

* Issue is here :)

* Fixed newReorgHandler

* Wrapped more tidb_ddl_reorg changes into separate transactions

* linting

* Removed updateDDLReorgStartHandle

* cleanups

* Made runInTxn a method on *session, instead of normal function

* Update test

* Final touches

* Removed duplicate test

* CleanupDDLReorgHandles should only be called from HandleJobDone.

* Variable rename

* Renamed 'delete' variabel name

* Updated test

* small revert

* Removed timeout debugging code

* Simplified the cleanup to only start a new txn and not a new session

* Reverted the change of GetDDLInfo

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2023-01-11 21:18:33 +08:00
45d71af649 ddl: support displaying sub-job reorg type in admin show ddl (#40387)
close pingcap/tidb#40386
2023-01-10 12:50:22 +08:00
b477b1c946 *: Supports create/alter/drop resource group (#40188)
ref pingcap/tidb#38825
2023-01-09 13:44:22 +08:00
b226dfcb05 ttl: add ttl_job_interval attribute and remove tidb_ttl_job_interval variable (#40033)
close pingcap/tidb#40028
2023-01-06 17:56:21 +08:00
cb5affbc3c ddl, parser: Implement the write-reorg state split task related functions, and the related interfaces of backfill worker (#39982)
close pingcap/tidb#37123
2023-01-04 15:20:19 +08:00
6dff69f680 ddl: Support flashback cluster with ddl history (#40209)
ref pingcap/tidb#40026
2022-12-29 21:02:19 +08:00
ad0c202088 *: fix issue of multi-schema change with foreign key (#40042)
close pingcap/tidb#40037
2022-12-21 19:58:55 +08:00
ae58fa1c8b expression: introduce cast(... as ... array) in expression index (#39992)
close pingcap/tidb#40045
2022-12-20 12:56:54 +08:00
9488ca9db6 *: Add backfill job related tables and operations (#39616)
close pingcap/tidb#37122
2022-12-12 14:34:51 +08:00
19dae1fa73 *: separate auto_increment ID allocator from _tidb_rowid allocator when AUTO_ID_CACHE=1 (#39041)
close pingcap/tidb#982
2022-11-29 20:20:00 +08:00
7f632be1d5 ddl: add ttl related jobs / execution (#39298)
close pingcap/tidb#39269, close pingcap/tidb#39270, close pingcap/tidb#39271
2022-11-28 10:42:00 +08:00
dd0a479b1a planner, parser: add basic preparations for intersection type IndexMerge (#39396)
ref pingcap/tidb#39335
2022-11-25 19:37:59 +08:00
11ab7b4953 parser: add ActionReorganizePartition (#39183)
ref pingcap/tidb#38535
2022-11-16 18:39:55 +08:00
acf1dcf696 planner: supply Task memory usage and correct some accumulation (#38638)
ref pingcap/tidb#37632
2022-11-02 12:03:59 +08:00
863d35290c ddl: support add foreign key constraint with auto-create index (#38763)
close pingcap/tidb#38762
2022-11-01 20:27:59 +08:00
6d6e9c4b10 *: show backfill type in admin show ddl jobs (#38733)
ref pingcap/tidb#35983
2022-10-29 00:53:58 +08:00
4bdd20b540 *: support 2-phases flashback cluster (#38164)
ref pingcap/tidb#37961, close pingcap/tidb#38554
2022-10-26 17:01:58 +08:00
300d9e7c63 ddl: Support flashback schema (#37438)
close pingcap/tidb#20463
2022-10-19 15:03:54 +08:00