Commit Graph

188 Commits

Author SHA1 Message Date
26dab31068 ttl: support float number and store ttl_job_interval in info schema (#40509)
Signed-off-by: YangKeao <yangkeao@chunibyo.icu>

Signed-off-by: YangKeao <yangkeao@chunibyo.icu>
Co-authored-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2023-01-12 16:42:34 +08:00
eb35c773b5 ddl: avoid commit conflicts when updating/delete from mysql.tidb_ddl_reorg. (#38738)
* Added test case

* ddl fix #38669.

The issue was that mysql.tidb_ddl_reorg table was updated by an
inner transaction after the outer transaction started,
which then made a commit conflict in the outer transaction,
when it deleted the same row.

* Fixed typo in comment

* Added test case for #24427

* Disabled tests for CI testing

* Revert "Disabled tests for CI testing"

This reverts commit 17c28f30ba8802c578fed5653107aa6995e17607.

* Revert "Revert "Disabled tests for CI testing""

This reverts commit 65c84d94f7ab4440c739703312f5329619c6ccdc.

* removed test skips

* Clean up the tidb_ddl_reorg entry after DDL is completed

* Use a cleanup job afterwards instead.

* Fixed test

* Moved cleanup before asyncNotify

* More detailed test failure log

* Refined test error message

* Injecting timoeut to get stack traces from CI

* Updated Debug Dump on timeout

* Delete mulitple entries in tidb_ddl_reorg if needed

* Linting

* Linting

* Added CI debug logs

* Linting + CI debugs

* fixed CI debug

* Try to cleanup also if job.State == synced

* check for non-error of runErr instead of error...

* Use a new session, instead of reusing worker.sess

* Also handle case when job == nil

* Removed CI debug logs

* Misssed change session from w.sess to newly created sess

* Improved TestConcurrentDDLSwitch and added CI debug logs

* Always cleaning up all orphan mysql.tidb_ddl_reorg entries

* linting

* Also cleanup if job is nil

* Updated TestModifyColumnReorgInfo + CI debug logs

* more CI debug

* refactored the cleanupDDLReorgHandle code

* Added missing cleanup in handleDDLJobQueue

* Removed debug panic

* Code cleanup

* Test updates

* Debug cleanup

* Cleaned up test after removal of old non-concurrent DDL code merge

* Linting

* always wrap changes to tidb_ddl_reorg in an own transaction

+ fixed some typos

* Minimum fix

* Always update reorg meta, not only on error

* Issue is here :)

* Fixed newReorgHandler

* Wrapped more tidb_ddl_reorg changes into separate transactions

* linting

* Removed updateDDLReorgStartHandle

* cleanups

* Made runInTxn a method on *session, instead of normal function

* Update test

* Final touches

* Removed duplicate test

* CleanupDDLReorgHandles should only be called from HandleJobDone.

* Variable rename

* Renamed 'delete' variabel name

* Updated test

* small revert

* Removed timeout debugging code

* Simplified the cleanup to only start a new txn and not a new session

* Reverted the change of GetDDLInfo

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2023-01-11 21:18:33 +08:00
45d71af649 ddl: support displaying sub-job reorg type in admin show ddl (#40387)
close pingcap/tidb#40386
2023-01-10 12:50:22 +08:00
b477b1c946 *: Supports create/alter/drop resource group (#40188)
ref pingcap/tidb#38825
2023-01-09 13:44:22 +08:00
b226dfcb05 ttl: add ttl_job_interval attribute and remove tidb_ttl_job_interval variable (#40033)
close pingcap/tidb#40028
2023-01-06 17:56:21 +08:00
cb5affbc3c ddl, parser: Implement the write-reorg state split task related functions, and the related interfaces of backfill worker (#39982)
close pingcap/tidb#37123
2023-01-04 15:20:19 +08:00
6dff69f680 ddl: Support flashback cluster with ddl history (#40209)
ref pingcap/tidb#40026
2022-12-29 21:02:19 +08:00
ad0c202088 *: fix issue of multi-schema change with foreign key (#40042)
close pingcap/tidb#40037
2022-12-21 19:58:55 +08:00
ae58fa1c8b expression: introduce cast(... as ... array) in expression index (#39992)
close pingcap/tidb#40045
2022-12-20 12:56:54 +08:00
9488ca9db6 *: Add backfill job related tables and operations (#39616)
close pingcap/tidb#37122
2022-12-12 14:34:51 +08:00
19dae1fa73 *: separate auto_increment ID allocator from _tidb_rowid allocator when AUTO_ID_CACHE=1 (#39041)
close pingcap/tidb#982
2022-11-29 20:20:00 +08:00
7f632be1d5 ddl: add ttl related jobs / execution (#39298)
close pingcap/tidb#39269, close pingcap/tidb#39270, close pingcap/tidb#39271
2022-11-28 10:42:00 +08:00
dd0a479b1a planner, parser: add basic preparations for intersection type IndexMerge (#39396)
ref pingcap/tidb#39335
2022-11-25 19:37:59 +08:00
11ab7b4953 parser: add ActionReorganizePartition (#39183)
ref pingcap/tidb#38535
2022-11-16 18:39:55 +08:00
acf1dcf696 planner: supply Task memory usage and correct some accumulation (#38638)
ref pingcap/tidb#37632
2022-11-02 12:03:59 +08:00
863d35290c ddl: support add foreign key constraint with auto-create index (#38763)
close pingcap/tidb#38762
2022-11-01 20:27:59 +08:00
6d6e9c4b10 *: show backfill type in admin show ddl jobs (#38733)
ref pingcap/tidb#35983
2022-10-29 00:53:58 +08:00
4bdd20b540 *: support 2-phases flashback cluster (#38164)
ref pingcap/tidb#37961, close pingcap/tidb#38554
2022-10-26 17:01:58 +08:00
300d9e7c63 ddl: Support flashback schema (#37438)
close pingcap/tidb#20463
2022-10-19 15:03:54 +08:00
8f18fcece0 *: delete mInFlashbackCluster related codes (#38241)
ref pingcap/tidb#37197
2022-09-30 12:15:45 +08:00
858b8a38ea *: add foreign key constraint check when execute insert statement (#37466)
close pingcap/tidb#37465
2022-09-24 00:41:43 +08:00
c5c5ceeaab planner: PhysicalPlan memory trace 4 (#37736)
ref pingcap/tidb#37632
2022-09-16 11:40:58 +08:00
40e67edcca *: redirect the DML writes to a temp index during creating index (#37709)
ref pingcap/tidb#35983
2022-09-15 11:22:59 +08:00
c67ccbaef9 planner: PhysicalPlan memory trace 2 (#37668)
ref pingcap/tidb#37632
2022-09-09 16:42:56 +08:00
9036de3394 *: support create table with foreign key and maintain foreign key reference (#37148)
close pingcap/tidb#37147
2022-09-07 13:22:56 +08:00
xhe
e79ddd3076 parser: correctly escape placement options (#37606)
close pingcap/tidb#37526
2022-09-06 17:32:55 +08:00
df844e814b ddl, parser: fix resume pd schedule and cancel for flashback cluster (#37601)
ref pingcap/tidb#37580, close pingcap/tidb#37584
2022-09-05 20:30:55 +08:00
a04000cd89 *: merge feature/flashback-cluster to master (#37529)
ref pingcap/tidb#37197
2022-09-01 10:58:24 +08:00
ccd4f347a2 *: Enable tiflash_fastscan variable and remove fast mode alter statment (#37027)
ref pingcap/tidb#35850
2022-08-29 11:28:22 +08:00
d0f8487dea *: support specifying range bits for auto_random (#36860)
close pingcap/tidb#32508
2022-08-16 20:54:50 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
42935af3cc parser,ddl: Interval partitioning (#35662)
ref pingcap/tidb#19132, close pingcap/tidb#35683
2022-08-09 19:06:49 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
96d2c25c92 ddl: implement intra-table DDL for SchemaTracker (#36176)
close pingcap/tidb#35933
2022-07-29 19:33:13 +08:00
be102a3d55 *: fix timestamp conversion (#36705)
close pingcap/tidb#36707
2022-07-29 19:05:12 +08:00
624171abcc *: decouple planner/core from ddl package (#36608) 2022-07-27 21:15:12 +08:00
893a114abc parser: fix DDL job.Clone() (#36523)
close pingcap/tidb#36522
2022-07-25 18:31:10 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
e9f3980853 table partition: exchange partition with table enhance (#35749)
close pingcap/tidb#35996
2022-07-21 00:13:09 +08:00
c087f6dc2a table partition: update job dependence for exchange partition with table (#35751)
close pingcap/tidb#35842
2022-07-20 12:41:08 +08:00
c8e27fe0b9 ddl: handle rolling back modify columns correctly (#36282)
ref pingcap/tidb#14766
2022-07-18 23:55:07 +08:00
8b30e52bcf ddl: only use one schema version for the non-revertible step (#36262)
ref pingcap/tidb#14766
2022-07-18 21:49:07 +08:00
911e7cc360 *: enable revive (#35970)
ref pingcap/tidb#35345
2022-07-15 16:03:06 +08:00
2193bfe3b7 *: remove system var tidb_enable_change_multi_schema (#36167)
ref pingcap/tidb#14766
2022-07-14 10:37:05 +08:00
2f934d67a2 *: support show ddl jobs for sub-jobs (#36168)
ref pingcap/tidb#14766
2022-07-13 20:57:05 +08:00
1a9a7a614c statistics,planner: let index support sync stats (#35879)
ref pingcap/tidb#35764
2022-07-11 17:23:05 +08:00
6e22e47f06 parser,ddl: support 'set tiflash mode' ddl and support check tiflash mode in tiflash_replica table (#35851)
ref pingcap/tidb#35850
2022-07-07 15:15:03 +08:00
55aea2787d *: use pdqsort to improve sort performance (#34404)
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
d5898d03a9 ddl: remove onDropIndexes (#35960)
ref pingcap/tidb#14766
2022-07-06 12:17:02 +08:00
aec4349cac statistics: let index support LoadNeededHistograms (#35775)
ref pingcap/tidb#35764
2022-07-04 14:03:00 +08:00