Commit Graph

200 Commits

Author SHA1 Message Date
87702f8dbc ddl: remove unused field and clean comments (#41757) 2023-02-27 17:23:08 +08:00
a47f8041b5 parser/model: move reorg related types to a new file (#41747) 2023-02-27 15:41:07 +08:00
696d7d06e9 *: REORGANIZE PARTITION (#38535) (#41096)
close pingcap/tidb#38535
2023-02-11 20:28:00 +08:00
8531018f04 ddl: improve backfill more general (#41093)
close pingcap/tidb#41002
2023-02-10 23:52:00 +08:00
a22d690fda ddl, model: support for dist-reorg on partitioned tables (#41145)
close pingcap/tidb#41144
2023-02-09 23:54:08 +08:00
495e225dc7 ddl: fix data race on job.SetWarnings (#41231)
close pingcap/tidb#40751
2023-02-09 21:26:41 +08:00
1140b7c3b1 *: remove ru token in resource group schema and set brust limit (#41174)
ref pingcap/tidb#38825
2023-02-09 06:55:59 +08:00
85c48edbb6 placement: supports survival preferences (#40613)
close pingcap/tidb#38605
2023-02-08 17:51:59 +08:00
ddaf0d7814 ddl, parser: implement the normal flow of distributed processing in DDL reorg phase for adding index (#40542)
close pingcap/tidb#37125
2023-02-06 13:37:57 +08:00
975d177286 *: add resource group name into information_schema.processlist (#40739)
close pingcap/tidb#40724
2023-02-03 22:23:56 +08:00
a4b18ce359 resource_group: supports burstable for resource group (#40925)
close pingcap/tidb#40380
2023-02-02 17:35:57 +08:00
f0575a847b *: unify wru,rru to ru (#40884)
close pingcap/tidb#40883
2023-02-02 11:47:56 +08:00
26dab31068 ttl: support float number and store ttl_job_interval in info schema (#40509)
Signed-off-by: YangKeao <yangkeao@chunibyo.icu>

Signed-off-by: YangKeao <yangkeao@chunibyo.icu>
Co-authored-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2023-01-12 16:42:34 +08:00
eb35c773b5 ddl: avoid commit conflicts when updating/delete from mysql.tidb_ddl_reorg. (#38738)
* Added test case

* ddl fix #38669.

The issue was that mysql.tidb_ddl_reorg table was updated by an
inner transaction after the outer transaction started,
which then made a commit conflict in the outer transaction,
when it deleted the same row.

* Fixed typo in comment

* Added test case for #24427

* Disabled tests for CI testing

* Revert "Disabled tests for CI testing"

This reverts commit 17c28f30ba8802c578fed5653107aa6995e17607.

* Revert "Revert "Disabled tests for CI testing""

This reverts commit 65c84d94f7ab4440c739703312f5329619c6ccdc.

* removed test skips

* Clean up the tidb_ddl_reorg entry after DDL is completed

* Use a cleanup job afterwards instead.

* Fixed test

* Moved cleanup before asyncNotify

* More detailed test failure log

* Refined test error message

* Injecting timoeut to get stack traces from CI

* Updated Debug Dump on timeout

* Delete mulitple entries in tidb_ddl_reorg if needed

* Linting

* Linting

* Added CI debug logs

* Linting + CI debugs

* fixed CI debug

* Try to cleanup also if job.State == synced

* check for non-error of runErr instead of error...

* Use a new session, instead of reusing worker.sess

* Also handle case when job == nil

* Removed CI debug logs

* Misssed change session from w.sess to newly created sess

* Improved TestConcurrentDDLSwitch and added CI debug logs

* Always cleaning up all orphan mysql.tidb_ddl_reorg entries

* linting

* Also cleanup if job is nil

* Updated TestModifyColumnReorgInfo + CI debug logs

* more CI debug

* refactored the cleanupDDLReorgHandle code

* Added missing cleanup in handleDDLJobQueue

* Removed debug panic

* Code cleanup

* Test updates

* Debug cleanup

* Cleaned up test after removal of old non-concurrent DDL code merge

* Linting

* always wrap changes to tidb_ddl_reorg in an own transaction

+ fixed some typos

* Minimum fix

* Always update reorg meta, not only on error

* Issue is here :)

* Fixed newReorgHandler

* Wrapped more tidb_ddl_reorg changes into separate transactions

* linting

* Removed updateDDLReorgStartHandle

* cleanups

* Made runInTxn a method on *session, instead of normal function

* Update test

* Final touches

* Removed duplicate test

* CleanupDDLReorgHandles should only be called from HandleJobDone.

* Variable rename

* Renamed 'delete' variabel name

* Updated test

* small revert

* Removed timeout debugging code

* Simplified the cleanup to only start a new txn and not a new session

* Reverted the change of GetDDLInfo

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2023-01-11 21:18:33 +08:00
45d71af649 ddl: support displaying sub-job reorg type in admin show ddl (#40387)
close pingcap/tidb#40386
2023-01-10 12:50:22 +08:00
b477b1c946 *: Supports create/alter/drop resource group (#40188)
ref pingcap/tidb#38825
2023-01-09 13:44:22 +08:00
b226dfcb05 ttl: add ttl_job_interval attribute and remove tidb_ttl_job_interval variable (#40033)
close pingcap/tidb#40028
2023-01-06 17:56:21 +08:00
cb5affbc3c ddl, parser: Implement the write-reorg state split task related functions, and the related interfaces of backfill worker (#39982)
close pingcap/tidb#37123
2023-01-04 15:20:19 +08:00
6dff69f680 ddl: Support flashback cluster with ddl history (#40209)
ref pingcap/tidb#40026
2022-12-29 21:02:19 +08:00
ad0c202088 *: fix issue of multi-schema change with foreign key (#40042)
close pingcap/tidb#40037
2022-12-21 19:58:55 +08:00
ae58fa1c8b expression: introduce cast(... as ... array) in expression index (#39992)
close pingcap/tidb#40045
2022-12-20 12:56:54 +08:00
9488ca9db6 *: Add backfill job related tables and operations (#39616)
close pingcap/tidb#37122
2022-12-12 14:34:51 +08:00
19dae1fa73 *: separate auto_increment ID allocator from _tidb_rowid allocator when AUTO_ID_CACHE=1 (#39041)
close pingcap/tidb#982
2022-11-29 20:20:00 +08:00
7f632be1d5 ddl: add ttl related jobs / execution (#39298)
close pingcap/tidb#39269, close pingcap/tidb#39270, close pingcap/tidb#39271
2022-11-28 10:42:00 +08:00
dd0a479b1a planner, parser: add basic preparations for intersection type IndexMerge (#39396)
ref pingcap/tidb#39335
2022-11-25 19:37:59 +08:00
11ab7b4953 parser: add ActionReorganizePartition (#39183)
ref pingcap/tidb#38535
2022-11-16 18:39:55 +08:00
acf1dcf696 planner: supply Task memory usage and correct some accumulation (#38638)
ref pingcap/tidb#37632
2022-11-02 12:03:59 +08:00
863d35290c ddl: support add foreign key constraint with auto-create index (#38763)
close pingcap/tidb#38762
2022-11-01 20:27:59 +08:00
6d6e9c4b10 *: show backfill type in admin show ddl jobs (#38733)
ref pingcap/tidb#35983
2022-10-29 00:53:58 +08:00
4bdd20b540 *: support 2-phases flashback cluster (#38164)
ref pingcap/tidb#37961, close pingcap/tidb#38554
2022-10-26 17:01:58 +08:00
300d9e7c63 ddl: Support flashback schema (#37438)
close pingcap/tidb#20463
2022-10-19 15:03:54 +08:00
8f18fcece0 *: delete mInFlashbackCluster related codes (#38241)
ref pingcap/tidb#37197
2022-09-30 12:15:45 +08:00
858b8a38ea *: add foreign key constraint check when execute insert statement (#37466)
close pingcap/tidb#37465
2022-09-24 00:41:43 +08:00
c5c5ceeaab planner: PhysicalPlan memory trace 4 (#37736)
ref pingcap/tidb#37632
2022-09-16 11:40:58 +08:00
40e67edcca *: redirect the DML writes to a temp index during creating index (#37709)
ref pingcap/tidb#35983
2022-09-15 11:22:59 +08:00
c67ccbaef9 planner: PhysicalPlan memory trace 2 (#37668)
ref pingcap/tidb#37632
2022-09-09 16:42:56 +08:00
9036de3394 *: support create table with foreign key and maintain foreign key reference (#37148)
close pingcap/tidb#37147
2022-09-07 13:22:56 +08:00
xhe
e79ddd3076 parser: correctly escape placement options (#37606)
close pingcap/tidb#37526
2022-09-06 17:32:55 +08:00
df844e814b ddl, parser: fix resume pd schedule and cancel for flashback cluster (#37601)
ref pingcap/tidb#37580, close pingcap/tidb#37584
2022-09-05 20:30:55 +08:00
a04000cd89 *: merge feature/flashback-cluster to master (#37529)
ref pingcap/tidb#37197
2022-09-01 10:58:24 +08:00
ccd4f347a2 *: Enable tiflash_fastscan variable and remove fast mode alter statment (#37027)
ref pingcap/tidb#35850
2022-08-29 11:28:22 +08:00
d0f8487dea *: support specifying range bits for auto_random (#36860)
close pingcap/tidb#32508
2022-08-16 20:54:50 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
42935af3cc parser,ddl: Interval partitioning (#35662)
ref pingcap/tidb#19132, close pingcap/tidb#35683
2022-08-09 19:06:49 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
96d2c25c92 ddl: implement intra-table DDL for SchemaTracker (#36176)
close pingcap/tidb#35933
2022-07-29 19:33:13 +08:00
be102a3d55 *: fix timestamp conversion (#36705)
close pingcap/tidb#36707
2022-07-29 19:05:12 +08:00
624171abcc *: decouple planner/core from ddl package (#36608) 2022-07-27 21:15:12 +08:00
893a114abc parser: fix DDL job.Clone() (#36523)
close pingcap/tidb#36522
2022-07-25 18:31:10 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00