Commit Graph

103 Commits

Author SHA1 Message Date
2fbf4cf032 ddl: integrate add index operator to dist framework (#46495)
ref pingcap/tidb#46258
2023-09-05 09:05:11 +00:00
5cbcc86e50 disttask: refactor dispatcher so we have chance to add init logics per task type (#46603)
ref pingcap/tidb#46258
2023-09-05 06:50:12 +00:00
6707afae63 distribute framework: add planner (#46395)
ref pingcap/tidb#46258
2023-09-04 12:11:13 +00:00
xhe
1901239f94 disktask: replace failure nodes with alive ones (#45935)
ref pingcap/tidb#46258
2023-09-04 08:15:43 +00:00
a4271136ec bootstrap: add summary field for system table tidb_background_subtask (#46562)
ref pingcap/tidb#46258
2023-09-04 01:53:13 +00:00
3036b6d225 importinto: support split large csv file (#46480)
ref pingcap/tidb#42930
2023-09-01 12:06:43 +00:00
1a9cfb55ff *: disable race for framework tests (#46594)
close pingcap/tidb#46573
2023-09-01 08:48:40 +00:00
d36478f4b2 disttask, ddl: rename flowhandle (#46497)
ref pingcap/tidb#46258
2023-08-31 07:27:39 +00:00
d434bd9f1d import into: fix id base (#46315)
close pingcap/tidb#46174
2023-08-29 09:50:09 +00:00
40c4a16753 ddl, disttask: implement add index operators (#46414)
ref pingcap/tidb#46258
2023-08-29 06:59:15 +00:00
2f2bc4134a disttask: replace manually mock with gomock (#46392)
ref pingcap/tidb#41495
2023-08-25 08:47:06 +00:00
c66d28f69c disttask: add pending to failed state transform (#46357)
ref pingcap/tidb#46258
2023-08-25 07:06:35 +00:00
c38f0c1ed2 disttask: record subtask start/update time (#46361)
close pingcap/tidb#45990
2023-08-24 06:08:05 +00:00
8ff9d89bf3 disttask: fix wrongly add subtask when state transform fail (#46259)
ref pingcap/tidb#46258, close pingcap/tidb#46261
2023-08-23 10:03:34 +00:00
1ea6499132 disttask: add operator abstraction (#46279)
ref pingcap/tidb#46258
2023-08-22 15:39:34 +00:00
883e88a645 distribute framework: restrict the task state transform rule (#45932)
ref pingcap/tidb#41495
2023-08-18 07:36:32 +00:00
24122b5db3 disttask: fix run one step SubtaskExecutor twice (#46106)
close pingcap/tidb#46098
2023-08-17 04:57:30 +00:00
86dd1802d5 disttask: add server info for dispatcher log (#46123)
close pingcap/tidb#46122
2023-08-16 11:41:00 +00:00
dbf7602911 disttask: fix owner change flaky test (#46075)
close pingcap/tidb#46014
2023-08-15 04:55:59 +00:00
0c3ff61728 ddl: split disttask scheduler to different stage (#45937)
ref pingcap/tidb#41495
2023-08-09 14:16:55 +00:00
d9f2226016 disttask: refine scheduleTask (#45828)
ref pingcap/tidb#41495
2023-08-07 11:19:46 +00:00
dc5d5394df lightning: make OpLevelOptional suppress the error of DoChecksum (#45486)
close pingcap/tidb#45382
2023-08-07 10:30:09 +00:00
64450c2ab5 distask: refine dispatcher test (#45821)
close pingcap/tidb#45788
2023-08-04 10:13:18 +00:00
b38868fb52 disttask: fix dispatcher cancel (#45790)
close pingcap/tidb#45788
2023-08-04 07:20:47 +00:00
9c213aac21 lightning: fix pd http request using old address (#45680)
close pingcap/tidb#43436
2023-08-01 11:22:08 +00:00
e5e507a1cb disttask: refine dispatcher (#45460)
ref pingcap/tidb#41495
2023-08-01 09:34:09 +00:00
cede736459 lightning: specify key range when switch mode (#45482) 2023-07-31 08:32:37 +00:00
a96d30253c disttask: remove the option of running subtasks concurrently (#45566)
ref pingcap/tidb#41495
2023-07-27 02:37:34 +00:00
c6a244a887 import into: fix disk quota context to make it cancellable (#45080)
close pingcap/tidb#45048
2023-06-30 11:21:48 +00:00
de437fefac disttask: update error to subtasks properly (#44961)
close pingcap/tidb#44440
2023-06-30 07:39:42 +00:00
e94e5b2051 revert import into: fix some subtask keeps running on cancel when triggered disk quota (#45074)
ref pingcap/tidb#45048
2023-06-30 05:38:11 +00:00
b6caf7bb0c import into: fix some subtask keeps running on cancel when triggered disk quota (#45049)
close pingcap/tidb#45048
2023-06-29 08:14:19 +00:00
ea8aeb62ed disttask: use the correct session pool for dist tasks (#44981)
close pingcap/tidb#44983
2023-06-27 09:38:35 +00:00
cae431432b test: fix unstable TestFrameworkCancelGTask (#44923)
close pingcap/tidb#44904
2023-06-26 07:41:35 +00:00
0f5eb866b8 disttask: refine the error handling interface (#44917)
ref pingcap/tidb#41495
2023-06-26 06:13:05 +00:00
3de4c121d0 disttask/test: add rollback test (#44924)
ref pingcap/tidb#44399
2023-06-26 02:50:35 +00:00
89bf743227 importinto/lightning: do remote checksum via sql (#44803)
close pingcap/tidb#41941, ref pingcap/tidb#44711
2023-06-21 13:41:42 +00:00
7112702e15 disttask/test: add subtaskExecutor run fail test (#44808)
ref pingcap/tidb#44399
2023-06-20 13:51:00 +00:00
9696d8f7c3 disttask: fix cleanupSubtaskEnv is called before minimal task end (#44766)
close pingcap/tidb#44761
2023-06-19 08:05:10 +00:00
8b1006f1af import into: exit ImportMode after import step (#44750)
close pingcap/tidb#44755
2023-06-19 01:53:10 +00:00
5bd56cb5d5 import into: change max pool size to num-cpu (#44749)
ref pingcap/tidb#42930
2023-06-18 06:05:10 +00:00
e606b782b1 import into: add precheck when total file size is 0 & enhance how we check task finish (#44731)
close pingcap/tidb#44729
2023-06-16 10:05:17 +00:00
d98cd4e910 import into: redact task meta after import & cancel on kill (#44712)
ref pingcap/tidb#42930
2023-06-16 07:57:11 +00:00
04eede11ec import into: add disable_tikv_import_mode option (#44587)
ref pingcap/tidb#42930
2023-06-16 07:17:11 +00:00
beccd05f12 import into: redact sensitive info & check active job before create (#44674)
ref pingcap/tidb#42930
2023-06-15 11:21:09 +00:00
aa33a09e54 test: fix race on store.Close in dist test (#44691)
close pingcap/tidb#44692
2023-06-15 07:43:11 +00:00
51964b5aa2 import into: revert add index via SQL (#44671)
ref pingcap/tidb#42930
2023-06-15 05:37:08 +00:00
62c93cff1b import into: make post process a step to be able cancel (#44616)
ref pingcap/tidb#42930
2023-06-15 03:59:09 +00:00
14ca3ce044 import into: add analyze table for import into (#44329)
ref pingcap/tidb#42930
2023-06-14 09:43:08 +00:00
f8719ba544 test: refine func signature of distributed execution test context (#44660) 2023-06-14 05:05:08 +00:00