Commit Graph

115 Commits

Author SHA1 Message Date
b7f0742f17 rc: add resource group name to ddl (#46756)
ref pingcap/tidb#46656
2023-09-12 05:42:09 +00:00
f85c9bed24 disttask: fix dispatcher checksubtask flaky test (#46887)
close pingcap/tidb#46884
2023-09-12 04:00:17 +00:00
dbb493ff22 disttask: dynamic dispatch subtasks (#46593)
ref pingcap/tidb#46258
2023-09-12 01:00:09 +00:00
322d8e5c7d importinto: add metrics and dashboard (#46749)
ref pingcap/tidb#46704
2023-09-11 15:34:41 +00:00
ae442add0b importinto: add retry when update job table (#46790)
ref pingcap/tidb#46704, close pingcap/tidb#46740
2023-09-11 07:34:42 +00:00
75fa8150da disttask: add role to select instance (#46453)
ref pingcap/tidb#46258
2023-09-08 04:29:13 +00:00
fadfb63868 disttask: increase checkTaskRunningInterval (#46686)
ref pingcap/tidb#46258
2023-09-08 03:00:43 +00:00
729746f900 importinto: convert encode and sort part into operator (#46532)
ref pingcap/tidb#42930, ref pingcap/tidb#46258
2023-09-08 00:38:13 +00:00
4ff3952c21 disttask: add Multitask test (#46646)
close pingcap/tidb#46641
2023-09-07 09:35:15 +00:00
d7033377b4 disttask: refactor scheduler part (#46669)
ref pingcap/tidb#46258
2023-09-06 18:12:44 +00:00
abec0c68e3 disttask: persist subtask error properly (#46674)
ref pingcap/tidb#46258
2023-09-05 15:53:12 +00:00
xhe
66fe053b46 ddl: fix taskNodes temporarily (#46671)
ref pingcap/tidb#46258
2023-09-05 10:33:57 +00:00
2fbf4cf032 ddl: integrate add index operator to dist framework (#46495)
ref pingcap/tidb#46258
2023-09-05 09:05:11 +00:00
5cbcc86e50 disttask: refactor dispatcher so we have chance to add init logics per task type (#46603)
ref pingcap/tidb#46258
2023-09-05 06:50:12 +00:00
6707afae63 distribute framework: add planner (#46395)
ref pingcap/tidb#46258
2023-09-04 12:11:13 +00:00
xhe
1901239f94 disktask: replace failure nodes with alive ones (#45935)
ref pingcap/tidb#46258
2023-09-04 08:15:43 +00:00
a4271136ec bootstrap: add summary field for system table tidb_background_subtask (#46562)
ref pingcap/tidb#46258
2023-09-04 01:53:13 +00:00
3036b6d225 importinto: support split large csv file (#46480)
ref pingcap/tidb#42930
2023-09-01 12:06:43 +00:00
1a9cfb55ff *: disable race for framework tests (#46594)
close pingcap/tidb#46573
2023-09-01 08:48:40 +00:00
d36478f4b2 disttask, ddl: rename flowhandle (#46497)
ref pingcap/tidb#46258
2023-08-31 07:27:39 +00:00
d434bd9f1d import into: fix id base (#46315)
close pingcap/tidb#46174
2023-08-29 09:50:09 +00:00
40c4a16753 ddl, disttask: implement add index operators (#46414)
ref pingcap/tidb#46258
2023-08-29 06:59:15 +00:00
2f2bc4134a disttask: replace manually mock with gomock (#46392)
ref pingcap/tidb#41495
2023-08-25 08:47:06 +00:00
c66d28f69c disttask: add pending to failed state transform (#46357)
ref pingcap/tidb#46258
2023-08-25 07:06:35 +00:00
c38f0c1ed2 disttask: record subtask start/update time (#46361)
close pingcap/tidb#45990
2023-08-24 06:08:05 +00:00
8ff9d89bf3 disttask: fix wrongly add subtask when state transform fail (#46259)
ref pingcap/tidb#46258, close pingcap/tidb#46261
2023-08-23 10:03:34 +00:00
1ea6499132 disttask: add operator abstraction (#46279)
ref pingcap/tidb#46258
2023-08-22 15:39:34 +00:00
883e88a645 distribute framework: restrict the task state transform rule (#45932)
ref pingcap/tidb#41495
2023-08-18 07:36:32 +00:00
24122b5db3 disttask: fix run one step SubtaskExecutor twice (#46106)
close pingcap/tidb#46098
2023-08-17 04:57:30 +00:00
86dd1802d5 disttask: add server info for dispatcher log (#46123)
close pingcap/tidb#46122
2023-08-16 11:41:00 +00:00
dbf7602911 disttask: fix owner change flaky test (#46075)
close pingcap/tidb#46014
2023-08-15 04:55:59 +00:00
0c3ff61728 ddl: split disttask scheduler to different stage (#45937)
ref pingcap/tidb#41495
2023-08-09 14:16:55 +00:00
d9f2226016 disttask: refine scheduleTask (#45828)
ref pingcap/tidb#41495
2023-08-07 11:19:46 +00:00
dc5d5394df lightning: make OpLevelOptional suppress the error of DoChecksum (#45486)
close pingcap/tidb#45382
2023-08-07 10:30:09 +00:00
64450c2ab5 distask: refine dispatcher test (#45821)
close pingcap/tidb#45788
2023-08-04 10:13:18 +00:00
b38868fb52 disttask: fix dispatcher cancel (#45790)
close pingcap/tidb#45788
2023-08-04 07:20:47 +00:00
9c213aac21 lightning: fix pd http request using old address (#45680)
close pingcap/tidb#43436
2023-08-01 11:22:08 +00:00
e5e507a1cb disttask: refine dispatcher (#45460)
ref pingcap/tidb#41495
2023-08-01 09:34:09 +00:00
cede736459 lightning: specify key range when switch mode (#45482) 2023-07-31 08:32:37 +00:00
a96d30253c disttask: remove the option of running subtasks concurrently (#45566)
ref pingcap/tidb#41495
2023-07-27 02:37:34 +00:00
c6a244a887 import into: fix disk quota context to make it cancellable (#45080)
close pingcap/tidb#45048
2023-06-30 11:21:48 +00:00
de437fefac disttask: update error to subtasks properly (#44961)
close pingcap/tidb#44440
2023-06-30 07:39:42 +00:00
e94e5b2051 revert import into: fix some subtask keeps running on cancel when triggered disk quota (#45074)
ref pingcap/tidb#45048
2023-06-30 05:38:11 +00:00
b6caf7bb0c import into: fix some subtask keeps running on cancel when triggered disk quota (#45049)
close pingcap/tidb#45048
2023-06-29 08:14:19 +00:00
ea8aeb62ed disttask: use the correct session pool for dist tasks (#44981)
close pingcap/tidb#44983
2023-06-27 09:38:35 +00:00
cae431432b test: fix unstable TestFrameworkCancelGTask (#44923)
close pingcap/tidb#44904
2023-06-26 07:41:35 +00:00
0f5eb866b8 disttask: refine the error handling interface (#44917)
ref pingcap/tidb#41495
2023-06-26 06:13:05 +00:00
3de4c121d0 disttask/test: add rollback test (#44924)
ref pingcap/tidb#44399
2023-06-26 02:50:35 +00:00
89bf743227 importinto/lightning: do remote checksum via sql (#44803)
close pingcap/tidb#41941, ref pingcap/tidb#44711
2023-06-21 13:41:42 +00:00
7112702e15 disttask/test: add subtaskExecutor run fail test (#44808)
ref pingcap/tidb#44399
2023-06-20 13:51:00 +00:00