Commit Graph

109 Commits

Author SHA1 Message Date
56a1af71f5 disttask: handle left subtask in running state (#47300)
close pingcap/tidb#46735
2023-09-26 14:30:18 +00:00
e70f6e41d2 disttask: remove scheduler/dispatcher id from logs and refinement (#47257)
ref pingcap/tidb#46258
2023-09-26 03:07:46 +00:00
84fe6be97a disttask: add metrics collection for dispatcher (#47018)
close pingcap/tidb#47017
2023-09-25 15:18:16 +00:00
dc8eade9a7 disttask: add cleanup routine for framework (#47218)
ref pingcap/tidb#46258
2023-09-25 12:46:46 +00:00
516542befe dist/ddl: add subtask metrics (#47175)
close pingcap/tidb#47017
2023-09-25 08:48:19 +00:00
231fb159f2 disttask: Add history table for global task (#47179)
ref pingcap/tidb#46258, close pingcap/tidb#47180
2023-09-25 03:33:16 +00:00
5f8be453a5 disttask: batch insert subtasks (#47207)
ref pingcap/tidb#46258, close pingcap/tidb#47178
2023-09-25 02:45:14 +00:00
34438f84a1 disttask: support pause/resume for framework (#47037)
ref pingcap/tidb#46258
2023-09-23 01:12:13 +00:00
9b6228cae4 importinto: add merge sort step (#47132)
ref pingcap/tidb#46704
2023-09-20 12:39:13 +00:00
4450ae4513 importinto: integrate global sort(without merge-sort) part 1 (#46998)
ref pingcap/tidb#46704
2023-09-19 11:10:42 +00:00
8d78d7a412 disttask, ddl: dispatch step-two tasks to proper instances (#46464)
ref pingcap/tidb#46258
2023-09-19 05:03:11 +00:00
1b83f20aee disttask,external: implement merge step (#46999)
ref pingcap/tidb#45719, close pingcap/tidb#47011
2023-09-18 04:22:41 +00:00
ae3f595538 disttask: refactor task step and batch subtask dispatching (#46957)
ref pingcap/tidb#46258
2023-09-14 16:04:39 +00:00
43d4385a49 disttask: fix subtask cancel bug (#45623)
ref pingcap/tidb#46258
2023-09-14 11:43:40 +00:00
f2cb16de91 disttask: update task in framework (#46913)
ref pingcap/tidb#46258
2023-09-14 09:55:39 +00:00
d2e39d7737 disttask, ddl: move backend ctx register code to scheduler (#46952)
ref pingcap/tidb#46258
2023-09-14 08:22:40 +00:00
762b2df608 ddl: fix flaky test TestGC (#46932)
close pingcap/tidb#46928
2023-09-13 13:40:39 +00:00
3735e11f0e disttask: remove mini executor abstraction (#46922)
ref pingcap/tidb#46258
2023-09-13 04:28:38 +00:00
f36f2a4b4e ddl/dist: gc subtask history table (#46723)
close pingcap/tidb#46722
2023-09-12 11:55:41 +00:00
be2a243cc0 ddl, lightning: integrate operator for global sort (#46734)
ref pingcap/tidb#45719
2023-09-12 09:58:49 +00:00
f85c9bed24 disttask: fix dispatcher checksubtask flaky test (#46887)
close pingcap/tidb#46884
2023-09-12 04:00:17 +00:00
dbb493ff22 disttask: dynamic dispatch subtasks (#46593)
ref pingcap/tidb#46258
2023-09-12 01:00:09 +00:00
322d8e5c7d importinto: add metrics and dashboard (#46749)
ref pingcap/tidb#46704
2023-09-11 15:34:41 +00:00
ae442add0b importinto: add retry when update job table (#46790)
ref pingcap/tidb#46704, close pingcap/tidb#46740
2023-09-11 07:34:42 +00:00
75fa8150da disttask: add role to select instance (#46453)
ref pingcap/tidb#46258
2023-09-08 04:29:13 +00:00
fadfb63868 disttask: increase checkTaskRunningInterval (#46686)
ref pingcap/tidb#46258
2023-09-08 03:00:43 +00:00
4ff3952c21 disttask: add Multitask test (#46646)
close pingcap/tidb#46641
2023-09-07 09:35:15 +00:00
d7033377b4 disttask: refactor scheduler part (#46669)
ref pingcap/tidb#46258
2023-09-06 18:12:44 +00:00
abec0c68e3 disttask: persist subtask error properly (#46674)
ref pingcap/tidb#46258
2023-09-05 15:53:12 +00:00
xhe
66fe053b46 ddl: fix taskNodes temporarily (#46671)
ref pingcap/tidb#46258
2023-09-05 10:33:57 +00:00
2fbf4cf032 ddl: integrate add index operator to dist framework (#46495)
ref pingcap/tidb#46258
2023-09-05 09:05:11 +00:00
5cbcc86e50 disttask: refactor dispatcher so we have chance to add init logics per task type (#46603)
ref pingcap/tidb#46258
2023-09-05 06:50:12 +00:00
6707afae63 distribute framework: add planner (#46395)
ref pingcap/tidb#46258
2023-09-04 12:11:13 +00:00
xhe
1901239f94 disktask: replace failure nodes with alive ones (#45935)
ref pingcap/tidb#46258
2023-09-04 08:15:43 +00:00
a4271136ec bootstrap: add summary field for system table tidb_background_subtask (#46562)
ref pingcap/tidb#46258
2023-09-04 01:53:13 +00:00
1a9cfb55ff *: disable race for framework tests (#46594)
close pingcap/tidb#46573
2023-09-01 08:48:40 +00:00
d36478f4b2 disttask, ddl: rename flowhandle (#46497)
ref pingcap/tidb#46258
2023-08-31 07:27:39 +00:00
2f2bc4134a disttask: replace manually mock with gomock (#46392)
ref pingcap/tidb#41495
2023-08-25 08:47:06 +00:00
c66d28f69c disttask: add pending to failed state transform (#46357)
ref pingcap/tidb#46258
2023-08-25 07:06:35 +00:00
c38f0c1ed2 disttask: record subtask start/update time (#46361)
close pingcap/tidb#45990
2023-08-24 06:08:05 +00:00
8ff9d89bf3 disttask: fix wrongly add subtask when state transform fail (#46259)
ref pingcap/tidb#46258, close pingcap/tidb#46261
2023-08-23 10:03:34 +00:00
883e88a645 distribute framework: restrict the task state transform rule (#45932)
ref pingcap/tidb#41495
2023-08-18 07:36:32 +00:00
24122b5db3 disttask: fix run one step SubtaskExecutor twice (#46106)
close pingcap/tidb#46098
2023-08-17 04:57:30 +00:00
86dd1802d5 disttask: add server info for dispatcher log (#46123)
close pingcap/tidb#46122
2023-08-16 11:41:00 +00:00
dbf7602911 disttask: fix owner change flaky test (#46075)
close pingcap/tidb#46014
2023-08-15 04:55:59 +00:00
0c3ff61728 ddl: split disttask scheduler to different stage (#45937)
ref pingcap/tidb#41495
2023-08-09 14:16:55 +00:00
d9f2226016 disttask: refine scheduleTask (#45828)
ref pingcap/tidb#41495
2023-08-07 11:19:46 +00:00
64450c2ab5 distask: refine dispatcher test (#45821)
close pingcap/tidb#45788
2023-08-04 10:13:18 +00:00
b38868fb52 disttask: fix dispatcher cancel (#45790)
close pingcap/tidb#45788
2023-08-04 07:20:47 +00:00
e5e507a1cb disttask: refine dispatcher (#45460)
ref pingcap/tidb#41495
2023-08-01 09:34:09 +00:00