Commit Graph

64 Commits

Author SHA1 Message Date
0c3ff61728 ddl: split disttask scheduler to different stage (#45937)
ref pingcap/tidb#41495
2023-08-09 14:16:55 +00:00
d9f2226016 disttask: refine scheduleTask (#45828)
ref pingcap/tidb#41495
2023-08-07 11:19:46 +00:00
64450c2ab5 distask: refine dispatcher test (#45821)
close pingcap/tidb#45788
2023-08-04 10:13:18 +00:00
b38868fb52 disttask: fix dispatcher cancel (#45790)
close pingcap/tidb#45788
2023-08-04 07:20:47 +00:00
e5e507a1cb disttask: refine dispatcher (#45460)
ref pingcap/tidb#41495
2023-08-01 09:34:09 +00:00
a96d30253c disttask: remove the option of running subtasks concurrently (#45566)
ref pingcap/tidb#41495
2023-07-27 02:37:34 +00:00
de437fefac disttask: update error to subtasks properly (#44961)
close pingcap/tidb#44440
2023-06-30 07:39:42 +00:00
ea8aeb62ed disttask: use the correct session pool for dist tasks (#44981)
close pingcap/tidb#44983
2023-06-27 09:38:35 +00:00
cae431432b test: fix unstable TestFrameworkCancelGTask (#44923)
close pingcap/tidb#44904
2023-06-26 07:41:35 +00:00
0f5eb866b8 disttask: refine the error handling interface (#44917)
ref pingcap/tidb#41495
2023-06-26 06:13:05 +00:00
3de4c121d0 disttask/test: add rollback test (#44924)
ref pingcap/tidb#44399
2023-06-26 02:50:35 +00:00
89bf743227 importinto/lightning: do remote checksum via sql (#44803)
close pingcap/tidb#41941, ref pingcap/tidb#44711
2023-06-21 13:41:42 +00:00
7112702e15 disttask/test: add subtaskExecutor run fail test (#44808)
ref pingcap/tidb#44399
2023-06-20 13:51:00 +00:00
9696d8f7c3 disttask: fix cleanupSubtaskEnv is called before minimal task end (#44766)
close pingcap/tidb#44761
2023-06-19 08:05:10 +00:00
d98cd4e910 import into: redact task meta after import & cancel on kill (#44712)
ref pingcap/tidb#42930
2023-06-16 07:57:11 +00:00
beccd05f12 import into: redact sensitive info & check active job before create (#44674)
ref pingcap/tidb#42930
2023-06-15 11:21:09 +00:00
aa33a09e54 test: fix race on store.Close in dist test (#44691)
close pingcap/tidb#44692
2023-06-15 07:43:11 +00:00
51964b5aa2 import into: revert add index via SQL (#44671)
ref pingcap/tidb#42930
2023-06-15 05:37:08 +00:00
62c93cff1b import into: make post process a step to be able cancel (#44616)
ref pingcap/tidb#42930
2023-06-15 03:59:09 +00:00
f8719ba544 test: refine func signature of distributed execution test context (#44660) 2023-06-14 05:05:08 +00:00
d58e752fdc test: mock multiple servers running dist task and ddl (#44326)
ref pingcap/tidb#44399
2023-06-13 08:37:07 +00:00
ce174c65f2 Import into: add job management statement (#44453)
ref pingcap/tidb#42930
2023-06-12 13:47:07 +00:00
5b54baaf8f sessionctx: make session_vars' type closer to MySQL (#44578)
close pingcap/tidb#44574
2023-06-12 10:29:13 +00:00
29dffb7591 disttask: Refine dispatcher (#44482)
close pingcap/tidb#44483
2023-06-08 08:50:57 +00:00
aa99eb3848 import into: support create index by SQL (#44198)
ref pingcap/tidb#42930
2023-06-06 06:17:41 +00:00
4c83352678 *: Introduce runaway statement in resource group (#43843)
ref pingcap/tidb#43691
2023-05-31 11:16:42 +00:00
dabe491ad2 disttask: fix a bug that session may not commit before putting into the session pool (#44289)
close pingcap/tidb#44286
2023-05-31 07:18:41 +00:00
440e3ef117 import into: part2, impl options/formats (#44204)
ref pingcap/tidb#42930
2023-05-29 05:00:40 +00:00
5cc1c3b39e import into: switch tikv mode during import (#44067)
ref pingcap/tidb#42930
2023-05-26 07:55:39 +00:00
cd834eec65 import into: impl IMPORT INTO statement part 1 (#44122)
ref pingcap/tidb#42930
2023-05-25 05:45:38 +00:00
5c0edbc0ae disttask: add handle to run/cancel task and fetch error (#43066)
close pingcap/tidb#43065
2023-05-23 07:31:39 +00:00
6e3d52e0c5 load data: use dist framework for single-node import (#43880)
ref pingcap/tidb#42930
2023-05-22 10:31:38 +00:00
4fc5aab31d disttask: add StatementContext result for load data (#43869)
close pingcap/tidb#43868
2023-05-22 07:07:37 +00:00
6dd86d7e02 resourcmanager: fix the excessive expansion (#43978)
close pingcap/tidb#43980
2023-05-18 13:21:36 +00:00
ae32420d69 disttask: using TiDB nodes' IP and port to generate dist_task execid (#43629)
close pingcap/tidb#43628
2023-05-17 16:35:35 +00:00
f1c388eae5 disttask: add checksum verification for load data (#43716)
close pingcap/tidb#43715
2023-05-17 09:13:49 +00:00
a60cf97237 disttask: add finish flow for distribute framework (#43676)
close pingcap/tidb#43675
2023-05-15 13:33:17 +00:00
1bddedc6d6 disttask: add option to run subtask concurrently (#43370)
close pingcap/tidb#43369
2023-05-09 10:22:58 +00:00
09bf23f1ba disttask: complete cancel in scheduler (#43594)
close pingcap/tidb#43497
2023-05-09 08:00:58 +00:00
88428bced4 disttask: support cancel for disttask (#43498)
close pingcap/tidb#43497
2023-05-05 10:03:56 +00:00
d901924725 disttask: Change rand choose TiDB to round selection TiDB to be an executor (#43440)
close pingcap/tidb#43439
2023-04-27 11:05:59 +00:00
66814ace5c *: enable race for more package (#43301)
* *: enable race for more package

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* update

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* update

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* update

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

---------

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2023-04-23 06:46:44 +00:00
2021b31bdc *: support error handling for distributed adding index (#43075)
close pingcap/tidb#42436, close pingcap/tidb#43029
2023-04-20 17:35:20 +08:00
bd9603489e disttask: add on subtask finished interface for scheduler (#43155)
close pingcap/tidb#43153
2023-04-20 11:39:20 +08:00
2062b6865f disttask: add load data scheduler and subtask executor (#42881)
close pingcap/tidb#42880
2023-04-14 17:22:47 +08:00
7c0097dd64 *: implement scheduler for adding index (#42753)
close pingcap/tidb#42754
2023-04-11 22:29:01 +08:00
84084c968b disttask: dispatcher should update global task and add new tasks in a txn (#42849)
close pingcap/tidb#42848
2023-04-11 16:41:01 +08:00
575b652c7a disttask: TaskMananger uses pool to get a session (#42832)
close pingcap/tidb#42831
2023-04-06 16:58:58 +08:00
e942ab6148 kazel: support auto-config shard_count (#42751)
close pingcap/tidb#42827
2023-04-06 15:46:58 +08:00
0c3a952617 disttask: make TestParallelErrFlow more stable (#42809)
close pingcap/tidb#42791
2023-04-04 19:07:09 +08:00