Commit Graph

159 Commits

Author SHA1 Message Date
7e491c3357 dxf: get task from both mysql.tidb_global_task and mysql.tidb_global_task_history (#57063)
close pingcap/tidb#56942
2024-11-05 05:26:36 +00:00
a00ba68b29 disttask: make task executor onError print error's stack. (#56618)
close pingcap/tidb#56014
2024-10-22 06:21:12 +00:00
f0b3bf0332 *: replace reflect.TypeOf((*T)(nil)).Elem() with reflect.TypeFor[T]() (#56598) 2024-10-12 04:21:17 +00:00
c43d0589be *: replace exportloopref with copyloopvar (#56503)
close pingcap/tidb#56509
2024-10-09 12:12:43 +00:00
3578e29613 lightning: job range keys and region split keys are 2 concepts (part 2) (#55759)
close pingcap/tidb#55374
2024-09-05 01:31:35 +00:00
3176b9c263 *: move XXInfo/Job, etc, out from model pkg in parser to meta (#55754)
ref pingcap/tidb#54436
2024-09-04 04:49:45 +00:00
c65692b9b2 external: range job keys and region split keys are 2 concepts (part 1) (#55659)
ref pingcap/tidb#55374
2024-08-30 10:50:48 +00:00
44f100f80a disttask: fix flaky test TestParallelCancel (#55668)
close pingcap/tidb#55658
2024-08-26 12:46:45 +00:00
d041cd054c test: fix unstable TestParallelErrStage (#55620)
close pingcap/tidb#55594
2024-08-23 15:25:43 +00:00
ae9e196dae workerpool: add TaskMayPanic interface to remind caller handles panic (#55537)
ref pingcap/tidb#55497
2024-08-21 07:27:12 +00:00
5aad7df941 *: use a unified session pool definition AMAP (#55170)
ref pingcap/tidb#54434
2024-08-05 12:23:08 +00:00
f490a98438 *: add context.Context parameter to infoschema TableByName (#54479)
ref pingcap/tidb#50959
2024-07-09 16:04:33 +00:00
04c66ee950 ddl: decouple job scheduler from 'ddl' and make it run/exit as owner changes (#53548)
ref pingcap/tidb#53246
2024-05-30 06:37:21 +00:00
d49a6541db test: switch some failpoints to InjectCall (#53588)
ref pingcap/tidb#49008
2024-05-28 04:50:49 +00:00
3004c07b93 copIterator: return context error to avoid return incorrect result on context cancel/timeout (#53489)
close pingcap/tidb#50089
2024-05-23 09:50:47 +00:00
d1b8c5b4f1 ddl: refine fatal log when upgrade failed because of tidb_enable_dist_task (#53392) 2024-05-22 02:23:45 +00:00
68219b9317 *: fix some typos in code comments (#53371) 2024-05-20 08:01:16 +00:00
f46db203f9 *: caller can use a fixed TS for fast reorg (#52993)
close pingcap/tidb#46986, ref pingcap/tidb#49233
2024-05-10 13:31:09 +00:00
dd478f3fb8 disttask: fix flaky handle test (#52968) 2024-04-29 05:19:28 +00:00
d626b6adf0 disttask: fix scope can't set different value (#52627)
close pingcap/tidb#52441
2024-04-26 07:19:42 +00:00
72e5460ee8 lightning/importinto: fix insert err after import for AUTO_ID_CACHE=1 and SHARD_ROW_ID_BITS (#52712)
close pingcap/tidb#52654
2024-04-18 08:10:38 +00:00
5954be7da2 *: let our unit test cover the infoschema v2 code (#52156)
ref pingcap/tidb#50959
2024-04-12 06:58:53 +00:00
e79a26f747 infoschema_v2: add bench test (#52200)
ref pingcap/tidb#50959
2024-04-08 12:52:51 +00:00
27e470ac55 disttask: fix flaky slot manager test (#52271)
close pingcap/tidb#52252
2024-04-02 07:01:47 +00:00
76abd8b836 disttask,ddl: use subtask concurrency (#52286)
ref pingcap/tidb#49008
2024-04-02 04:24:16 +00:00
f2ea18c07f lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
2024-04-01 07:13:46 +00:00
ad63eb8d1e disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
2024-03-29 04:20:19 +00:00
40456f36fe *: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
2024-03-25 11:59:17 +00:00
490e17c9ab importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
2024-03-25 05:45:46 +00:00
df79e5ca11 globalsort: opt merge step mem to run on 8c (#51924)
ref pingcap/tidb#50752
2024-03-22 10:36:50 +00:00
61c471487e globalsort: split files evenly in MergeOverlappingFiles (#51878)
ref pingcap/tidb#50752
2024-03-19 08:41:13 +00:00
5a2b8e8e1a importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
2024-03-18 07:54:42 +00:00
222fe17e25 global sort: remove some unused code (#51811)
ref pingcap/tidb#50752
2024-03-15 12:48:40 +00:00
dfe6dbc94a disttask: make sure task meta consistent between scheduler and table (#51788)
close pingcap/tidb#51786
2024-03-14 12:20:10 +00:00
dbdae85432 importinto, disttask: allow multi import job & adjust total memory for cgroup v2 (#51575)
ref pingcap/tidb#49008
2024-03-14 05:05:09 +00:00
7e9e8949ca disttask: add metrics for used slots (#51662)
ref pingcap/tidb#49008
2024-03-13 02:44:09 +00:00
a1d5a5a79e disttask: fix flaky pause test (#51689)
close pingcap/tidb#51684
2024-03-12 11:39:46 +00:00
8b02143e2b disttask: skip scheduler take slots for some states (#51022)
ref pingcap/tidb#49008
2024-03-11 07:29:08 +00:00
b55c855142 importinto: fix incorrect index kv group count when table have common handle (#51615)
ref pingcap/tidb#50752
2024-03-08 07:06:36 +00:00
911bcf16a8 importinto: calculate writer mem size using step resource & add a option for test (#51486)
ref pingcap/tidb#49008
2024-03-07 10:59:06 +00:00
6566269a35 disttask: refresh whole task info when state/step changed (#51426)
ref pingcap/tidb#49008
2024-03-05 11:11:06 +00:00
4182a418c8 *: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
2024-02-29 07:42:31 +00:00
332086ebc8 importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
2024-02-27 09:05:09 +00:00
7b61b1a97b disttask: refine planErr state transition (#51279)
ref pingcap/tidb#49008
2024-02-27 07:26:08 +00:00
23190ff540 disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
2024-02-27 03:32:01 +00:00
f35778ff81 disttask: refine manager retry (#51071)
ref pingcap/tidb#49008
2024-02-26 11:05:01 +00:00
a84d57c7da disttask: extract task/subtask base (#51231)
ref pingcap/tidb#49008
2024-02-23 03:55:57 +00:00
b634fbf518 disttask: rollback subtasks without init taskexecutor (#50987)
close pingcap/tidb#49008
2024-02-22 12:48:27 +00:00
6200123137 disttask: add benchmark to test scheduler overhead (#51182)
ref pingcap/tidb#49008
2024-02-21 10:50:03 +00:00
e34702f10e disttask: unify task order naming to 'rank' & refactor failpoint (#51136)
ref pingcap/tidb#49008
2024-02-21 03:37:57 +00:00