|
|
ad63eb8d1e
|
disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
|
2024-03-29 04:20:19 +00:00 |
|
|
|
40456f36fe
|
*: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
|
2024-03-25 11:59:17 +00:00 |
|
|
|
490e17c9ab
|
importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
|
2024-03-25 05:45:46 +00:00 |
|
|
|
df79e5ca11
|
globalsort: opt merge step mem to run on 8c (#51924)
ref pingcap/tidb#50752
|
2024-03-22 10:36:50 +00:00 |
|
|
|
61c471487e
|
globalsort: split files evenly in MergeOverlappingFiles (#51878)
ref pingcap/tidb#50752
|
2024-03-19 08:41:13 +00:00 |
|
|
|
5a2b8e8e1a
|
importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
|
2024-03-18 07:54:42 +00:00 |
|
|
|
222fe17e25
|
global sort: remove some unused code (#51811)
ref pingcap/tidb#50752
|
2024-03-15 12:48:40 +00:00 |
|
|
|
dfe6dbc94a
|
disttask: make sure task meta consistent between scheduler and table (#51788)
close pingcap/tidb#51786
|
2024-03-14 12:20:10 +00:00 |
|
|
|
dbdae85432
|
importinto, disttask: allow multi import job & adjust total memory for cgroup v2 (#51575)
ref pingcap/tidb#49008
|
2024-03-14 05:05:09 +00:00 |
|
|
|
7e9e8949ca
|
disttask: add metrics for used slots (#51662)
ref pingcap/tidb#49008
|
2024-03-13 02:44:09 +00:00 |
|
|
|
a1d5a5a79e
|
disttask: fix flaky pause test (#51689)
close pingcap/tidb#51684
|
2024-03-12 11:39:46 +00:00 |
|
|
|
8b02143e2b
|
disttask: skip scheduler take slots for some states (#51022)
ref pingcap/tidb#49008
|
2024-03-11 07:29:08 +00:00 |
|
|
|
b55c855142
|
importinto: fix incorrect index kv group count when table have common handle (#51615)
ref pingcap/tidb#50752
|
2024-03-08 07:06:36 +00:00 |
|
|
|
911bcf16a8
|
importinto: calculate writer mem size using step resource & add a option for test (#51486)
ref pingcap/tidb#49008
|
2024-03-07 10:59:06 +00:00 |
|
|
|
6566269a35
|
disttask: refresh whole task info when state/step changed (#51426)
ref pingcap/tidb#49008
|
2024-03-05 11:11:06 +00:00 |
|
|
|
4182a418c8
|
*: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
|
2024-02-29 07:42:31 +00:00 |
|
|
|
332086ebc8
|
importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
|
2024-02-27 09:05:09 +00:00 |
|
|
|
7b61b1a97b
|
disttask: refine planErr state transition (#51279)
ref pingcap/tidb#49008
|
2024-02-27 07:26:08 +00:00 |
|
|
|
23190ff540
|
disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
|
2024-02-27 03:32:01 +00:00 |
|
|
|
f35778ff81
|
disttask: refine manager retry (#51071)
ref pingcap/tidb#49008
|
2024-02-26 11:05:01 +00:00 |
|
|
|
a84d57c7da
|
disttask: extract task/subtask base (#51231)
ref pingcap/tidb#49008
|
2024-02-23 03:55:57 +00:00 |
|
|
|
b634fbf518
|
disttask: rollback subtasks without init taskexecutor (#50987)
close pingcap/tidb#49008
|
2024-02-22 12:48:27 +00:00 |
|
|
|
6200123137
|
disttask: add benchmark to test scheduler overhead (#51182)
ref pingcap/tidb#49008
|
2024-02-21 10:50:03 +00:00 |
|
|
|
e34702f10e
|
disttask: unify task order naming to 'rank' & refactor failpoint (#51136)
ref pingcap/tidb#49008
|
2024-02-21 03:37:57 +00:00 |
|
|
|
1f034200e4
|
disttask: fix subtask cannot resume after upgrade (#51072)
close pingcap/tidb#50894
|
2024-02-19 06:55:55 +00:00 |
|
|
|
65d57c0a43
|
import into: log checksum for each KV group (#50871)
ref pingcap/tidb#50832
|
2024-02-18 08:55:55 +00:00 |
|
|
|
464a12651b
|
build(deps): bump github.com/golangci/golangci-lint from 1.55.2 to 1.56.1 (#51089)
|
2024-02-18 06:57:01 +00:00 |
|
|
|
c5f2935e1b
|
disttask: add integration test for resource control (#50962)
ref pingcap/tidb#49008
|
2024-02-05 09:05:44 +00:00 |
|
|
|
ba778070a2
|
external: onefile writer should have onClose, and add KV count to WriteSummary (#50955)
ref pingcap/tidb#50832
|
2024-02-04 09:32:43 +00:00 |
|
|
|
0fff995a9b
|
disttask: fix routine leak & refine logs & refactor failpoint (#50912)
ref pingcap/tidb#49008
|
2024-02-04 06:56:42 +00:00 |
|
|
|
cac449b337
|
ddl, disttask: collect summary for each subtask (#50838)
ref pingcap/tidb#48795
|
2024-02-01 07:58:54 +00:00 |
|
|
|
134d2bfbe0
|
disttask: move framework integration tests into separate pkg (#50868)
ref pingcap/tidb#49008
|
2024-02-01 05:52:54 +00:00 |
|
|
|
2c25e893be
|
disttask: refactor metrics, collect metrics in scheduler manager (#50634)
close pingcap/tidb#49615
|
2024-01-31 11:01:54 +00:00 |
|
|
|
27fbccb1da
|
disttask: workaround for #50089 to fix subtask rerun (#50821)
close pingcap/tidb#50818
|
2024-01-30 13:04:53 +00:00 |
|
|
|
be57d2fd87
|
disttask: mock to start multiple scheduler/taskexecutor (#50801)
ref pingcap/tidb#49008
|
2024-01-30 09:48:23 +00:00 |
|
|
|
b5542c5ed2
|
disttask: decouple handleExecutableTask from manager & separate executor context (#50724)
ref pingcap/tidb#49008
|
2024-01-30 05:22:52 +00:00 |
|
|
|
51e1e13494
|
*: update interface{} to any (#50770)
ref pingcap/tidb#50765
|
2024-01-29 07:21:29 +00:00 |
|
|
|
40f0d1693b
|
disttask: alloc or occupy resource when there are subtasks to run & fix scheduler block task (#50650)
ref pingcap/tidb#49008
|
2024-01-24 09:16:58 +00:00 |
|
|
|
87ffb95856
|
disttask: replace spool with waitgroup (#50664)
ref pingcap/tidb#49008
|
2024-01-24 04:00:21 +00:00 |
|
|
|
7ce7fb2a85
|
external: round robin to use multiple GCS clients (#50408)
close pingcap/tidb#50413
|
2024-01-23 09:43:49 +00:00 |
|
|
|
d1e6f1c291
|
disttask: remove revert subtask (#50550)
close pingcap/tidb#50549
|
2024-01-22 10:25:49 +00:00 |
|
|
|
8bb4d2f412
|
disttask: move step2Str to framework (#50565)
ref pingcap/tidb#49008
|
2024-01-22 03:12:19 +00:00 |
|
|
|
6c4b1ead78
|
disttask: refine logctx (#50503)
ref pingcap/tidb#48795
|
2024-01-18 12:25:47 +00:00 |
|
|
|
549a5d9bba
|
test: fix flaky case (#50525)
close pingcap/tidb#50524
|
2024-01-18 04:54:18 +00:00 |
|
|
|
890230e17e
|
disttask: add available resource param to step executor (#50475)
ref pingcap/tidb#49008
|
2024-01-17 11:51:16 +00:00 |
|
|
|
518f0afd87
|
disttask: fix data race when accessing task concurrently in scheduler (#50509)
close pingcap/tidb#50498
|
2024-01-17 10:30:16 +00:00 |
|
|
|
5fee75661a
|
lightning: use SprintfWithIdentifier to process strings with identifier (#50434)
ref pingcap/tidb#30699
|
2024-01-17 08:34:47 +00:00 |
|
|
|
595fa7affc
|
disttask: refine taskTable and remove useless code (#50461)
ref pingcap/tidb#48795
|
2024-01-17 04:06:15 +00:00 |
|
|
|
caa5539686
|
disttask: fix executor err handling missing part (#50429)
close pingcap/tidb#50417
|
2024-01-16 09:55:59 +00:00 |
|
|
|
4d9c645933
|
test: fix flaky dispatch loop (#50446)
close pingcap/tidb#50409
|
2024-01-16 06:24:16 +00:00 |
|
