Commit Graph

31 Commits

Author SHA1 Message Date
dd911e70f6 lightning, importinto: reduce disk quota interval (#44927)
close pingcap/tidb#44926
2023-06-27 11:11:47 +00:00
89bf743227 importinto/lightning: do remote checksum via sql (#44803)
close pingcap/tidb#41941, ref pingcap/tidb#44711
2023-06-21 13:41:42 +00:00
8b1006f1af import into: exit ImportMode after import step (#44750)
close pingcap/tidb#44755
2023-06-19 01:53:10 +00:00
d98cd4e910 import into: redact task meta after import & cancel on kill (#44712)
ref pingcap/tidb#42930
2023-06-16 07:57:11 +00:00
1b2c2725cf import into: remove sort dir because we do not support checkpoint now (#44630)
ref pingcap/tidb#42930
2023-06-16 02:27:09 +00:00
62c93cff1b import into: make post process a step to be able cancel (#44616)
ref pingcap/tidb#42930
2023-06-15 03:59:09 +00:00
ce174c65f2 Import into: add job management statement (#44453)
ref pingcap/tidb#42930
2023-06-12 13:47:07 +00:00
c7f2a2317d linter: enable early return (#44564)
close pingcap/tidb#40786
2023-06-12 05:43:05 +00:00
336b893423 import into: add disk quota (#44307)
ref pingcap/tidb#42930
2023-06-09 07:58:47 +00:00
bc45bdf3c0 lightning: deprecate send-kv-pairs (#44463)
ref pingcap/tidb#43853
2023-06-07 05:19:41 +00:00
be8d865044 import into: impl import from server disk (#44273)
ref pingcap/tidb#42930
2023-06-05 13:21:40 +00:00
ce9c0b9b8f *: refine log for GenRLimit (#44318)
close pingcap/tidb#44319
2023-06-01 05:32:42 +00:00
440e3ef117 import into: part2, impl options/formats (#44204)
ref pingcap/tidb#42930
2023-05-29 05:00:40 +00:00
5cc1c3b39e import into: switch tikv mode during import (#44067)
ref pingcap/tidb#42930
2023-05-26 07:55:39 +00:00
4fc5aab31d disttask: add StatementContext result for load data (#43869)
close pingcap/tidb#43868
2023-05-22 07:07:37 +00:00
ca629447df lightning: add send-kv-size to avoid oom when each kv is large on default config (#43870)
close pingcap/tidb#43853
2023-05-18 09:49:36 +00:00
6e5604f08c lightning: improve region actions for huge region number (#43807)
close pingcap/tidb#43510
2023-05-17 10:01:36 +00:00
f1c388eae5 disttask: add checksum verification for load data (#43716)
close pingcap/tidb#43715
2023-05-17 09:13:49 +00:00
6043234d98 lightning: add option to control pause scheduler scope (#43762)
close pingcap/tidb#43657
2023-05-15 06:19:17 +00:00
5f11392afc load data: sync rewrite set expr for concurrent load (#43492)
ref pingcap/tidb#42930
2023-05-09 08:46:58 +00:00
e2277cf7dd load data: time and log for different phase, use err group in chunk_process (#43245)
ref pingcap/tidb#42930
2023-04-26 07:29:52 +00:00
f224d95093 lightning: reuse worker-concurr and remove range-concurr in local backend (#43348)
ref pingcap/tidb#42930
2023-04-25 07:13:52 +00:00
1c49453136 disttask: enable load data for distribute framework (#43107)
close pingcap/tidb#43106
2023-04-24 11:04:46 +00:00
2aa72b7db6 load data: physical mode part 4 (#43162)
ref pingcap/tidb#42930
2023-04-19 19:01:20 +08:00
0c3b88c0ce lightning: fix generating region job is serialized (#43123)
close pingcap/tidb#42456
2023-04-19 11:43:19 +08:00
c7f5868df0 load data: physical mode part 3 (#43020)
ref pingcap/tidb#42930
2023-04-17 15:35:19 +08:00
2062b6865f disttask: add load data scheduler and subtask executor (#42881)
close pingcap/tidb#42880
2023-04-14 17:22:47 +08:00
2002ca106e load data: physical mode part2 (#42883)
ref pingcap/tidb#40499
2023-04-13 14:09:01 +08:00
d250a3fc16 lightning: refactor to reuse in load data part 5 (#42856)
ref pingcap/tidb#40499
2023-04-11 12:11:01 +08:00
2bf6eead13 *: LOAD DATA support compressed source file (#42813)
ref pingcap/tidb#40499
2023-04-10 16:33:00 +08:00
2af85d1fe9 load data: physical mode part1 (#42817)
ref pingcap/tidb#40499
2023-04-07 15:12:58 +08:00