|
|
586b854a0b
|
importinto: estimate real file size by sample on compressed file (#46404)
ref pingcap/tidb#42930
|
2023-09-05 12:11:11 +00:00 |
|
|
|
3036b6d225
|
importinto: support split large csv file (#46480)
ref pingcap/tidb#42930
|
2023-09-01 12:06:43 +00:00 |
|
|
|
d434bd9f1d
|
import into: fix id base (#46315)
close pingcap/tidb#46174
|
2023-08-29 09:50:09 +00:00 |
|
|
|
a06bcc60e1
|
br/lightning: add DecompressConfig to external storage (#46430)
ref pingcap/tidb#42930
|
2023-08-29 06:18:38 +00:00 |
|
|
|
5ecf9801ae
|
lightning: local backend use external engine part 1 (#46406)
ref pingcap/tidb#45719
|
2023-08-28 06:42:36 +00:00 |
|
|
|
bfacaf8887
|
importinto: remove useless code and add test (#46413)
ref pingcap/tidb#42930
|
2023-08-26 01:12:35 +00:00 |
|
|
|
9c213aac21
|
lightning: fix pd http request using old address (#45680)
close pingcap/tidb#43436
|
2023-08-01 11:22:08 +00:00 |
|
|
|
cede736459
|
lightning: specify key range when switch mode (#45482)
|
2023-07-31 08:32:37 +00:00 |
|
|
|
f3ea1c1e06
|
import into: enlarge subtask size to reduce range overlap (#45488)
close pingcap/tidb#44975, ref pingcap/tidb#45005
|
2023-07-27 12:18:06 +00:00 |
|
|
|
dd911e70f6
|
lightning, importinto: reduce disk quota interval (#44927)
close pingcap/tidb#44926
|
2023-06-27 11:11:47 +00:00 |
|
|
|
89bf743227
|
importinto/lightning: do remote checksum via sql (#44803)
close pingcap/tidb#41941, ref pingcap/tidb#44711
|
2023-06-21 13:41:42 +00:00 |
|
|
|
8b1006f1af
|
import into: exit ImportMode after import step (#44750)
close pingcap/tidb#44755
|
2023-06-19 01:53:10 +00:00 |
|
|
|
d98cd4e910
|
import into: redact task meta after import & cancel on kill (#44712)
ref pingcap/tidb#42930
|
2023-06-16 07:57:11 +00:00 |
|
|
|
1b2c2725cf
|
import into: remove sort dir because we do not support checkpoint now (#44630)
ref pingcap/tidb#42930
|
2023-06-16 02:27:09 +00:00 |
|
|
|
62c93cff1b
|
import into: make post process a step to be able cancel (#44616)
ref pingcap/tidb#42930
|
2023-06-15 03:59:09 +00:00 |
|
|
|
ce174c65f2
|
Import into: add job management statement (#44453)
ref pingcap/tidb#42930
|
2023-06-12 13:47:07 +00:00 |
|
|
|
c7f2a2317d
|
linter: enable early return (#44564)
close pingcap/tidb#40786
|
2023-06-12 05:43:05 +00:00 |
|
|
|
336b893423
|
import into: add disk quota (#44307)
ref pingcap/tidb#42930
|
2023-06-09 07:58:47 +00:00 |
|
|
|
bc45bdf3c0
|
lightning: deprecate send-kv-pairs (#44463)
ref pingcap/tidb#43853
|
2023-06-07 05:19:41 +00:00 |
|
|
|
be8d865044
|
import into: impl import from server disk (#44273)
ref pingcap/tidb#42930
|
2023-06-05 13:21:40 +00:00 |
|
|
|
ce9c0b9b8f
|
*: refine log for GenRLimit (#44318)
close pingcap/tidb#44319
|
2023-06-01 05:32:42 +00:00 |
|
|
|
440e3ef117
|
import into: part2, impl options/formats (#44204)
ref pingcap/tidb#42930
|
2023-05-29 05:00:40 +00:00 |
|
|
|
5cc1c3b39e
|
import into: switch tikv mode during import (#44067)
ref pingcap/tidb#42930
|
2023-05-26 07:55:39 +00:00 |
|
|
|
4fc5aab31d
|
disttask: add StatementContext result for load data (#43869)
close pingcap/tidb#43868
|
2023-05-22 07:07:37 +00:00 |
|
|
|
ca629447df
|
lightning: add send-kv-size to avoid oom when each kv is large on default config (#43870)
close pingcap/tidb#43853
|
2023-05-18 09:49:36 +00:00 |
|
|
|
6e5604f08c
|
lightning: improve region actions for huge region number (#43807)
close pingcap/tidb#43510
|
2023-05-17 10:01:36 +00:00 |
|
|
|
f1c388eae5
|
disttask: add checksum verification for load data (#43716)
close pingcap/tidb#43715
|
2023-05-17 09:13:49 +00:00 |
|
|
|
6043234d98
|
lightning: add option to control pause scheduler scope (#43762)
close pingcap/tidb#43657
|
2023-05-15 06:19:17 +00:00 |
|
|
|
5f11392afc
|
load data: sync rewrite set expr for concurrent load (#43492)
ref pingcap/tidb#42930
|
2023-05-09 08:46:58 +00:00 |
|
|
|
e2277cf7dd
|
load data: time and log for different phase, use err group in chunk_process (#43245)
ref pingcap/tidb#42930
|
2023-04-26 07:29:52 +00:00 |
|
|
|
f224d95093
|
lightning: reuse worker-concurr and remove range-concurr in local backend (#43348)
ref pingcap/tidb#42930
|
2023-04-25 07:13:52 +00:00 |
|
|
|
1c49453136
|
disttask: enable load data for distribute framework (#43107)
close pingcap/tidb#43106
|
2023-04-24 11:04:46 +00:00 |
|
|
|
2aa72b7db6
|
load data: physical mode part 4 (#43162)
ref pingcap/tidb#42930
|
2023-04-19 19:01:20 +08:00 |
|
|
|
0c3b88c0ce
|
lightning: fix generating region job is serialized (#43123)
close pingcap/tidb#42456
|
2023-04-19 11:43:19 +08:00 |
|
|
|
c7f5868df0
|
load data: physical mode part 3 (#43020)
ref pingcap/tidb#42930
|
2023-04-17 15:35:19 +08:00 |
|
|
|
2062b6865f
|
disttask: add load data scheduler and subtask executor (#42881)
close pingcap/tidb#42880
|
2023-04-14 17:22:47 +08:00 |
|
|
|
2002ca106e
|
load data: physical mode part2 (#42883)
ref pingcap/tidb#40499
|
2023-04-13 14:09:01 +08:00 |
|
|
|
d250a3fc16
|
lightning: refactor to reuse in load data part 5 (#42856)
ref pingcap/tidb#40499
|
2023-04-11 12:11:01 +08:00 |
|
|
|
2bf6eead13
|
*: LOAD DATA support compressed source file (#42813)
ref pingcap/tidb#40499
|
2023-04-10 16:33:00 +08:00 |
|
|
|
2af85d1fe9
|
load data: physical mode part1 (#42817)
ref pingcap/tidb#40499
|
2023-04-07 15:12:58 +08:00 |
|
