Commit Graph

40 Commits

Author SHA1 Message Date
440e3ef117 import into: part2, impl options/formats (#44204)
ref pingcap/tidb#42930
2023-05-29 05:00:40 +00:00
5cc1c3b39e import into: switch tikv mode during import (#44067)
ref pingcap/tidb#42930
2023-05-26 07:55:39 +00:00
cd834eec65 import into: impl IMPORT INTO statement part 1 (#44122)
ref pingcap/tidb#42930
2023-05-25 05:45:38 +00:00
6e11eefcfc loaddata: don't split transaction and revert some change (#44136)
ref pingcap/tidb#44078
2023-05-25 03:43:38 +00:00
0ac7473ec9 loaddata: revert concurrent writing to TiKV and WITH detached (#44056)
ref pingcap/tidb#44078
2023-05-23 06:43:38 +00:00
6e3d52e0c5 load data: use dist framework for single-node import (#43880)
ref pingcap/tidb#42930
2023-05-22 10:31:38 +00:00
4fc5aab31d disttask: add StatementContext result for load data (#43869)
close pingcap/tidb#43868
2023-05-22 07:07:37 +00:00
ca629447df lightning: add send-kv-size to avoid oom when each kv is large on default config (#43870)
close pingcap/tidb#43853
2023-05-18 09:49:36 +00:00
6e5604f08c lightning: improve region actions for huge region number (#43807)
close pingcap/tidb#43510
2023-05-17 10:01:36 +00:00
f1c388eae5 disttask: add checksum verification for load data (#43716)
close pingcap/tidb#43715
2023-05-17 09:13:49 +00:00
6043234d98 lightning: add option to control pause scheduler scope (#43762)
close pingcap/tidb#43657
2023-05-15 06:19:17 +00:00
56dacd0265 lightning: fix oom when mem/cpu ratio is low (#43729)
close pingcap/tidb#43728
2023-05-12 03:36:21 +00:00
5f11392afc load data: sync rewrite set expr for concurrent load (#43492)
ref pingcap/tidb#42930
2023-05-09 08:46:58 +00:00
e2277cf7dd load data: time and log for different phase, use err group in chunk_process (#43245)
ref pingcap/tidb#42930
2023-04-26 07:29:52 +00:00
78e614f0e6 loaddata: make some test use 1 thread explicitly (#43394)
ref pingcap/tidb#42930
2023-04-26 02:29:51 +00:00
f224d95093 lightning: reuse worker-concurr and remove range-concurr in local backend (#43348)
ref pingcap/tidb#42930
2023-04-25 07:13:52 +00:00
1c49453136 disttask: enable load data for distribute framework (#43107)
close pingcap/tidb#43106
2023-04-24 11:04:46 +00:00
66c36ededb *: support load data for table with generated columns (#43108)
close pingcap/tidb#39885
2023-04-20 12:27:19 +08:00
2aa72b7db6 load data: physical mode part 4 (#43162)
ref pingcap/tidb#42930
2023-04-19 19:01:20 +08:00
d33b9ae173 load data: check table empty or not for physical mode (#43157)
ref pingcap/tidb#42930
2023-04-19 13:21:19 +08:00
0c3b88c0ce lightning: fix generating region job is serialized (#43123)
close pingcap/tidb#42456
2023-04-19 11:43:19 +08:00
c7f5868df0 load data: physical mode part 3 (#43020)
ref pingcap/tidb#42930
2023-04-17 15:35:19 +08:00
2062b6865f disttask: add load data scheduler and subtask executor (#42881)
close pingcap/tidb#42880
2023-04-14 17:22:47 +08:00
2002ca106e load data: physical mode part2 (#42883)
ref pingcap/tidb#40499
2023-04-13 14:09:01 +08:00
d250a3fc16 lightning: refactor to reuse in load data part 5 (#42856)
ref pingcap/tidb#40499
2023-04-11 12:11:01 +08:00
2bf6eead13 *: LOAD DATA support compressed source file (#42813)
ref pingcap/tidb#40499
2023-04-10 16:33:00 +08:00
2af85d1fe9 load data: physical mode part1 (#42817)
ref pingcap/tidb#40499
2023-04-07 15:12:58 +08:00
e942ab6148 kazel: support auto-config shard_count (#42751)
close pingcap/tidb#42827
2023-04-06 15:46:58 +08:00
31a3b2c0ce loaddata: support concurrent writing to TiKV (#42667)
ref pingcap/tidb#40499
2023-03-31 16:34:55 +08:00
4e30a64a66 lightning: refactor to reuse in load data, part 3 (#42689)
ref pingcap/tidb#40499
2023-03-31 14:48:55 +08:00
22ff00237d *: LOAD DATA support GBK character set (#42644)
ref pingcap/tidb#40499
2023-03-29 19:38:54 +08:00
a1407b29fa loaddata: split functionalities to prepare concurrent load (#42565)
ref pingcap/tidb#40499
2023-03-28 23:20:55 +08:00
976148d868 lightning: refactor for reuse part2 (#42626)
ref pingcap/tidb#40499
2023-03-28 21:26:54 +08:00
7f16e500d8 executor: LOAD DATA use VisibleCols to skip hidden columns (#42450)
close pingcap/tidb#42446
2023-03-24 17:40:45 +08:00
fc166ffae8 *: enable more race and set timeout for test (#42371) 2023-03-20 12:44:40 +08:00
e09a2140ca executor: add default value for LOAD DATA batch size (#42310)
ref pingcap/tidb#40499
2023-03-16 22:04:40 +08:00
a8733c0050 load data: format 'delimited data', defined null by (#42191)
ref pingcap/tidb#40499
2023-03-16 13:34:40 +08:00
982e0dcb7f *: LOAD DATA support WITH DETACHED (#42159)
ref pingcap/tidb#40499
2023-03-15 19:48:39 +08:00
7c3a22e48d *: implement SHOW LOAD DATA JOB (#42118)
ref pingcap/tidb#40499
2023-03-13 22:24:39 +08:00
ea243088e1 load data: move param and some init logic into importer pkg (#42075)
ref pingcap/tidb#40499
2023-03-13 18:58:40 +08:00