Commit Graph

120 Commits

Author SHA1 Message Date
4716f1b070 *: refine panic log (#46853)
ref pingcap/tidb#46852
2023-09-11 16:33:11 +00:00
3036b6d225 importinto: support split large csv file (#46480)
ref pingcap/tidb#42930
2023-09-01 12:06:43 +00:00
a06bcc60e1 br/lightning: add DecompressConfig to external storage (#46430)
ref pingcap/tidb#42930
2023-08-29 06:18:38 +00:00
b1feeca170 linter: enable revive for executor (#45504)
ref pingcap/tidb#40786
2023-07-24 03:22:18 +00:00
30cafb3c3a executor: refactor executor and baseExecutor (#45065)
ref pingcap/tidb#44940
2023-07-03 07:56:12 +00:00
440e3ef117 import into: part2, impl options/formats (#44204)
ref pingcap/tidb#42930
2023-05-29 05:00:40 +00:00
6e11eefcfc loaddata: don't split transaction and revert some change (#44136)
ref pingcap/tidb#44078
2023-05-25 03:43:38 +00:00
0ac7473ec9 loaddata: revert concurrent writing to TiKV and WITH detached (#44056)
ref pingcap/tidb#44078
2023-05-23 06:43:38 +00:00
6e3d52e0c5 load data: use dist framework for single-node import (#43880)
ref pingcap/tidb#42930
2023-05-22 10:31:38 +00:00
5f11392afc load data: sync rewrite set expr for concurrent load (#43492)
ref pingcap/tidb#42930
2023-05-09 08:46:58 +00:00
1c49453136 disttask: enable load data for distribute framework (#43107)
close pingcap/tidb#43106
2023-04-24 11:04:46 +00:00
66c36ededb *: support load data for table with generated columns (#43108)
close pingcap/tidb#39885
2023-04-20 12:27:19 +08:00
2aa72b7db6 load data: physical mode part 4 (#43162)
ref pingcap/tidb#42930
2023-04-19 19:01:20 +08:00
d33b9ae173 load data: check table empty or not for physical mode (#43157)
ref pingcap/tidb#42930
2023-04-19 13:21:19 +08:00
c7f5868df0 load data: physical mode part 3 (#43020)
ref pingcap/tidb#42930
2023-04-17 15:35:19 +08:00
2062b6865f disttask: add load data scheduler and subtask executor (#42881)
close pingcap/tidb#42880
2023-04-14 17:22:47 +08:00
2002ca106e load data: physical mode part2 (#42883)
ref pingcap/tidb#40499
2023-04-13 14:09:01 +08:00
dc32451b91 executor: fix flaky LOAD DATA test by adding a channel to synchronize (#42741)
close pingcap/tidb#42722
2023-04-04 09:42:56 +08:00
31a3b2c0ce loaddata: support concurrent writing to TiKV (#42667)
ref pingcap/tidb#40499
2023-03-31 16:34:55 +08:00
a1407b29fa loaddata: split functionalities to prepare concurrent load (#42565)
ref pingcap/tidb#40499
2023-03-28 23:20:55 +08:00
976148d868 lightning: refactor for reuse part2 (#42626)
ref pingcap/tidb#40499
2023-03-28 21:26:54 +08:00
3ea364720b load data: add root cause to an error message (#42352)
ref pingcap/tidb#40499
2023-03-17 17:39:13 +08:00
8d8d608093 bootstrap: move LOAD DATA system table into bootstrap (#42343)
ref pingcap/tidb#40499
2023-03-17 12:56:47 +08:00
04741ae4ca *: implement CANCEL/DROP LOAD DATA JOB (#42137)
ref pingcap/tidb#40499
2023-03-17 11:58:39 +08:00
e09a2140ca executor: add default value for LOAD DATA batch size (#42310)
ref pingcap/tidb#40499
2023-03-16 22:04:40 +08:00
a8733c0050 load data: format 'delimited data', defined null by (#42191)
ref pingcap/tidb#40499
2023-03-16 13:34:40 +08:00
982e0dcb7f *: LOAD DATA support WITH DETACHED (#42159)
ref pingcap/tidb#40499
2023-03-15 19:48:39 +08:00
19c53a32cc executor: fix broken happens-before during refactor LOAD DATA (#42235)
close pingcap/tidb#42233
2023-03-15 12:30:46 +08:00
fff7fb9fec executor: enable deadlock (#42173) 2023-03-15 09:00:39 +08:00
7c3a22e48d *: implement SHOW LOAD DATA JOB (#42118)
ref pingcap/tidb#40499
2023-03-13 22:24:39 +08:00
ea243088e1 load data: move param and some init logic into importer pkg (#42075)
ref pingcap/tidb#40499
2023-03-13 18:58:40 +08:00
fd91259793 executor: LOAD DATA INFILE support asterisk matching (#42050)
ref pingcap/tidb#40499
2023-03-13 13:50:39 +08:00
25770ffc6b executor: unify replace into logic for InsertValues and ReplaceExec (#41947)
ref pingcap/tidb#40499
2023-03-08 23:47:12 +08:00
4f97ade0e0 executor: LOAD DATA record progress in a table (#41871)
ref pingcap/tidb#40499
2023-03-08 18:55:12 +08:00
1d293d8159 executor: implement part of restrictive LOAD DATA (#41793)
close pingcap/tidb#41784
2023-03-03 22:23:10 +08:00
04fefc97e6 load data: add with options (#41890)
ref pingcap/tidb#40499
2023-03-03 21:21:23 +08:00
1da60a3ce4 executor: check error message and refine LOAD DATA logic (#41640)
ref pingcap/tidb#40499
2023-02-28 21:19:09 +08:00
1ee5d2597d executor: LOAD DATA support sqldumpfile and parquet FORMAT (#41620)
ref pingcap/tidb#40499
2023-02-21 16:09:05 +08:00
65e524a73f executor: fix LOAD DATA can't use uppercase user var (#41603)
close pingcap/tidb#41596, close pingcap/tidb#41611
2023-02-21 11:47:05 +08:00
90412c432a lightning/parser: add more options to support LOAD DATA (#41573)
ref pingcap/tidb#41543
2023-02-20 22:51:05 +08:00
9e120b68ce executor: implement NULL DEFINED BY for LOAD DATA (#41541)
ref pingcap/tidb#40499
2023-02-20 20:43:05 +08:00
c47bb5da53 executor: Check for column mismatch (#41411)
* executor: Check for column mismatch when the table and statement have the same number of columns

* Add test for LOAD DATA and column mismatch

* Set the correct error message for column mismatch in LOAD DATA
2023-02-16 15:32:47 +01:00
d161aa6e45 executor: LOAD DATA use lightning CSV parser (#40852)
ref pingcap/tidb#40499
2023-02-16 19:22:02 +08:00
391c551258 parser: move LOAD DATA REMOTE into LOAD DATA (#41091)
ref pingcap/tidb#40499
2023-02-07 20:25:58 +08:00
dc30a5b7b3 *: LOAD DATA support load one file from s3 and other OSS (#40489)
ref pingcap/tidb#40499
2023-01-18 15:27:51 +08:00
b1ecabb559 txn: Optimize pessimistic transaction by supporting locking with conflict (#35588)
close pingcap/tidb#40537
2023-01-13 11:09:46 +08:00
23543a4805 *: merge the runtime stats in time to avoid using too many memory (#39394)
close pingcap/tidb#39413
2022-11-29 21:00:00 +08:00
7d8c45aa4d planner: provide a unified interface to set and get user variables and types (#37046)
ref pingcap/tidb#36598
2022-08-11 19:18:50 +08:00
6b83cdbea2 executor: handle NULL values properly when LOAD DATA INFILE (#36124)
close pingcap/tidb#34358
2022-07-29 13:03:12 +08:00
d25adf057d load_data: fix the bug that column list does not work in load data. (#35222)
close pingcap/tidb#35198
2022-06-16 21:36:36 +08:00