Commit Graph

94 Commits

Author SHA1 Message Date
982e0dcb7f *: LOAD DATA support WITH DETACHED (#42159)
ref pingcap/tidb#40499
2023-03-15 19:48:39 +08:00
19c53a32cc executor: fix broken happens-before during refactor LOAD DATA (#42235)
close pingcap/tidb#42233
2023-03-15 12:30:46 +08:00
fff7fb9fec executor: enable deadlock (#42173) 2023-03-15 09:00:39 +08:00
7c3a22e48d *: implement SHOW LOAD DATA JOB (#42118)
ref pingcap/tidb#40499
2023-03-13 22:24:39 +08:00
ea243088e1 load data: move param and some init logic into importer pkg (#42075)
ref pingcap/tidb#40499
2023-03-13 18:58:40 +08:00
fd91259793 executor: LOAD DATA INFILE support asterisk matching (#42050)
ref pingcap/tidb#40499
2023-03-13 13:50:39 +08:00
25770ffc6b executor: unify replace into logic for InsertValues and ReplaceExec (#41947)
ref pingcap/tidb#40499
2023-03-08 23:47:12 +08:00
4f97ade0e0 executor: LOAD DATA record progress in a table (#41871)
ref pingcap/tidb#40499
2023-03-08 18:55:12 +08:00
1d293d8159 executor: implement part of restrictive LOAD DATA (#41793)
close pingcap/tidb#41784
2023-03-03 22:23:10 +08:00
04fefc97e6 load data: add with options (#41890)
ref pingcap/tidb#40499
2023-03-03 21:21:23 +08:00
1da60a3ce4 executor: check error message and refine LOAD DATA logic (#41640)
ref pingcap/tidb#40499
2023-02-28 21:19:09 +08:00
1ee5d2597d executor: LOAD DATA support sqldumpfile and parquet FORMAT (#41620)
ref pingcap/tidb#40499
2023-02-21 16:09:05 +08:00
65e524a73f executor: fix LOAD DATA can't use uppercase user var (#41603)
close pingcap/tidb#41596, close pingcap/tidb#41611
2023-02-21 11:47:05 +08:00
90412c432a lightning/parser: add more options to support LOAD DATA (#41573)
ref pingcap/tidb#41543
2023-02-20 22:51:05 +08:00
9e120b68ce executor: implement NULL DEFINED BY for LOAD DATA (#41541)
ref pingcap/tidb#40499
2023-02-20 20:43:05 +08:00
c47bb5da53 executor: Check for column mismatch (#41411)
* executor: Check for column mismatch when the table and statement have the same number of columns

* Add test for LOAD DATA and column mismatch

* Set the correct error message for column mismatch in LOAD DATA
2023-02-16 15:32:47 +01:00
d161aa6e45 executor: LOAD DATA use lightning CSV parser (#40852)
ref pingcap/tidb#40499
2023-02-16 19:22:02 +08:00
391c551258 parser: move LOAD DATA REMOTE into LOAD DATA (#41091)
ref pingcap/tidb#40499
2023-02-07 20:25:58 +08:00
dc30a5b7b3 *: LOAD DATA support load one file from s3 and other OSS (#40489)
ref pingcap/tidb#40499
2023-01-18 15:27:51 +08:00
b1ecabb559 txn: Optimize pessimistic transaction by supporting locking with conflict (#35588)
close pingcap/tidb#40537
2023-01-13 11:09:46 +08:00
23543a4805 *: merge the runtime stats in time to avoid using too many memory (#39394)
close pingcap/tidb#39413
2022-11-29 21:00:00 +08:00
7d8c45aa4d planner: provide a unified interface to set and get user variables and types (#37046)
ref pingcap/tidb#36598
2022-08-11 19:18:50 +08:00
6b83cdbea2 executor: handle NULL values properly when LOAD DATA INFILE (#36124)
close pingcap/tidb#34358
2022-07-29 13:03:12 +08:00
d25adf057d load_data: fix the bug that column list does not work in load data. (#35222)
close pingcap/tidb#35198
2022-06-16 21:36:36 +08:00
1bf64c60f4 *: Refactor FieldType structure (#33569)
close pingcap/tidb#32116
2022-04-26 19:28:51 +08:00
c11e650527 *: make golangci-lint work on Go1.18 (#33081)
close pingcap/tidb#33080
2022-03-15 22:43:52 +08:00
65365628b7 executor: fix load data panic if the data is broken at escape character (#30868)
close pingcap/tidb#31589
2022-01-18 17:53:44 +08:00
dc969f0eb8 executor: Add replace support for LOAD DATA (#31303)
ref pingcap/tidb#24515
2022-01-18 12:31:44 +08:00
80d18b6efb load data: fix bug if load data with long content (#29222) 2021-12-01 16:25:54 +08:00
xhe
94e30df8e2 parser: fix compiling, add unit tests (#28700) 2021-10-11 23:15:25 +08:00
7755d25aba *: Integrate SkyWalking-eyes to check license headers in CI and fix licenses headers (#27198) 2021-08-16 18:52:00 +08:00
76d48c1fec executor, server: load_data.go is changed and add unit test (#23201) 2021-03-29 15:45:24 +08:00
8ddaf03db1 executor: fix load data losing connection when batch_dml_size is set (#22724) 2021-02-05 10:51:42 +08:00
558d5610ce executor: fix load-data result when field term be the prefix of line term (#22585)
Signed-off-by: lysu <sulifx@gmail.com>
2021-01-28 17:46:00 +08:00
fdd
2364fec8f0 executor: fix load data in file get wrong result #20854 (#21895) 2021-01-21 21:53:29 +08:00
c7165bc518 executor, planner: ON DUPLICATE UPDATE can refer to un-project col (#14412)
Co-authored-by: Kenan Yao <cauchy1992@gmail.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2021-01-06 19:03:51 +08:00
31ddba99da executor: fix The JSON Data can not import to TiDB correctly by load data (#21043) 2020-11-16 12:07:28 +08:00
ae5dc3f69a executor: fix issue of load data statement doesn't record into slow query and statements_summary (#20713)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-11-04 16:27:01 +08:00
2f067c0542 *: redact arguments for Error (#20436) 2020-10-21 14:44:08 +08:00
a2e2ce6339 *: use int instead of fmt.Stringer as executor id (#19207) 2020-08-19 13:39:31 +08:00
d0639b0056 *: use the newly designed memdb (#18657)
* *: use the newly designed memdb

* address comments

* remove duplicated comments

Co-authored-by: Evan Zhou <coocood@gmail.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-03 20:51:05 +08:00
5f393fde7e *: support user defined variable and SET clause in LOAD DATA statement (#18753) 2020-08-03 10:42:10 +08:00
d66d5028da *: support plain insert on cluster index table (#17674) 2020-06-05 13:23:43 +08:00
5bf9ad7b81 executor: fix load data deal with escape character. (#16340) 2020-04-20 20:33:28 +08:00
71234a0348 server: check kill flag for load data (#15391) 2020-03-17 16:50:14 +08:00
4adff06b99 executor: reduce task queue size to reduce memory consume for load statement (#15369) 2020-03-14 20:23:53 +08:00
41142266b2 *: use SetString() for string instead of SetBytes() (#14989) 2020-03-02 15:48:10 +08:00
eb12799152 *: Collation should be set accordingly when setting string datum (#14757) 2020-02-20 23:01:53 +08:00
174ff27943 *: fix static check issues (#14286) 2020-01-06 16:07:15 +08:00
ebc4fa9dee executor: resort fields for reducing the memory allocated (#14208) 2019-12-31 17:19:59 +08:00