Commit Graph

69 Commits

Author SHA1 Message Date
c11e650527 *: make golangci-lint work on Go1.18 (#33081)
close pingcap/tidb#33080
2022-03-15 22:43:52 +08:00
65365628b7 executor: fix load data panic if the data is broken at escape character (#30868)
close pingcap/tidb#31589
2022-01-18 17:53:44 +08:00
dc969f0eb8 executor: Add replace support for LOAD DATA (#31303)
ref pingcap/tidb#24515
2022-01-18 12:31:44 +08:00
80d18b6efb load data: fix bug if load data with long content (#29222) 2021-12-01 16:25:54 +08:00
xhe
94e30df8e2 parser: fix compiling, add unit tests (#28700) 2021-10-11 23:15:25 +08:00
7755d25aba *: Integrate SkyWalking-eyes to check license headers in CI and fix licenses headers (#27198) 2021-08-16 18:52:00 +08:00
76d48c1fec executor, server: load_data.go is changed and add unit test (#23201) 2021-03-29 15:45:24 +08:00
8ddaf03db1 executor: fix load data losing connection when batch_dml_size is set (#22724) 2021-02-05 10:51:42 +08:00
558d5610ce executor: fix load-data result when field term be the prefix of line term (#22585)
Signed-off-by: lysu <sulifx@gmail.com>
2021-01-28 17:46:00 +08:00
fdd
2364fec8f0 executor: fix load data in file get wrong result #20854 (#21895) 2021-01-21 21:53:29 +08:00
c7165bc518 executor, planner: ON DUPLICATE UPDATE can refer to un-project col (#14412)
Co-authored-by: Kenan Yao <cauchy1992@gmail.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2021-01-06 19:03:51 +08:00
31ddba99da executor: fix The JSON Data can not import to TiDB correctly by load data (#21043) 2020-11-16 12:07:28 +08:00
ae5dc3f69a executor: fix issue of load data statement doesn't record into slow query and statements_summary (#20713)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-11-04 16:27:01 +08:00
2f067c0542 *: redact arguments for Error (#20436) 2020-10-21 14:44:08 +08:00
a2e2ce6339 *: use int instead of fmt.Stringer as executor id (#19207) 2020-08-19 13:39:31 +08:00
d0639b0056 *: use the newly designed memdb (#18657)
* *: use the newly designed memdb

* address comments

* remove duplicated comments

Co-authored-by: Evan Zhou <coocood@gmail.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-03 20:51:05 +08:00
5f393fde7e *: support user defined variable and SET clause in LOAD DATA statement (#18753) 2020-08-03 10:42:10 +08:00
d66d5028da *: support plain insert on cluster index table (#17674) 2020-06-05 13:23:43 +08:00
5bf9ad7b81 executor: fix load data deal with escape character. (#16340) 2020-04-20 20:33:28 +08:00
71234a0348 server: check kill flag for load data (#15391) 2020-03-17 16:50:14 +08:00
4adff06b99 executor: reduce task queue size to reduce memory consume for load statement (#15369) 2020-03-14 20:23:53 +08:00
41142266b2 *: use SetString() for string instead of SetBytes() (#14989) 2020-03-02 15:48:10 +08:00
eb12799152 *: Collation should be set accordingly when setting string datum (#14757) 2020-02-20 23:01:53 +08:00
174ff27943 *: fix static check issues (#14286) 2020-01-06 16:07:15 +08:00
ebc4fa9dee executor: resort fields for reducing the memory allocated (#14208) 2019-12-31 17:19:59 +08:00
c1bc9ffe5b *: add memory tracker for InsertExec and ReplaceExec (#14179) 2019-12-30 11:43:01 +08:00
b04001b2a5 *: make golint happy #14025 (#14034) 2019-12-12 11:42:58 +08:00
c50355303b executor: add log for commit work (#13965) 2019-12-09 12:46:11 +08:00
fbf0d90c06 executor: error processing refactor for load data (#12465) 2019-10-11 13:01:32 +08:00
d438e103be executor: load data statement, separate data preparing routine and commit routine (#11533) 2019-09-16 19:46:12 +08:00
728ed194c0 fix load data rowCount should added first before call colsToRow(). (#11980) 2019-09-02 05:58:28 -05:00
6d51ad33fd *: Optimize struct memory usage by adjust field order (#11629) 2019-08-13 17:20:53 +08:00
9828c2ef65 fix field type error (#11713) 2019-08-12 15:51:08 +08:00
3076e632c8 *: use bytes.Equal to check byte slice equivalent (#11706) 2019-08-11 17:36:20 +08:00
d210889a6c *: trace the execution of the insert operation (#11667) 2019-08-09 14:22:03 +08:00
036e7e207d *: support new 'log' format for trace (#11681) 2019-08-09 12:43:33 +08:00
a92902aeee load data: avoid an unnecessary converting from byte slice to… (#11516) 2019-07-30 11:01:04 +08:00
1cca2d1455 improvement. change unessesary mem copy in for index substring call (#11405)
Test pass, auto merge by Bot
2019-07-24 16:40:13 +08:00
119d532979 executor: load data/batch insert improvement reducing memory a… (#11284) 2019-07-23 18:41:52 +08:00
e0fc847c8b executor: handle missing timestamp value for load data (#11093) 2019-07-12 14:56:55 +08:00
84432823b3 refactor the logic of load data batch insert, make batchCheckGet happen once per transaction (#11132) 2019-07-12 13:36:58 +08:00
66f5754c68 *: add trace support for the AllocAutoIncrementValue function (#11158) 2019-07-10 15:07:42 +08:00
d244723a5e executor: remove unused structure RecordBatch (#10891) 2019-06-26 15:26:16 +08:00
c8d1ff7ca6 *: replace 'logutil.Logger(context.Background())' with 'logutil.BgLogger()' (#10866) 2019-06-21 19:13:31 +08:00
54899f66f6 parser: support LOAD DATA ... IGNORE/REPLACE (#10336) 2019-05-22 17:03:29 +08:00
d6396daa77 *: lazy eval explain id and tracker label (#10139) 2019-04-22 14:23:33 +08:00
e9653675dd *: remove errors.Trace in main handle path (#10033) 2019-04-04 14:27:15 +08:00
76a01da313 remove unnecessary expensive trace call and log from hot path (#10025) 2019-04-03 23:09:51 +08:00
f738ba24ad executor: replace logger with zap logger (#9521) 2019-03-14 15:14:38 +08:00
33b4c3e3c8 executor: fix csv parser (#9005) 2019-01-15 22:46:23 +08:00