Commit Graph

49 Commits

Author SHA1 Message Date
40456f36fe *: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
2024-03-25 11:59:17 +00:00
490e17c9ab importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
2024-03-25 05:45:46 +00:00
5e19822d0d importinto: precheck to avoid run 2 jobs to import the same table (#51997)
ref pingcap/tidb#49008
2024-03-21 14:45:43 +00:00
5a2b8e8e1a importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
2024-03-18 07:54:42 +00:00
c039855869 importinto: limit global sort minimum thread required (#51776)
ref pingcap/tidb#49008
2024-03-14 09:08:18 +00:00
dbdae85432 importinto, disttask: allow multi import job & adjust total memory for cgroup v2 (#51575)
ref pingcap/tidb#49008
2024-03-14 05:05:09 +00:00
ccc453bfe9 lightning: improve post-import conflict detection 'error' semantic (#51277)
ref pingcap/tidb#51036
2024-03-13 10:48:40 +00:00
69ab2a4de6 import into: enable [] glob matching (#51643)
ref pingcap/tidb#50752
2024-03-12 04:02:09 +00:00
911bcf16a8 importinto: calculate writer mem size using step resource & add a option for test (#51486)
ref pingcap/tidb#49008
2024-03-07 10:59:06 +00:00
4182a418c8 *: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
2024-02-29 07:42:31 +00:00
332086ebc8 importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
2024-02-27 09:05:09 +00:00
6f02e99396 experssion: table: standalone implement for EvalContext and BuildContext (#51299)
close pingcap/tidb#51298
2024-02-27 07:26:21 +00:00
fc36864a1f table: standalone implement for table.MutateContext and table.AllocatorContext (#51262)
close pingcap/tidb#51259
2024-02-23 07:21:27 +00:00
5b187e5e56 planner: standalone implement for PlanContext (#51237)
close pingcap/tidb#51236
2024-02-22 15:03:28 +00:00
11f716e206 bootstrap, br: add sys.schema_unused_indexes view (#50887)
close pingcap/tidb#50886
2024-02-21 05:22:57 +00:00
52052f1044 bootstrap: remove mysql.load_data_jobs (#51176)
ref pingcap/tidb#44078
2024-02-20 13:21:27 +00:00
aca145b164 ddl, lightning: use TiDB PD client's discovery to create local backend (#51108)
close pingcap/tidb#51103
2024-02-18 10:55:55 +00:00
65d57c0a43 import into: log checksum for each KV group (#50871)
ref pingcap/tidb#50832
2024-02-18 08:55:55 +00:00
fdcbd896e2 importinto: add disable_precheck option & change default threadcnt when import from select (#51077)
ref pingcap/tidb#49883
2024-02-08 13:20:46 +00:00
526d738207 expression: refactor functions to build expressions (#50997)
close pingcap/tidb#50996
2024-02-07 03:05:45 +00:00
6e022a5c31 table: introduce MutateContext and AllocatorContext for table.Table (#50862)
close pingcap/tidb#50861
2024-02-01 09:01:54 +00:00
fdb13d1080 importinto: fix checksum always use default distsql-scan-concurrency (#50807)
close pingcap/tidb#50805
2024-01-30 06:33:22 +00:00
51e1e13494 *: update interface{} to any (#50770)
ref pingcap/tidb#50765
2024-01-29 07:21:29 +00:00
9416934ea3 *: split planner errors and remove duplicate definitions (#50695)
ref pingcap/tidb#48875
2024-01-26 09:42:21 +00:00
761b404fe2 executor: ChecksumTableExec respects SQLKiller (#50726)
close pingcap/tidb#50651
2024-01-26 03:39:28 +00:00
c852515fe2 lightning: convert pebbleDB block size to default when user passes in 0 (#50690)
ref pingcap/tidb#45037
2024-01-25 05:40:51 +00:00
1db15879c1 importinto: add more test (#50558)
ref pingcap/tidb#49883
2024-01-22 05:00:19 +00:00
188726aec6 importinto: fix multiple pd addr (#50587)
close pingcap/tidb#50586
2024-01-19 06:19:47 +00:00
12d273e00f importinto: executor part of import from select (#50341)
ref pingcap/tidb#49883
2024-01-17 15:52:47 +00:00
5fee75661a lightning: use SprintfWithIdentifier to process strings with identifier (#50434)
ref pingcap/tidb#30699
2024-01-17 08:34:47 +00:00
e87d94904a lightning: always use PD HTTP client to access PD HTTP API (#50078)
ref pingcap/tidb#49865
2024-01-12 08:25:56 +00:00
e15c517afa import/index: adjust concurrency using cpu-count of managed node depends on use case (#50091)
ref pingcap/tidb#49008
2024-01-10 08:31:54 +00:00
d791a79a3d Lightning: support multiple PD addresses (#49516)
close pingcap/tidb#49515
2024-01-03 06:05:09 +00:00
89fc4403f3 Lightning : make pebbleDB block size configurable (#49514)
close pingcap/tidb#45037
2024-01-03 02:35:02 +00:00
3d939d4b6f disttask: init capacity and check concurrency using cpu count of managed node (#49875)
ref pingcap/tidb#49008
2024-01-02 05:36:31 +00:00
84d9bc3b6a importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
2023-12-29 07:27:35 +00:00
323b0f772b *: remove deprecated LOAD DATA actions (#49470)
ref pingcap/tidb#44078
2023-12-15 14:00:21 +00:00
93225684c1 br/storage: add scope to support service_account type of credential file & remove default GCS httpclient (#49363)
ref pingcap/tidb#49340
2023-12-12 17:16:48 +00:00
a7260ff598 disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
2023-12-11 13:49:48 +00:00
eff04125e7 br, util/ranger: replace EvalWithInnerCtx with Eval for packages br and util/ranger (#48785)
close pingcap/tidb#48783
2023-11-23 03:40:11 +00:00
9062834986 expression: add ctx to expression.Eval (#48609)
close pingcap/tidb#48608
2023-11-22 05:29:40 +00:00
e392766f8e importinto: calculate subtask count for global sort (#48169)
ref pingcap/tidb#47572
2023-11-03 02:59:17 +00:00
d99c5a547b *: fix TestSupportedSuffixForServerDisk when in RBE (#48249)
close pingcap/tidb#48225
2023-11-03 02:06:39 +00:00
1ba524c756 importinto: fix import compressed server file (#48173)
close pingcap/tidb#48049
2023-11-01 12:33:43 +00:00
f917b7a81f pkg/executor/importer: add OWNERS file (#47876)
close pingcap/tidb#47875
2023-11-01 04:00:38 +00:00
99a4f35146 importinto: optimize write ingest step and fix oom (#48047)
ref pingcap/tidb#47572, close pingcap/tidb#47643
2023-10-31 11:48:38 +00:00
f135464cd7 *: upgrade grpc (#48057)
close pingcap/tidb#48060
2023-10-30 06:05:20 +00:00
ab4c20ba16 importinto: revert "use one writer for each kv group for all concurrent encoder" (#47666)
ref pingcap/tidb#46704
2023-10-16 14:34:58 +00:00
318e82bbb7 *: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
2023-10-13 14:36:26 +00:00