Commit Graph

119 Commits

Author SHA1 Message Date
e11cbec12b lightning: support data files with bom header (#40813)
close pingcap/tidb#40744
2023-01-30 01:13:54 +08:00
06e2b29551 lightning: check hasDupe and tableID when resolve duplicate rows (#40696)
close pingcap/tidb#40657
2023-01-28 14:17:53 +08:00
eef8438e14 lightning: not set pos to end if fail to ReadUntil (#40232)
* fix: not set pos to end

* add it

* fix: return to prevPos

* fix: return err

* fix

* fix

* fix it

* fix

* fix: not exit when err

Co-authored-by: Zak Zhao <57036248+joccau@users.noreply.github.com>
2023-01-12 12:20:33 +08:00
875c002ad5 lightning: add foreign key test (#40103)
close pingcap/tidb#40226
2022-12-29 21:34:19 +08:00
cf34941401 ttl: make the TTL compatible with dumpling, lightning and BR (#40216)
close pingcap/tidb#40215
2022-12-29 16:30:21 +08:00
1ace97069e lightning: disable foreign key checks (#40032)
close pingcap/tidb#40027
2022-12-26 10:58:15 +08:00
4b98439f33 lightning: record network usage (#39673)
ref pingcap/tidb#39674
2022-12-08 18:24:05 +08:00
edabc32d92 br: fix integration test cases with --with-sys-table (#39655)
close pingcap/tidb#39692
2022-12-07 18:48:05 +08:00
26bbb71099 lightning: fix integration test (#39697)
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-12-07 14:20:50 +08:00
b33ff62413 *: enable tidb_enable_foreign_key variable default (#39677) 2022-12-07 13:01:55 +08:00
35819ee43f import: check table empty skips using index (#39604)
close pingcap/tidb#39477
2022-12-05 21:40:03 +08:00
7a1ea937b2 br: fix br foreign key test (#39607) 2022-12-05 11:10:02 +08:00
f5487e3f25 br: add foreign key test for br (#39427) 2022-11-30 18:46:01 +08:00
5b9d96b948 lightning: support compress for lightning, add compress unit and integration tests (#39153)
ref pingcap/tidb#38514
2022-11-28 18:58:01 +08:00
05d616c2d3 lightning: recover status from checkpoint after index engine closed (#39365) 2022-11-25 16:39:58 +08:00
f50113f6d8 lightning: finer granularity for tidb backend finished bytes (#39318) 2022-11-23 15:59:58 +08:00
a20b70ffa9 lightning: fix cluster index (#39010)
close pingcap/tidb#39009
2022-11-10 17:19:52 +08:00
275896cd89 br: fix broken integration test with tiflash (#38692) 2022-10-28 17:33:58 +08:00
0f6baa3f9b lightning: support extracting source/schema/table name to specific column (#37790)
close pingcap/tidb#37797
2022-10-26 17:47:57 +08:00
00791e7968 restore: ignore error when downstream db/table is created (#38327)
ref pingcap/tidb#37984
2022-10-12 19:09:51 +08:00
0e3e44001b ebs-br: change command line flags of restore (#38027)
close pingcap/tidb#38011
2022-09-21 23:21:03 +08:00
181fb8e905 br: merge feature branch of ebs-based-br (#37297)
ref pingcap/tidb#35306
2022-09-18 20:37:00 +08:00
ed9a0cdd7f lightning: fix lightning_various_types integration test (#37883)
close pingcap/tidb#37884
2022-09-16 11:58:59 +08:00
08cab41f07 lightning: support importing timestamp from Hive parquet (#37685)
close pingcap/tidb#37536
2022-09-13 10:14:58 +08:00
29b57e3569 lightning: fix dpanic log when init session vars (#37301)
close pingcap/tidb#37266
2022-08-24 23:12:21 +08:00
e4338c1e4a lightning: support column starts with slash/number/non-ascii for parquet (#36985)
close pingcap/tidb#36980, close pingcap/tidb#36981
2022-08-15 14:40:50 +08:00
7ca368650c br: add a test for cached table (#31191)
close pingcap/tidb#31190
2022-08-12 18:08:51 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
0ddf413ed5 br: Fix testing Docker script br/tests/up.sh (#36744)
ref pingcap/tidb#36743
2022-08-10 16:40:48 +08:00
cb211e0edf br: add flag to control whether restore priv table on default (#36652)
close pingcap/tidb#36651
2022-07-30 16:40:03 +08:00
56dadec862 ddl: Preparation for add index acceleration (#36085)
ref pingcap/tidb#35983
2022-07-28 16:43:11 +08:00
f22098cc5d br: don't encode key of raw kv. (#36491)
ref pingcap/tidb#36490
2022-07-27 19:05:11 +08:00
6ae88c4309 br: use one shot session to close domain ASAP (#36558)
* br: use one shot session to close domain ASAP



Co-authored-by: Ian <ArGregoryIan@gmail.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-07-26 20:15:53 +08:00
28a8ffcf67 br: fix compatibility issue with concurrent ddl (#36474)
close pingcap/tidb#36453
2022-07-23 17:47:09 +08:00
656b5a5e80 br: fix broken integration test (#36411) 2022-07-21 16:49:09 +08:00
a1abdbe38a br: more i t for restore priv table (#36330)
ref pingcap/tidb#35395
2022-07-19 19:37:08 +08:00
1883a4444d br: restore privilege tables on full restore by default (#35397)
close pingcap/tidb#35395
2022-07-18 13:11:06 +08:00
6a5a2aa1fb br: fix broken integration test (#36250) 2022-07-17 08:59:06 +08:00
911e7cc360 *: enable revive (#35970)
ref pingcap/tidb#35345
2022-07-15 16:03:06 +08:00
f12badc98e lightning: parquet parser supports bool value (#35980)
close pingcap/tidb#31222
2022-07-11 16:37:05 +08:00
ae2cd91a04 lightning: allocate autoid globally when increment-import is enabled (#35905)
close pingcap/tidb#35904
2022-07-11 15:39:05 +08:00
680b78cc98 lightning: revert new policy of allocating rowid and refine it later (#35817)
close pingcap/tidb#35816
2022-06-29 16:38:39 +08:00
3dd54b8bbb lightning: support disable scheduler by key range (#34130)
close pingcap/tidb#35148
2022-06-24 15:06:38 +08:00
fde7c36e10 raw_restore: fix the issue that raw restore rewrite the t prefix keys (#35641)
close pingcap/tidb#35279
2022-06-23 20:06:37 +08:00
2648989a55 lightning: add store write limiter (#35193)
close pingcap/tidb#35192
2022-06-21 13:02:36 +08:00
674def3b78 lightning: sample files and pre-allocate rowID before restoring chunk (#34288)
close pingcap/tidb#28776
2022-06-16 19:52:35 +08:00
f5d3b0272c br: return given error and wait retry when failed to ScanRegions (#35339)
close pingcap/tidb#35211
2022-06-14 14:12:33 +08:00
2b4a4c6d7a *: support bazel (#33691)
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
0f85650aa4 br: add error into retry list when backup (#34930)
close pingcap/tidb#34865
2022-05-26 16:54:47 +08:00
b824e351b9 lightning: support null value for auto-incr column on local backend (#34552)
close pingcap/tidb#34208
2022-05-12 14:04:35 +08:00