Commit Graph

146 Commits

Author SHA1 Message Date
bc08b50127 lightning: fix gcs max key limit (#30393) 2021-12-07 01:59:56 +08:00
720370767a br: fix the integration tests (#30423) 2021-12-06 15:27:56 +08:00
124f1fcf3e br: add more precise check for lock file (#30218) 2021-12-02 10:15:53 +08:00
7746b6b70a test: fix incorrect regexp pattern during migrating test (#30080) 2021-12-02 05:51:53 +08:00
7124e62bdb *: update client-go to use resolveForRead (#30314) 2021-12-01 18:23:54 +08:00
1b6ffe95c2 lightning: avoid retry write rows and record duplicate rows in tidb backend (#30179) 2021-11-29 20:03:52 +08:00
df113a1242 unistore: get/batchGet/scan support read-through-lock (#29898) 2021-11-29 14:37:51 +08:00
f45a8f0511 br : migrate test-infra to testify for lightning/backend/importer (#30073) 2021-11-24 14:49:50 +08:00
791f59df47 br/pkg/utils: migrate tests to testify (#30032) 2021-11-24 10:53:51 +08:00
71e64bf05e br/pkg/mock: migrate test-infra to testify (#30034) 2021-11-23 19:57:50 +08:00
c68791566d lightning: let ignore columns be compatible with tidb backend (#27850) 2021-11-23 19:11:50 +08:00
f7ff198c84 br : migrate test-infra to testify for lightning/backend/tidb/tidb_test.go (#30042) 2021-11-23 18:11:50 +08:00
cc8617e062 br: migrate test-infra to testify for redact (#29747) 2021-11-23 17:15:50 +08:00
e482122d4e br : migrate test-infra to testify for lightning/backend/backend_test (#30009) 2021-11-22 23:11:50 +08:00
b93ce18982 lightning: fix log doesn't output to stdout when passing --log-file="-" (#29896) 2021-11-19 11:19:48 +08:00
73b0a4e4ae tidb-lightning.toml: add data charset conversion config (#29880) 2021-11-19 11:05:47 +08:00
ab70e7a3d9 lightning: add unit test for lightning check multi ingest (#28959) 2021-11-19 10:55:47 +08:00
4a7aad98a1 lightning: add a precheck for csv header (#27819) 2021-11-18 13:53:48 +08:00
6f753d5bc7 br/lightning: don't make NextMajorVersion() crash if ReleaseVersion is not a semver (#29186) 2021-11-18 11:13:47 +08:00
3a2c8c43b8 lightning: split engine logic from local.go (#29869) 2021-11-18 11:01:48 +08:00
c6f4cb5cb3 br: fix DATA RACE in the TestRunServer (#29836) 2021-11-16 17:33:08 +08:00
155c93eece lightning: fix the bug where type error row data was always empty (#29537) 2021-11-15 18:39:06 +08:00
5992cdab6d lightning: fix init error-manager (#29768) 2021-11-15 18:27:07 +08:00
bb37653add *: fix unstable test testChecksumSuite.TestChecksum (#29767) 2021-11-15 18:13:06 +08:00
bc10104e05 br: Remove statement from closure to prevent concurrent operation during backup system table (#29730) 2021-11-15 15:09:07 +08:00
4324e4e95e lightning: avoid init error manager if not needed (#29748) 2021-11-14 14:15:05 +08:00
4eb51724d4 br/pkg/version: migrate test-infra to testify (#29409) 2021-11-13 15:31:05 +08:00
31a4f6abbb lightning: make charset setting case-insensitive (#29713)
* make charset case-insensitive

* fmt code

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2021-11-12 13:55:04 +08:00
b266d7d574 util: add WaitGroupWrapper (#29614) 2021-11-12 02:27:05 +08:00
58c02d5bb7 br: Add system table from v5.3.0 into blacklist which shouldn't be restored (#29701) 2021-11-11 19:41:05 +08:00
6512fe5a49 lightning: fix checksum mismatch when parallel import data (#29695) 2021-11-11 19:15:05 +08:00
f071f8bc00 br: fix check sum time inaccurate in restore log (#29420) 2021-11-11 16:45:05 +08:00
99ab8bf16f br: Create grpc.connection with block mode (#29601) 2021-11-10 12:17:05 +08:00
96a9ce1b14 lightning: do not shadow checksum error (#29626) 2021-11-10 11:07:05 +08:00
a6c2c4316a br: fix-panic, call close(chan) before waitgroup.done() (#29491) 2021-11-09 14:19:05 +08:00
ffd6ee6583 pkg/lightning: reduce cpu&memory usage when duplicate-resolution is enabled (#29555)
* bug fix

* set default resolution algorithm to 'none'

* remove switchToNormalMode

* Update br/pkg/lightning/restore/table_restore.go

Co-authored-by: glorv <glorvs@163.com>

Co-authored-by: glorv <glorvs@163.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2021-11-09 13:58:03 +08:00
3537d7e5af lightning,dumpling: make tidb version check more compitible (#29500) 2021-11-07 16:55:04 +08:00
b74c13a898 *: run go fmt in go1.17 (#28784) 2021-11-05 12:33:03 +08:00
d80efa5c1e br: Compatibility problem between br and TiDB for DDLs about attribute in Incremental Backup (#29360) 2021-11-04 21:41:02 +08:00
b64537d090 br: Update mysql.stats_meta after checksum in restore (#29429) 2021-11-04 19:55:02 +08:00
8368eeed24 *: remove useless parameter (#29392) 2021-11-04 12:39:02 +08:00
dc2d5a4f45 lightning: fix duplicate check panic (#29338) 2021-11-02 22:48:51 +08:00
55a38a1c76 *: tiny clean up the RecordSet NewChunk() method (#29232) 2021-11-02 20:02:51 +08:00
c9a516981f pkg/lightning: refine config for duplicate-resolution and pause GC when duplicate-resolution is enabled (#29249) 2021-11-02 11:56:52 +08:00
bdc9987370 lightning: fix in-correctly check for session variable (#29291) 2021-11-01 19:36:52 +08:00
9dc4630b47 *: make expression index as experimental feature (#28307) 2021-10-30 00:40:51 +08:00
a3dc997216 BR: use sperated thread for loading stat (#29180) 2021-10-29 14:54:49 +08:00
6a62f9d18c br/lightning: fix test lightning_duplicate_detection (#29225) 2021-10-29 13:04:49 +08:00
97776fdb1a br: retry for push down to tikv if error is retryable (#28811) 2021-10-28 16:38:51 +08:00
aef456d0d4 br: Simplify long function:BackupSchemas() (#29153) 2021-10-28 14:40:48 +08:00