Commit Graph

58 Commits

Author SHA1 Message Date
7c56706622 *: support predeclared golangci-lint linter (#32066)
close pingcap/tidb#30733
2022-02-14 10:35:38 +08:00
9c64224c49 *: Reduce data inconsistencies (#31547)
ref pingcap/tidb#26833
2022-02-11 13:51:36 +08:00
cea9f1be97 br: Delete useless code (#31021)
close pingcap/tidb#32131
2022-02-07 18:21:35 +08:00
c30e8320d8 *: correct use require (#31904)
ref pingcap/tidb#31716
2022-02-07 18:11:35 +08:00
7f442079ac *: Minimize file and directory permissions (#31740)
ref pingcap/tidb#31310
2022-01-22 10:27:46 +08:00
34ce5b5e60 topsql: optimize life cycle of stmtstats (#31727)
ref pingcap/tidb#31704
2022-01-17 21:11:45 +08:00
a5435cd22e br: unified the lint rules with tidb. (#31644)
close pingcap/tidb#31643
2022-01-17 20:03:45 +08:00
1c7d3c7973 br: remove some useless code for golang lint check (#31504)
close pingcap/tidb#31046
2022-01-12 23:47:42 +08:00
c8f04b0a7b lightning: migrate test-infra to testify for backend/local and reduce test time (#31410)
close pingcap/tidb#29980
2022-01-10 09:44:38 +08:00
0073ca9365 lightning/backend/kv: migrate test-infra to testify (#31254)
close pingcap/tidb#29979
2022-01-04 19:54:35 +08:00
56a27676cd lightning: improve the performance of duplicate detection (#30203)
close pingcap/tidb#29588
2021-12-30 22:29:51 +08:00
5609c55569 lightning: return the right error in restore engine (#31059)
close pingcap/tidb#31057
2021-12-30 14:29:50 +08:00
7688d3759e lightning: remove the unnecessary offset field in the key encoding for duplicate detection (#29975) 2021-12-28 12:17:49 +08:00
2b0400aa23 br: Enable lint gosec in br (#30895)
close pingcap/tidb#30699
2021-12-27 14:03:49 +08:00
dfc25ff06b br/pkg/membuf: remove global buffer pool (#29934) 2021-12-23 11:13:47 +08:00
efb5330979 restore: use new ScatterRegions API (#30899)
close pingcap/tidb#30425
2021-12-23 00:45:48 +08:00
92207005ec lightning: optimize region split check logic (#30428)
close pingcap/tidb#30018
2021-12-20 15:45:46 +08:00
5eac82b052 lightning: emit tidb log by change FilterCore to only allow matched packages (#30700) 2021-12-16 15:48:36 +08:00
b4df7ca4dc test: make all the tests run in serial (#30692) 2021-12-14 18:06:36 +08:00
7746b6b70a test: fix incorrect regexp pattern during migrating test (#30080) 2021-12-02 05:51:53 +08:00
1b6ffe95c2 lightning: avoid retry write rows and record duplicate rows in tidb backend (#30179) 2021-11-29 20:03:52 +08:00
f45a8f0511 br : migrate test-infra to testify for lightning/backend/importer (#30073) 2021-11-24 14:49:50 +08:00
c68791566d lightning: let ignore columns be compatible with tidb backend (#27850) 2021-11-23 19:11:50 +08:00
f7ff198c84 br : migrate test-infra to testify for lightning/backend/tidb/tidb_test.go (#30042) 2021-11-23 18:11:50 +08:00
e482122d4e br : migrate test-infra to testify for lightning/backend/backend_test (#30009) 2021-11-22 23:11:50 +08:00
ab70e7a3d9 lightning: add unit test for lightning check multi ingest (#28959) 2021-11-19 10:55:47 +08:00
3a2c8c43b8 lightning: split engine logic from local.go (#29869) 2021-11-18 11:01:48 +08:00
155c93eece lightning: fix the bug where type error row data was always empty (#29537) 2021-11-15 18:39:06 +08:00
4324e4e95e lightning: avoid init error manager if not needed (#29748) 2021-11-14 14:15:05 +08:00
ffd6ee6583 pkg/lightning: reduce cpu&memory usage when duplicate-resolution is enabled (#29555)
* bug fix

* set default resolution algorithm to 'none'

* remove switchToNormalMode

* Update br/pkg/lightning/restore/table_restore.go

Co-authored-by: glorv <glorvs@163.com>

Co-authored-by: glorv <glorvs@163.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2021-11-09 13:58:03 +08:00
3537d7e5af lightning,dumpling: make tidb version check more compitible (#29500) 2021-11-07 16:55:04 +08:00
b74c13a898 *: run go fmt in go1.17 (#28784) 2021-11-05 12:33:03 +08:00
dc2d5a4f45 lightning: fix duplicate check panic (#29338) 2021-11-02 22:48:51 +08:00
c9a516981f pkg/lightning: refine config for duplicate-resolution and pause GC when duplicate-resolution is enabled (#29249) 2021-11-02 11:56:52 +08:00
8f192f0e54 br: Set check-static enable for br (#27642) 2021-10-27 18:22:49 +08:00
2dc09885bb lightning: support duplicate resolution by deleting all offending entries (#28464) 2021-10-25 15:26:48 +08:00
f739a53da3 br: optimizing retry-able function (#28434) 2021-10-14 10:11:27 +08:00
xhe
94e30df8e2 parser: fix compiling, add unit tests (#28700) 2021-10-11 23:15:25 +08:00
7e184f1d01 lightning: support dm set session variables and remove checkpoint. (#28471) 2021-10-11 15:13:25 +08:00
267a3b8162 executor: add auto id allocator execution runtime stats (#28013) 2021-10-08 17:35:24 +08:00
b2dd60d3c4 br: make lightning tidb backend compatible with mysql (#27988) 2021-09-29 15:28:47 +08:00
1cd932c310 lightning: implement max-error reporting for type conversion and unique key conflict errors (#27181) 2021-09-27 10:56:47 +08:00
4ba43a0d4c br: Fix typo in br (#28312) 2021-09-25 17:06:46 +08:00
76368e9e4a br: refactoring code - remove unnecessary variables (#28158) 2021-09-23 16:26:46 +08:00
48c624b201 *: remove some unnecessary exported/interface functions (#28134) 2021-09-22 15:22:45 +08:00
8a7bd55907 br: add retry for check multi ingest (#27774) 2021-09-06 14:36:58 +08:00
f8b4713391 lightning: save status checkpoint synchronously (#27096) 2021-08-31 13:16:13 +08:00
777b40cb8c *: refactor Allocator.Rebase() interface (#27649) 2021-08-30 13:10:11 +08:00
9f28c4ed12 lightning: auto adjust region-split-size (#27389) 2021-08-26 18:50:05 +08:00
60b1b01514 br: better estimate and adjust lightning max-open-files conf (#27597) 2021-08-26 15:52:05 +08:00