Commit Graph

302 Commits

Author SHA1 Message Date
0220773306 linter: add skywalking-eyes into bazel (#40788)
close pingcap/tidb#40789
2023-01-28 15:55:53 +08:00
3291b6de67 makefile: enable deadlock in the with-real-tikv (#40359)
close pingcap/tidb#40293
2023-01-06 14:00:20 +08:00
5eea731db0 util: use go-deadlock to find deadlock (#40288)
close pingcap/tidb#40293
2023-01-05 15:10:20 +08:00
f7de8beede *: remove the support of the old ddl framework (#39684)
ref pingcap/tidb#39824
2022-12-30 18:30:18 +08:00
a48fe7913d executor: close resultset (#39474) 2022-11-30 13:57:59 +08:00
328aef88b0 lightning: add precheck about downstream CDC/PiTR (#39338)
close pingcap/tidb#39346
2022-11-30 13:17:59 +08:00
9689b4763d ddl: improve log messages (#39376) 2022-11-29 17:15:59 +08:00
e618d864fb bazel: enable --remote_download_minimal again (#39307) 2022-11-29 13:35:59 +08:00
9761e6789a *: enable the CI test for concurrent ddl (#38926) 2022-11-10 01:02:02 +08:00
490e4c4d60 session, sessionctx: enable metadata lock by default (#38866)
close pingcap/tidb#37275, ref pingcap/tidb#38890
2022-11-07 09:37:50 +08:00
fce4fda3a7 sessionctx: fix tidb_gogc_tuner_threshold (#38851) 2022-11-03 18:32:01 +08:00
8db7c3b30e ci, Makefile: add make rule to check bazel prepare (#38818)
close pingcap/tidb#38817
2022-11-02 20:52:00 +08:00
7e4d7598be bazel: use --remote_download_minimal in ci (#38780) 2022-11-01 14:07:59 +08:00
xhe
85b53e1878 *: fix docker script (#38602) 2022-10-22 11:27:54 +08:00
89e9aa31aa *: optimize the bazel build (#38286) 2022-10-08 18:27:48 +08:00
c1be2015d9 makefile: add parser_yacc check when to linter (#38219) 2022-09-28 17:23:44 +08:00
59f6a53eb7 makefile: add bazel linter (#38096) 2022-09-22 19:17:03 +08:00
181fb8e905 br: merge feature branch of ebs-based-br (#37297)
ref pingcap/tidb#35306
2022-09-18 20:37:00 +08:00
57febedb35 *: enable rowserrcheck for nogo (#37761) 2022-09-13 14:28:58 +08:00
xhe
5f0c580026 *: refine github actions and makefile (#37235) 2022-09-08 02:22:57 +08:00
64c30c0a24 tests/realtikvtest: add tests for adding index (#37320)
ref pingcap/tidb#35983
2022-08-24 00:04:20 +08:00
ed84b0f161 bazel: enable color for all (#37164) 2022-08-18 09:36:51 +08:00
9c0d6157e2 executor/splittest: add a benchmark test for locating region cache (#37132)
close pingcap/tidb#37107
2022-08-16 16:06:51 +08:00
xhe
8cbc4a418b dumpling: better github action (#37090) 2022-08-15 17:54:50 +08:00
a7d18d5f2c makefile: skip realtikvtest in the ut (#37061) 2022-08-12 17:00:50 +08:00
fb1b8509eb *: fix check-2 to bazel (#37055) 2022-08-11 19:04:50 +08:00
fa73ba8529 makefile: add bazel realtikvtest (#37042) 2022-08-11 14:44:48 +08:00
xhe
2873057592 *: do not rely on git to check file perm (#37008) 2022-08-10 13:46:47 +08:00
xhe
b41d751e75 server: fully support CLIENT_DEPRECATE_EOF (#36971)
ref pingcap/tidb#32118
2022-08-10 11:34:48 +08:00
xhe
4b3563c6cb *: forbid creation of normal files with exec perm (#36691) 2022-08-09 15:42:47 +08:00
952675b540 *: remove redundant steps (#36871)
close pingcap/tidb#36872
2022-08-04 11:16:06 +08:00
1a0c92b7dd *: enable makezero for bazel nogo (#36842)
close pingcap/tidb#36850
2022-08-03 19:30:06 +08:00
5680ce663b *: bazel build keep same behavior as gobuild (#36814)
close pingcap/tidb#36821
2022-08-03 18:56:06 +08:00
e4b7e4b068 *: remove golangcilinter to bazel (#36742)
close pingcap/tidb#36843
2022-08-03 17:42:06 +08:00
d18a8bef8a *: remove keeping flag for build (#36809) 2022-08-02 16:42:06 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
xhe
e5c900c8cd tools: use go install to cleanup go.mod (#36702) 2022-07-29 20:57:12 +08:00
0f692b38e2 makefile: remove useless linter and enable revive for distsql (#36607) 2022-07-27 20:03:11 +08:00
db179bf721 Makefile: remove target gotest and use ut instead (#36530)
close pingcap/tidb#36493
2022-07-26 11:55:10 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
dff77a9394 *: remove repetitive linter (#36334) 2022-07-20 14:31:08 +08:00
db03c0c9e5 *: use generic to improve btree performance (#35492)
close pingcap/tidb#34248
2022-07-15 17:53:05 +08:00
58e88e7528 dumpling: fix dumpling s3 integration tests (#36054)
close pingcap/tidb#36080
2022-07-11 14:55:04 +08:00
a1c752795f *: improve bazel build (#36009) 2022-07-07 18:57:02 +08:00
e00ad2b3ef *: enable errcheck for nogo (#35704)
ref pingcap/tidb#35345
2022-07-02 22:08:39 +08:00
680b78cc98 lightning: revert new policy of allocating rowid and refine it later (#35817)
close pingcap/tidb#35816
2022-06-29 16:38:39 +08:00
xhe
fe1b9915ba *: add parser generation command at the root (#35396)
close pingcap/tidb#29322
2022-06-17 20:44:35 +08:00
674def3b78 lightning: sample files and pre-allocate rowID before restoring chunk (#34288)
close pingcap/tidb#28776
2022-06-16 19:52:35 +08:00
6432975be3 *: enable race test on util/chunk and update bazel config (#35235)
ref pingcap/tidb#35234
2022-06-09 16:32:31 +08:00