Commit Graph

548 Commits

Author SHA1 Message Date
0823fdb6b3 planner, executor: implement the null-aware antiSemiJoin and null-aware antiLeftOuterSemiJoin (hash join with inner build) (#37512)
close pingcap/tidb#37525
2022-09-20 00:05:03 +08:00
40e87a3697 table partition: set tidb_enable_exchange_partition default on (#37284)
close pingcap/tidb#35996
2022-09-19 15:09:01 +08:00
c4638b70fd *: support metadata lock (#37393)
ref pingcap/tidb#37275
2022-09-18 20:57:00 +08:00
efc07201e3 planner: support 3 stage aggregation for single scalar distinct agg (#37203)
close pingcap/tidb#37202
2022-09-17 13:36:59 +08:00
f61024b2dc variables: change tidb_rc_read_check_ts to instance level (#37803)
close pingcap/tidb#37802
2022-09-16 18:28:59 +08:00
20d46c2c53 planner: make unsafe substitute can be used in generated column (#37779)
close pingcap/tidb#35490
2022-09-16 12:50:59 +08:00
5209ac2fa1 sessionctx: support session var tidb_last_plan_replayer_token (#37851)
ref pingcap/tidb#37798
2022-09-15 18:15:00 +08:00
b5ab19c098 planner: remove old useless interfaces about cost model (#37801)
ref pingcap/tidb#35240
2022-09-15 15:47:00 +08:00
100b65819b Optimize: TiDB skip getting tso from PD at RC isolation for some special scenes (#36823)
close pingcap/tidb#36812
2022-09-13 16:40:58 +08:00
d86e7956d4 *: support send flashback cluster RPC (#37659)
close pingcap/tidb#37651, close pingcap/tidb#37665
2022-09-09 11:40:56 +08:00
ca5de8928b session, planner: add a session variable "tidb_opt_force_inline_cte" (#37626)
close pingcap/tidb#36514
2022-09-08 15:52:57 +08:00
52c847651d sessionctx/variable: add system variable tidb_opt_range_max_size (#37706)
ref pingcap/tidb#37176
2022-09-08 15:20:57 +08:00
1d482db4dd *: Support for tidb_sm3_password authentication (#36193)
close pingcap/tidb#36192
2022-09-08 12:00:57 +08:00
9036de3394 *: support create table with foreign key and maintain foreign key reference (#37148)
close pingcap/tidb#37147
2022-09-07 13:22:56 +08:00
878ac8e38f ddl/ingest: add the management infra for lightning struct (#37521)
ref pingcap/tidb#35983
2022-09-06 12:20:55 +08:00
3e39d4514f *: add a config to enable write statements to read on TiFlash (#37516)
close pingcap/tidb#37515
2022-09-02 17:54:25 +08:00
835922a5cd txn: support skipping locking of some INSERT in pessimistic transactions (#36473)
close pingcap/tidb#36579
2022-09-01 18:34:25 +08:00
ccd4f347a2 *: Enable tiflash_fastscan variable and remove fast mode alter statment (#37027)
ref pingcap/tidb#35850
2022-08-29 11:28:22 +08:00
2c22fff571 sessionctx/variable: fix range check for @@timestamp (#37249)
close pingcap/tidb#31585
2022-08-23 16:30:20 +08:00
21847fe58b planner: set EnableOuterJoinReorder to false by default (#37264)
ref pingcap/tidb#37238
2022-08-22 19:30:20 +08:00
f65948d8d5 planner: modify sysvar TiDBPrepPlanCacheSize scope (#37131)
ref pingcap/tidb#36598
2022-08-16 16:22:51 +08:00
0039dd2fde planner: introduce tidb_general_plan_cache_size for general plan cache (#37087)
ref pingcap/tidb#36598
2022-08-16 12:04:52 +08:00
323fdb224d ddl: add index acceleration introduce sysvars and config param (#36088)
ref pingcap/tidb#35983
2022-08-12 15:44:49 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
d67e29e658 sessionctx/variable: remove further skipinit (#36199)
ref pingcap/tidb#35051
2022-08-10 14:22:48 +08:00
244b353a11 planner: support session level for the variable tidb_enable_prepared_plan_cache (#36923)
ref pingcap/tidb#36598
2022-08-08 11:18:47 +08:00
6be08109fb variable: Remove WARN for variable tidb_enable_noop_variable (#36890)
close pingcap/tidb#36647
2022-08-05 14:26:06 +08:00
0a8611ddfe sysvar: add parsing phase for setting 'init_connect' (#36865)
close pingcap/tidb#35324
2022-08-05 12:42:06 +08:00
5ef18981cc Revert "planner: refactor the IsolationReadEngines variable for plan cache" (#36873) 2022-08-04 10:30:06 +08:00
bd3d138049 planner: remove the useless variable tidb_enable_point_get_cache (#36844)
close pingcap/tidb#36598
2022-08-03 20:20:05 +08:00
3847d9e56f planner: refactor the IsolationReadEngines variable for plan cache (#36770)
ref pingcap/tidb#36598
2022-08-03 19:44:05 +08:00
6a6fa8a882 ddl: Add sql_require_primary_key sysvar (#36146)
close pingcap/tidb#28544
2022-08-03 17:20:06 +08:00
c060208b2f *: move config file option oom-use-tmp-storage to sysvar (#36679)
ref pingcap/tidb#33769
2022-08-02 16:58:05 +08:00
0b1d3e0da3 *: cleanup sysvar API usage (#36640)
close pingcap/tidb#36639
2022-08-02 07:54:04 +08:00
fc217d432c config, sysvar: add config instance.enable_ddl and sysvar tidb_enable_ddl (#35425)
ref pingcap/tidb#34960
2022-08-01 15:02:06 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
1cd8c31b1a session: fix auto commit variable change effect on transaction commit (#36631)
close pingcap/tidb#36581
2022-08-01 09:36:04 +08:00
8e77ce264c *: introduce @@tidb_max_paging_size system variable for tuning (#36599)
close pingcap/tidb#36328
2022-07-29 15:29:12 +08:00
b0c6c5afa7 *: cleanup default sysvar value usage (#36487)
close pingcap/tidb#36485
2022-07-26 19:51:10 +08:00
f0717dfe07 statistics, sessionctx: introduce topn assisted cardinality estimation for string matching functions (#36210)
close pingcap/tidb#36209
2022-07-20 21:55:09 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
fbbae462f1 planner: expose two variables related to the cost model (#36356)
ref pingcap/tidb#35240
2022-07-20 20:45:09 +08:00
fd6f5dd798 *: GC-aware memory track for analyze (#35248)
close pingcap/tidb#34996
2022-07-20 20:17:09 +08:00
a52656fde4 *: add binary plan in stmt summary and slow log/query (#35698)
close pingcap/tidb#35889
2022-07-20 18:21:09 +08:00
d00b984f4c executor, statistics: analyze use MaxUint64 ts to read data (#35232)
close pingcap/tidb#35233
2022-07-20 16:09:08 +08:00
afd71bdefd executor: support dispatch cop request to closest replica adaptively (#35927)
ref pingcap/tidb#35926
2022-07-19 17:59:07 +08:00
67be460efe planner: enable the new cost interface by default (#36241)
ref pingcap/tidb#35240
2022-07-18 21:21:08 +08:00
c28bac3d72 planner: support rewrite for skew group distinct aggregate to avoid skew execution (#36181)
close pingcap/tidb#36169
2022-07-18 15:29:07 +08:00
9a2ed52119 server, sessionctx: support token-based authentication (#36152)
close pingcap/tidb#35913
2022-07-14 18:29:06 +08:00
2193bfe3b7 *: remove system var tidb_enable_change_multi_schema (#36167)
ref pingcap/tidb#14766
2022-07-14 10:37:05 +08:00