f0717dfe07
statistics, sessionctx: introduce topn assisted cardinality estimation for string matching functions ( #36210 )
...
close pingcap/tidb#36209
2022-07-20 21:55:09 +08:00
ab513bf0ca
ddl: support concurrent ddl ( #32169 )
...
* 1. init ddl tables
create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table
* 2. setup concurrent ddl env and add ddl worker pool
adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute
* 3. add ddl manager to handle ddl job
* 4. reorg handler for concurrent ddl
just implements the partner of the reorg information.
* 5. manage ddl jobs for concurrent ddl
add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller
* 6. add metrics for concurrent ddl
add metrics
* 7. support multiple tables
* 8. fix test
* 9. migrate ddl between table and queue
support switch between the old and new ddl framework, migrate the existing ddl job between queue and table
* 10. check tikv version and set reorg worker count according cpu count
* *: add featuretag on tests
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com >
* use a determined table id for 3 tables
* remove ctx value
* add GetSchemaVersionWithNonEmptyDiff function
* address tangenta and zimulala comment
* use only one etcd path
* make ActionRenameTable support multi-schema
* reset sql digest to make top sql work correct
* add comment
* fix test
* remove 0 for schema version lock
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com >
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io >
Co-authored-by: wjHuang <huangwenjun1997@gmail.com >
2022-07-20 21:20:07 +08:00
fbbae462f1
planner: expose two variables related to the cost model ( #36356 )
...
ref pingcap/tidb#35240
2022-07-20 20:45:09 +08:00
fd6f5dd798
*: GC-aware memory track for analyze ( #35248 )
...
close pingcap/tidb#34996
2022-07-20 20:17:09 +08:00
a52656fde4
*: add binary plan in stmt summary and slow log/query ( #35698 )
...
close pingcap/tidb#35889
2022-07-20 18:21:09 +08:00
d00b984f4c
executor, statistics: analyze use MaxUint64 ts to read data ( #35232 )
...
close pingcap/tidb#35233
2022-07-20 16:09:08 +08:00
afd71bdefd
executor: support dispatch cop request to closest replica adaptively ( #35927 )
...
ref pingcap/tidb#35926
2022-07-19 17:59:07 +08:00
67be460efe
planner: enable the new cost interface by default ( #36241 )
...
ref pingcap/tidb#35240
2022-07-18 21:21:08 +08:00
c28bac3d72
planner: support rewrite for skew group distinct aggregate to avoid skew execution ( #36181 )
...
close pingcap/tidb#36169
2022-07-18 15:29:07 +08:00
fa00fc5cd5
*: set fine grain timeout and update bazel config ( #36220 )
2022-07-15 11:11:05 +08:00
9a2ed52119
server, sessionctx: support token-based authentication ( #36152 )
...
close pingcap/tidb#35913
2022-07-14 18:29:06 +08:00
2193bfe3b7
*: remove system var tidb_enable_change_multi_schema ( #36167 )
...
ref pingcap/tidb#14766
2022-07-14 10:37:05 +08:00
0b427e1fd6
*: add tidb_min_paging_size system variable ( #36107 )
...
close pingcap/tidb#36106
2022-07-13 22:27:05 +08:00
bdc6397023
executor: support tidb memory debug mode ( #35322 )
...
ref pingcap/tidb#33877
2022-07-13 12:33:06 +08:00
dced89a231
planner/core, planner, sessionctx/variable: remove more skipInit ( #35992 )
...
ref pingcap/tidb#35051
2022-07-13 11:27:05 +08:00
2eb101abcf
sessionctx/variable: remove skipInit from non-session scoped variables ( #35801 )
...
ref pingcap/tidb#35051
2022-07-07 00:01:02 +08:00
a5e973ca5a
sessionctx/variable: convert TiDBLogFileMaxDays and TiDBConfig to ScopeInstance ( #35733 )
...
close pingcap/tidb#35190
2022-07-06 17:11:02 +08:00
b40fc86538
session, sessionctx/variable: ensure sysvars are always in lower case ( #35659 )
...
close pingcap/tidb#35658
2022-07-06 16:49:02 +08:00
55aea2787d
*: use pdqsort to improve sort performance ( #34404 )
...
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
cdde0398fe
sessionctx,kv,planner: add system variable for fine_grained_shuffle ( #35256 )
...
close pingcap/tidb#35342
2022-07-06 10:27:02 +08:00
65e0b8e541
client: KV requests with source label ( #34833 )
...
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
323411dda4
*: remove support for hidden sysvars ( #35740 )
...
close pingcap/tidb#35735
2022-07-01 14:28:40 +08:00
16df1942d0
*: add timeout for test cases ( #35844 )
2022-06-30 20:18:38 +08:00
4fc86936ff
sessionctx: support encoding and decoding prepared statements ( #35808 )
...
close pingcap/tidb#35689
2022-06-30 11:56:38 +08:00
27e7bbdd4e
sessionctx/variable: add tests to ensure skipInit can be removed ( #35703 )
...
ref pingcap/tidb#35051
2022-06-28 16:40:40 +08:00
31c92c67bc
sessionctx: support encoding and decoding statement context ( #35688 )
...
close pingcap/tidb#35664
2022-06-27 12:20:39 +08:00
e2b55640c1
config, sysvar: map max-server-connections to max_connections ( #35453 )
...
ref pingcap/tidb#34960
2022-06-23 15:12:37 +08:00
e99d82a9b4
*: fix issue of cast string as time is incompatible with MySQL ( #35455 )
...
close pingcap/tidb#34539
2022-06-23 13:50:37 +08:00
e44277d8fe
sessionctx: support encoding and decoding session contexts ( #35648 )
...
close pingcap/tidb#35573
2022-06-23 12:46:36 +08:00
193f04db70
session,sessionctx: enable tidb_enable_paging by default ( #35275 )
...
close pingcap/tidb#35273
2022-06-23 08:32:37 +08:00
e0527ba27c
sessionctx: support encoding and decoding session variables ( #35531 )
...
close pingcap/tidb#35414
2022-06-21 19:20:36 +08:00
f89466daa2
sessionctx: set skipInit false for TiDBOptProjectionPushDown and TiDBOptAggPushDown ( #35491 )
...
close pingcap/tidb#35083
2022-06-21 15:38:37 +08:00
5c9ad77ae1
*: add support for disabling noop variables ( #35496 )
...
close pingcap/tidb#8895
2022-06-21 14:10:36 +08:00
44623f03f4
*: enable more flaky and update bazel config ( #35500 )
...
ref pingcap/tidb#35247
2022-06-20 21:46:37 +08:00
79d9d6fa75
executor, sessionctx/variable: convert some system variables to different builtin types ( #35143 )
...
close pingcap/tidb#35048
2022-06-17 02:34:34 +08:00
081bd10d54
system_variables: remove the limitation for set tidb_gc_life_time ( #35411 )
...
close pingcap/tidb#35392
2022-06-16 18:18:35 +08:00
4fc9551dd1
sessionctx, types, executor: support encoding and decoding user-defined variables ( #35343 )
...
close pingcap/tidb#35288
2022-06-15 21:02:34 +08:00
017ac90e67
planner: introduce some new variables for the cost model version2 ( #35241 )
...
ref pingcap/tidb#35240
2022-06-09 17:52:30 +08:00
4d8cf5e1e2
metrics: add a config to unregister the unused metrics ( #34990 )
...
close pingcap/tidb#34989
2022-06-09 15:34:31 +08:00
c8fcad4d82
planner: refactor to use the standard function GetXXFactor() to get cost model factors ( #35226 )
...
ref pingcap/tidb#33945
2022-06-08 16:10:30 +08:00
2b4a4c6d7a
*: support bazel ( #33691 )
...
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
7ffab33a47
variables: add concurrent DDL switch ( #35028 )
...
ref pingcap/tidb#32031
2022-06-06 14:56:29 +08:00
233a7335fd
sessionctx/variable, ddl: fix sysvar API usage ( #35052 )
...
ref pingcap/tidb#35051
2022-06-06 10:34:29 +08:00
22e9f4dc9e
txn: Provide PessimisticRCTxnContextProvider for RC isolation ( #34702 )
...
close pingcap/tidb#34746
2022-06-02 15:36:28 +08:00
69b573ca7d
executor: fix compatibility issue of release savepoint ( #35064 )
...
close pingcap/tidb#35063
2022-06-01 15:20:27 +08:00
e2fd394fbf
table partition: add more warnings to inform the user that setting TiDB partition prune mode to dynamic at session level ( #35046 )
...
close pingcap/tidb#35042
2022-05-31 18:04:27 +08:00
b598bd2214
*: support savepoint in transaction ( #34466 )
...
close pingcap/tidb#6840
2022-05-30 14:38:27 +08:00
dfb22c064d
config, executor, sessionctx/variable: Remove old config items ( #34927 )
...
close pingcap/tidb#34867 , close pingcap/tidb#34879 , close pingcap/tidb#34945
2022-05-29 05:22:48 +08:00
43f83c0799
*: kill auto analyze when it runs too long ( #34950 )
...
close pingcap/tidb#34952
2022-05-27 13:36:47 +08:00
dae0a4104a
sessionctx: enable list partition by default ( #34954 )
...
close pingcap/tidb#34953
2022-05-27 12:22:47 +08:00
