Commit Graph

1467 Commits

Author SHA1 Message Date
2aa64f562b test: stabilize leak test (#19526) 2020-08-27 16:39:27 +08:00
db3c96b3ff executor: add transaction commit runtime information in slow log (#19366) 2020-08-27 16:18:47 +08:00
b78f4896fe statistics, util/ranger: improve selectivity calculation for DNF filters (#18741) 2020-08-27 15:40:12 +08:00
933c0667bf executor: reduce parameter count for detach ranges methods (#19486)
* executor:  add merge flag

* use fields to pass more params

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-27 10:28:52 +08:00
945f7cc4a0 ddl, tables: support the column type change between the integer types (#19059) 2020-08-26 21:30:14 +08:00
cf0297590e server: fix region table http response (#19437)
Signed-off-by: disksing <i@disksing.com>
2020-08-26 20:50:52 +08:00
eff7837795 executor: support 'recover index' in clustered index tables (#19284)
* support 'recover index' in clustered index table

* ddl: add truncate to buildCommonHandleFromChunkRow

* executor: truncate the updated handle

* executor: set core.HandleCols in the initialization of RecoverIndexExec

* refine code

* remove unused code

* fix integration test

* fix integration test

* address comment

* early return when recovering clustered pk

* remove panic

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 11:51:52 +08:00
d355b82f1c expression: unicode_ci support when infer collation and charset information (#19142)
* add mix unicode_ci collation support

* comments change

* bug fix

* add test

* refactor illegal mix collation message

* fmt

* fix check

* fmt

* refactor infer collation

* refactor infer collation

* add charset info

* address comments

* return bin if something wrong

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 11:08:21 +08:00
1b56a070eb util: fix typo s/goods/good and update some function (#17612) 2020-08-25 22:34:32 +08:00
xhe
963b82a0d7 tidb-server: try best to get a meaningful IP (#18786) 2020-08-25 16:18:04 +08:00
e6a69309a5 range: build right range for NULL value on index column (#19385) 2020-08-25 13:55:49 +08:00
2f100eca2b config: Add labels configuration (#19212)
* add labels

* add config test

* fmt file

* add test and example

* add intergration test

* add comment

* address the comment

* solve test error

* address the comment

* fix comment

* fix comment error

* remove example

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-24 19:17:51 +08:00
9620b710a0 executor: fix log desensitization bug in prestmt (#19392) 2020-08-24 17:31:51 +08:00
0d997f2b8b update pd / br / unistore / tidb-tools dependencies (#19323) 2020-08-20 16:55:34 +08:00
4774cb9505 util: add encryptWriter/Reader interface to support encrypt spilled file (#19070) 2020-08-19 21:21:32 +08:00
a2e2ce6339 *: use int instead of fmt.Stringer as executor id (#19207) 2020-08-19 13:39:31 +08:00
cd8654fe6f ranger: support using nulleq conditions to calculate index ranges (#19035) 2020-08-19 12:45:24 +08:00
92513a2f4d util: create the tmpdir if the directory is removed by mistake. (#18970) 2020-08-18 22:10:44 +08:00
ea3da25984 *: record more rpc runtime information in cop runtime stats (#18916) 2020-08-18 16:34:07 +08:00
4f96c84637 util/rowcodec: make IsRowKey() recognize common handles (#19228) 2020-08-17 13:48:28 +08:00
5184a0d706 executor: fix the bug: can not join if join keys are type bigint and type bit (#19032)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-14 19:44:48 +08:00
37984d7cb0 tests: improve tests for Windows platform (#19088)
* tests: improve tests for Windows platform

* fix race build

* update badger to fix kill issue on Windows

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-13 17:17:19 +08:00
3f38fa5d02 executor, planner: enable duplication check on prefix clustered index (#19099)
* executor, planner: store clustered prefix index intact

* make fmt

* address comment

* decoding row value is prior than decoding key

* unexport DecodeHandleToDatum()

* make fmt

* address comments

* fix unit test: TestSplitRegionTimeout
2020-08-13 14:05:18 +08:00
148f2d456b planner: add store type to statement summary (#17825) 2020-08-12 19:28:17 +08:00
3b35c89958 util/ranger: fix explain does not display range[NULL, NULL] (#19028) (#19068) 2020-08-11 17:23:01 +08:00
xhe
a0160612a8 ddl: support ALTER PLACEMENT clause (#19065)
* ddl: check count here

* ddl: drop all rules that will be overrided

* ddl: change ID format

* ddl: local placement deifinition

* ddl: support `ALTER PLACEMENT` clause

* ddl: add test cases

* ddl: fix ID format

* ddl: copy comments too

* ddl: allow ignore replicas with dict constraints

* ddl: rename COUNT to REPLICAS

* ddl: clone method for RuleOp

* ddl: checkPlacementSpec => buildPlacementSpec

* ddl: remove TODO
It is possible to incrementally add replicas. Consider drop later. Let
us support it correctly first.

* ddl: ID format
Datbase/schema ID is added back. A common prefix will improve the
efficience of PD batch operation. Drop a whole db/table will only need
one loop for rules.

* ddl: move const/util to placement package

* ddl: fix test

* ddl: fix format error

* ddl: error check fix

* ddl: use an explicit condition flag

* ddl: adapt parser changes

* ddl: fix go.mod/simplify code path

* ddl: go mod tidy

* ddl: improve tests

* ddl: return new rules instead of appending

* ddl: return constraints instead of appending

* ddl: fix test

* ddl: one more test

* ddl: remove rules rollback, meaningless

* ddl: fix slice

* ddl: add period to comments

* Update ddl/ddl_api.go

Co-authored-by: tangenta <tangenta@126.com>

* ddl: remove unused arguments

* infosync: do not request PD if no ruleOperations

* ddl: a new test suite

Co-authored-by: tangenta <tangenta@126.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-11 15:05:05 +08:00
aa22a9088c util: make rowContainer can spill again after calling reset. (#19058) 2020-08-11 11:27:29 +08:00
07ae6078e8 *: support clustered index for fast analyze (#18767) 2020-08-07 19:22:14 +08:00
931ff98df5 simple fixes for the staticcheck linter (#18923)
Note that this found 2 bugs where errors were being silently ignored.

These are really simple fixes that didn't require much thought.
There are still more staticcheck warnings that should be fixed.

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-06 13:38:17 +08:00
cd3e5ed826 *: update kvproto, PD, BR and unistore dependencies (#18938) 2020-08-05 13:30:26 +08:00
xhe
4ef3b86e5a *: support ALTER PARTITION clause (#18611) 2020-08-04 10:15:13 +08:00
0887dc6c56 util: add checksumWriter/Reader interface to support evaluate checksum (#18649) 2020-08-03 21:50:04 +08:00
d0639b0056 *: use the newly designed memdb (#18657)
* *: use the newly designed memdb

* address comments

* remove duplicated comments

Co-authored-by: Evan Zhou <coocood@gmail.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-03 20:51:05 +08:00
950ca5062c plan: optimize the performance of decodePlan for big union query (#18891) 2020-08-03 14:17:36 +08:00
c7c98d7380 ddl: add addingDefinition field for adding partition replica check (#18495) 2020-07-29 17:08:26 +08:00
c7dcf9c542 util: fix a encode bug causes the wrong result of hashJoin with set and enum (#18855)
Signed-off-by: wjhuang2016 <huangwenjun1997@gmail.com>
2020-07-29 14:12:10 +08:00
f3554241bb planner, executor: support except and intersect set operator (#18459)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-27 17:56:07 +08:00
29178dfa8d planner, executor: support broadcast join for tiflash engine. (#17232)
* support batch cop for tiflash

* support batch cop

* support join push down to tiflash

* refine

* change pb

* push join

* fix

* add hint

* refine hint

* add ranges

* fix

* fix

* fix push down

* fix index

* enable distsql for join

* add a session var to disable/enable broadcast join

* fix bug

* fix bug

* tiny fix

* enable cast decimal pushdown to tiflash

* fix

* fix bc join bug

* make broadcast plan stable

* refine code

* fix bug

* basic support for multi table broadcast join

* fix bug

* basic cbo for broadcast join

* improve

* fix bug

* remote useless code

* add tests

* pass unit tests

* refine code

* support execute summary info for broadcast join

* fix bug in explain for broadcast join

* format code

* remove un-needed code

* fix make dev

* address comments

* Hanfei/join merge (#7)

* enable exec details for batch cop

* format code

* fix test

* change tidb_opt_broadcast_join to global vars

* Ban cartesian join to be pushed down to TiFlash (#8)

* merge master (#10)

* merge master

* fix bug

* fix bug

* fix ut

* check session var conflict

* Add perfer local hint for broadcast join (#12)

* update

* remove useless code

* remove useless code

* update parser

* add test for prefer local join

* use bcj_local

* update go.mod

* refine planner

* refine comments

* fix make dev

* fix make dev

* update parser

* address comments

* fix make dev

* disable broadcast join when new collation is enabled

* Update planner/core/exhaust_physical_plans.go

Co-authored-by: Zhuomin(Charming) Liu <lzmhhh123@gmail.com>

* address comments

* fix

* address comments

* fix tests

* address comments

Co-authored-by: xufei <xufeixw@mail.ustc.edu.cn>
Co-authored-by: xufei <xufei@pingcap.com>
Co-authored-by: 虎 <ichneumon.hu@foxmail.com>
Co-authored-by: Zhuomin(Charming) Liu <lzmhhh123@gmail.com>
2020-07-27 12:41:36 +08:00
b642045ff2 charset: add utf8_unicode_ci and utf8mb4_unicode_ci interface (#18678)
* add unicode_ci interface

* fix build

* fix check

* fix test

* change comments

* add test

* Update util/collate/unicode_ci.go

Co-authored-by: djshow832 <zhangming@pingcap.com>

Co-authored-by: djshow832 <zhangming@pingcap.com>
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: djshow832 <873581766@qq.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-24 17:16:03 +08:00
baf6c99b95 *: fix a bug causes indexed virtual generated column return wrong value and refine admin check table (#18408) 2020-07-24 12:59:47 +08:00
0b035c850a util: oom-action waits spilling result when acting again (#18381) 2020-07-23 14:08:20 +08:00
c84aa79970 *: simplify LIKE patterns with multiple consecutive wildcards (#17490) 2020-07-21 22:43:42 +08:00
af685f511f Revert "coprocessor: Exceed action for copiterator (#17324)" (#18706) 2020-07-21 15:21:20 +08:00
292dea768e util/ranger: extract DNF as equal access conditions for composite indexes (#18315)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-21 00:30:19 +08:00
ace80c7411 planner: apply min-max eliminator on common handle columns (#18589)
* planner: apply min-max eliminator on common handle columns

* reuse AccessPath.IsTablePath()

* planner: apply min-max eliminator on common handle columns

* address comments

* address comment

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-17 18:01:47 +08:00
f0e5876353 util/execdetails: refactor execdetails information of runtime collect (#18530) 2020-07-15 20:05:29 +08:00
761a961ba0 kv: refactor MemBuffer and reduce the memory usage (#18372) 2020-07-15 15:26:25 +08:00
8a6554a21f telemetry: disable telemetry by default for non-community edition (#18524)
Signed-off-by: Zheng Xiangsheng <hundundm@gmail.com>
2020-07-15 11:37:36 +08:00
b12f94b967 executor: fix mislead inconsistent log after Context.Cancel (#18537) 2020-07-14 20:21:41 +08:00
a6971dd685 *: support 'admin check table' on clustered index table (#18346) 2020-07-14 15:59:37 +08:00