Commit Graph

657 Commits

Author SHA1 Message Date
2836011470 executor, planner: refactor analyze tableID to analyzeTableID & add CanRuntimePrune (#19846)
* executor, planner:  refactor analyze tableID to analyzeTableID

* *: add util to help decide whether use new runtime prune partition executor

* address comments

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-08 23:49:39 +08:00
354f3997c0 executor: add concurrency limit on union executor (#19827) 2020-09-08 19:16:23 +08:00
a961a70c53 executor: fix fast analyze race condition on session ctx (#19716)
* executor:  fix fast analyze race condition on session

* unify return error

* make lint happy

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-07 14:35:21 +08:00
ce849c3e19 *: remove DirtyDB and DirtyTable to reduce memory usage (#19042) 2020-09-04 16:50:36 +08:00
6fdd609c00 privilege: fix user change after show grants and add user existed check for show grants (#19568)
* fix show grant change user object and add check

* fix lint

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-28 20:54:21 +08:00
127c3aa61d executor: support admin cleanup for clustered index table (#19522)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-28 11:46:52 +08:00
933c0667bf executor: reduce parameter count for detach ranges methods (#19486)
* executor:  add merge flag

* use fields to pass more params

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-27 10:28:52 +08:00
ce1ad327d7 executor: fix wrong results when index join on union scan partition table (#19436)
* executor: fix wrong results when index join on union scan new parition table

* move partitionTableReader inner buildUnionScanFromReader

* fix conflicts

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 15:51:22 +08:00
c8f436cbc6 executor : refine partition table read for tiflash table read (#19406)
* executor : refine partition table read for tiflash table read

* refine code

* address comments

* fix ci

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 14:29:51 +08:00
eff7837795 executor: support 'recover index' in clustered index tables (#19284)
* support 'recover index' in clustered index table

* ddl: add truncate to buildCommonHandleFromChunkRow

* executor: truncate the updated handle

* executor: set core.HandleCols in the initialization of RecoverIndexExec

* refine code

* remove unused code

* fix integration test

* fix integration test

* address comment

* early return when recovering clustered pk

* remove panic

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 11:51:52 +08:00
3ac0baf61c *: fix unable prune problem caused by mismatch column infos (#19391) 2020-08-25 12:24:48 +08:00
74ef1a2f9c executor: fix build union-scan for index-join on patitioned tables (#19333) 2020-08-21 15:52:36 +08:00
47526d3986 executor: fix build table reader for index join on partition table (#19210) 2020-08-20 10:03:15 +08:00
a2e2ce6339 *: use int instead of fmt.Stringer as executor id (#19207) 2020-08-19 13:39:31 +08:00
783d2f0ea9 executor: fix bug of tiflash executing apply (#19182)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-14 14:54:48 +08:00
3f38fa5d02 executor, planner: enable duplication check on prefix clustered index (#19099)
* executor, planner: store clustered prefix index intact

* make fmt

* address comment

* decoding row value is prior than decoding key

* unexport DecodeHandleToDatum()

* make fmt

* address comments

* fix unit test: TestSplitRegionTimeout
2020-08-13 14:05:18 +08:00
ed4004ac04 executor: fix apply with union scan and point batch point get (#19128) 2020-08-12 10:49:30 +08:00
d81150394f executor: fix cluster index encode wrong key in plan cached point get (#19033)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-10 14:44:14 +08:00
07ae6078e8 *: support clustered index for fast analyze (#18767) 2020-08-07 19:22:14 +08:00
3df573d2fc planner,executor: use new table partition implementation and fix CI (#18981) 2020-08-06 17:50:40 +08:00
f3abdb027f executor: handle index join for the new partition table implementation (#18862)
* planner,executor: implement PartitionTable executor for the three reader

* add the new file

* make fmt

* forget to add the test file to git

* fix a tiny bug

* executor: handle partition table for index join

* make golint happy
2020-08-05 10:42:18 +08:00
4e829aaee7 planner,executor: fix index merge for partition table (#18940)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-04 20:38:17 +08:00
5f393fde7e *: support user defined variable and SET clause in LOAD DATA statement (#18753) 2020-08-03 10:42:10 +08:00
5dd7cd8553 planner/core: implement Explain for the new partition table (#18834)
Co-authored-by: lysu <sulifx@gmail.com>
2020-07-30 15:37:02 +08:00
a1dc4381c5 planner,executor: implement PartitionTable executor for the three reader (#18823) 2020-07-30 11:00:55 +08:00
6ce8f0f56a txn: support pessimistic transaction amend for specific ddls (#18447) 2020-07-29 11:35:31 +08:00
8b19d67bad executor: add runtime information for point-get executor (#18666) 2020-07-28 14:20:36 +08:00
56fd348d20 executor: support index merge on cluster index (#18699)
* executor: support index merge on cluster index

* fix fmt

* fix

* fix

* fix

* fix

* address comments

* address comments

* address comments

* fix

* fix

* fix

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-27 18:09:32 +08:00
f3554241bb planner, executor: support except and intersect set operator (#18459)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-27 17:56:07 +08:00
f6ef1c371f executor: implement parallel apply (#18044) 2020-07-27 17:49:28 +08:00
29178dfa8d planner, executor: support broadcast join for tiflash engine. (#17232)
* support batch cop for tiflash

* support batch cop

* support join push down to tiflash

* refine

* change pb

* push join

* fix

* add hint

* refine hint

* add ranges

* fix

* fix

* fix push down

* fix index

* enable distsql for join

* add a session var to disable/enable broadcast join

* fix bug

* fix bug

* tiny fix

* enable cast decimal pushdown to tiflash

* fix

* fix bc join bug

* make broadcast plan stable

* refine code

* fix bug

* basic support for multi table broadcast join

* fix bug

* basic cbo for broadcast join

* improve

* fix bug

* remote useless code

* add tests

* pass unit tests

* refine code

* support execute summary info for broadcast join

* fix bug in explain for broadcast join

* format code

* remove un-needed code

* fix make dev

* address comments

* Hanfei/join merge (#7)

* enable exec details for batch cop

* format code

* fix test

* change tidb_opt_broadcast_join to global vars

* Ban cartesian join to be pushed down to TiFlash (#8)

* merge master (#10)

* merge master

* fix bug

* fix bug

* fix ut

* check session var conflict

* Add perfer local hint for broadcast join (#12)

* update

* remove useless code

* remove useless code

* update parser

* add test for prefer local join

* use bcj_local

* update go.mod

* refine planner

* refine comments

* fix make dev

* fix make dev

* update parser

* address comments

* fix make dev

* disable broadcast join when new collation is enabled

* Update planner/core/exhaust_physical_plans.go

Co-authored-by: Zhuomin(Charming) Liu <lzmhhh123@gmail.com>

* address comments

* fix

* address comments

* fix tests

* address comments

Co-authored-by: xufei <xufeixw@mail.ustc.edu.cn>
Co-authored-by: xufei <xufei@pingcap.com>
Co-authored-by: 虎 <ichneumon.hu@foxmail.com>
Co-authored-by: Zhuomin(Charming) Liu <lzmhhh123@gmail.com>
2020-07-27 12:41:36 +08:00
baf6c99b95 *: fix a bug causes indexed virtual generated column return wrong value and refine admin check table (#18408) 2020-07-24 12:59:47 +08:00
a6971dd685 *: support 'admin check table' on clustered index table (#18346) 2020-07-14 15:59:37 +08:00
77aecd4b27 executor, planner: support split table regions on clustered index (#18465) 2020-07-13 21:40:40 +08:00
ff94f2be2d information: Fix issue of query information_schema.columns cost too much memory when there are lots of tables in TiDB (#18362) 2020-07-08 14:23:00 +08:00
5f983b860f planner,executor,infoschema: add system tables tiflash_tables and tiflash_segments (#18092) 2020-07-07 21:45:59 +08:00
658132fcf3 planner: refactor handle columns (#18391) 2020-07-07 12:26:14 +08:00
b178de06ad executor: Trace the memory usage of AggFunc in HashAggExec (#18257) 2020-07-06 20:48:41 +08:00
daad2699dd *: support clustered index for index join (#18204) 2020-07-01 16:15:51 +08:00
3b63270909 telemetry: Add telemetry initial implementation (#18180)
Signed-off-by: Breezewish <me@breeswish.org>

Co-authored-by: crazycs <crazycs520@gmail.com>
Co-authored-by: Lynn <zimu_xia@126.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-06-24 14:41:46 +08:00
5250f7f53f *: support clustered index in double read (#18127) 2020-06-23 15:33:38 +08:00
c98514e751 executor: unify executor concurrency (#16999) 2020-06-22 17:39:32 +08:00
7daa4a7f88 *: fix bugs that creating index on clustered index table or table with the virtual generated column (#18114) 2020-06-19 19:58:37 +08:00
ad598e431a executor: add the cache for apply executor (#17039) 2020-06-17 21:24:12 +08:00
8943b1edc4 *: fix analyze on clustered index miss some handle columns (#18004) 2020-06-15 15:43:13 +08:00
7c3e9d2427 *: support analyze on cluster index (#17895) 2020-06-15 10:51:33 +08:00
b2922a7098 executor: remove unused code (#17923)
Signed-off-by: wjhuang2016 <huangwenjun1997@gmail.com>
2020-06-11 02:16:42 +08:00
c9c9f873e9 planner: do correlated column's datum match in physical optimize phase (#17578) 2020-06-09 14:56:38 +08:00
88dfb22dc5 executor: support batch-get cluster index & add test case (#17858) 2020-06-09 13:40:47 +08:00
b05327509c session/statistics: discard feedbacks from delete / update (#17452) 2020-06-08 14:34:58 +08:00