Commit Graph

672 Commits

Author SHA1 Message Date
ceddc106f0 executor,planner/core,util/plancodec: extend executor.ShuffleExec and planner.core.PhysicalShuffle to support multiple data sources (#20942) 2020-11-24 10:59:03 +08:00
41786cb976 *: seperate hash keys from join keys in IndexJoin (#20761) 2020-11-16 16:24:51 +08:00
4e1cbca5c2 executor: fix panic when set partition handle for index join (#20551) 2020-11-05 14:21:35 +08:00
272f964031 executor: support global kill (#17649) 2020-10-27 19:39:20 +08:00
9660283d2d infoschema: Provide a system table to query placement rules (#20616) 2020-10-27 14:35:38 +08:00
0d613a2dfa [executor, store/tikv]: implement a prototype for MPP framework. (#19954) 2020-10-26 14:46:47 +08:00
5738191a23 *: clean some stuff related to dirtyTable (#20554)
Signed-off-by: wjhuang2016 <huangwenjun1997@gmail.com>
2020-10-21 12:19:26 +08:00
4501f6d7ab planner, executor: enable inline projection for Limit (#20288) 2020-10-19 10:55:13 +08:00
50f5ddc70e executor,distsql: support multiple physical tables in one table reader (#20404) 2020-10-14 20:05:26 +08:00
dcefa58035 *: use global stats & make ddl/feedback/show/export works(part III) (#20271) 2020-10-14 16:11:33 +08:00
170e2fec92 *: collect multiple partitions and store in tidb (part II) (#19899) 2020-09-29 21:25:56 +08:00
132d9817d7 executor: support partition pruning for IndexJoin inner table (#19990) 2020-09-29 11:08:53 +08:00
0b7c7167d1 planner,executor: support global index for IndexScan and IndexLookUpReader (#19821) 2020-09-24 20:50:28 +08:00
640cb42f54 executor: do not reorder handles when building requests for IndexMergeJoin (#20138) 2020-09-22 15:11:59 +08:00
2a3a5ab076 *: disable new partition prune in master distribution (#19911) 2020-09-14 16:26:54 +08:00
2836011470 executor, planner: refactor analyze tableID to analyzeTableID & add CanRuntimePrune (#19846)
* executor, planner:  refactor analyze tableID to analyzeTableID

* *: add util to help decide whether use new runtime prune partition executor

* address comments

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-08 23:49:39 +08:00
354f3997c0 executor: add concurrency limit on union executor (#19827) 2020-09-08 19:16:23 +08:00
a961a70c53 executor: fix fast analyze race condition on session ctx (#19716)
* executor:  fix fast analyze race condition on session

* unify return error

* make lint happy

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-07 14:35:21 +08:00
ce849c3e19 *: remove DirtyDB and DirtyTable to reduce memory usage (#19042) 2020-09-04 16:50:36 +08:00
6fdd609c00 privilege: fix user change after show grants and add user existed check for show grants (#19568)
* fix show grant change user object and add check

* fix lint

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-28 20:54:21 +08:00
127c3aa61d executor: support admin cleanup for clustered index table (#19522)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-28 11:46:52 +08:00
933c0667bf executor: reduce parameter count for detach ranges methods (#19486)
* executor:  add merge flag

* use fields to pass more params

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-27 10:28:52 +08:00
ce1ad327d7 executor: fix wrong results when index join on union scan partition table (#19436)
* executor: fix wrong results when index join on union scan new parition table

* move partitionTableReader inner buildUnionScanFromReader

* fix conflicts

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 15:51:22 +08:00
c8f436cbc6 executor : refine partition table read for tiflash table read (#19406)
* executor : refine partition table read for tiflash table read

* refine code

* address comments

* fix ci

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 14:29:51 +08:00
eff7837795 executor: support 'recover index' in clustered index tables (#19284)
* support 'recover index' in clustered index table

* ddl: add truncate to buildCommonHandleFromChunkRow

* executor: truncate the updated handle

* executor: set core.HandleCols in the initialization of RecoverIndexExec

* refine code

* remove unused code

* fix integration test

* fix integration test

* address comment

* early return when recovering clustered pk

* remove panic

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 11:51:52 +08:00
3ac0baf61c *: fix unable prune problem caused by mismatch column infos (#19391) 2020-08-25 12:24:48 +08:00
74ef1a2f9c executor: fix build union-scan for index-join on patitioned tables (#19333) 2020-08-21 15:52:36 +08:00
47526d3986 executor: fix build table reader for index join on partition table (#19210) 2020-08-20 10:03:15 +08:00
a2e2ce6339 *: use int instead of fmt.Stringer as executor id (#19207) 2020-08-19 13:39:31 +08:00
783d2f0ea9 executor: fix bug of tiflash executing apply (#19182)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-14 14:54:48 +08:00
3f38fa5d02 executor, planner: enable duplication check on prefix clustered index (#19099)
* executor, planner: store clustered prefix index intact

* make fmt

* address comment

* decoding row value is prior than decoding key

* unexport DecodeHandleToDatum()

* make fmt

* address comments

* fix unit test: TestSplitRegionTimeout
2020-08-13 14:05:18 +08:00
ed4004ac04 executor: fix apply with union scan and point batch point get (#19128) 2020-08-12 10:49:30 +08:00
d81150394f executor: fix cluster index encode wrong key in plan cached point get (#19033)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-10 14:44:14 +08:00
07ae6078e8 *: support clustered index for fast analyze (#18767) 2020-08-07 19:22:14 +08:00
3df573d2fc planner,executor: use new table partition implementation and fix CI (#18981) 2020-08-06 17:50:40 +08:00
f3abdb027f executor: handle index join for the new partition table implementation (#18862)
* planner,executor: implement PartitionTable executor for the three reader

* add the new file

* make fmt

* forget to add the test file to git

* fix a tiny bug

* executor: handle partition table for index join

* make golint happy
2020-08-05 10:42:18 +08:00
4e829aaee7 planner,executor: fix index merge for partition table (#18940)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-04 20:38:17 +08:00
5f393fde7e *: support user defined variable and SET clause in LOAD DATA statement (#18753) 2020-08-03 10:42:10 +08:00
5dd7cd8553 planner/core: implement Explain for the new partition table (#18834)
Co-authored-by: lysu <sulifx@gmail.com>
2020-07-30 15:37:02 +08:00
a1dc4381c5 planner,executor: implement PartitionTable executor for the three reader (#18823) 2020-07-30 11:00:55 +08:00
6ce8f0f56a txn: support pessimistic transaction amend for specific ddls (#18447) 2020-07-29 11:35:31 +08:00
8b19d67bad executor: add runtime information for point-get executor (#18666) 2020-07-28 14:20:36 +08:00
56fd348d20 executor: support index merge on cluster index (#18699)
* executor: support index merge on cluster index

* fix fmt

* fix

* fix

* fix

* fix

* address comments

* address comments

* address comments

* fix

* fix

* fix

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-27 18:09:32 +08:00
f3554241bb planner, executor: support except and intersect set operator (#18459)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-27 17:56:07 +08:00
f6ef1c371f executor: implement parallel apply (#18044) 2020-07-27 17:49:28 +08:00
29178dfa8d planner, executor: support broadcast join for tiflash engine. (#17232)
* support batch cop for tiflash

* support batch cop

* support join push down to tiflash

* refine

* change pb

* push join

* fix

* add hint

* refine hint

* add ranges

* fix

* fix

* fix push down

* fix index

* enable distsql for join

* add a session var to disable/enable broadcast join

* fix bug

* fix bug

* tiny fix

* enable cast decimal pushdown to tiflash

* fix

* fix bc join bug

* make broadcast plan stable

* refine code

* fix bug

* basic support for multi table broadcast join

* fix bug

* basic cbo for broadcast join

* improve

* fix bug

* remote useless code

* add tests

* pass unit tests

* refine code

* support execute summary info for broadcast join

* fix bug in explain for broadcast join

* format code

* remove un-needed code

* fix make dev

* address comments

* Hanfei/join merge (#7)

* enable exec details for batch cop

* format code

* fix test

* change tidb_opt_broadcast_join to global vars

* Ban cartesian join to be pushed down to TiFlash (#8)

* merge master (#10)

* merge master

* fix bug

* fix bug

* fix ut

* check session var conflict

* Add perfer local hint for broadcast join (#12)

* update

* remove useless code

* remove useless code

* update parser

* add test for prefer local join

* use bcj_local

* update go.mod

* refine planner

* refine comments

* fix make dev

* fix make dev

* update parser

* address comments

* fix make dev

* disable broadcast join when new collation is enabled

* Update planner/core/exhaust_physical_plans.go

Co-authored-by: Zhuomin(Charming) Liu <lzmhhh123@gmail.com>

* address comments

* fix

* address comments

* fix tests

* address comments

Co-authored-by: xufei <xufeixw@mail.ustc.edu.cn>
Co-authored-by: xufei <xufei@pingcap.com>
Co-authored-by: 虎 <ichneumon.hu@foxmail.com>
Co-authored-by: Zhuomin(Charming) Liu <lzmhhh123@gmail.com>
2020-07-27 12:41:36 +08:00
baf6c99b95 *: fix a bug causes indexed virtual generated column return wrong value and refine admin check table (#18408) 2020-07-24 12:59:47 +08:00
a6971dd685 *: support 'admin check table' on clustered index table (#18346) 2020-07-14 15:59:37 +08:00
77aecd4b27 executor, planner: support split table regions on clustered index (#18465) 2020-07-13 21:40:40 +08:00
ff94f2be2d information: Fix issue of query information_schema.columns cost too much memory when there are lots of tables in TiDB (#18362) 2020-07-08 14:23:00 +08:00