Commit Graph

135 Commits

Author SHA1 Message Date
bada2801ac *: fix cop task runtime information is wrong in the concurrent executor (#19849)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-09-11 14:14:37 +08:00
221223b46b executor: add more runtime information for join executor (#19721)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-09-07 14:53:20 +08:00
1e9b519ff7 executor: clean outerMatchedStatus when HashJoin.Close is called (#19510) 2020-08-31 14:45:04 +08:00
e356136b72 *: annotate execution info in runtime/trace (#19407)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-27 11:23:36 +08:00
a2e2ce6339 *: use int instead of fmt.Stringer as executor id (#19207) 2020-08-19 13:39:31 +08:00
b8670fb231 executor: implement a concurrent hash table for Concurrent build (#16678)
* refine code of unsafeHashTable

* refine unsafeHashTable

* concurrentMapHashTable is ok

* update comments

* add comments

* add comments

* update make slickes

* update according to comments

* add comments

* update according to comments from liyuan

* remove useless estRows

* update test because the output of INL_hash_join does not promose order

* update testConcurrentMap

* update imports

* update test

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-10 19:32:19 +08:00
f3554241bb planner, executor: support except and intersect set operator (#18459)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-27 17:56:07 +08:00
f0e5876353 util/execdetails: refactor execdetails information of runtime collect (#18530) 2020-07-15 20:05:29 +08:00
9d9f330a4b executor, util: fix spilling disk when oom. (#16895) 2020-06-30 16:32:14 +08:00
ad598e431a executor: add the cache for apply executor (#17039) 2020-06-17 21:24:12 +08:00
0d95b09e8a executor: Remove unnecessary information in explain analyze output (#16248) 2020-05-21 19:26:00 +08:00
e90aac2710 executor: add config EnableCollectExecutionInfo (#15493) 2020-04-13 20:45:25 +08:00
bce2d39d17 executor: fix naming of a confusing variable (#15797) 2020-03-30 09:38:15 +08:00
574a014f70 *: deprecate system variables tidb_mem_quota_XXX (#15084) 2020-03-10 15:57:03 +08:00
2c5170875d collation: add some collation tests for HashJoinExec, MergeJoinExec and SelectExec (#15067) 2020-03-03 17:33:18 +08:00
a4e8341add executor: fix offset of outerMatchStatus for outer hash join (#14773) 2020-02-13 18:57:04 +08:00
0f7a3e838c executor: fix hash join panic after killing (#14712) 2020-02-11 10:15:34 +08:00
f2d0e90740 executor: Count the number of hash table collisions and build elapse during Hash Join. (#14423) 2020-02-05 13:37:23 +08:00
72b1f0e7b8 executor: correctly handle panic for hashjoin build phase (#14056) 2020-02-05 12:23:23 +08:00
174ff27943 *: fix static check issues (#14286) 2020-01-06 16:07:15 +08:00
a487748b46 executor: support merge join on disk (#13946) 2019-12-31 18:49:10 +08:00
ebc4fa9dee executor: resort fields for reducing the memory allocated (#14208) 2019-12-31 17:19:59 +08:00
8fab2548d0 executor: show operators' disk consumption in results of EXPLAIN ANALYZE (#13764) 2019-12-02 17:04:29 +08:00
6a59557500 executor: show operators' concurrency information in results of EXPLAIN ANALYZE (#13539) 2019-11-27 16:46:25 +08:00
b84c5a73ad executor: implement the execution part of the outer hash join (#12882) 2019-11-12 17:48:30 +08:00
60bfdf5ba4 Revert "executor, util: rename original List to ListInMemory and add a new interface List (#13353)" (#13363)
This reverts commit 2b5f81add11497b5b5595b3ba16ac88cddf33a65.
2019-11-11 18:30:34 +08:00
2b5f81add1 executor, util: rename original List to ListInMemory and add a new interface List (#13353) 2019-11-11 15:50:43 +08:00
b697fac4ba expression: vectorize hash calculation during probing (#12048) (#12669) 2019-11-05 21:42:34 +08:00
7bfa8967e1 executor: rename HashJoin.outer and inner to probe and build (#13045) 2019-10-31 11:43:36 +08:00
1f922559df executor: implement disk-based hash join (#12067) 2019-09-24 23:23:05 +08:00
d29751ca5d executor: vectorize hash calculation in hashJoin (#12048) (#12076) 2019-09-11 16:06:46 +08:00
d88cd749f5 executor, expression: 1. rename tryToMatch to tryToMatchOuters 2. tiny refine tryToMatchOuters (#12138) 2019-09-11 11:24:14 +08:00
1ff620d4d0 executor: reorg codes for hashtable in HashJoinExec (#11937) 2019-09-03 13:34:23 +08:00
304619a184 executor: fix execution info of explain analyze (#11967) 2019-09-02 16:45:35 +08:00
bdbaeb419d executor: decrease the memory usage of hashTable in HashJoinExec (#11832) 2019-08-29 14:45:52 +08:00
db6c36c75f executor: fix data race in (*HashJoinExec).Close() since fetchInnerAndBuildHashTable is still running 2019-08-15 15:21:09 +08:00
6d51ad33fd *: Optimize struct memory usage by adjust field order (#11629) 2019-08-13 17:20:53 +08:00
cffd04518c executor: no need to wait for fetchInnerRows if buildHashTableForList fails, and clean code (#11571) 2019-08-02 17:07:43 +08:00
1ad073bf80 executor: show operators' memory consumption in results of EXPLAIN ANALYZE (#11334) 2019-07-24 10:53:02 +08:00
d244723a5e executor: remove unused structure RecordBatch (#10891) 2019-06-26 15:26:16 +08:00
c5a157a883 *: revert all of the radix-join-related commits (#10926) 2019-06-24 23:35:15 +08:00
dc378a2cff executor: tiny refactor the runtimeStats collection code (#10917) 2019-06-24 14:09:31 +08:00
421de5ef20 executor,server: re-implement the kill statement by checking the Next() function (#10841) 2019-06-20 11:03:21 +08:00
f6be085bc6 executor: tiny refactor the Executor interface (#10846)
Introduce a base() method to get the baseExecutor, so we don't need to add
method from baseExecutor to the Executor interface any more

Before:
```
type Executor interface {
	Open(context.Context) error
	Next(ctx context.Context, req *chunk.RecordBatch) error
	Close() error
	Schema() *expression.Schema

	retTypes() []*types.FieldType
	newFirstChunk() *chunk.Chunk
}
```

After:
```
type Executor interface {
        base() *baseExecutor
	Open(context.Context) error
	Next(ctx context.Context, req *chunk.RecordBatch) error
	Close() error
	Schema() *expression.Schema
}
```
2019-06-19 15:55:28 +08:00
d6396daa77 *: lazy eval explain id and tracker label (#10139) 2019-04-22 14:23:33 +08:00
e9653675dd *: remove errors.Trace in main handle path (#10033) 2019-04-04 14:27:15 +08:00
821af9e9f6 executor: control Chunk size for Joiners (#9614) 2019-03-19 21:30:21 +08:00
2433e28d8d *: fix ineffectual assignments and misspellings (#9481) 2019-02-28 19:25:07 +08:00
5a283a98dd plan/executor: make semi joins null and empty aware (#9051) 2019-02-25 15:42:38 +08:00
ec833bc4d2 *: fix some lints produced by golangci-lint (#8999) 2019-01-16 16:44:49 +08:00