Commit Graph

3191 Commits

Author SHA1 Message Date
b99376b521 executor: add metric definition in metric profile (#19978)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-09-14 17:51:08 +08:00
2a3a5ab076 *: disable new partition prune in master distribution (#19911) 2020-09-14 16:26:54 +08:00
1c9c5e39af executor: fix clustered index with new collation bug (#19955) 2020-09-14 15:41:07 +08:00
64c2cc5cbc sessionctx,store,kv: add a session variable to export last txn info (#19949)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2020-09-14 13:04:05 +08:00
c713018a9c executor: fix the unit test of the rank funcs memUsage tracking (#19896) 2020-09-14 12:45:05 +08:00
94704d0cc4 expression: incorrect error message of inserting enum & set (#19380) 2020-09-11 15:48:24 +08:00
bada2801ac *: fix cop task runtime information is wrong in the concurrent executor (#19849)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-09-11 14:14:37 +08:00
8446ec9e08 tikv: support scatter region with option api (#19844) 2020-09-11 14:02:34 +08:00
f13d605273 executor: fix cluster_slow_query time type in streaming request bug (#19938)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-09-11 10:55:09 +08:00
52d3dae1d3 executor: support memory track for max/min 2020-09-10 17:47:20 +08:00
0859e757a2 statistics: add default value of CMSketch for Analyze (#19455) 2020-09-10 16:57:01 +08:00
0fc03a9f71 session: use new PD TS as forUpdateTS on pessimistic write conflict (#19916)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2020-09-10 16:35:20 +08:00
71d7262067 expression: Support distinct in select stddev_pop() (#19680) 2020-09-10 14:43:51 +08:00
5d52a34b24 executor: trace memory usage of ntile() (#19756) 2020-09-10 13:24:09 +08:00
80e04b55bb executor: trace memory usage of first_row() (#19757)
Signed-off-by: Howie <haoweili35@gmail.com>
2020-09-10 10:47:20 +08:00
4a638269dd executor: support memory trace for value functions (#19811) 2020-09-09 18:15:10 +08:00
5fd2919945 executor: trace memory usage of cume_dist() (#19832) 2020-09-09 17:25:19 +08:00
7b6a5cdb76 executor: fix escape for select into outfile (#19661) 2020-09-09 16:55:29 +08:00
0c36203f1d expression: add new scalar function IsTruthWithNull (#19621) 2020-09-09 16:03:10 +08:00
b6b9b8a6df exector, planner: Improve the performance of the aggFuncMaxMin by using sliding window (#16819)
* temp

* temp

* unit test

* executor: Improve the performance of `aggFuncMin` by using sliding window

* executor: Improve the performance of `aggFuncMin` by using sliding window

* executor: Improve the performance of `aggFuncMin` by using sliding window

add ut

* fix: ResetPartialResult

* add maxMin4Time.Slide and maxMin4Duration.Slide

* add benchmark

* add var `dirty`

* add a comment

* fix Decimal

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* implementing the maxMinQueue using heap

* fix import check

* fix import check

* fix check

* remove PushMyDecimal

* refactor maxMinHeap

* 尝试优化heap

* 尝试优化heap

* fix benchmark

* fix:*

* solved pr comments

* solved pr comments

* fix

* fix

* fix

* 先回家

* maxMin4IntSliding

* fix import

* fix

* new builder

* fix ut

* fix

* fix

* fix ut

* fix ut

* fix fmt

* add benchmark

* fix

* fix

* lazyload

* lazyload

* fix frame

* fix check_dev

* add a unit test

* sliding aggFunc

* sliding aggFunc

* fix

* move ut

* fix dev_check

* fix dev_check

* resolved comments

* refactor ut

* refactor ut

* refactor ut

Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
2020-09-09 14:31:41 +08:00
f9b71fca1f executor: implement memDelta for BitFunc funcs to track memUsage (#19808)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: HuaiyuXu <391585975@qq.com>
2020-09-09 11:57:10 +08:00
8a1f11ecee executor: add memory trace for percent rank agg functions (#19852)
* add memory trace for percent_rank func

* add unit tests

* add func_percent_rank_test.go

* modify year in license

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-09 11:33:12 +08:00
7e357b5092 executor: trace memory usage of row_number() 2020-09-09 11:16:33 +08:00
2836011470 executor, planner: refactor analyze tableID to analyzeTableID & add CanRuntimePrune (#19846)
* executor, planner:  refactor analyze tableID to analyzeTableID

* *: add util to help decide whether use new runtime prune partition executor

* address comments

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-08 23:49:39 +08:00
449587a085 *: using standard error to replace terror (#19425) 2020-09-08 20:15:51 +08:00
48388a7b48 planner,executor: enable plan cache for partition table (#19124)
* planner,executor: enable plan cache for partition table

* address comment

* tiny clean up

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: lysu <sulifx@gmail.com>
2020-09-08 19:40:39 +08:00
354f3997c0 executor: add concurrency limit on union executor (#19827) 2020-09-08 19:16:23 +08:00
05809a9cf2 Revert "expression, types: fix decimal precision for SUM function (#19592)" (#19882) 2020-09-08 18:21:18 +08:00
2f2c57ecc8 executor, util: fix TestGlobalMemoryTrackerOnCleanUp ci error (#19863) 2020-09-08 18:15:46 +08:00
2d52e99d0f executor: fix error tikv_cop_wait metric (#19859)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-09-08 16:59:53 +08:00
0e26d40948 distsql: fix wrong default max allowed packet (#19573)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-08 15:35:53 +08:00
47270445d9 server: fix the missing detachment for the mem/disk tracker (#19794) 2020-09-08 10:48:51 +08:00
dy
726341146b expression, types: fix decimal precision for SUM function (#19592) 2020-09-07 16:23:54 +08:00
221223b46b executor: add more runtime information for join executor (#19721)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2020-09-07 14:53:20 +08:00
3d33bdf49f privilege: fix wrong result of SHOW GRANTS (#19704)
* fix show grants user filter

* address comment

* address comment

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-07 14:45:20 +08:00
a961a70c53 executor: fix fast analyze race condition on session ctx (#19716)
* executor:  fix fast analyze race condition on session

* unify return error

* make lint happy

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-07 14:35:21 +08:00
397e31a673 planner: fix incorrect result for != all (subq) (#19576)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-07 14:07:21 +08:00
c283bc66bd txn:support wait second grammar for "select for update" (#19630)
* support select for update wait seconds grammar

* use function

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-07 13:47:59 +08:00
bcfaaf5595 executor: implement meldata for rank funcs to track memUsage (#19766) 2020-09-07 11:09:06 +08:00
7cd20c0373 executor: implement memDelta for count funcs to track memUsage (#19770)
* executor: implement memDelta for count funcs to track memUsage

* fix stdlib unsafe need be group together and before non-stdlib group in ../../executor/aggfuncs/func_count.go

* fix UpdatePartialResult memDelta return if err != nil

* fix
1 DefPartialResult4CountSize is the memory usage of AllocPartialResult, UpdatePartialResult will not use more memory, return 0, err.
2 in testcase TestMemCount count funcs are not distinct, use defaultUpdateMemDeltaGens and set isDistinct false

* fix UpdatePartialResult not use more memory

* fix  MergePartialResult memDelta

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-05 17:43:46 +08:00
78166329e2 executor: set the correct resultCh for task when indexHashJoin keep order (#18840)
* executor: set the correct resultCh for task when indexHashJoin keep order (#18757)

* update test

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-05 17:24:57 +08:00
7f56b302d5 executor: implement memDelta for varpop to trace the memory usage (#19755)
* try to solve tidb issue 19745

issue link: https://github.com/pingcap/tidb/issues/19745

* format file

* bug fix: return memDelta when err occur

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-04 19:55:09 +08:00
a428d472e9 *: remove the unused terminology (#19727)
* *: remove the unused terminology

* rename back

* delete more

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-04 17:12:01 +08:00
ce849c3e19 *: remove DirtyDB and DirtyTable to reduce memory usage (#19042) 2020-09-04 16:50:36 +08:00
19590a7a5d executor: infoschema table partition method wrong for range column partition (#19633) 2020-09-04 11:05:38 +08:00
9c344ce66e types: fix bug of converting enum and set (#19699) 2020-09-03 23:43:49 +08:00
48eb295925 *: change some tests using failpoint to serialSuite (#19753)
Signed-off-by: wjhuang2016 <huangwenjun1997@gmail.com>
2020-09-03 21:12:58 +08:00
fdcc19eb11 sessionctx: fix a bug where update stmt not considered when clipping negative num to 0 (#19605) 2020-09-03 20:16:17 +08:00
862d8b8996 check privileges for show stats (#19702) 2020-09-03 16:48:44 +08:00
d0dfc77322 fix read failure from system tables tiflash_segments and tiflash_tables when some tiflash node is down (#19714)
Co-authored-by: crazycs <crazycs520@gmail.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-03 12:51:10 +08:00