Commit Graph

131 Commits

Author SHA1 Message Date
c8bc701170 *: misc cleanups to variable package (#24507) 2021-05-11 13:23:38 +08:00
6084a6a5ff variable: change SetSessionSystemVar to accept string (#24247) 2021-04-26 11:47:55 +08:00
04c334ba56 executor: Improve max/min window function with deque-based sliding window (#22628) 2021-04-14 13:11:52 +08:00
c32895f667 expression: fix approx_percent panic on bit column (#23687) 2021-03-30 20:17:24 +08:00
35eded065e *: fix structcheck lint warnings (#23062) 2021-03-24 21:09:37 +08:00
b298b86ba1 executor: group_concat aggr panic when session.group_concat_max_len is small (#23131) 2021-03-11 15:30:55 +08:00
7c552f52fa executor: track memory usage of map in agg partial result. (#23072) 2021-03-09 12:44:55 +08:00
8761adc59f executor: make the memory tracker of Jsonobjectagg more accurate (#23024) 2021-03-04 11:34:54 +08:00
bee6d37c8b executor: make the memory tracker of groupConcat more accurate. (#23034) 2021-03-04 10:50:54 +08:00
b81e547e66 executor: fix err check (#22991) 2021-03-03 19:26:56 +08:00
602bcd2e40 *: fix some structcheck lint warnings (#22983) 2021-03-02 23:12:54 +08:00
ec788ac154 executor: reduce useless memory allocation in min/max aggregate (#22912) 2021-02-26 18:04:53 +08:00
35534ae752 *: apply golangci-lint to the new code (#22824) 2021-02-24 18:24:03 +08:00
b74dfaf810 mockstore: move mockstore/cluster to tikv/mockstore/cluster (#22856)
Signed-off-by: disksing <i@disksing.com>
2021-02-22 15:42:16 +08:00
8ddd41c960 executor: fix typo (#22385) 2021-01-18 16:15:28 +08:00
1265a115f6 chunk: fix min/max for enum/set is incompatible with MySQL (#21566) 2020-12-21 17:07:00 +08:00
6e1c2ac8a2 executor: fix LEAD and LAG's default value can not adapt to field type (#20747) 2020-12-11 14:55:22 +08:00
28c9e9290b *: gocritic fixes for commentFormatting (#21578) 2020-12-09 12:03:17 +08:00
e608e4bca9 ddl: fix the enum's default value where create table (#20849) 2020-11-11 20:18:17 +08:00
dy
a3facd0f71 expression, planner: fix decimal results for aggregate functions (#20017) 2020-11-11 14:46:22 +08:00
2f067c0542 *: redact arguments for Error (#20436) 2020-10-21 14:44:08 +08:00
Ion
877fa6320b executor: support memory trace for group_concat (#20153) 2020-10-14 14:36:37 +08:00
247a26ec70 util: reset the unused bytes in writeTime (#20284) 2020-10-04 13:36:12 +08:00
aceecf0732 executor: support new aggregate funtion APPROX_PERCENTILE (#19799)
Signed-off-by: leiysky <leiysky@outlook.com>
2020-09-24 15:59:38 +08:00
1d5b724e82 executor: implement meldata for jsonobjectagg funcs to track memUsage (#19819) 2020-09-22 10:42:08 +08:00
205c40186a *: support aggregate function stddev_samp() and var_samp() (#19810)
Co-authored-by: Zhuomin(Charming) Liu <lzmhhh123@gmail.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-16 17:44:41 +08:00
1bfeff96c7 executor: trace memory usage of lag/lead agg (#19966) 2020-09-16 15:12:39 +08:00
c713018a9c executor: fix the unit test of the rank funcs memUsage tracking (#19896) 2020-09-14 12:45:05 +08:00
52d3dae1d3 executor: support memory track for max/min 2020-09-10 17:47:20 +08:00
71d7262067 expression: Support distinct in select stddev_pop() (#19680) 2020-09-10 14:43:51 +08:00
5d52a34b24 executor: trace memory usage of ntile() (#19756) 2020-09-10 13:24:09 +08:00
80e04b55bb executor: trace memory usage of first_row() (#19757)
Signed-off-by: Howie <haoweili35@gmail.com>
2020-09-10 10:47:20 +08:00
4a638269dd executor: support memory trace for value functions (#19811) 2020-09-09 18:15:10 +08:00
5fd2919945 executor: trace memory usage of cume_dist() (#19832) 2020-09-09 17:25:19 +08:00
b6b9b8a6df exector, planner: Improve the performance of the aggFuncMaxMin by using sliding window (#16819)
* temp

* temp

* unit test

* executor: Improve the performance of `aggFuncMin` by using sliding window

* executor: Improve the performance of `aggFuncMin` by using sliding window

* executor: Improve the performance of `aggFuncMin` by using sliding window

add ut

* fix: ResetPartialResult

* add maxMin4Time.Slide and maxMin4Duration.Slide

* add benchmark

* add var `dirty`

* add a comment

* fix Decimal

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* newMyDecimalMaxMinQueue

* implementing the maxMinQueue using heap

* fix import check

* fix import check

* fix check

* remove PushMyDecimal

* refactor maxMinHeap

* 尝试优化heap

* 尝试优化heap

* fix benchmark

* fix:*

* solved pr comments

* solved pr comments

* fix

* fix

* fix

* 先回家

* maxMin4IntSliding

* fix import

* fix

* new builder

* fix ut

* fix

* fix

* fix ut

* fix ut

* fix fmt

* add benchmark

* fix

* fix

* lazyload

* lazyload

* fix frame

* fix check_dev

* add a unit test

* sliding aggFunc

* sliding aggFunc

* fix

* move ut

* fix dev_check

* fix dev_check

* resolved comments

* refactor ut

* refactor ut

* refactor ut

Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
2020-09-09 14:31:41 +08:00
f9b71fca1f executor: implement memDelta for BitFunc funcs to track memUsage (#19808)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: HuaiyuXu <391585975@qq.com>
2020-09-09 11:57:10 +08:00
8a1f11ecee executor: add memory trace for percent rank agg functions (#19852)
* add memory trace for percent_rank func

* add unit tests

* add func_percent_rank_test.go

* modify year in license

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-09 11:33:12 +08:00
7e357b5092 executor: trace memory usage of row_number() 2020-09-09 11:16:33 +08:00
05809a9cf2 Revert "expression, types: fix decimal precision for SUM function (#19592)" (#19882) 2020-09-08 18:21:18 +08:00
dy
726341146b expression, types: fix decimal precision for SUM function (#19592) 2020-09-07 16:23:54 +08:00
bcfaaf5595 executor: implement meldata for rank funcs to track memUsage (#19766) 2020-09-07 11:09:06 +08:00
7cd20c0373 executor: implement memDelta for count funcs to track memUsage (#19770)
* executor: implement memDelta for count funcs to track memUsage

* fix stdlib unsafe need be group together and before non-stdlib group in ../../executor/aggfuncs/func_count.go

* fix UpdatePartialResult memDelta return if err != nil

* fix
1 DefPartialResult4CountSize is the memory usage of AllocPartialResult, UpdatePartialResult will not use more memory, return 0, err.
2 in testcase TestMemCount count funcs are not distinct, use defaultUpdateMemDeltaGens and set isDistinct false

* fix UpdatePartialResult not use more memory

* fix  MergePartialResult memDelta

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-05 17:43:46 +08:00
7f56b302d5 executor: implement memDelta for varpop to trace the memory usage (#19755)
* try to solve tidb issue 19745

issue link: https://github.com/pingcap/tidb/issues/19745

* format file

* bug fix: return memDelta when err occur

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-09-04 19:55:09 +08:00
9047a9c881 executor: fix wrong behavior for max/min on ENUM/SET column (#19552)
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Co-authored-by: Yiding Cui <winoros@gmail.com>
2020-09-01 21:18:03 +08:00
89c1b0f3e6 executor: Implement memDelta for sum functions (#19376) 2020-08-31 14:24:10 +08:00
f3c8b008df executor: accelerate TestMemCount (#19581)
* test

* executor: accelerate TestMemCount

* refine

* fix ci

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-29 21:03:21 +08:00
b3f5678717 executor: skip TestMemCount test case to make race test more stable (#19578) 2020-08-28 17:07:51 +08:00
b4f0854d19 executor: implement memDelta for avg funcs to track memUsage (#18901) 2020-08-28 14:01:41 +08:00
49af6a511f expression: Support stddev_pop function (#19195)
* add stddev_pop function

* fix for make check

* not push down

* add util test

* stddevpop inherit from varpop

* fix typo

* support std and stddev

* update go.mod

* uodate parser master

* fix ditto

* fix fix

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-27 19:42:53 +08:00
b178de06ad executor: Trace the memory usage of AggFunc in HashAggExec (#18257) 2020-07-06 20:48:41 +08:00