f5572ac732
[pick]reset memtable flush thread num ( #37092 )
...
## Proposed changes
pick #37028
2024-07-02 19:20:17 +08:00
88e02c836d
[Fix]Fix insert select missing audit log when connect follower FE ( #36481 )
...
## Proposed changes
pick #36472
2024-06-20 15:16:16 +08:00
75a6f28f2e
[cherry-pick]Add query type when report ( #35918 )
...
pick #34978
2024-06-11 10:51:59 +08:00
615765c1c0
[improvement](spill) improve spill directory and fix bugs ( #33900 )
...
* [improvement](spill) improve spill directory and fix bugs
* fix
2024-04-22 11:28:22 +08:00
517c12478f
[improvement](spill) spill trigger improvement ( #32641 )
2024-04-10 14:52:46 +08:00
cf7595d423
[opt](memory) Optimize mem tracker accuracy ( #32039 ) ( #33140 )
2024-04-10 11:42:19 +08:00
bfc9260507
[bugfix](deadlock) avoid deadlock in memtracker cancel query ( #33400 )
...
get_query_ctx(hold query ctx map lock) ---> QueryCtx ---> runtime statistics mgr --->
runtime statistics mgr ---> allocate block memory ---> cancel query
memtracker will try to cancel query when memory is not available during allocator.
BUT the allocator is a foundermental API, if it call the upper API it may deadlock.
Should not call any API during allocator.
2024-04-09 12:20:54 +08:00
77349ca71a
[pipelineX](fix) Fix coredump by incorrect cancel order ( #33294 )
2024-04-07 12:06:12 +08:00
7675383c40
[bugfix](deadlock) fix dead lock in cancel fragment ( #33181 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-04-03 13:41:24 +08:00
6b54171778
[bugfix](deadlock) pipelinex map lock should only scope in map not about pipelinectx's cancel method ( #32622 )
...
both global lock in fragment mgr should only protect the map logic, could not use it to protect cancel method.
fragment ctx cancel method should be protected by a lock.
query ctx cancel --> pipelinex fragment cancel ---> query ctx cancel will dead lock.
2024-03-22 08:52:38 +08:00
4bf5a21ba3
[pipelineX](cancel) Remove lock for mapping query ctx to fragment ( #32346 )
2024-03-21 14:07:23 +08:00
62023d705d
[refactor](rename) rename task group to workload group in be ( #32204 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-03-15 18:04:02 +08:00
d2e7a68d11
[enhancement](util) print if using nereids planner when be coredump ( #31981 )
2024-03-09 19:55:47 +08:00
b177b26d39
[branch-2.1](tracing) Pick pipeline tracing and relative bugfix ( #31367 )
...
* [Feature](pipeline) Trace pipeline scheduling (part I) (#31027 )
* [fix](compile) Fix performance compile fail #31305
* [fix](compile) Fix macOS compilation issues for PURE macro and CPU core identification (#31357 )
* [fix](compile) Correct PURE macro definition to fix compilation on macOS
* 2
---------
Co-authored-by: zy-kkk <zhongyk10@gmail.com >
2024-02-29 08:42:35 +08:00
c34639245e
[Improvement](executor)add remote scan thread pool ( #31376 )
...
* add remote scan thread pool
* +1
2024-02-27 10:12:33 +08:00
2f960c49f5
[Fix](executor)Fix query runtime statistics report failed #31064
2024-02-19 17:20:21 +08:00
89695f43d4
[refactor](queryctx) move tg related code to task group ( #30829 )
...
init query ctx memtracker in queryctx constructor
set all task group related property during set taskgroup
2024-02-16 10:12:23 +08:00
2c99c53812
[refactor](taskqueue) remove old task scheduler based wg ( #30832 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-05 22:00:27 +08:00
5ba9987d3a
[Fix](executor)Release resource correctly when drop workload group ( #30279 )
2024-01-25 13:24:52 +08:00
9e0c518aaf
[Feature](executor)Workload Group support Non-Pipeline Execution ( #30164 )
2024-01-23 10:11:25 +08:00
e35b26f4fc
[feature](auditlog)Add runtime cpu time/peak memory metric ( #29925 )
2024-01-16 18:39:00 +08:00
0d691c638b
[Feature](profile)Support report runtime workload statistics #29591
2024-01-12 11:59:27 +08:00
c84cd30223
[pipelineX](fix) Fix query cancel timeout ( #29460 )
...
There are 2 potential reasons to cancel pipelineX query timeout.
Cancel fragment context first and set ready to execute will set cancel flag to false.
Dead lock.
2024-01-03 20:29:04 +08:00
18ad8562f2
[refactor](broadcastbuffer) using a queue to remove ref and unref codes ( #28698 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >Add a new class broadcastbufferholderqueue to manage holders
Using shared ptr to manage holders, not use ref and unref, it is too difficult to maintain.
2023-12-20 21:23:25 +08:00
c26c0c31a5
[refactor](runtimefilter) do not use QueryContext in runtime filter ( #28559 )
2023-12-20 10:28:55 +08:00
73f7b61019
[refactor](scanner) use weak ptr to lock task execution context to avoid core in scanner dctor ( #28493 )
...
using weak ptr as a lock between fragment execute thread and scanner thread, to solve the core problem in scanner's dctor to access scannode's profile.
2023-12-18 14:09:32 +08:00
89d5efac46
[pipelineX](dependency) Use dependency to replace ready_to_execute ( #27528 )
2023-11-24 16:03:14 +08:00
1b3512d942
[pipelineX](bug) Fix cancel timeout ( #27396 )
2023-11-22 22:31:34 +08:00
