database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
16,102 Commits 1 Branch 0 Tags
bd8113f4243ed607121a2e76ee69eabd738e32b0
Commit Graph

221 Commits

Author SHA1 Message Date
yiguolei
bd8113f424 [bugfix](scannerscheduler) should minus num_of_scanners before check should schedule #28926 (#29331) 
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-01-03 20:47:35 +08:00
Gabriel
c84cd30223 [pipelineX](fix) Fix query cancel timeout (#29460) 
There are 2 potential reasons to cancel pipelineX query timeout.

Cancel fragment context first and set ready to execute will set cancel flag to false.
Dead lock.
 2024-01-03 20:29:04 +08:00
yiguolei
738abac9ed [minor](context) duplicate query context in fragment ctx (#29364) 
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-01-01 22:08:23 +08:00
wangbo
31b3be456c add workload scheduler in be (#29116) 2023-12-28 15:04:22 +08:00
zhiqiang
8c59e16f81 [opt](query cancel) optimization for query cancel #28778 2023-12-22 12:48:37 +08:00
Mryange
fe184e322a [code](pipelineX) refine some pipelineX code (#28570) 2023-12-20 11:45:06 +08:00
zhangstar333
f770403cca [enhancement](pipeline) add bvar for pipeline fragment instance and task (#28500) 2023-12-16 10:47:53 +08:00
Mryange
877935442f [feature](pipelineX)use markFragments instead of markInstances in pipelineX (#27829) 2023-12-11 17:59:53 +08:00
meiyi
1e5ff40e17 [refactor](group commit) remove future block (#27720) 
Co-authored-by: huanghaibin <284824253@qq.com>
 2023-12-11 08:41:51 +08:00
Gabriel
421ab56c3e [pipelineX](improvement) Support local shuffle for join and agg (#27852) 2023-12-02 20:17:18 +08:00
wangbo
0b7becd4b7 [fix](executor)Fix memtracker not set to task group #27699 2023-11-30 22:35:51 +08:00
Mryange
d9d5468621 [feature](audit-log) add audit-log in insert into (#27641) 2023-11-29 15:01:57 +08:00
zhiqiang
d0fea8db27 [chore][log] Opt log, revert some log introduced by #25739 (#26365) 2023-11-27 10:48:02 +08:00
Gabriel
75d1594d11 [pipelineX](minor) remove unused code (#27446) 2023-11-23 11:53:06 +08:00
Gabriel
1b3512d942 [pipelineX](bug) Fix cancel timeout (#27396) 2023-11-22 22:31:34 +08:00
wangbo
be7273da83 [refactor](executor)Refactor workload meta update to be #26710 2023-11-18 11:19:38 +08:00
Gabriel
b1eef30b49 [pipelineX](dependency) Wake up task by dependencies (#26879) 
---------

Co-authored-by: Mryange <2319153948@qq.com>
 2023-11-18 03:20:24 +08:00
zhiqiang
a5565f68b2 [Refactor](opentelemetry) Remove opentelemetry (#26605) 2023-11-09 18:05:34 +08:00
wangbo
6637f9c15f Add enable_cgroup_cpu_soft_limit (#26510) 2023-11-08 15:52:13 +08:00
zhiqiang
d6c64d305f [chore](log) Add log to trace query execution #25739 2023-10-26 14:09:25 +08:00
HHoflittlefish777
235ae9ded4 [improvement](fragment) optimize to get query context logic (#25621) 2023-10-25 14:03:47 +08:00
Pxl
2972daaed9 [Bug](status) process error status on es_scroll_parser and compaction_action (#25745) 
process error status on es_scroll_parser and compaction_action
 2023-10-24 15:51:01 +08:00
zhiqiang
87b414cdae [Fix](query execution) Fix result sink fragment can't be cancelled in non-pipeline (#25524) 2023-10-24 11:30:29 +08:00
yiguolei
215c1625b2 [chore](fragmentid) rename fragment id to fragment instance id in thrift definition file (#25787) 
* rename fragment id to fragment instance id in thrift definition file

* f

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-10-24 11:26:52 +08:00
Pxl
642c149e6a remove datetime_value and move vecdatetime_value to doris namespace (#25695) 
remove datetime_value and move vecdatetime_value to doris namespace
 2023-10-20 22:08:17 +08:00
Mryange
b0e70bd02b [fix](pipelineX) fix error set delta_urls (#25631) 2023-10-19 19:27:31 +08:00
wangbo
54780c62e0 [improvement](executor)Using cgroup to implement cpu hard limit (#25489) 
* Using cgroup to implement cpu hard limit

* code style
 2023-10-19 18:56:26 +08:00
wangbo
7b2ff38401 query cpu hard limit based on doris scheduler (#24844) 2023-10-07 12:03:07 +08:00
bobhan1
642e5cdb69 [Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly (#23395) 2023-09-29 22:38:52 +08:00
Lijia Liu
864a0f9bcb [opt](pipeline) Make pipeline fragment context send_report asynchronized (#23142) 2023-09-28 17:55:53 +08:00
Gabriel
1b0e3246ea [pipelineX](fix) Fix exception reporting and Nereids plan (#24936) 2023-09-27 13:15:40 +08:00
wangbo
c9b2f4cb92 [workload](pipeline) Add cgroup cpu controller (#24052) 2023-09-21 21:49:33 +08:00
Gabriel
d62b59b620 [pipelineX](profile) Complete load profile (#24690) 2023-09-21 09:57:34 +08:00
Pxl
8c8c563c3c [Chore](status) adjust some error status print log (#24660) 
adjust some error status print log
 2023-09-20 17:42:51 +08:00
Gabriel
d24f3efd4a [pipelineX](profile) Phase 1: refactor pipelineX detailed profile (#24322) 2023-09-15 16:14:05 +08:00
zhiqqqq
c7ae2a7d22 [Refactor & Bugfix](static variables) move some static vairables to exec_env (#24029) 2023-09-13 09:27:03 +08:00
Lijia Liu
a05003fbe1 [fix](pipeline) fix remove pipeline_x_context from fragment manager (#24062) 2023-09-10 20:53:26 +08:00
meiyi
82dc970916 [feature](insert) Support group commit insert (#22829) 2023-09-08 15:51:03 +08:00
Gabriel
cdb1b341c7 [pipelineX](runtime filter) Support runtime filter (#24054) 2023-09-08 10:17:22 +08:00
hzq
80097f0752 [fix](fragment mgr) Do not cancel queries when upgrading cluster. #23924 2023-09-06 09:04:28 +08:00
Gabriel
5853ed385e [pipelineX](join) Support shared hash table (#23876) 2023-09-05 10:14:40 +08:00
yiguolei
0179e5c2ba [bugfix](fragment mgr) heap used after free in fragment manager when query is cancelled (#23817) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-09-04 12:20:16 +08:00
hzq
201c0cc4ef [fix](pipeline) Fix cancel_query locks nothing #23815 2023-09-04 11:50:24 +08:00
hzq
16d6357266 [fix] (mac compile) Fix mac compile error & fe start time related (#23727) 
Fix of PR #23582

Some Fe codes are deleted by [Improvement](pipeline) Cancel outdated query if original fe restarts #23582 , need to be added back;
Fix mac build failed caused by wrong thrift declaration order.
 2023-09-01 08:02:30 +08:00
hzq
c083336bbe [Improvement](pipeline) Cancel outdated query if original fe restarts (#23582) 
If any FE restarts, queries that is emitted from this FE will be cancelled.

Implementation of #23704
 2023-08-31 17:58:52 +08:00
Mryange
a305f2ffc2 [fix](pipeline) update status when prepare failed #23419 2023-08-25 10:34:37 +08:00
yiguolei
bcdb481374 [refactor](fragment) refactor non pipeline fragment executor (#23281) 
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-08-22 16:00:34 +08:00
Gabriel
dcd6c3c022 [pipelineX](refactor) propose a new pipeline execution model (#22562) 2023-08-21 15:38:45 +08:00
zhengyu
1d825f57bc [fix](load) expose error root cause msg for load (#22968) 
Currently, we only return ambiguous "INTERNAL ERROR" to the user when
load. This commit will no more hide the root cause.

Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
 2023-08-15 13:22:45 +08:00
yiguolei
e47d1fccf5 [bugfix](be core) fragment executor's destruct method should be called before query context (#22362) 
fragment executor's destruct method will call close, it depends on query context's object pool, because many object is put in query context's object pool such as runtime filter.
It should be deleted before query context. Or there will be heap use after free error.
It is fixed in #17675, but Do not know why not in master. So 1.2-lts does not have this problem.
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-07-29 22:41:46 +08:00