database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
85362a907e2c55f0a856daaaa34dd9e0d461d736
doris/be/src/runtime
History
Xinyi Zou 85362a907e [fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072) 
1. Fix the memory leak. When the load task is canceled, the `IndexChannel` and `NodeChannel` mem trackers cannot be destructed in time.
2. Fix Load task being frequently canceled by oom and inaccurate `LoadChannel` mem tracker limit, and rewrite the variable name of `mem limit` in `LoadChannel`.
3. Fix core dump, when logout task mem tracker, phmap erase fails, resulting in repeated logout of the same tracker.
4. Fix the deadlock, when add_child_tracker mem limit exceeds, calling log_usage causes `_child_trackers_lock` deadlock.
5. Fix frequent log printing when thread mem tracker limit exceeds, which will affect readability and performance.
6. Optimize some details of mem tracker display.
2022-06-14 21:38:37 +08:00
..
bufferpool
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
cache
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
memory
[feature-wip] (memory tracker) (step6, End) Fix some details (#9301)
2022-05-10 18:17:09 +08:00
routine_load
[Refactor] Use file factory to replace create file reader/writer (#9505)
2022-06-08 15:07:39 +08:00
stream_load
[Refactor] Use file factory to replace create file reader/writer (#9505)
2022-06-08 15:07:39 +08:00
broker_mgr.cpp
[refactor] refactor code, replace some file with stl libs (#8759)
2022-04-13 09:55:29 +08:00
broker_mgr.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
buffer_control_block.cpp
1. Fix an error when fetch string type field may cause malform packet error. (#7262)
2021-12-01 10:02:34 +08:00
buffer_control_block.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
buffered_block_mgr2.cc
[bugfix]teach BufferedBlockMgr2 track memory right (#9722)
2022-05-24 10:18:51 +08:00
buffered_block_mgr2.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
buffered_tuple_stream2.cc
[refactor][be] Optimize headers (#9708)
2022-05-30 16:12:10 +08:00
buffered_tuple_stream2.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
buffered_tuple_stream2.inline.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
buffered_tuple_stream3.cc
[refactor] add reference path for source file from impala (#9115)
2022-04-20 12:29:57 +08:00
buffered_tuple_stream3.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
buffered_tuple_stream3.inline.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
client_cache.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
client_cache.h
[refactor](es) Clean es tcp scannode and related thrift definitions (#9553)
2022-05-14 10:03:55 +08:00
CMakeLists.txt
[Enhancement] Remove minidump (#9894)
2022-06-01 08:04:24 +08:00
collection_value.cpp
[refactor][be] Optimize headers (#9708)
2022-05-30 16:12:10 +08:00
collection_value.h
[refactor][be] Optimize headers (#9708)
2022-05-30 16:12:10 +08:00
data_stream_mgr.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
data_stream_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
data_stream_recvr.cc
[refactor] add reference path for source file from impala (#9115)
2022-04-20 12:29:57 +08:00
data_stream_recvr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
data_stream_sender.cpp
[fix](brpc) Embed serialized request into the attachment and transmit it through http brpc (#9803)
2022-06-13 20:41:48 +08:00
data_stream_sender.h
[fix](brpc) Embed serialized request into the attachment and transmit it through http brpc (#9803)
2022-06-13 20:41:48 +08:00
datetime_value.cpp
[improvement](rewrite) Make RewriteDateLiteralRule to be compatible with mysql (#7876)
2022-01-27 10:32:18 +08:00
datetime_value.h
[Bug] Fix timestamp_diff issue when timeunit is year and month (#9574)
2022-05-19 21:24:43 +08:00
decimalv2_value.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
decimalv2_value.h
[refactor][be] Optimize headers (#9708)
2022-05-30 16:12:10 +08:00
descriptor_helper.h
[refactor] Remove decimal v1 related code from code base (#6079)
2021-07-07 10:26:32 +08:00
descriptors.cpp
[feature](mysql-table) support utf8mb4 for mysql external table (#9402)
2022-05-11 09:39:23 +08:00
descriptors.h
[feature](mysql-table) support utf8mb4 for mysql external table (#9402)
2022-05-11 09:39:23 +08:00
disk_io_mgr_internal.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
disk_io_mgr_reader_context.cc
[refactor] add reference path for source file from impala (#9115)
2022-04-20 12:29:57 +08:00
disk_io_mgr_scan_range.cc
[refactor] add reference path for source file from impala (#9115)
2022-04-20 12:29:57 +08:00
disk_io_mgr.cc
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
disk_io_mgr.h
Fix some typos in be/. (#9681)
2022-05-19 20:55:39 +08:00
dpp_sink_internal.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
dpp_sink_internal.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
dpp_writer.cpp
[Refactor] Cleanup some unused include (#9063)
2022-04-18 09:52:31 +08:00
dpp_writer.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
etl_job_mgr.cpp
Revert "[Refactor][agent_task] Remove etl mgr and etl job pool from be (#8635)" (#8666)
2022-03-25 18:32:50 +08:00
etl_job_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
exec_env_init.cpp
[feature][config] introduce a new BE config storage_page_cache_shard_size (#9821)
2022-05-28 10:17:09 +08:00
exec_env.cpp
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
exec_env.h
[refactor](es) Clean es tcp scannode and related thrift definitions (#9553)
2022-05-14 10:03:55 +08:00
export_sink.cpp
[Refactor] Use file factory to replace create file reader/writer (#9505)
2022-06-08 15:07:39 +08:00
export_sink.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
export_task_mgr.cpp
[LOG] Standardize the use of VLOG in code (#5264)
2021-01-21 12:09:09 +08:00
export_task_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
external_scan_context_mgr.cpp
[refactor] refactor code, replace some file with stl libs (#8759)
2022-04-13 09:55:29 +08:00
external_scan_context_mgr.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
file_result_writer.cpp
[Refactor] Use file factory to replace create file reader/writer (#9505)
2022-06-08 15:07:39 +08:00
file_result_writer.h
[Refactor] Use file factory to replace create file reader/writer (#9505)
2022-06-08 15:07:39 +08:00
fold_constant_executor.cpp
[refactor][be] Optimize headers (#9708)
2022-05-30 16:12:10 +08:00
fold_constant_executor.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
fragment_mgr.cpp
[improvement] Optimize send fragment logic to reduce send fragment timeout error (#9720)
2022-06-03 15:47:40 +08:00
fragment_mgr.h
[improvement] Optimize send fragment logic to reduce send fragment timeout error (#9720)
2022-06-03 15:47:40 +08:00
free_pool.hpp
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
heartbeat_flags.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
initial_reservations.cc
[refactor] add reference path for source file from impala (#9115)
2022-04-20 12:29:57 +08:00
initial_reservations.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
large_int_value.cpp
Use fmt and std::from_chars to make convert integer to string and convert string to integer more efficient (#6361)
2021-08-04 10:55:19 +08:00
large_int_value.h
[refactor][be] Optimize headers (#9708)
2022-05-30 16:12:10 +08:00
load_channel_mgr.cpp
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
load_channel_mgr.h
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
load_channel.cpp
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
load_channel.h
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
load_path_mgr.cpp
[refactor] refactor code, replace some file with stl libs (#8759)
2022-04-13 09:55:29 +08:00
load_path_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
mem_pool.cpp
[feature-wip] (memory tracker) (step6, End) Fix some details (#9301)
2022-05-10 18:17:09 +08:00
mem_pool.h
Fix some typos in be/. (#9681)
2022-05-19 20:55:39 +08:00
mem_tracker_task_pool.cpp
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
mem_tracker_task_pool.h
[feature-wip] (memory tracker) (step6, End) Fix some details (#9301)
2022-05-10 18:17:09 +08:00
mem_tracker.cpp
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
mem_tracker.h
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
memory_scratch_sink.cpp
[Refactor] Cleanup some unused include (#9063)
2022-04-18 09:52:31 +08:00
memory_scratch_sink.h
[refactor] refactor the implement of MemTracker, and related usage (#8322)
2022-03-11 22:04:23 +08:00
message_body_sink.cpp
[Refactor] Cleanup some unused include (#9063)
2022-04-18 09:52:31 +08:00
message_body_sink.h
[fix](stream-load) fix bug that stream load may be blocked with unqualified data (#8176)
2022-02-22 09:26:23 +08:00
multi_precision.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
mysql_result_writer.cpp
[feature-wip][array-type] Support more sub types. (#9466)
2022-05-26 08:41:34 +08:00
mysql_result_writer.h
[refactor][style] Use clang-format to sort includes (#9483)
2022-05-10 21:25:35 +08:00
mysql_table_sink.cpp
[feature](mysql-table) support utf8mb4 for mysql external table (#9402)
2022-05-11 09:39:23 +08:00
mysql_table_sink.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
mysql_table_writer.cpp
[feature](mysql-table) support utf8mb4 for mysql external table (#9402)
2022-05-11 09:39:23 +08:00
mysql_table_writer.h
[feature](mysql-table) support utf8mb4 for mysql external table (#9402)
2022-05-11 09:39:23 +08:00
odbc_table_sink.cpp
[refactor][style] Use clang-format to sort includes (#9483)
2022-05-10 21:25:35 +08:00
odbc_table_sink.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
plan_fragment_executor.cpp
[feature-wip] (memory tracker) (step5) Fix track bthread, fix track vectorized query (#9145)
2022-04-27 20:34:02 +08:00
plan_fragment_executor.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
primitive_type.cpp
[enhancement][diagnostics] Add a diagnostic: detect unused includes (#9117)
2022-06-08 11:52:48 +08:00
primitive_type.h
[enhancement][diagnostics] Add a diagnostic: detect unused includes (#9117)
2022-06-08 11:52:48 +08:00
qsorter.cpp
[Feature](Memory) Hook TCMalloc new/delete automatically counts to MemTracker (#8476)
2022-03-20 23:06:54 +08:00
qsorter.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
query_fragments_ctx.h
[improvement] Optimize send fragment logic to reduce send fragment timeout error (#9720)
2022-06-03 15:47:40 +08:00
query_statistics.cpp
[feat](memory-track) Print peak memory use of all backend after query in audit log (#7030)
2021-11-22 14:46:08 +08:00
query_statistics.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
raw_value.cpp
[refactor][be] Optimize headers (#9708)
2022-05-30 16:12:10 +08:00
raw_value.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
record_batch_queue.cpp
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
record_batch_queue.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
result_buffer_mgr.cpp
[Refactor] Cleanup some unused include (#9063)
2022-04-18 09:52:31 +08:00
result_buffer_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
result_file_sink.cpp
[feature-wip] (memory tracker) (step6, End) Fix some details (#9301)
2022-05-10 18:17:09 +08:00
result_file_sink.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
result_queue_mgr.cpp
[Refactor] Cleanup some unused include (#9063)
2022-04-18 09:52:31 +08:00
result_queue_mgr.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
result_sink.cpp
[fix](memory tracker) Fix lru cache, compaction tracker, add USE_MEM_TRACKER compile (#9661)
2022-05-25 08:56:17 +08:00
result_sink.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
result_writer.cpp
[OUTFILE] Support INTO OUTFILE to export query result (#3584)
2020-05-25 21:24:56 +08:00
result_writer.h
[feature](load)(csv) CSV import and export support header (#8765)
2022-04-18 15:29:18 +08:00
row_batch_interface.hpp
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
row_batch.cpp
[fix](brpc) Embed serialized request into the attachment and transmit it through http brpc (#9803)
2022-06-13 20:41:48 +08:00
row_batch.h
[spell] Fix spell error in row_batch.h (#10109)
2022-06-14 15:28:29 +08:00
runtime_filter_mgr.cpp
[improvement] send merged runtime filter asynchrously (#10080)
2022-06-14 08:16:25 +08:00
runtime_filter_mgr.h
[typo] Fix typos in comments (#10111)
2022-06-14 15:28:11 +08:00
runtime_state.cpp
[typo] Fix typos in runtime_state.cpp (#10112)
2022-06-14 15:27:40 +08:00
runtime_state.h
[fix](broker-scan-node) Remove trailing spaces in broker_scanner. Make it consistent with hive and trino behavior. (#9190)
2022-05-20 09:55:13 +08:00
small_file_mgr.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
small_file_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
snapshot_loader.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
snapshot_loader.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
sorted_run_merger.cc
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
sorted_run_merger.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
sorter.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
spill_sorter.cc
Fix some typos in be/. (#9681)
2022-05-19 20:55:39 +08:00
spill_sorter.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
string_buffer.hpp
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
string_search.hpp
[refactor](fe) Remove old fe meta version (#8246)
2022-02-28 17:47:01 +08:00
string_value.cpp
[refactor] add reference path for source file from impala (#9115)
2022-04-20 12:29:57 +08:00
string_value.h
[refactor][style] Use clang-format to sort includes (#9483)
2022-05-10 21:25:35 +08:00
string_value.hpp
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
tablets_channel.cpp
[refactor](load) add tablet errors when close_wait return error (#9619)
2022-05-22 21:27:42 +08:00
tablets_channel.h
[refactor](load) add tablet errors when close_wait return error (#9619)
2022-05-22 21:27:42 +08:00
tcmalloc_hook.h
[feature-wip] (memory tracker) (step6, End) Fix some details (#9301)
2022-05-10 18:17:09 +08:00
thread_context.cpp
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
thread_context.h
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
thread_mem_tracker_mgr.cpp
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
thread_mem_tracker_mgr.h
[fix](mem tracker) Fix some memory leaks, inaccurate statistics, core dump, deadlock bugs (#10072)
2022-06-14 21:38:37 +08:00
thread_resource_mgr.cpp
[Refactor] Cleanup some unused include (#9063)
2022-04-18 09:52:31 +08:00
thread_resource_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
threadlocal.cc
[Refactor] Cleanup some unused include (#9063)
2022-04-18 09:52:31 +08:00
threadlocal.h
[feature](thread-local) Add thread local variable ThreadContext (#7234)
2022-03-10 09:05:40 +08:00
tmp_file_mgr.cc
[fix](s3) fix s3 Temp file may write failed because of has no space on disk (#9421)
2022-05-09 09:28:43 +08:00
tmp_file_mgr.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
tuple_row.cpp
[refactor] add reference path for source file from impala (#9115)
2022-04-20 12:29:57 +08:00
tuple_row.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
tuple.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
tuple.h
[feature-wip][array-type] Support more sub types. (#9466)
2022-05-26 08:41:34 +08:00
type_limit.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00
types.cpp
[feature-wip](array-type) Support array type which doesn't contain null (#9809)
2022-06-12 23:35:28 +08:00
types.h
[feature-wip](array-type) Support array type which doesn't contain null (#9809)
2022-06-12 23:35:28 +08:00
user_function_cache.cpp
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
user_function_cache.h
[style] clang-format all c++ code (#9305)
2022-04-29 16:14:22 +08:00
vectorized_row_batch.cpp
[feature] Support pre-aggregation for quantile type (#8234)
2022-03-24 09:11:34 +08:00
vectorized_row_batch.h
[Refactor] Replace '#ifndef' with '#pragma once' (#9456)
2022-05-10 09:25:59 +08:00