database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
82f421a019556e34ee9fa5e8fbea4801beed7fca
doris/be/src/exec
History
Mingyu Chen 82f421a019 [fix](brpc-attachment) Fix bug that may cause BE crash when enable transfer_data_by_brpc_attachment (#7921) 
This PR mainly changes:

1. Fix bug when enable `transfer_data_by_brpc_attachment`

    In `data_stream_sender`, we will send a serialized PRowBatch data to multiple Channels.
    And if `transfer_data_by_brpc_attachment` is enabled, we will mistakenly clear the data in PRowBatch
    after sending PRowBatch to the first Channel.
    As a result, the following Channel cannot receive the correct data, causing an error.

    So I use a separate buffer instead of `tuple_data` in PRowBatch to store the serialized data
    and reuse it in multiple channels.

2. Fix bug that the the offset in serialized row batch may overflow

    Use int64 to replace int32 offset. And for compatibility, add a new field `new_tuple_offsets` in PRowBatch.
2022-02-01 08:51:16 +08:00
..
es
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
schema_scanner
[feat](mysql-compatibility) Increase compatibility with mysql (#7041)
2021-11-20 21:39:37 +08:00
aggregation_node_ir.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
aggregation_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
aggregation_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
analytic_eval_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
analytic_eval_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
assert_num_rows_node.cpp
Fixes some be typo (#4714)
2020-10-13 09:37:15 +08:00
assert_num_rows_node.h
[Planner]Enhance AssertNumRowsNode (#3485)
2020-05-08 12:49:48 +08:00
base_scanner.cpp
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
base_scanner.h
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
blocking_join_node.cpp
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
blocking_join_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
broker_reader.cpp
[config] use thrift_rpc_timeout_ms config replace hard code value (#6637)
2021-09-16 10:22:57 +08:00
broker_reader.h
add read buffer when use s3 reader (#5791)
2021-05-17 11:46:38 +08:00
broker_scan_node.cpp
[improvement](load) memory usage optimization for load job (#7454)
2021-12-24 21:30:28 +08:00
broker_scan_node.h
[fix](broker-load) BE may crash when using preceding filter in broker or routine load (#7193)
2021-11-30 22:04:05 +08:00
broker_scanner.cpp
[improvement](load) Improve load fault tolerance (#7674)
2022-01-20 09:23:21 +08:00
broker_scanner.h
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
broker_writer.cpp
[config] use thrift_rpc_timeout_ms config replace hard code value (#6637)
2021-09-16 10:22:57 +08:00
broker_writer.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
buffered_reader.cpp
[Profile] Support show load profile for broker load job (#6214)
2021-07-27 13:37:34 +08:00
buffered_reader.h
[Profile] Support show load profile for broker load job (#6214)
2021-07-27 13:37:34 +08:00
CMakeLists.txt
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
cross_join_node.cpp
[New Featrue] Support Vectorization Execution Engine Interface For Doris (#6329)
2021-08-11 14:54:06 +08:00
cross_join_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
csv_scan_node.cpp
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
csv_scan_node.h
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
csv_scanner.cpp
[LOG] Standardize the use of VLOG in code (#5264)
2021-01-21 12:09:09 +08:00
csv_scanner.h
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
data_sink.cpp
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
data_sink.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
decompressor.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
decompressor.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
empty_set_node.cpp
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
empty_set_node.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
es_http_scan_node.cpp
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
es_http_scan_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
es_http_scanner.cpp
[Enhance] Improve the readability of memtrackers' name (#5455)
2021-03-11 22:33:31 +08:00
es_http_scanner.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
es_scan_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
es_scan_node.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
except_node.cpp
[Optimize][Set Operation Node] Reduce the memory expansion operation of the hash table in ExceptNode and IntersectNode (#6915)
2021-11-12 10:39:59 +08:00
except_node.h
[Refactor] Fixes some be typo part 2 (#4747)
2020-10-20 09:28:57 +08:00
exchange_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
exchange_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
exec_node.cpp
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
exec_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
file_reader.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
file_writer.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
hash_join_node_ir.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
hash_join_node.cpp
[Optimize](Runtime Filter) Support merge in runtime filter(#7546) (#7547)
2022-01-06 19:08:35 +08:00
hash_join_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
hash_table.cpp
dd a method to get doris current memory usage (#6979)
2021-11-24 10:07:54 +08:00
hash_table.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
hash_table.hpp
[BUG] Fix Left Semi Join Got a Wrong Result (#6379)
2021-08-07 21:33:44 +08:00
hdfs_file_reader.cpp
mark the load job fail when more than a half of replica write failed of a tablet, (#7126)
2021-11-17 10:18:04 +08:00
hdfs_file_reader.h
[ARM64] Fix some problem when compiling on ARM64 platform (#6836)
2021-10-16 21:56:49 +08:00
hdfs_reader_writer.cpp
[ARM64] Fix some problem when compiling on ARM64 platform (#6836)
2021-10-16 21:56:49 +08:00
hdfs_reader_writer.h
[ARM64] Fix some problem when compiling on ARM64 platform (#6836)
2021-10-16 21:56:49 +08:00
hdfs_writer.cpp
[docs] Add user manual for hdfs load and transaction. (#7497)
2021-12-30 10:22:48 +08:00
hdfs_writer.h
[ARM64] Fix some problem when compiling on ARM64 platform (#6836)
2021-10-16 21:56:49 +08:00
intersect_node.cpp
[Optimize][Set Operation Node] Reduce the memory expansion operation of the hash table in ExceptNode and IntersectNode (#6915)
2021-11-12 10:39:59 +08:00
intersect_node.h
[Refactor] Fixes some be typo part 2 (#4747)
2020-10-20 09:28:57 +08:00
json_scanner.cpp
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
json_scanner.h
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
line_reader.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
local_file_reader.cpp
add read buffer when use s3 reader (#5791)
2021-05-17 11:46:38 +08:00
local_file_reader.h
add read buffer when use s3 reader (#5791)
2021-05-17 11:46:38 +08:00
local_file_writer.cpp
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
local_file_writer.h
[OUTFILE] Support INTO OUTFILE to export query result (#3584)
2020-05-25 21:24:56 +08:00
lzo_decompressor.cpp
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
merge_join_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
merge_join_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
merge_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
merge_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
mysql_scan_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
mysql_scan_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
mysql_scanner.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
mysql_scanner.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
odbc_connector.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
odbc_connector.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
odbc_scan_node.cpp
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
odbc_scan_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
olap_common.cpp
[refactor] Remove decimal v1 related code from code base (#6079)
2021-07-07 10:26:32 +08:00
olap_common.h
[Bug] big_int * big_int product overflow (#6788)
2021-10-03 12:17:03 +08:00
olap_scan_node.cpp
[feature] add Generic debug timer for debugging or profiling (#7923)
2022-01-31 22:15:43 +08:00
olap_scan_node.h
[feature] add Generic debug timer for debugging or profiling (#7923)
2022-01-31 22:15:43 +08:00
olap_scanner.cpp
[feature] add Generic debug timer for debugging or profiling (#7923)
2022-01-31 22:15:43 +08:00
olap_scanner.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
olap_utils.h
[chore] Prolog of hermetic build with GCC 11 and Clang 13. (#7712)
2022-01-21 12:12:04 +08:00
orc_scanner.cpp
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
orc_scanner.h
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
parquet_reader.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
parquet_reader.h
[Dependency] Upgrade thirdparty libs (#6766)
2021-10-15 13:03:04 +08:00
parquet_scanner.cpp
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
parquet_scanner.h
[improvement](Load) Cancel the load job ASAP when encounter unqualified data (#6319)
2022-01-18 13:13:55 +08:00
parquet_writer.cpp
[feature] Support return bitmp/hll data in select statement (#7276)
2021-12-15 09:48:27 +08:00
parquet_writer.h
[feature] Support return bitmp/hll data in select statement (#7276)
2021-12-15 09:48:27 +08:00
partitioned_aggregation_node_ir.cc
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
partitioned_aggregation_node.cc
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
partitioned_aggregation_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
partitioned_hash_table_ir.cc
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
partitioned_hash_table.cc
dd a method to get doris current memory usage (#6979)
2021-11-24 10:07:54 +08:00
partitioned_hash_table.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
partitioned_hash_table.inline.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
pl_task_root.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
pl_task_root.h
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
plain_binary_line_reader.cpp
[Feature][Insert] Add transaction for the operation of insert #6244 (#6245)
2021-07-21 10:54:11 +08:00
plain_binary_line_reader.h
[Feature][Insert] Add transaction for the operation of insert #6244 (#6245)
2021-07-21 10:54:11 +08:00
plain_text_line_reader.cpp
add read buffer when use s3 reader (#5791)
2021-05-17 11:46:38 +08:00
plain_text_line_reader.h
[Load] Support multi bytes LineDelimiter and ColumnSeparator (#5462)
2021-03-09 09:35:39 +08:00
read_write_util.cpp
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
read_write_util.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
repeat_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
repeat_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
row_batch_list.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
s3_reader.cpp
[fix] fix malloc and free mismatch issue (#7702)
2022-01-14 09:32:33 +08:00
s3_reader.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
s3_writer.cpp
[fix] fix malloc and free mismatch issue (#7702)
2022-01-14 09:32:33 +08:00
s3_writer.h
[Outfile] Support concurrent export of query results (#6539)
2021-09-07 11:53:32 +08:00
scan_node.cpp
update gcc to gcc 10 and support c++17 (#5394)
2021-03-25 09:30:38 +08:00
scan_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
scanner_ir.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
schema_scan_node.cpp
[feat](mysql-compatibility) Increase compatibility with mysql (#7041)
2021-11-20 21:39:37 +08:00
schema_scan_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
schema_scanner.cpp
[feat](mysql-compatibility) Increase compatibility with mysql (#7041)
2021-11-20 21:39:37 +08:00
schema_scanner.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
select_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
select_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
set_operation_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
set_operation_node.h
[Optimize][Set Operation Node] Reduce the memory expansion operation of the hash table in ExceptNode and IntersectNode (#6915)
2021-11-12 10:39:59 +08:00
sort_exec_exprs.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
sort_exec_exprs.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
spill_sort_node.cc
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
spill_sort_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
table_function_node.cpp
[fix](lateral-view) Fix some lateral view bugs (#7772)
2022-01-18 12:09:32 +08:00
table_function_node.h
[fix](lateral-view) Fix some lateral view bugs (#7772)
2022-01-18 12:09:32 +08:00
tablet_info.cpp
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
tablet_info.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
tablet_sink.cpp
[fix](brpc-attachment) Fix bug that may cause BE crash when enable transfer_data_by_brpc_attachment (#7921)
2022-02-01 08:51:16 +08:00
tablet_sink.h
[fix](brpc-attachment) Fix bug that may cause BE crash when enable transfer_data_by_brpc_attachment (#7921)
2022-02-01 08:51:16 +08:00
text_converter.cpp
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
text_converter.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
text_converter.hpp
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
topn_node.cpp
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
topn_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00
union_node_ir.cpp
[CodeFormat] Clang-format cpp sources (#4965)
2020-11-28 18:36:49 +08:00
union_node.cpp
[Bug] Fix bug that query multi mysql external table with union will get incomplete result (#5067)
2020-12-15 09:28:39 +08:00
union_node.h
[refactor] replace boost smart ptr with stl (#6856)
2021-11-17 10:18:35 +08:00