database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
b4663062da972d95297e374155c13a6de8d16ab0
doris/be/src/vec/exec
History
Ashin Gau b4663062da [feature-wip](parquet-reader) bug fix, parquet footer buffer is small when containing many columns (#12477) 
Failed when reading parquet file with many columns(>1600).

mysql> select int_col from types_sf100_r100w limit 5;
ERROR 1105 (HY000): errCode = 2, detailMessage = Couldn't deserialize thrift msg:
TProtocolException: Invalid data
parse_thrift_footer uses fixed length buffer(=64k) to read parquet footer, but the meta data of a parquet file with 1600 columns can exceed 5MB.

Therefore, the buffer size needs to be applied according to the actual length.
2022-09-09 09:12:34 +08:00
..
format/parquet
[feature-wip](parquet-reader) bug fix, parquet footer buffer is small when containing many columns (#12477)
2022-09-09 09:12:34 +08:00
join
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan (#11842)
2022-08-30 16:17:10 +08:00
scan
[fix](scan) fix potential wrong cancel when sql has limit (#12224)
2022-09-01 19:11:40 +08:00
tablefunction
Fix compilation error reported by clang (#10494)
2022-06-29 20:38:06 +08:00
file_arrow_scanner.cpp
[fix](core)fix bug for status not init(#11730)
2022-08-12 17:42:37 +08:00
file_arrow_scanner.h
[improvement](arrow) add arrow block convertion time profile (#11072)
2022-07-22 22:11:33 +08:00
file_hdfs_scanner.cpp
[feature-wip](parquet-reader) bug fix, create compress codec before parsing dictionary (#12422)
2022-09-08 09:54:25 +08:00
file_hdfs_scanner.h
[feature-wip](parquet-reader) bug fix, create compress codec before parsing dictionary (#12422)
2022-09-08 09:54:25 +08:00
file_scan_node.cpp
[fix](projections) get error row_descriptor when have projections on ExecNode (#12232)
2022-09-01 10:48:10 +08:00
file_scan_node.h
[feature-wip](multi-catalog) Support runtime filter for file scan node (#11000)
2022-07-20 12:36:57 +08:00
file_scanner.cpp
[feature-wip](multi-catalog)(fix) partition value error when a block contains multiple splits (#11260)
2022-07-29 18:48:59 +08:00
file_scanner.h
[feature-wip](multi-catalog)(fix) partition value error when a block contains multiple splits (#11260)
2022-07-29 18:48:59 +08:00
file_text_scanner.cpp
[feature-wip](multi-catalog)(fix) partition value error when a block contains multiple splits (#11260)
2022-07-29 18:48:59 +08:00
file_text_scanner.h
[improvement](parquet-reader) Add some profile for parquet reader (#10740)
2022-07-11 12:19:06 +08:00
vaggregation_node.cpp
[fix](agg) crash caused by failure of prepare (#12437)
2022-09-08 15:03:45 +08:00
vaggregation_node.h
[chore](profile) add some counters in aggregatation & sender (#12385)
2022-09-07 10:09:05 +08:00
vanalytic_eval_node.cpp
[fix](projections) get error row_descriptor when have projections on ExecNode (#12232)
2022-09-01 10:48:10 +08:00
vanalytic_eval_node.h
[TYPO] fix typo 'destory' -> 'destroy' (#10373)
2022-06-24 19:11:28 +08:00
varrow_scanner.cpp
[fix](core)fix bug for status not init(#11730)
2022-08-12 17:42:37 +08:00
varrow_scanner.h
[feature](multi-catalog) read parquet file by start/offset (#10843)
2022-07-18 20:51:08 +08:00
vassert_num_rows_node.cpp
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan (#11842)
2022-08-30 16:17:10 +08:00
vassert_num_rows_node.h
[refactor] fix warings when compile with clang (#8069)
2022-02-19 11:29:02 +08:00
vblocking_join_node.cpp
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan (#11842)
2022-08-30 16:17:10 +08:00
vblocking_join_node.h
[refactor][style] Use clang-format to sort includes (#9483)
2022-05-10 21:25:35 +08:00
vbroker_scan_node.cpp
[Bug](load) block call clear_column_data may have ref not equal 1 (#12350)
2022-09-05 20:40:40 +08:00
vbroker_scan_node.h
[Refactor] Refactor vectorized scan node (#9968)
2022-06-16 11:10:56 +08:00
vbroker_scanner.cpp
[Opt](load) Speed up the vectorized load (#12146)
2022-08-31 16:23:36 +08:00
vbroker_scanner.h
[Opt][VecLoad] Opt the vec stream load performance (#9772)
2022-05-31 11:53:32 +08:00
vcross_join_node.cpp
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan (#11842)
2022-08-30 16:17:10 +08:00
vcross_join_node.h
[enhancement] Refactor to improve the usability of MemTracker (step2) (#10823)
2022-07-21 17:11:28 +08:00
vempty_set_node.cpp
[feature](tracing) Support query tracing to improve doris observability by introducing OpenTelemetry. (#10533)
2022-07-09 15:50:40 +08:00
vempty_set_node.h
[refactor] fix warings when compile with clang (#8069)
2022-02-19 11:29:02 +08:00
ves_http_scan_node.cpp
[fix](exec-node) fix nullptr of runtime state (#12395)
2022-09-07 08:46:42 +08:00
ves_http_scan_node.h
[Bug](function) fix dcheck fail on close vexpr ctx (#11908)
2022-08-19 19:11:10 +08:00
ves_http_scanner.cpp
[Bug](doe) fix closing scanner twice (#12408)
2022-09-07 22:45:30 +08:00
ves_http_scanner.h
[Bug](doe) fix closing scanner twice (#12408)
2022-09-07 22:45:30 +08:00
vexcept_node.cpp
[fix](core)fix bug for status not init(#11730)
2022-08-12 17:42:37 +08:00
vexcept_node.h
[refactor] fix warings when compile with clang (#8069)
2022-02-19 11:29:02 +08:00
vexchange_node.cpp
[enhancement] Refactor to improve the usability of MemTracker (step2) (#10823)
2022-07-21 17:11:28 +08:00
vexchange_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
vintersect_node.cpp
[fix](core)fix bug for status not init(#11730)
2022-08-12 17:42:37 +08:00
vintersect_node.h
[refactor] fix warings when compile with clang (#8069)
2022-02-19 11:29:02 +08:00
vjdbc_connector.cpp
[Feature](Vectorized) support jdbc scan node (#12010)
2022-09-07 10:29:41 +08:00
vjdbc_connector.h
[Feature](Vectorized) support jdbc scan node (#12010)
2022-09-07 10:29:41 +08:00
vjdbc_scan_node.cpp
[Feature](Vectorized) support jdbc scan node (#12010)
2022-09-07 10:29:41 +08:00
vjdbc_scan_node.h
[Feature](Vectorized) support jdbc scan node (#12010)
2022-09-07 10:29:41 +08:00
vjson_scanner.cpp
[fix](stream load) Fix wrong conversion of null value when vstream load json format (#12460)
2022-09-08 16:48:35 +08:00
vjson_scanner.h
(vec-stream-load-json) simdjson throw execption lead to core dump (#11880)
2022-08-18 10:27:34 +08:00
vmysql_scan_node.cpp
[enhancement] Refactor to improve the usability of MemTracker (step2) (#10823)
2022-07-21 17:11:28 +08:00
vmysql_scan_node.h
[Refactor] Refactor vectorized scan node (#9968)
2022-06-16 11:10:56 +08:00
vodbc_scan_node.cpp
[Bug](ODBC) fix vectorized null value error report in odbc scan node (#11420)
2022-08-02 15:44:12 +08:00
vodbc_scan_node.h
[Bug](ODBC) fix vectorized null value error report in odbc scan node (#11420)
2022-08-02 15:44:12 +08:00
volap_scan_node.cpp
[fix](memtracker) Fix the exceeded limit of the first query execution (#12332)
2022-09-05 19:22:46 +08:00
volap_scan_node.h
[feature-wip](scan) add profile for new olap scan node (#12042)
2022-08-30 10:55:48 +08:00
volap_scanner.cpp
[bugfix](delete hanlder) delete predicate is merged and could not find schema cause core dump (#12161)
2022-08-30 09:18:21 +08:00
volap_scanner.h
[minor](conjuncts) remove row-based conjuncts from vectorized engine (#12053)
2022-08-25 10:13:20 +08:00
vorc_scanner.cpp
[feature-wip](multi-catalog) Support orc format file split for file scan node (#11046)
2022-07-25 11:41:46 +08:00
vorc_scanner.h
[feature](multi-catalog) read parquet file by start/offset (#10843)
2022-07-18 20:51:08 +08:00
vparquet_scanner.cpp
[feature](multi-catalog) read parquet file by start/offset (#10843)
2022-07-18 20:51:08 +08:00
vparquet_scanner.h
[feature](multi-catalog) read parquet file by start/offset (#10843)
2022-07-18 20:51:08 +08:00
vrepeat_node.cpp
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan (#11842)
2022-08-30 16:17:10 +08:00
vrepeat_node.h
[fix] Fix the query result error caused by the grouping sets statemen… (#11316)
2022-08-01 13:52:18 +08:00
vschema_scan_node.cpp
[Improvement][chore] replace from_decv2_to_packed128 to decv2.value (#11261)
2022-07-28 10:41:27 +08:00
vschema_scan_node.h
[compile&build]clang compile errors fix (#10201)
2022-06-17 08:41:25 +08:00
vselect_node.cpp
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan (#11842)
2022-08-30 16:17:10 +08:00
vselect_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00
vset_operation_node.cpp
[feature](Nereids)add the ability of projection on each ExecNode and add column prune on OlapScan (#11842)
2022-08-30 16:17:10 +08:00
vset_operation_node.h
[enhancement] Refactor to improve the usability of MemTracker (step2) (#10823)
2022-07-21 17:11:28 +08:00
vsort_exec_exprs.cpp
[enhancement] Refactor to improve the usability of MemTracker (step2) (#10823)
2022-07-21 17:11:28 +08:00
vsort_exec_exprs.h
[enhancement] Refactor to improve the usability of MemTracker (step2) (#10823)
2022-07-21 17:11:28 +08:00
vsort_node.cpp
[Improvement](sort) Accumulate blocks to do partial sort (#12336)
2022-09-07 10:34:28 +08:00
vsort_node.h
[Improvement](sort) Accumulate blocks to do partial sort (#12336)
2022-09-07 10:34:28 +08:00
vtable_function_node.cpp
[fix](projections) get error row_descriptor when have projections on ExecNode (#12232)
2022-09-01 10:48:10 +08:00
vtable_function_node.h
[Enhancement](table_function) table function node enhancement (#12038)
2022-08-26 10:37:15 +08:00
vtable_valued_function_scannode.cpp
[refactor] Remove debug action since it is never used. (#10484)
2022-06-29 20:37:51 +08:00
vtable_valued_function_scannode.h
[feature] add table valued function framework and numbers table valued function (#10214)
2022-06-28 14:01:57 +08:00
vunion_node.cpp
[fix](projections) get error row_descriptor when have projections on ExecNode (#12232)
2022-09-01 10:48:10 +08:00
vunion_node.h
[feature](vectorization) Support Vectorized Exec Engine In Doris (#7785)
2022-01-18 10:07:15 +08:00