doris

rowset

[cherry-pick](branch-2.1) Pick "[Fix](Rowset Id) Use a randomly generated rowset ID to handle memory write failures (#42949 )" (#44086 )

2024-12-10 15:48:02 +08:00

task

branch-2.1: [fix](clone) Fix wrong clone file path #44746 (#44773 )

2024-11-29 14:09:16 +08:00

wal

[fix](cloud) cloud group commit should skip repaly wal if label is already used and the txn state is committed or visible (#41262 ) (#41461 )

2024-10-10 22:27:04 +08:00

accept_null_predicate.h

[Bug](predicate) fix wrong result of AcceptNullPredicate (#39497 ) (#39672 )

2024-08-22 00:24:57 +08:00

base_compaction.cpp

[enhancement](compaction) optimizing memory usage for compaction (#37099 ) (#37486 )

2024-08-04 10:49:18 +08:00

base_compaction.h

Prevent making snapshot on remote rowset in single replica compaction (#28716 )

2023-12-27 23:43:43 +08:00

base_tablet.cpp

[feature](compaction) Add an http action for visibility of compaction score on each tablet (#38489 ) (#40826 )

2024-09-21 20:35:55 +08:00

base_tablet.h

[feature](compaction) Add an http action for visibility of compaction score on each tablet (#38489 ) (#40826 )

2024-09-21 20:35:55 +08:00

binlog_config.cpp

…

binlog_config.h

…

binlog.h

…

bitmap_filter_predicate.h

branch-2.1: [Bug](bitmap-filter) fix wrong type cast on BitmapFilterColumnPredicate::evaluate #43877 (#43886 )

2024-11-15 00:02:51 +08:00

block_column_predicate.cpp

[refactor](exception safe) Refactor delete handler and block column predicates to make sure exception safe (#31618 )

2024-03-01 14:21:17 +08:00

block_column_predicate.h

[refactor](exception safe) Refactor delete handler and block column predicates to make sure exception safe (#31618 )

2024-03-01 14:21:17 +08:00

bloom_filter_predicate.h

[Bug](runtime-filter) fix core dump on rf between varchar and char #43758 (#43934 )

2024-11-16 15:59:19 +08:00

bloom_filter.hpp

…

calc_delete_bitmap_executor.cpp

[opt](memory) Optimize mem tracker accuracy (#32039 ) (#33140 )

2024-04-10 11:42:19 +08:00

calc_delete_bitmap_executor.h

[opt](memory) Optimize mem tracker accuracy (#32039 ) (#33140 )

2024-04-10 11:42:19 +08:00

CMakeLists.txt

…

cold_data_compaction.cpp

[enhancement](rowset-meta) Remove rowset meta from olap meta directly when rowsets deleted (#41716 ) (#43183 )

2024-11-05 00:40:12 +08:00

cold_data_compaction.h

…

column_mapping.h

[fix](schema-change) Fix wrong intput column for cast validity check (#38894 ) (#39107 )

2024-08-08 19:36:06 +08:00

column_predicate.h

[improvement](inverted index) Change inverted index field_name from column_name to id in format v2 #36470 (#36516 )

2024-06-19 17:29:26 +08:00

compaction_permit_limiter.cpp

[fix] (compaction) fix CompactionPermitLimiter causing compaction to stall (#35078 )

2024-05-28 18:52:34 +08:00

compaction_permit_limiter.h

…

compaction.cpp

[branch-2.1]Add customStdAllocator for vector/map (#41193 ) (#45124 )

2024-12-09 18:33:51 +08:00

compaction.h

[branch-2.1]Add customStdAllocator for vector/map (#41193 ) (#45124 )

2024-12-09 18:33:51 +08:00

comparison_predicate.h

[fix] (bloom filter) Fix the bloom filter calculation for date and datetime (#43351 ) (#43622 )

2024-11-12 10:56:55 +08:00

cumulative_compaction_policy.cpp

[Cherry-pick](branch-2.1) Pick #34043 and #34112 (#34318 )

2024-04-30 07:26:23 +08:00

cumulative_compaction_policy.h

(invert index) modify of time series compaction policy

2024-03-22 08:16:30 +08:00

cumulative_compaction_time_series_policy.cpp

Revert "[fix] (compaction) fix compaction score in time series policy (#40242 )" (#44527 )

2024-11-26 12:18:59 +08:00

cumulative_compaction_time_series_policy.h

(invert index) modify of time series compaction policy

2024-03-22 08:16:30 +08:00

cumulative_compaction.cpp

Revert "[fix](compaction) fix the longest continuous rowsets cannot be selected when missing rowsets (#38728 ) (#39262 )" (#40375 )

2024-09-05 00:01:03 +08:00

cumulative_compaction.h

Prevent making snapshot on remote rowset in single replica compaction (#28716 )

2023-12-27 23:43:43 +08:00

data_dir.cpp

[enhancement](trash) support skip trash, update trash default expire time (#37170 ) (#37409 )

2024-07-08 15:33:02 +08:00

data_dir.h

[fix](clone) Fix clone and alter tablet use same tablet path #34889 (#36858 )

2024-06-30 20:40:54 +08:00

decimal12.h

[refactor](storage) Expressing the types of computation layer and storage layer in PrimitiveTypeTraits (#26191 )

2023-11-15 21:34:49 +08:00

delete_bitmap_calculator.cpp

branch-2.1: [Fix](merge-on-write) Fix MergeIndexDeleteBitmapCalculator::calculate_one() coredump #44284 (#44330 )

2024-11-20 21:07:43 +08:00

delete_bitmap_calculator.h

[feature-wip](merge-on-write) MOW table support different primary keys and sort keys (#24788 )

2023-11-24 16:37:30 +08:00

delete_handler.cpp

[fix](delete) Fix static type dispatch by mistake due to typo (#42260 ) (#43488 )

2024-11-11 17:44:20 +08:00

delete_handler.h

[fix](delete) Fix static type dispatch by mistake due to typo (#42260 ) (#43488 )

2024-11-11 17:44:20 +08:00

delta_writer_context.h

[fix](move-memtable) fix schema use-after-free in delta writer v2 (#30254 )

2024-01-24 10:00:25 +08:00

delta_writer_v2.cpp

[branch-2.1] pick some workload group pr (#44634 )

2024-11-27 09:42:41 +08:00

delta_writer_v2.h

[fix](move-memtable) check segment num when closing each tablet (#36753 ) (#37536 )

2024-07-11 20:33:44 +08:00

delta_writer.cpp

[branch-2.1] pick some workload group pr (#44634 )

2024-11-27 09:42:41 +08:00

delta_writer.h

[Refactor](Sink) Remove is_append mode in table sink (#34684 )

2024-05-11 11:20:10 +08:00

field.h

[improvement](inverted index) Change inverted index field_name from column_name to id in format v2 #36470 (#36516 )

2024-06-19 17:29:26 +08:00

file_header.h

[enhance](FS) Improve FS error code (#29432 )

2024-01-06 21:17:22 +08:00

full_compaction.cpp

[cherry-pick](branch-2.1) Pick "[Fix](full compaction) Full compaction should not do ordered data compaction (#44359 )" (#44529 )

2024-11-26 12:21:30 +08:00

full_compaction.h

Prevent making snapshot on remote rowset in single replica compaction (#28716 )

2023-12-27 23:43:43 +08:00

hll.cpp

[fix](ub) fix uninitialized accesses in BE (#35370 )

2024-05-29 20:31:07 +08:00

hll.h

[fix](ub) fix uninitialized accesses in BE (#35370 )

2024-05-29 20:31:07 +08:00

in_list_predicate.h

[Bug](predicate) Fixed the problem that the number of rows in inlist #41824 (#41910 )

2024-10-17 17:13:00 +08:00

inverted_index_parser.cpp

[opt](inverted index) the "unicode" tokenizer can be configured to disable stop words. (#34467 )

2024-05-07 18:23:43 +08:00

inverted_index_parser.h

[pick 2.1 ][fix ut][fix](inverted index) cloud mode supports lowercase (#32841 ) (#36034 )

2024-06-07 17:08:29 +08:00

iterators.h

[Chore](inverted index) remove useless code of compound filters for inverted index #40258 (#41448 )

2024-09-29 17:27:29 +08:00

itoken_extractor.cpp

…

itoken_extractor.h

…

key_coder.cpp

…

key_coder.h

…

like_column_predicate.cpp

[Feature](runtime filter) normalize ignore runtime filter (#30152 )

2024-02-03 20:24:39 +08:00

like_column_predicate.h

[Fix](compile) Fix gcc compile on master (#33864 )

2024-04-19 23:41:37 +08:00

lru_cache.cpp

[improvement](segmentcache) limit segment cache by memory or segment … (#37035 )

2024-06-30 20:34:13 +08:00

lru_cache.h

[improvement](segmentcache) limit segment cache by memory or segment … (#37035 )

2024-06-30 20:34:13 +08:00

match_predicate.cpp

[feature](inverted index) String type inverted index match function c… (#38872 )

2024-08-06 09:06:05 +08:00

match_predicate.h

[feature](inverted index) String type inverted index match function c… (#38872 )

2024-08-06 09:06:05 +08:00

memtable_flush_executor.cpp

[branch-2.1] pick some workload group pr (#44634 )

2024-11-27 09:42:41 +08:00

memtable_flush_executor.h

[branch-2.1] pick some workload group pr (#44634 )

2024-11-27 09:42:41 +08:00

memtable_memory_limiter.cpp

[improve](load) do not block delta writer if memtable memory is low (#42649 ) (#44305 )

2024-11-21 11:17:35 +08:00

memtable_memory_limiter.h

[improve](load) reduce memory reserved in memtable limiter (#37511 ) (#37699 )

2024-07-15 11:09:09 +08:00

memtable_writer.cpp

[branch-2.1] pick some workload group pr (#44634 )

2024-11-27 09:42:41 +08:00

memtable_writer.h

[branch-2.1] pick some workload group pr (#44634 )

2024-11-27 09:42:41 +08:00

memtable.cpp

[cherrypick](branch21) pick some exception handleing pr in page io (#40883 )

2024-09-16 08:56:43 +08:00

memtable.h

[cherrypick](branch21) pick some exception handleing pr in page io (#40883 )

2024-09-16 08:56:43 +08:00

merger.cpp

[fix](block-reader) Make rowsets union iterating work (#40877 ) (#43175 )

2024-11-08 10:05:10 +08:00

merger.h

[fix](merge-on-write) segcompaction should process delete bitmap if necessary (#38369 ) (#39707 )

2024-08-22 00:42:56 +08:00

metadata_adder.h

[branch-2.1]count tablet meta's static memory load from disk (#41429 ) (#45128 )

2024-12-09 14:44:20 +08:00

null_predicate.cpp

[improvement](inverted index) Change inverted index field_name from column_name to id in format v2 #36470 (#36516 )

2024-06-19 17:29:26 +08:00

null_predicate.h

[improvement](inverted index) Change inverted index field_name from column_name to id in format v2 #36470 (#36516 )

2024-06-19 17:29:26 +08:00

olap_common.h

[cherry-pick](branch-2.1) Pick "[Fix](Rowset Id) Use a randomly generated rowset ID to handle memory write failures (#42949 )" (#44086 )

2024-12-10 15:48:02 +08:00

olap_define.h

[feature](spill) Implement spill to disk for hash join, aggregation and sort for pipelineX (#31910 )

2024-03-12 14:12:09 +08:00

olap_meta.cpp

[chore] Add bvar for meta operations of BE (#28374 )

2023-12-19 15:54:19 +08:00

olap_meta.h

…

olap_server.cpp

branch-2.1: [fix](compaction) tablet is not removed in compaction queue if dropped #45085 (#45136 )

2024-12-07 12:15:20 +08:00

olap_tuple.h

…

options.cpp

[opt](file cache) make the cache queue percentage configurable (#29537 )

2024-01-12 11:36:58 +08:00

options.h

[opt](file cache) make the cache queue percentage configurable (#29537 )

2024-01-12 11:36:58 +08:00

page_cache.cpp

[branch-2.1](memory) Pick some memory GC patch (#37725 )

2024-07-14 15:19:40 +08:00

page_cache.h

[branch-2.1](memory) Pick some memory GC patch (#37725 )

2024-07-14 15:19:40 +08:00

parallel_scanner_builder.cpp

[opt](scan) Release instances of Segment to avoid consuming a large amount of memory in ParallelScannerBuilder (#44189 ) (#44608 )

2024-11-26 19:25:58 +08:00

parallel_scanner_builder.h

[opt](scan) Release instances of Segment to avoid consuming a large amount of memory in ParallelScannerBuilder (#44189 ) (#44608 )

2024-11-26 19:25:58 +08:00

partial_update_info.cpp

[branch-2.1] Picks "[Fix](partial update) Fix __DORIS_SEQUENCE_COL__ is not set for newly inserted rows in partial update #40272 " (#40964 )

2024-09-26 22:54:27 +08:00

partial_update_info.h

[branch-2.1] Picks "[Fix](partial update) Fix __DORIS_SEQUENCE_COL__ is not set for newly inserted rows in partial update #40272 " (#40964 )

2024-09-26 22:54:27 +08:00

pb_helper.h

…

predicate_creator.h

[refactor](storage) Expressing the types of computation layer and storage layer in PrimitiveTypeTraits (#26191 )

2023-11-15 21:34:49 +08:00

primary_key_index.cpp

[enhancement](oom) return error when bloom filter allocate memory failed (#35790 )

2024-06-03 18:22:11 +08:00

primary_key_index.h

[enhancement](mow) Add bvar for bloom filter and segment (#32355 )

2024-03-22 08:52:12 +08:00

push_handler.cpp

[Opt](load) Optimize the error messages of -235 and -238 for loading #41048 (#41638 )

2024-10-10 14:20:52 +08:00

push_handler.h

[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default (#27587 )

2023-11-28 13:02:30 +08:00

row_cursor_cell.h

[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default (#27587 )

2023-11-28 13:02:30 +08:00

row_cursor.cpp

[Improve](TabletSchemaCache) reduce duplicated memory consumption for column name and column path (#31141 )

2024-03-09 19:44:42 +08:00

row_cursor.h

[Improve](TabletSchemaCache) reduce duplicated memory consumption for column name and column path (#31141 )

2024-03-09 19:44:42 +08:00

rowid_conversion.h

[branch-2.1]Add customStdAllocator for vector/map (#41193 ) (#45124 )

2024-12-09 18:33:51 +08:00

rowset_builder.cpp

[Opt](load) Optimize the error messages of -235 and -238 for loading #41048 (#41638 )

2024-10-10 14:20:52 +08:00

rowset_builder.h

[branch-2.1] Picks "[opt](merge-on-write) Skip the alignment process of some rowsets in partial update #38487 " (#38682 )

2024-08-02 20:05:31 +08:00

schema_cache.cpp

[pick](SchemaCache) remove redundant Schema cache (#40257 )

2024-09-02 19:24:03 +08:00

schema_cache.h

[pick](SchemaCache) remove redundant Schema cache (#40257 )

2024-09-02 19:24:03 +08:00

schema_change.cpp

[enhancement](rowset-meta) Remove rowset meta from olap meta directly when rowsets deleted (#41716 ) (#43183 )

2024-11-05 00:40:12 +08:00

schema_change.h

[enhancement](schema-change) Make the schema change memory space adaptive (#40822 )

2024-09-14 11:17:41 +08:00

schema.cpp

[Improve](TabletSchemaCache) reduce duplicated memory consumption for column name and column path (#31141 )

2024-03-09 19:44:42 +08:00

schema.h

[Improve](TabletSchemaCache) reduce duplicated memory consumption for column name and column path (#31141 )

2024-03-09 19:44:42 +08:00

segment_loader.cpp

[bugfix](segmentload) should remove segment from segment cache if load segment failed (#41608 ) (#41660 )

2024-10-10 19:40:22 +08:00

segment_loader.h

[bugfix](becore) use after free problem when the segment is pop (#41685 ) (#41697 )

2024-10-11 14:07:46 +08:00

selection_vector.h

[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default (#27587 )

2023-11-28 13:02:30 +08:00

shared_predicate.h

[Bug](predicate) fix wrong result of AcceptNullPredicate (#39497 ) (#39672 )

2024-08-22 00:24:57 +08:00

short_key_index.cpp

[fix](segment cache) estimate momory consumed by segment (#35647 ) (#35751 )

2024-06-01 09:34:32 +08:00

short_key_index.h

[fix](segment cache) estimate momory consumed by segment (#35647 ) (#35751 )

2024-06-01 09:34:32 +08:00

simple_rowid_conversion.h

[branch-2.1]Add customStdAllocator for vector/map (#41193 ) (#45124 )

2024-12-09 18:33:51 +08:00

single_replica_compaction.cpp

[improve](http) Save the requested url in http execution error #43855 (#44106 )

2024-11-18 15:06:02 +08:00

single_replica_compaction.h

[improve](http) Save the requested url in http execution error #43855 (#44106 )

2024-11-18 15:06:02 +08:00

snapshot_manager.cpp

[fix](snapshot) Link binlog files according to consistent rowsets #41319 (#41345 )

2024-09-26 21:47:21 +08:00

snapshot_manager.h

[feature](restore) support atomic restore (#41107 )

2024-09-24 09:41:41 +08:00

storage_engine.cpp

[enhancement](schema-change) Make the schema change memory space adaptive (#40822 )

2024-09-14 11:17:41 +08:00

storage_engine.h

[branch-2.1]add internal workload group (#42006 ) (#44592 )

2024-11-26 17:09:55 +08:00

storage_policy.cpp

[chore](StoragePolicy) Don't print stack when invoking the storage manager #28091

2023-12-07 10:06:31 +08:00

storage_policy.h

…

tablet_column_object_pool.cpp

[Opt](TabletSchema) reuse TabletColumn info to reduce mem (#42448 ) (#43349 )

2024-11-11 10:38:42 +08:00

tablet_column_object_pool.h

[Opt](TabletSchema) reuse TabletColumn info to reduce mem (#42448 ) (#43349 )

2024-11-11 10:38:42 +08:00

tablet_fwd.h

…

tablet_manager.cpp

branch-2.1: [fix](compaction) tablet is not removed in compaction queue if dropped #45085 (#45136 )

2024-12-07 12:15:20 +08:00

tablet_manager.h

[fix](compaction) fixing the inaccurate statistics of concurrent compaction tasks (#37318 ) (#37496 )

2024-07-10 22:23:25 +08:00

tablet_meta_manager.cpp

branch-2.1: [fix](compaction) tablet is not removed in compaction queue if dropped #45085 (#45136 )

2024-12-07 12:15:20 +08:00

tablet_meta_manager.h

[fix](typo) typo fix for 'delete bimap' changing to 'delete bitmap' (#32341 )

2024-04-10 11:34:30 +08:00

tablet_meta.cpp

[branch-2.1]count tablet meta's static memory load from disk (#41429 ) (#45128 )

2024-12-09 14:44:20 +08:00

tablet_meta.h

[branch-2.1]count tablet meta's static memory load from disk (#41429 ) (#45128 )

2024-12-09 14:44:20 +08:00

tablet_reader.cpp

[fix](block-reader) Make rowsets union iterating work (#40877 ) (#43175 )

2024-11-08 10:05:10 +08:00

tablet_reader.h

[fix](block-reader) Make rowsets union iterating work (#40877 ) (#43175 )

2024-11-08 10:05:10 +08:00

tablet_schema_cache.cpp

[Opt](TabletSchema) reuse TabletColumn info to reduce mem (#42448 ) (#43349 )

2024-11-11 10:38:42 +08:00

tablet_schema_cache.h

[branch-2.1](memory) Refactor LRU cache policy memory tracking (#37658 )

2024-07-11 21:04:01 +08:00

tablet_schema.cpp

[branch-2.1]count tablet meta's static memory load from disk (#41429 ) (#45128 )

2024-12-09 14:44:20 +08:00

tablet_schema.h

[branch-2.1]count tablet meta's static memory load from disk (#41429 ) (#45128 )

2024-12-09 14:44:20 +08:00

tablet.cpp

[improvement](compaction) reduce tablet skip compaction time (#44273 ) (#44791 )

2024-12-02 10:07:17 +08:00

tablet.h

[enhancement](rowset-meta) Remove rowset meta from olap meta directly when rowsets deleted (#41716 ) (#43183 )

2024-11-05 00:40:12 +08:00

txn_manager.cpp

[fix](load) Fix potential data loss during disk migration #42296 (#42386 )

2024-10-24 17:19:38 +08:00

txn_manager.h

[branch-2.1] Picks "[Fix](partial update) Persist partial_update_info in RocksDB in case of BE restart after a partial update has commited #38331 " (#39035 )

2024-08-08 14:50:08 +08:00

types.cpp

[Refactor](opentelemetry) Remove opentelemetry (#26605 )

2023-11-09 18:05:34 +08:00

types.h

[branch-2.1](function) fix date_format and from_unixtime core when meet long format string (#35883 ) (#36158 )

2024-07-01 20:35:31 +08:00

uint24.h

…

utils.cpp

[fix](delete) Incorrect precision detection for the decimal type in condition. (#37801 ) (#37904 )

2024-07-16 19:02:02 +08:00

utils.h

[pick21][opt](mow) reduce memory usage for mow table compaction (#36865 ) (#36968 )

2024-07-01 15:33:18 +08:00

version_graph.cpp

…

version_graph.h

…

wrapper_field.cpp

[fix](log) regularise some BE error type and fix a load task check #28729

2023-12-25 10:45:19 +08:00

wrapper_field.h

[fix](log) regularise some BE error type and fix a load task check #28729

2023-12-25 10:45:19 +08:00