d6cb2d6d5c
[improvement](compaction) start 1 cumu compaction thread each disk by default ( #29430 )
2024-01-03 20:48:11 +08:00
bd8113f424
[bugfix](scannerscheduler) should minus num_of_scanners before check should schedule #28926 ( #29331 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-01-03 20:47:35 +08:00
c84cd30223
[pipelineX](fix) Fix query cancel timeout ( #29460 )
...
There are 2 potential reasons to cancel pipelineX query timeout.
Cancel fragment context first and set ready to execute will set cancel flag to false.
Dead lock.
2024-01-03 20:29:04 +08:00
e3c9f535dc
[refactor](wal) refactor some wal code ( #29434 )
2024-01-03 14:45:57 +08:00
329d57fdd7
[regression](move-memtable) test LoadStream on_idle_timeout ( #29354 )
...
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2024-01-03 14:07:51 +08:00
1fbbff32b2
[fix](pipelinex) coredump caused by VRuntimeFilterSlots::_is_global was not set ( #29446 )
2024-01-03 12:40:41 +08:00
c0db8533af
[fix](load) fix single replica load with auto partition
2024-01-03 11:53:09 +08:00
fab1a627fc
[fix](scan) _insert_data_normal should catch exception when BlockReader::_unique_key_next_block ( #29426 )
...
Co-authored-by: xingying01 <xingying01@corp.netease.com >
2024-01-03 11:44:02 +08:00
1e8bb75182
[improve](move-memtable) add log on idle timeout ( #29438 )
2024-01-03 11:26:26 +08:00
be1d9c3358
[fix](memory) Fix mem tracker web page notice #29361
2024-01-03 11:25:00 +08:00
14e7eb7624
[Opt](rf) Opt broadcast join remote runtime filter merge and wait ( #29439 )
2024-01-03 11:21:28 +08:00
3a8ae590ec
[fix](pipelineX) Fix unexpected OOM on pipelineX ( #29436 )
2024-01-03 10:40:44 +08:00
358995e4ac
[Chore](sort) fix block used after it was moved( #29416 )
...
/mnt/disk2/pengyu/codebase/apache/doris/be/src/vec/common/sort/heap_sorter.cpp:91:23: error: 'tmp_block' used after it was moved [bugprone-use-after-move,-warnings-as-errors]
2024-01-03 10:02:35 +08:00
f54f79515c
[Bug](fix) str_to_date "" should be null ( #29402 )
2024-01-03 08:25:22 +08:00
1edf5b31b6
[Regression-test](wal) Add fault injection case for wal mem back pressure ( #29298 )
2024-01-03 00:06:52 +08:00
797238cbb7
[fix](merge-on-write) fix schema change may result in delete bitmap incorrect ( #29386 )
2024-01-02 23:45:04 +08:00
69a01e0cf5
[improve](move-memtable) skip load stream stub close wait when cancel ( #29427 )
2024-01-02 23:35:50 +08:00
69524ccf98
[improve](group commit) Group commit support commit by data size ( #29428 )
2024-01-02 23:20:23 +08:00
5db496d844
[Improve](Variant) make output stable ( #29389 )
2024-01-02 20:29:17 +08:00
9490d5e9a2
[Debug](Variant) sanitize variant in write_column_to_mysql ( #29380 )
2024-01-02 20:28:59 +08:00
243b075eef
[improve](move-memtable) report failed tablets with status ( #29351 )
2024-01-02 20:24:53 +08:00
b3f69211b7
[refactor](wal) move group commit load content length to runtime state ( #29188 )
2024-01-02 15:53:38 +08:00
706463781c
[refactor](group commit) refactor group commit wal code ( #29375 )
2024-01-02 15:52:03 +08:00
2ed122b787
[improvement](task exec context) add parent class HasTaskExecutionCtx to own the task ctx ( #29388 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-01-02 15:28:27 +08:00
4581618b09
[improvement](disk) pick disk randomly when usage is less than 0.7 ( #29368 )
2024-01-02 14:08:09 +08:00
b7487430da
Revert "[improve](move-memtable) cancel load rapidly when stream close wait ( #29322 )" ( #29371 )
...
This reverts commit bbf58c5aa42d40e66bc6ccc9ed91a4fcb4bdfff7.
2024-01-02 11:32:14 +08:00
7cb3239599
[fix](sink) add writting restriction for OlapTableSinkV2Operator ( #29340 )
2024-01-02 11:16:06 +08:00
cec69f4cbd
[Enhancement](wal) Add timout for wal memory back pressure ( #29178 )
2024-01-02 11:02:17 +08:00
4cbbd25d8c
[fix](ctx) manager the lifecycle of connection context ( #29346 )
...
In FrontendService, we may create some connection context and set it as a thread local varaible.
These context should be removed from thread local after call.
Otherwise, it may be reused by other thread incorrectly.
2024-01-01 23:32:28 +08:00
738abac9ed
[minor](context) duplicate query context in fragment ctx ( #29364 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-01-01 22:08:23 +08:00
b07ce175de
Revert "[fix](move-memtable) only check missing tablets when commit i… ( #29352 )
...
* Revert "[fix](move-memtable) only check missing tablets when commit info is not empty (#29326 )"
This reverts commit 4634c723d7fb86f434060c0e6fa6168d92630cb9.
* Revert "[fix](move-memtable) check missing tablets before commit (#29223 )"
This reverts commit fb0ed8c253f5241c23c71fb88f031604b0bf5a1f.
2023-12-31 22:25:25 +08:00
cc40cdf2d4
[improve](load) don't limit add_segment running count in load stream ( #29332 )
...
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com >
2023-12-31 16:47:46 +08:00
9a90c1cd57
[improve](move-memtable)add multi replica fault injection ( #29348 )
2023-12-31 16:30:27 +08:00
bbf58c5aa4
[improve](move-memtable) cancel load rapidly when stream close wait ( #29322 )
2023-12-31 16:26:41 +08:00
4634c723d7
[fix](move-memtable) only check missing tablets when commit info is not empty ( #29326 )
...
Some sink may not get any success tablets, because load stream will only report them at the last CLOSE_LOAD.
For these sinks (no commit info), we should not check missing tablets since it's expected to be empty.
2023-12-31 13:50:13 +08:00
3661c316c9
Revert "[improvement](create tablet) backend create tablet round robin among disks ( #23218 )" ( #29347 )
...
This reverts commit df5b5ae0cb2f30f026ec104a64b4d9a5ce2904f3.
2023-12-31 12:51:21 +08:00
cc6013bfab
[fix](partial update) Fix error message when doing strict mode partial update on a table with column that is non-nullable and has no default value #29218
2023-12-31 11:18:37 +08:00
fcc4cfb900
[Fix](Variant) add more info before crash in serialization ( #29344 )
2023-12-31 11:17:36 +08:00
9a7c15b635
[fix](log) PipelineFragmentContext has already been destoried in try_close_task before logging it #29237
2023-12-30 21:29:58 +08:00
018d8b1326
[fix](doc) spell errors fixes and align with code log for check-rpc-channel. ( #28151 )
2023-12-30 20:56:56 +08:00
56648e0bd6
[Bug](security) BE SingleReplicaCompaction download_files function exists log print sensitive msg #28929 ( #28930 )
...
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com >
2023-12-30 20:50:08 +08:00
673a0137ce
[fix] (schema change) fix missing data bug in schema change ( #28938 ) ( #29064 )
2023-12-30 20:45:58 +08:00
7623b5cc31
[cleanup](move-memtable) remove namespace stream_load ( #27441 )
2023-12-30 20:08:23 +08:00
03901b9a7a
[enhancement](group_commit): refector relay wal code ( #29183 )
2023-12-30 12:59:46 +08:00
30b7357604
[improve](logging) make glog FLAGS_v configurable ( #29182 )
2023-12-30 12:47:47 +08:00
e7d67e9411
[fix](be) resolves some unused-raii and used-after-moved issues ( #29285 )
2023-12-30 12:14:49 +08:00
51cb15d032
[improve](move-memtable) cancel load immediately when back pressure in delta writer v2 ( #29280 )
2023-12-30 10:45:06 +08:00
2c4e52e44e
[fix](es catalog) only es_query function can push down to ES ( #29320 )
...
Issue Number: close #29318
1. Only push down `es_query` function to ES
2. Add null check where ES query result not have `_source` or `fields` fields.
2023-12-30 09:33:26 +08:00
56058623f6
[fix](expr) Re fix BE core dump while common expr filter delete condition column ( #29328 )
...
Additional deleted filter condition will be materialized column be at the end of the block,
after _output_column_by_sel_idx will be erase, we not need to filter it,
so erase it from _columns_to_filter in the first next_batch.
Eg:
delete from table where a = 10;
select b from table;
a column only effective in segment iterator, the block from query engine only contain the b column,
so no need to filter a column by expr.
2023-12-30 08:40:03 +08:00
5c9e0d906a
[Fix](segment iterator) fix wrong segment cache remove ( #29333 )
2023-12-30 08:36:15 +08:00
