b0cac0014d
[enhance](FS) Improve FS error code ( #29432 )
2024-01-06 21:17:22 +08:00
85dd606fd1
[fix](group_commit) Fix group_commit ut ( #29587 )
2024-01-06 18:11:13 +08:00
a0c3ddf902
[fix](memory) Fix LRUCacheType::NUMBER charge ( #29588 )
...
if LRUCacheType::NUMBER, charge not add handle_size, because charge at this time is no longer the memory size, but an independent weight.
2024-01-06 10:37:56 +08:00
f40cce1406
[Fix](partition) Skip rowset partition id eq 0 smaller than config wh… ( #29510 )
2024-01-05 19:39:51 +08:00
e3c9f535dc
[refactor](wal) refactor some wal code ( #29434 )
2024-01-03 14:45:57 +08:00
69a01e0cf5
[improve](move-memtable) skip load stream stub close wait when cancel ( #29427 )
2024-01-02 23:35:50 +08:00
243b075eef
[improve](move-memtable) report failed tablets with status ( #29351 )
2024-01-02 20:24:53 +08:00
706463781c
[refactor](group commit) refactor group commit wal code ( #29375 )
2024-01-02 15:52:03 +08:00
b7487430da
Revert "[improve](move-memtable) cancel load rapidly when stream close wait ( #29322 )" ( #29371 )
...
This reverts commit bbf58c5aa42d40e66bc6ccc9ed91a4fcb4bdfff7.
2024-01-02 11:32:14 +08:00
bbf58c5aa4
[improve](move-memtable) cancel load rapidly when stream close wait ( #29322 )
2023-12-31 16:26:41 +08:00
7623b5cc31
[cleanup](move-memtable) remove namespace stream_load ( #27441 )
2023-12-30 20:08:23 +08:00
03901b9a7a
[enhancement](group_commit): refector relay wal code ( #29183 )
2023-12-30 12:59:46 +08:00
51cb15d032
[improve](move-memtable) cancel load immediately when back pressure in delta writer v2 ( #29280 )
2023-12-30 10:45:06 +08:00
82635d4b59
[opt](memory) All LRU Cache inherit from LRUCachePolicy ( #28940 )
...
After all LRU Cache inherits from LRUCachePolicy, this will allow prune stale entry, eviction when memory exceeds limit, and define common properties. LRUCache constructor change to private, only allow LRUCachePolicy to construct it.
Impl DummyLRUCache, when LRU Cache capacity is 0, will no longer be meaningless insert and evict.
2023-12-29 16:15:56 +08:00
a525d5c5a3
[refactor](decimal) change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion ( #29265 )
...
change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion
2023-12-29 10:11:44 +08:00
efea006f3a
[ut](move-memtable) add CLOSE_LOAD before EOS ut case ( #29253 )
...
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-12-29 00:33:34 +08:00
fd90c3a6a6
[optimize](cooldown)Reduce the number of calls to the pick_cooldown_rowset ( #27091 )
...
Co-authored-by: xingying01 <xingying01@corp.netease.com >
2023-12-28 13:03:33 +08:00
9ff8bd2e9c
[Enhancement](Wal)Support dynamic wal space limit ( #27726 )
2023-12-27 11:51:32 +08:00
cefae3dc90
[bug](storage) Fix gc rowset bug ( #28979 )
2023-12-26 00:29:03 +08:00
7081139bdc
[fix](block) fix be core while mutable block merge may cause different row size between columns in origin block ( #27943 )
2023-12-25 20:35:22 +08:00
e51f75e424
[FIX](map)fix map with rowstore table ( #28877 )
2023-12-23 12:11:06 +08:00
fa0ad56817
[exec](compress) use FragmentTransmissionCompressionCodec control the exchange compress behavior ( #28818 )
2023-12-22 19:50:57 +08:00
0af6bd6390
[fix](group-commit) check if wal need recovery is abnormal ( #28769 )
2023-12-22 11:06:11 +08:00
0c9c32c52d
[Feature](datatype) update be ut codes and fix bugs for IPv4/v6 ( #28670 )
2023-12-20 14:38:46 +08:00
aab859be56
[enhance](partition_id) check partition id before store meta ( #28055 )
2023-12-19 21:31:41 +08:00
b142ade69e
[refactor](renamefile) rename some files according to the class names ( #28606 )
2023-12-19 14:10:11 +08:00
d6514618b2
[Improvement](decimal) reduce overhead on disable check decimal overflow ( #28249 )
...
reduce overhead on disable check decimal overflow
2023-12-19 10:12:30 +08:00
e6e8632167
[improvement](merge-on-write) Optimize publish when there are missing versions ( #28012 )
...
1. Do not retry publishing on be When there are too many missing versions, just
add to async publish task.
2. To reduce memory consumption, clean up the tasks when there are too many
async publish tasks.
2023-12-13 16:59:25 +08:00
a719d7a222
[fix](memory) Fix LRU Cache of type NUMBER charge ( #28175 )
2023-12-13 11:15:57 +08:00
877935442f
[feature](pipelineX)use markFragments instead of markInstances in pipelineX ( #27829 )
2023-12-11 17:59:53 +08:00
e1587537bc
[Fix](status) fix unhandled status in exprs #28218
...
which marked static_cast<void> in https://github.com/apache/doris/pull/23395/files
partially fixed #28160
2023-12-11 11:04:58 +08:00
1e5ff40e17
[refactor](group commit) remove future block ( #27720 )
...
Co-authored-by: huanghaibin <284824253@qq.com >
2023-12-11 08:41:51 +08:00
4e86f9bab5
[improve](move-memtable) include and check offset when append data ( #28159 )
2023-12-09 16:21:36 +08:00
6da36e1077
[feature](merge-cloud) Refactor write path code by abstract base class ( #26537 )
...
Refactor write path code by abstract base class. Whether to use `StorageEngine` or `CloudStorageEngine` will be determined during compilation instead of runtime `config::cloud_mode` to avoid unexpected null pointer or undefined behavior issues caused by merging code.
Class that depend on `StorageEngine` but are shared by the cloud mode need to have an abstract base class. Common code should be extracted into the base class, while the code that depends on `StorageEngine` should be implemented in a `StorageEngine` mix-in class of the base class.
2023-12-08 14:50:36 +08:00
17016b9797
[improvement](decimal) use new way for decimal arithmetic precision promotion ( #27787 )
...
* [DNM](decimal) use new way for decimal arithmetic precision promotion
* [improvement](decimal) [DNM](decimal) use new way for decimal arithmetic precision promotion
1. [DNM](decimal) use new way for decimal arithmetic precision promotion
2. throw exception if it overflows for decimal arithmetics
3. throw exception if it overflows when casting among number types
* fix compile error of gcc
* improvement
---------
Co-authored-by: morrySnow <morrysnow@126.com >
2023-12-05 12:54:40 +08:00
358d73a0ae
[FIX](complextype) fix empty quote with complex type ( #27942 )
2023-12-05 12:25:26 +08:00
1ed99c4d8a
[Improvement](inverted index) improve inverted index bkd performance in high concurrent scenario ( #27820 )
...
Improve BKD performance by enable bkd reader cache and improvement of fast compare and visit in compressed values in BKD tree.
2023-12-05 11:39:53 +08:00
1afdbfe723
[enhance](BE) Refactor TaskWorkerPool ( #27555 )
2023-12-04 21:46:10 +08:00
4d1aa131ee
[Feature](datatype) add be ut codes for IPv4/v6 ( #26534 )
...
Add unit test codes for IP types
2023-12-04 15:25:02 +08:00
a64656748b
[Enhancenment](wal) disable group commit when streamload size is too large ( #27781 )
2023-12-03 23:05:11 +08:00
f65103e2a6
[Chore](runtime-filter) unify interfaces of bloom filter and remove some unused code ( #27822 )
...
* unify interfaces of bloom filter and remove some unused code
2023-12-02 07:42:55 +08:00
d969047b50
[Refactor](join) refactor of hash join ( #27557 )
...
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table
Co-authored-by: HappenLee <happenlee@hotmail.com >
Co-authored-by: BiteTheDDDDt <pxl290@qq.com >
2023-11-28 19:46:00 +08:00
f565f60bc3
[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default ( #27587 )
2023-11-28 13:02:30 +08:00
13b26ee920
[Fix](core) Fix wal space back pressure core and add regression test ( #27311 )
2023-11-27 15:10:26 +08:00
553e4a8903
[feature-wip](merge-on-write) MOW table support different primary keys and sort keys ( #24788 )
2023-11-24 16:37:30 +08:00
dd65cc1d14
[opt](MergedIO) no need to merge large columns ( #27315 )
...
1. Fix a profile bug of `MergeRangeFileReader`, and add a profile `ApplyBytes` to show the total bytes of ranges.
2. There's no need to merge large columns, because `MergeRangeFileReader` will increase the copy time.
2023-11-23 19:15:47 +08:00
5d548935e0
[improvement](insert) support schema change and decommission for group commit ( #26359 )
2023-11-17 21:41:38 +08:00
0eabe9a651
[Test](orc-reader) Add orc submodule's unit tests. ( #26878 )
2023-11-16 09:53:42 +08:00
3ad865fef9
[refactor](storage) Expressing the types of computation layer and storage layer in PrimitiveTypeTraits ( #26191 )
2023-11-15 21:34:49 +08:00
035e593b26
remove useless hash function ( #26955 )
2023-11-15 20:37:21 +08:00
