0aa7108ee2
[fix](merge-on-write) incorrect result caused by key range filter with pk ( #31456 )
2024-02-29 19:51:47 +08:00
4a05e5a275
[fix](load) delete bytes_appended debug point which may cause bad page ( #31602 )
2024-02-29 19:51:18 +08:00
92e3b31f50
[feature](invert index) match_phrase_edge feature added ( #31142 )
2024-02-29 19:51:18 +08:00
c72e55d867
[enhancement](core) throw exception instead of core during insert_range_from method ( #31592 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-29 19:51:18 +08:00
e7de2ba0ac
[refactor](raw ptr) disable some raw pointer usage and some unused code ( #31595 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-29 19:51:18 +08:00
c40c16b8b3
[improve](conf)refactor fuzzy mode in BE ( #31412 )
...
refactor the code of fuzzy in BE, and will be add more variables in it, then could test case at different mode.
2024-02-29 19:51:07 +08:00
0b5b7175d6
[fix](multi-catalog) add max compute custom odps and tunnel url ( #31390 )
...
add max compute custom odps and tunnel url
2024-02-29 16:44:40 +08:00
9c4708ee74
[function](random_bytes)add random_bytes function ( #31547 )
...
SELECT random_bytes(10);
random_bytes(10) |
----------------------+
0x9b8ea00b7d1084bc5b26|
2024-02-29 16:44:39 +08:00
4636b6195b
[Fix](JNI) fix BE core when using JNI to query the empty map type value ( #31502 )
2024-02-29 14:03:38 +08:00
ff3c7765d6
[Bug](Func) Fix negative number in bitmap return error result ( #31563 )
2024-02-29 12:38:03 +08:00
82add8dfc1
[Fix](timezone) Introduce a config to use Doris tzdata directly ( #31561 )
2024-02-29 12:38:03 +08:00
2b7fa9d6bb
[pipelineX](refactor) Rebuild relationship between dep and operator ( #31487 )
2024-02-29 12:38:03 +08:00
3c37fb085c
[refactor](jdbc catalog) split jdbc executor for different data sources (step-1) ( #31406 )
2024-02-29 12:38:03 +08:00
d36ad56dce
[Opt](Exec) Support runtime update topn filter ( #31250 )
2024-02-29 12:38:03 +08:00
770cdabda3
[fix](group_commit) GroupCommitBlockSink shoud not use load_block_queue when creating load task fail ( #31416 )
2024-02-29 12:38:02 +08:00
60de835d48
[fix](meta-tool) Fix compile meta tool ( #31457 )
2024-02-29 12:38:02 +08:00
8c570c217e
[fix](load) Fix using uint32 for tablet id overflow ( #31532 )
2024-02-29 12:38:02 +08:00
b177b26d39
[branch-2.1](tracing) Pick pipeline tracing and relative bugfix ( #31367 )
...
* [Feature](pipeline) Trace pipeline scheduling (part I) (#31027 )
* [fix](compile) Fix performance compile fail #31305
* [fix](compile) Fix macOS compilation issues for PURE macro and CPU core identification (#31357 )
* [fix](compile) Correct PURE macro definition to fix compilation on macOS
* 2
---------
Co-authored-by: zy-kkk <zhongyk10@gmail.com >
2024-02-29 08:42:35 +08:00
8633a0c0cc
[Opt](exec) enable top opt in string type ( #31489 )
...
enable top opt in string type
2024-02-29 08:42:35 +08:00
586217bf73
[Improve](Variant) support prune segment for quering variant ( #31310 )
2024-02-28 17:52:11 +08:00
f18c853495
[enhance](S3) Init default retry strategy for aws s3 sdk ( #31329 )
2024-02-28 13:08:36 +08:00
e86cc7e8e8
[chore](log) reduce a lot inject debug point log #31474
2024-02-28 13:07:47 +08:00
7f566f9365
Reset report_workload_runtime_status to optional ( #31479 )
2024-02-28 13:07:47 +08:00
747faeed17
[Enhancement](group commit) optimize some group commit code ( #31392 )
...
This PR optimizes some of the logic related to group commit:
1. Improved the error handling when there is insufficient WAL space during import.
2. Accounted for cases where the content length is negative during import.
3. Added missing error log printing in `group_commit_mgr.cpp`.
2024-02-28 13:05:57 +08:00
2f6251ccde
[pipelineX](refactor) remove source state from operator functions ( #31435 )
2024-02-28 13:05:57 +08:00
41e31ee333
creat hdfs fs with it's resource id ( #31505 )
2024-02-28 11:33:34 +08:00
82fd3af54b
[chore](log) change merge-on-write correctness check log to VLOG_NOTICE ( #31414 ) ( #31467 )
2024-02-27 23:36:24 +08:00
f039ec8cfb
[debug](Variant) sanitize variant type and column in find_and_set_leave_value ( #31436 )
2024-02-27 13:58:13 +08:00
4b0d6716dc
[Fix](be)Fix gcc compile failed #31431
2024-02-27 10:12:53 +08:00
3b093cabd1
Fix building issue in be on ubuntu with test enabled. ( #31407 )
...
Co-authored-by: tangye <tangye@bestpay.com.cn >
2024-02-27 10:12:44 +08:00
1fbf32ead2
[enhancement](pipelinex) limit add_child to and dependency to avoid error ( #31394 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-27 10:12:36 +08:00
6e62017ed5
[fix](scanner) allocated_bytes should be called after success ( #31428 )
...
allocated_bytes should be called after success
2024-02-27 10:12:36 +08:00
c34639245e
[Improvement](executor)add remote scan thread pool ( #31376 )
...
* add remote scan thread pool
* +1
2024-02-27 10:12:33 +08:00
1127b0065a
[Improment](executor)Add scanbytes/scanrows condition ( #31364 )
...
* Add scanbytes/scanrows condition
* fix reg
2024-02-27 10:12:33 +08:00
b8fe620ba3
Fix cgroup cpu controller file leak ( #31398 )
2024-02-27 10:12:33 +08:00
f163d56a98
[feature](function) support sequence function(alias of array_range), enhance both to handle datetimev2 ( #30823 )
2024-02-27 10:12:19 +08:00
3cee6c6722
[fix](function) fix unexpected be core in string search function ( #31312 )
...
Fix be core in multi_match_any/multi_search_all_positions functions.
2024-02-27 10:12:18 +08:00
35333d7a77
[opt](scanner) scan enough blocks in each scan task ( #31277 )
2024-02-27 10:12:18 +08:00
0f38769102
[fix](scan) Fix missing shared tablet header lock ( #31433 )
2024-02-26 23:39:10 +08:00
3acffaa205
[Feature](agg-state) support write_column_to_pb from DataTypeFixedLengthObjectSerDe ( #31171 )
2024-02-26 19:07:10 +08:00
48804a978a
[Fix](group commit) Fix group commit flink error message ( #31350 )
...
* When using stream processing frameworks like Flink with group commit mode enabled, the uncertain size of imported data makes such behavior prohibitive. Previously, to simplify the process, the error message for excessive data volume during streamload was combined with the one for group commit mode, leading to confusion for users when encountering errors indicating the data volume is too large during Flink imports. To address this issue, we are adjusting the logic: if a user employs stream processing imports like Flink with group commit mode enabled, we will automatically disable group commit mode, switching to the standard import mode instead. This is the essence of this PR.
2024-02-26 19:07:10 +08:00
3451cd6c23
[fix](datetime) fix hour 24 on be ( #31304 )
2024-02-26 19:07:10 +08:00
859e56ac16
[bugfix](wg) should set task group down after thread pool stopped
2024-02-25 18:09:39 +08:00
4e5147c6a4
[fix](parquet) Fix possible memory leak if ParquetReader::parse_thrift_footer failed ( #31375 )
2024-02-25 18:08:19 +08:00
70304bffd2
[refactor](wg) move memory gc logic to workload group ( #31334 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-23 23:12:09 +08:00
db58104bc3
[fix](inverted index) Fix inverted index for MOR unique table #31051 ( #31354 )
2024-02-23 23:10:36 +08:00
1c443661c1
[Fix](rf) fix multi thread init error in RuntimeFilterMergeControllerEntity ( #31337 )
2024-02-23 20:44:43 +08:00
52c45e38af
[Refactor](RF) refactor the profile of rf and pipeline-x support local ignore ( #31287 )
...
* [Refactor](RF) refactor the profile of rf and pipeline-x support local ignore
* fix local merge filter
2024-02-23 19:05:06 +08:00
8f77e6363a
[Feature](function) Support xxhash function like murmur hash function ( #31193 )
2024-02-23 19:03:28 +08:00
1456785aa1
[fix](join) incorrect result of mark join in nested loop join ( #31280 )
2024-02-23 19:03:28 +08:00
