54b5d04ff9
[improve](csv_reader) handle csv reader error ( #27892 )
2023-12-02 10:05:02 +08:00
f65103e2a6
[Chore](runtime-filter) unify interfaces of bloom filter and remove some unused code ( #27822 )
...
* unify interfaces of bloom filter and remove some unused code
2023-12-02 07:42:55 +08:00
1706699e7e
[fix](multi-catalog)support the max compute partition prune ( #27154 )
...
1. max compute partition prune,
we just support filter mc partitions by '='，it can filter just one partition
to support multiple partition filter and range operator('>','<', '>='..), the partition prune should be supported.
2. add max compute row count cache and partitionValues cache
3. add max compute regression case
2023-12-01 22:28:26 +08:00
68525fc112
[feature](profile) add RuntimeFilterInfo in merge profile #27869
2023-12-01 21:42:25 +08:00
7e3d6bc9f1
[Fix](Variant) Implement ColumnObject::update_hash_with_value ( #27873 )
2023-12-01 20:14:47 +08:00
007506ce42
[fix](like_func) incorrect result of like with 'NO_BACKSLASH_ESCAPES' mode ( #27842 )
2023-12-01 17:32:46 +08:00
18338a33b6
[bugfix](mergeprofile) ignore null profile to avoid bug ( #27860 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-12-01 16:56:29 +08:00
137f94eac9
[Bug](func) coredump in equal for null in function ( #27844 )
2023-12-01 15:48:01 +08:00
8ca8a0655e
[fix](memtracking) require size in Allocator::free ( #27795 )
2023-11-30 15:57:15 +08:00
838225b6be
[fix](move-memtable) wait stream close before releasing streams ( #27791 )
2023-11-30 15:03:07 +08:00
3e910e2978
[refactor](simd_json_reader) refactor simd json reader to adapt to parse multi json ( #27272 )
2023-11-30 15:01:06 +08:00
e4149c6e4c
[Fix](parquet-reader) Fix null map issue in parquet reader. ( #27777 )
...
Fix null map issue in parquet reader which cause result incorrect such as `min()`, `max()`.
In order to share null map between parquet converted src column and dst column to avoid copying. It is very tricky that will call mutable function `doris_nullable_column->get_null_map_column_ptr()` which will set `_need_update_has_null = true`. Because some operations such as agg will call `has_null()` to set `_need_update_has_null = false`.
2023-11-30 13:55:37 +08:00
112ae59aa4
[fix](move-memtable) add timeout for load stream close wait ( #27439 )
2023-11-30 12:00:06 +08:00
5739167142
[feature](window_function) support to secondary argument to ignore null values in first_value/last_value ( #27623 )
2023-11-30 09:56:43 +08:00
e9debca97c
[Improve](sort) avoid too may tmp vectors for get_columns ( #27734 )
2023-11-30 09:47:31 +08:00
1f9aa8ab16
[fix](group commit) Fix some group commit problems ( #27769 )
2023-11-29 23:43:21 +08:00
498d27c905
[improve](json_reader) add prompt when all fields is null ( #27630 )
2023-11-29 18:26:42 +08:00
d9d5468621
[feature](audit-log) add audit-log in insert into ( #27641 )
2023-11-29 15:01:57 +08:00
f3a1abf20b
[chore](compile) fix compile error in ColumnObject ( #27739 )
...
This is issue is caused by the two PR merged without conflict
2023-11-29 13:39:32 +08:00
7398c3daf1
[Feature-Variant](Variant Type) support variant type query and index ( #27676 )
2023-11-29 10:37:28 +08:00
d969047b50
[Refactor](join) refactor of hash join ( #27557 )
...
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table
Co-authored-by: HappenLee <happenlee@hotmail.com >
Co-authored-by: BiteTheDDDDt <pxl290@qq.com >
2023-11-28 19:46:00 +08:00
91b0edfaa2
[Bug](join) try fix wrong _has_null_in_build_side setted ( #27684 )
...
try fix wrong _has_null_in_build_side setted
2023-11-28 17:42:14 +08:00
b93dd1d5f7
[enhancement](load) improve error msg for load when cancelled by mem gc ( #26809 )
...
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-11-28 17:36:11 +08:00
f565f60bc3
[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default ( #27587 )
2023-11-28 13:02:30 +08:00
fe7ff6f113
[Opt](functions) Opt tvf number for performance regression framework ( #27582 )
...
Opt tvf number for performance regression framework
2023-11-28 10:43:51 +08:00
ea7eca9345
[pipelineX](bug) Add some logs ( #27596 )
2023-11-28 10:02:13 +08:00
13b26ee920
[Fix](core) Fix wal space back pressure core and add regression test ( #27311 )
2023-11-27 15:10:26 +08:00
3838b6fbae
[refine](pipelineX) refine some code in pipelineX ( #27472 )
2023-11-27 11:04:16 +08:00
d10a708fa2
[improve](jdbc catalog) add profile for jdbc scan ( #27447 )
2023-11-27 10:33:39 +08:00
baadc14e60
[Enhancement](function) support unix_timestamp with float ( #26827 )
...
---------
Co-authored-by: YangWithU <plzw8@outlook.com >
2023-11-27 09:58:53 +08:00
b6dd43bb9d
[fix](load) return error instead of panic when slot and expr do not ( #27423 )
2023-11-26 18:53:37 +08:00
148f365da8
[fix](move-memtable) handle tablet location not found ( #27561 )
2023-11-26 18:42:15 +08:00
3d2b194985
[refactor](if_function) handle result status of function ( #27491 )
2023-11-25 10:35:55 +08:00
553e4a8903
[feature-wip](merge-on-write) MOW table support different primary keys and sort keys ( #24788 )
2023-11-24 16:37:30 +08:00
dfe3a2dd01
[feature](mtmv)(3)Implementing multi table materialized views ( #26146 )
...
Introduction to Main Classes：
- MTMVService：MTMV services for other modules to call
- MTMVHookService：All operations that affect the MTMV
- MTMVJobManager：All operations that affect the MTMV job
- MTMVCacheManager：All operations that affect the MTMV Cache
- MTMVTask&MTMVJob：Inherit from job framework
2023-11-24 12:34:38 +08:00
75c9f00137
[Bug](bitmap) Fix heap-use-after-free in the bitmap functions ( #27411 )
2023-11-24 10:09:31 +08:00
b580ee91ce
[fix](compile) fix macOS compile and format code ( #27494 )
2023-11-23 23:24:10 +08:00
dd65cc1d14
[opt](MergedIO) no need to merge large columns ( #27315 )
...
1. Fix a profile bug of `MergeRangeFileReader`, and add a profile `ApplyBytes` to show the total bytes of ranges.
2. There's no need to merge large columns, because `MergeRangeFileReader` will increase the copy time.
2023-11-23 19:15:47 +08:00
2ea33518b0
[Opt](load) use batching to optimize auto partition ( #26915 )
...
use batching to optimize auto partition
2023-11-23 19:12:28 +08:00
b457856bd2
[chore](be) remove bthread scanner related codes ( #27417 )
2023-11-23 15:18:49 +08:00
699798eaa7
[fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT ( #27343 )
...
* fix
* fix nullable
* remove null
* add case
2023-11-23 14:26:19 +08:00
7a75f8c380
[improve](move-memtable) set brpc streaming params in config ( #27442 )
2023-11-23 14:14:43 +08:00
b79f5d77f1
[improve](move-memtable) improve logging messages ( #27443 )
2023-11-23 11:46:29 +08:00
301bfe4d5d
[Bug](mark-join) fix mark join report error when probe block have column do not output ( #27360 )
...
fix mark join report error when probe block have column do not output
2023-11-23 11:16:02 +08:00
1b3512d942
[pipelineX](bug) Fix cancel timeout ( #27396 )
2023-11-22 22:31:34 +08:00
a68b62b421
[refactor](datatype) Introduce a toolkits for clarify datelike types usage ( #26810 )
2023-11-22 22:08:13 +08:00
5442e8d1fc
[pipelineX](dependency) split different dependencies ( #27366 )
2023-11-22 12:50:39 +08:00
604842526b
[improvement](expr) improve if expr performance ( #27296 )
2023-11-22 12:48:06 +08:00
b541de7a03
do not push down agg on aggregate column ( #27356 )
...
do not push down agg on aggregate column
2023-11-22 10:53:29 +08:00
4fbcad9c7c
[minor](show_export) make result of file url usable ( #27209 )
...
* [minor](show_export) make result of file url usable
* update regression-test
* update regression-test
2023-11-22 10:14:45 +08:00
