17016b9797
[improvement](decimal) use new way for decimal arithmetic precision promotion ( #27787 )
...
* [DNM](decimal) use new way for decimal arithmetic precision promotion
* [improvement](decimal) [DNM](decimal) use new way for decimal arithmetic precision promotion
1. [DNM](decimal) use new way for decimal arithmetic precision promotion
2. throw exception if it overflows for decimal arithmetics
3. throw exception if it overflows when casting among number types
* fix compile error of gcc
* improvement
---------
Co-authored-by: morrySnow <morrysnow@126.com >
2023-12-05 12:54:40 +08:00
a13227cf4b
[fix](move-memtable) fix sink v2 profile ( #27982 )
2023-12-05 11:53:18 +08:00
2b4c4bb442
[Fix][Opt](parquet-reader) Fix filter push down with decimal types in parquet reader. ( #27897 )
...
Fix filter push down with decimal types in parquet reader introduced by #22842
2023-12-04 22:25:39 +08:00
a7d1e92fc2
[Fix](variant) handle StorageReadOptions to avoid crash in new_column_iterator_with_path ( #27936 )
...
In partial update, read variant without `opt` will lead to crash
2023-12-04 17:02:35 +08:00
4d1aa131ee
[Feature](datatype) add be ut codes for IPv4/v6 ( #26534 )
...
Add unit test codes for IP types
2023-12-04 15:25:02 +08:00
48935c14e2
[Improvement](variant) limit the column size on tablet schema ( #27399 ) ( #27785 )
...
1. limit the column count to default 2048
2. fix get_inverted_index return nullptr when variant's unique id is -1, using it's parent unique id instead
3. avoid add same path subcolumn duplicately in tablet schema
4. make extracted column unique id -1
2023-12-04 14:47:36 +08:00
2b715924c5
[Chore](function) set normal function use_default_implementation_for_constants to default ( #27891 )
...
set normal function use_default_implementation_for_constants to default
2023-12-04 14:19:25 +08:00
45a49ac059
Bug](column) support insert default for ColumnFixedLengthObject #27927
2023-12-04 12:52:50 +08:00
e62d19d90d
[improve](partition) support auto list partition with more columns ( #27817 )
...
before the partition by column only have one column.
now remove those limit, could have more columns.
2023-12-04 11:33:18 +08:00
e3d2425d47
[Improvement](join) remove insert_indices_from_join and special judge for -1 ( #27779 )
...
remove insert_indices_from_join and special judge for -1
2023-12-04 11:03:22 +08:00
d2a99aa03b
[refactor](scan) change scan reschedule into scan context ( #27766 )
...
* [refactor](scan) change scan reschedule into scan context
2023-12-04 10:25:52 +08:00
97d36b4f38
[fix](csv_reader) fix trim_double_quotes behavior change ( #27882 )
2023-12-03 22:57:55 +08:00
fc8b32be7a
[Opt](multi-catalog) Opt parquet orc reader numeric copy by memcpy() and memset(). ( #27545 )
...
Opt parquet orc reader null map decoding by memset().
2023-12-03 09:55:05 +08:00
10483ea12c
[fix](profile) fix error set with peak_memory_usage in pipeline #27749
2023-12-02 14:12:38 +08:00
2e1ce758f1
[feature](function) support ip function ipv6numtostring(alias inet6_ntoa) ( #27342 )
2023-12-02 11:48:19 +08:00
54b5d04ff9
[improve](csv_reader) handle csv reader error ( #27892 )
2023-12-02 10:05:02 +08:00
f65103e2a6
[Chore](runtime-filter) unify interfaces of bloom filter and remove some unused code ( #27822 )
...
* unify interfaces of bloom filter and remove some unused code
2023-12-02 07:42:55 +08:00
1706699e7e
[fix](multi-catalog)support the max compute partition prune ( #27154 )
...
1. max compute partition prune,
we just support filter mc partitions by '='，it can filter just one partition
to support multiple partition filter and range operator('>','<', '>='..), the partition prune should be supported.
2. add max compute row count cache and partitionValues cache
3. add max compute regression case
2023-12-01 22:28:26 +08:00
68525fc112
[feature](profile) add RuntimeFilterInfo in merge profile #27869
2023-12-01 21:42:25 +08:00
7e3d6bc9f1
[Fix](Variant) Implement ColumnObject::update_hash_with_value ( #27873 )
2023-12-01 20:14:47 +08:00
007506ce42
[fix](like_func) incorrect result of like with 'NO_BACKSLASH_ESCAPES' mode ( #27842 )
2023-12-01 17:32:46 +08:00
18338a33b6
[bugfix](mergeprofile) ignore null profile to avoid bug ( #27860 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-12-01 16:56:29 +08:00
137f94eac9
[Bug](func) coredump in equal for null in function ( #27844 )
2023-12-01 15:48:01 +08:00
8ca8a0655e
[fix](memtracking) require size in Allocator::free ( #27795 )
2023-11-30 15:57:15 +08:00
838225b6be
[fix](move-memtable) wait stream close before releasing streams ( #27791 )
2023-11-30 15:03:07 +08:00
3e910e2978
[refactor](simd_json_reader) refactor simd json reader to adapt to parse multi json ( #27272 )
2023-11-30 15:01:06 +08:00
e4149c6e4c
[Fix](parquet-reader) Fix null map issue in parquet reader. ( #27777 )
...
Fix null map issue in parquet reader which cause result incorrect such as `min()`, `max()`.
In order to share null map between parquet converted src column and dst column to avoid copying. It is very tricky that will call mutable function `doris_nullable_column->get_null_map_column_ptr()` which will set `_need_update_has_null = true`. Because some operations such as agg will call `has_null()` to set `_need_update_has_null = false`.
2023-11-30 13:55:37 +08:00
112ae59aa4
[fix](move-memtable) add timeout for load stream close wait ( #27439 )
2023-11-30 12:00:06 +08:00
5739167142
[feature](window_function) support to secondary argument to ignore null values in first_value/last_value ( #27623 )
2023-11-30 09:56:43 +08:00
e9debca97c
[Improve](sort) avoid too may tmp vectors for get_columns ( #27734 )
2023-11-30 09:47:31 +08:00
1f9aa8ab16
[fix](group commit) Fix some group commit problems ( #27769 )
2023-11-29 23:43:21 +08:00
498d27c905
[improve](json_reader) add prompt when all fields is null ( #27630 )
2023-11-29 18:26:42 +08:00
d9d5468621
[feature](audit-log) add audit-log in insert into ( #27641 )
2023-11-29 15:01:57 +08:00
f3a1abf20b
[chore](compile) fix compile error in ColumnObject ( #27739 )
...
This is issue is caused by the two PR merged without conflict
2023-11-29 13:39:32 +08:00
7398c3daf1
[Feature-Variant](Variant Type) support variant type query and index ( #27676 )
2023-11-29 10:37:28 +08:00
d969047b50
[Refactor](join) refactor of hash join ( #27557 )
...
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table
Co-authored-by: HappenLee <happenlee@hotmail.com >
Co-authored-by: BiteTheDDDDt <pxl290@qq.com >
2023-11-28 19:46:00 +08:00
91b0edfaa2
[Bug](join) try fix wrong _has_null_in_build_side setted ( #27684 )
...
try fix wrong _has_null_in_build_side setted
2023-11-28 17:42:14 +08:00
b93dd1d5f7
[enhancement](load) improve error msg for load when cancelled by mem gc ( #26809 )
...
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-11-28 17:36:11 +08:00
f565f60bc3
[refactor](standard)BE:Initialize pointer variables in the class to nullptr by default ( #27587 )
2023-11-28 13:02:30 +08:00
fe7ff6f113
[Opt](functions) Opt tvf number for performance regression framework ( #27582 )
...
Opt tvf number for performance regression framework
2023-11-28 10:43:51 +08:00
ea7eca9345
[pipelineX](bug) Add some logs ( #27596 )
2023-11-28 10:02:13 +08:00
13b26ee920
[Fix](core) Fix wal space back pressure core and add regression test ( #27311 )
2023-11-27 15:10:26 +08:00
3838b6fbae
[refine](pipelineX) refine some code in pipelineX ( #27472 )
2023-11-27 11:04:16 +08:00
d10a708fa2
[improve](jdbc catalog) add profile for jdbc scan ( #27447 )
2023-11-27 10:33:39 +08:00
baadc14e60
[Enhancement](function) support unix_timestamp with float ( #26827 )
...
---------
Co-authored-by: YangWithU <plzw8@outlook.com >
2023-11-27 09:58:53 +08:00
b6dd43bb9d
[fix](load) return error instead of panic when slot and expr do not ( #27423 )
2023-11-26 18:53:37 +08:00
148f365da8
[fix](move-memtable) handle tablet location not found ( #27561 )
2023-11-26 18:42:15 +08:00
3d2b194985
[refactor](if_function) handle result status of function ( #27491 )
2023-11-25 10:35:55 +08:00
553e4a8903
[feature-wip](merge-on-write) MOW table support different primary keys and sort keys ( #24788 )
2023-11-24 16:37:30 +08:00
dfe3a2dd01
[feature](mtmv)(3)Implementing multi table materialized views ( #26146 )
...
Introduction to Main Classes：
- MTMVService：MTMV services for other modules to call
- MTMVHookService：All operations that affect the MTMV
- MTMVJobManager：All operations that affect the MTMV job
- MTMVCacheManager：All operations that affect the MTMV Cache
- MTMVTask&MTMVJob：Inherit from job framework
2023-11-24 12:34:38 +08:00
