25358564ca
[Fix](compile) Fix gcc compile on master ( #33864 )
...
This is imported by #33511 . wrongly used
ColumnStr<T> ();
which violate C++20 standard(see https://wg21.cmeerw.net/cwg/issue2237 ) but still supported by clang up until now(see llvm/llvm-project#58112 )
2024-04-19 23:41:37 +08:00
1300317723
[Exec](join) Support column string64 to avoid join failed in string size overflow the uint32 ( #33511 ) ( #33850 )
2024-04-18 19:43:08 +08:00
5b616da543
[refine](Operator) When _stop_emplace_flag is not set to true, perform batch processing on the block. ( #33173 )
2024-04-17 23:42:12 +08:00
249a9c9875
[Feature](Variant) support aggregation model for Variant type ( #33493 )
...
refactor use `insert_from` to replace `replace_column_data` for variable lengths columns
2024-04-17 23:42:00 +08:00
3d66723214
[branch-2.1](auto-partition) pick auto partition and some more prs ( #33523 )
2024-04-11 17:12:17 +08:00
ef26479282
[improve](serde) support complex type in write/read pb serde ( #33124 )
...
support complex type and ip/jsonb in DataTypeSerDe::write_column_to_pb/read_column_from_pb function
2024-04-11 09:31:50 +08:00
8fd6d4c41b
[Chore](build) add -Wconversion and remove some unused code ( #33127 )
...
add -Wconversion and remove some unused code
2024-04-10 15:26:08 +08:00
8b1d174b13
[Optimize] Move strings_pool from individual tree nodes to the tree itself ( #33089 )
...
Previously, strings_pool was allocated within each tree node. However, due to the Arena's alignment of allocated chunks to at least 4K, this allocation size was excessively large for a single tree node. Consequently, when there are numerous nodes within the SubcolumnTree, a significant portion of memory was wasted. Moving strings_pool to the tree itself optimizes memory usage and reduces wastage, improving overall efficiency.
2024-04-10 14:53:56 +08:00
e4993a19e5
[Chore](column) remove ColumnVectorHelper ( #33036 )
...
remove ColumnVectorHelper
2024-04-10 11:56:41 +08:00
cf7595d423
[opt](memory) Optimize mem tracker accuracy ( #32039 ) ( #33140 )
2024-04-10 11:42:19 +08:00
ebbfb06162
[Bug](array) fix array column core dump in get_shrinked_column as not check type ( #33295 )
...
* [Bug](array) fix array column core dump in get_shrinked_column as not check type
* add function could_shrinked_column
2024-04-08 07:27:40 +08:00
797b8fa456
[FIX](agg) fix vertical_compaction_reader for agg table with array/map type ( #33130 )
2024-04-03 18:09:45 +08:00
617cc667fe
[Fix](Variant) fix variant serialize root node ( #31769 )
2024-03-21 14:07:50 +08:00
724bc82362
[refactor](chore) replace HashMapWithStackMemory with std::unordered_map ( #32309 )
2024-03-21 14:07:19 +08:00
b248d3a27e
[Refactor](rf) Refactor the rf code interface to remove update filter v1 ( #31643 )
2024-03-02 17:12:49 +08:00
c72e55d867
[enhancement](core) throw exception instead of core during insert_range_from method ( #31592 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-29 19:51:18 +08:00
f039ec8cfb
[debug](Variant) sanitize variant type and column in find_and_set_leave_value ( #31436 )
2024-02-27 13:58:13 +08:00
f2a38e6345
[chore](columns) remove update_hashes_with_value for SipHash ( #31224 )
2024-02-22 13:01:48 +08:00
bb4575a392
[Improvement](join) optimization for build_side_output_column ( #30826 )
...
optimization for build_side_output_column
2024-02-19 17:22:03 +08:00
0442d5dc0e
[fix](Variant Type) Add sparse columns meta to fix compaction ( #28673 )
...
Co-authored-by: eldenmoon <15605149486@163.com >
2024-02-16 10:12:23 +08:00
b23a785775
[Fix](Variant) support materialize view for variant and accessing variant subcolumns ( #30603 )
...
* [Fix](Variant) support materialize view for variant and accessing variant subcolumns
1. fix schema change with path lost and lead to invalid data read
2. support element_at function in BE side and use simdjson to parse data
3. fix multi slot expression
2024-02-16 10:12:23 +08:00
8ff8d94697
[fix](ip) change IPv6 to little-endian byte order storage (like IPv4) ( #30730 )
2024-02-05 21:56:57 +08:00
82aa304706
[Opt](exec) opt the repeat node code ( #30683 )
2024-02-01 23:14:14 +08:00
e6fbccd3ed
[Feature](Variant) support row store for variant type ( #30052 )
2024-01-31 23:53:39 +08:00
221308f78a
[fix](datatype) fix bugs for IPv4/v6 datatype and add some basic regression test cases ( #30261 )
2024-01-31 23:53:39 +08:00
5e66e2519d
[improve](column) support append_data_by_selector function in const column ( #29996 )
...
support append_data_by_selector function in const column
2024-01-24 09:59:45 +08:00
24ed3e4103
[Fix](Expr&code-style) check prepare&open before every VExpr execute ( #26673 )
2024-01-23 10:09:54 +08:00
3cf95d0fdf
[Improvement](execute) optimize for ColumnNullable's serialize_vec/deserialize_vec ( #28788 )
...
optimize for ColumnNullable's serialize_vec/deserialize_vec
2024-01-12 11:59:52 +08:00
cbcb81f381
[FIX](complextype)fix compare_at base function support nested types ( #29297 )
2024-01-06 12:05:43 +08:00
5db496d844
[Improve](Variant) make output stable ( #29389 )
2024-01-02 20:29:17 +08:00
9490d5e9a2
[Debug](Variant) sanitize variant in write_column_to_mysql ( #29380 )
2024-01-02 20:28:59 +08:00
fcc4cfb900
[Fix](Variant) add more info before crash in serialization ( #29344 )
2023-12-31 11:17:36 +08:00
e7d67e9411
[fix](be) resolves some unused-raii and used-after-moved issues ( #29285 )
2023-12-30 12:14:49 +08:00
411f819306
[Opt](join) opt the join copy column from build side ( #29007 )
2023-12-29 14:39:33 +08:00
a525d5c5a3
[refactor](decimal) change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion ( #29265 )
...
change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion
2023-12-29 10:11:44 +08:00
6440fbfab6
[feature](scan) Implement parallel scanning by dividing the tablets based on the row range ( #28967 )
...
* [feature](scan) parallel scann on dup/mow mode
* fix bugs
2023-12-26 17:18:41 +08:00
e9e1e2894b
[performance](variant) support topn 2phase read for variant column ( #28318 )
...
[performance](variant) support topn 2phase read for variant column
2023-12-25 11:50:41 +08:00
e51f75e424
[FIX](map)fix map with rowstore table ( #28877 )
2023-12-23 12:11:06 +08:00
d75300f166
[fix](hash join) fix stack overflow caused by evaluate case expr on huge build block ( #28851 )
2023-12-22 15:45:12 +08:00
007f152e5e
[Improve](compile) add __AVX2__ macro for JsonbParser ( #28754 )
...
* [Improve](compile) add `__AVX2__` macro for JsonbParser
* throw exception instead of CHECK
2023-12-21 10:25:26 +08:00
9ebacb1faa
[fix](expr) fix performance problem caused by too many virtual function call ( #28508 )
2023-12-18 12:01:55 +08:00
613b0bd552
[fix](decimal) fix decimal overflow caused by null value ( #28260 )
2023-12-13 14:53:39 +08:00
d534cdf027
[compile](BE) let arm gcc know some function no return ( #28157 )
...
let arm gcc know some function no return
2023-12-08 11:32:08 +08:00
81a0f8c041
[Feature](function) support generating const values from tvf numbers ( #28051 )
...
If specified, got a column of constant. otherwise an incremental series like it always be.
mysql> select * from numbers("number" = "5", "const_value" = "-123");
+--------+
| number |
+--------+
| -123 |
| -123 |
| -123 |
| -123 |
| -123 |
+--------+
5 rows in set (0.11 sec)
2023-12-07 22:26:43 +08:00
942450a2e5
[Fix](Variant) ColumnObject need to be finalized when doing ColumnObject::update_hash_with_value ( #28119 )
...
Otherwise accessing rows at `n` will lead to heap buffer overflow
```
5# SipHash::update(char const*, unsigned long) at /home/zcp/repo_center/doris_master/doris/be/src/vec/common/sip_hash.h:132
6# doris::vectorized::ColumnString::update_hash_with_value(unsigned long, SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/columns/column_string.h:452
7# doris::vectorized::ColumnObject::update_hash_with_value(unsigned long, SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/columns/column_object.cpp:1433
8# doris::vectorized::Block::update_hash(SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/core/block.cpp:721
9# doris::EngineChecksumTask::_compute_checksum() at
```
2023-12-07 18:48:05 +08:00
c98b80ae6a
[Feature](functions) support ignore and nullable functions ( #27848 )
...
support ignore and nullable functions
2023-12-05 14:09:32 +08:00
45a49ac059
Bug](column) support insert default for ColumnFixedLengthObject #27927
2023-12-04 12:52:50 +08:00
e3d2425d47
[Improvement](join) remove insert_indices_from_join and special judge for -1 ( #27779 )
...
remove insert_indices_from_join and special judge for -1
2023-12-04 11:03:22 +08:00
7e3d6bc9f1
[Fix](Variant) Implement ColumnObject::update_hash_with_value ( #27873 )
2023-12-01 20:14:47 +08:00
f3a1abf20b
[chore](compile) fix compile error in ColumnObject ( #27739 )
...
This is issue is caused by the two PR merged without conflict
2023-11-29 13:39:32 +08:00
