724bc82362
[refactor](chore) replace HashMapWithStackMemory with std::unordered_map ( #32309 )
2024-03-21 14:07:19 +08:00
b248d3a27e
[Refactor](rf) Refactor the rf code interface to remove update filter v1 ( #31643 )
2024-03-02 17:12:49 +08:00
c72e55d867
[enhancement](core) throw exception instead of core during insert_range_from method ( #31592 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-29 19:51:18 +08:00
f039ec8cfb
[debug](Variant) sanitize variant type and column in find_and_set_leave_value ( #31436 )
2024-02-27 13:58:13 +08:00
f2a38e6345
[chore](columns) remove update_hashes_with_value for SipHash ( #31224 )
2024-02-22 13:01:48 +08:00
bb4575a392
[Improvement](join) optimization for build_side_output_column ( #30826 )
...
optimization for build_side_output_column
2024-02-19 17:22:03 +08:00
0442d5dc0e
[fix](Variant Type) Add sparse columns meta to fix compaction ( #28673 )
...
Co-authored-by: eldenmoon <15605149486@163.com >
2024-02-16 10:12:23 +08:00
b23a785775
[Fix](Variant) support materialize view for variant and accessing variant subcolumns ( #30603 )
...
* [Fix](Variant) support materialize view for variant and accessing variant subcolumns
1. fix schema change with path lost and lead to invalid data read
2. support element_at function in BE side and use simdjson to parse data
3. fix multi slot expression
2024-02-16 10:12:23 +08:00
8ff8d94697
[fix](ip) change IPv6 to little-endian byte order storage (like IPv4) ( #30730 )
2024-02-05 21:56:57 +08:00
82aa304706
[Opt](exec) opt the repeat node code ( #30683 )
2024-02-01 23:14:14 +08:00
e6fbccd3ed
[Feature](Variant) support row store for variant type ( #30052 )
2024-01-31 23:53:39 +08:00
221308f78a
[fix](datatype) fix bugs for IPv4/v6 datatype and add some basic regression test cases ( #30261 )
2024-01-31 23:53:39 +08:00
5e66e2519d
[improve](column) support append_data_by_selector function in const column ( #29996 )
...
support append_data_by_selector function in const column
2024-01-24 09:59:45 +08:00
24ed3e4103
[Fix](Expr&code-style) check prepare&open before every VExpr execute ( #26673 )
2024-01-23 10:09:54 +08:00
3cf95d0fdf
[Improvement](execute) optimize for ColumnNullable's serialize_vec/deserialize_vec ( #28788 )
...
optimize for ColumnNullable's serialize_vec/deserialize_vec
2024-01-12 11:59:52 +08:00
cbcb81f381
[FIX](complextype)fix compare_at base function support nested types ( #29297 )
2024-01-06 12:05:43 +08:00
5db496d844
[Improve](Variant) make output stable ( #29389 )
2024-01-02 20:29:17 +08:00
9490d5e9a2
[Debug](Variant) sanitize variant in write_column_to_mysql ( #29380 )
2024-01-02 20:28:59 +08:00
fcc4cfb900
[Fix](Variant) add more info before crash in serialization ( #29344 )
2023-12-31 11:17:36 +08:00
e7d67e9411
[fix](be) resolves some unused-raii and used-after-moved issues ( #29285 )
2023-12-30 12:14:49 +08:00
411f819306
[Opt](join) opt the join copy column from build side ( #29007 )
2023-12-29 14:39:33 +08:00
a525d5c5a3
[refactor](decimal) change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion ( #29265 )
...
change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion
2023-12-29 10:11:44 +08:00
6440fbfab6
[feature](scan) Implement parallel scanning by dividing the tablets based on the row range ( #28967 )
...
* [feature](scan) parallel scann on dup/mow mode
* fix bugs
2023-12-26 17:18:41 +08:00
e9e1e2894b
[performance](variant) support topn 2phase read for variant column ( #28318 )
...
[performance](variant) support topn 2phase read for variant column
2023-12-25 11:50:41 +08:00
e51f75e424
[FIX](map)fix map with rowstore table ( #28877 )
2023-12-23 12:11:06 +08:00
d75300f166
[fix](hash join) fix stack overflow caused by evaluate case expr on huge build block ( #28851 )
2023-12-22 15:45:12 +08:00
007f152e5e
[Improve](compile) add __AVX2__ macro for JsonbParser ( #28754 )
...
* [Improve](compile) add `__AVX2__` macro for JsonbParser
* throw exception instead of CHECK
2023-12-21 10:25:26 +08:00
9ebacb1faa
[fix](expr) fix performance problem caused by too many virtual function call ( #28508 )
2023-12-18 12:01:55 +08:00
613b0bd552
[fix](decimal) fix decimal overflow caused by null value ( #28260 )
2023-12-13 14:53:39 +08:00
d534cdf027
[compile](BE) let arm gcc know some function no return ( #28157 )
...
let arm gcc know some function no return
2023-12-08 11:32:08 +08:00
81a0f8c041
[Feature](function) support generating const values from tvf numbers ( #28051 )
...
If specified, got a column of constant. otherwise an incremental series like it always be.
mysql> select * from numbers("number" = "5", "const_value" = "-123");
+--------+
| number |
+--------+
| -123 |
| -123 |
| -123 |
| -123 |
| -123 |
+--------+
5 rows in set (0.11 sec)
2023-12-07 22:26:43 +08:00
942450a2e5
[Fix](Variant) ColumnObject need to be finalized when doing ColumnObject::update_hash_with_value ( #28119 )
...
Otherwise accessing rows at `n` will lead to heap buffer overflow
```
5# SipHash::update(char const*, unsigned long) at /home/zcp/repo_center/doris_master/doris/be/src/vec/common/sip_hash.h:132
6# doris::vectorized::ColumnString::update_hash_with_value(unsigned long, SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/columns/column_string.h:452
7# doris::vectorized::ColumnObject::update_hash_with_value(unsigned long, SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/columns/column_object.cpp:1433
8# doris::vectorized::Block::update_hash(SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/core/block.cpp:721
9# doris::EngineChecksumTask::_compute_checksum() at
```
2023-12-07 18:48:05 +08:00
c98b80ae6a
[Feature](functions) support ignore and nullable functions ( #27848 )
...
support ignore and nullable functions
2023-12-05 14:09:32 +08:00
45a49ac059
Bug](column) support insert default for ColumnFixedLengthObject #27927
2023-12-04 12:52:50 +08:00
e3d2425d47
[Improvement](join) remove insert_indices_from_join and special judge for -1 ( #27779 )
...
remove insert_indices_from_join and special judge for -1
2023-12-04 11:03:22 +08:00
7e3d6bc9f1
[Fix](Variant) Implement ColumnObject::update_hash_with_value ( #27873 )
2023-12-01 20:14:47 +08:00
f3a1abf20b
[chore](compile) fix compile error in ColumnObject ( #27739 )
...
This is issue is caused by the two PR merged without conflict
2023-11-29 13:39:32 +08:00
7398c3daf1
[Feature-Variant](Variant Type) support variant type query and index ( #27676 )
2023-11-29 10:37:28 +08:00
d969047b50
[Refactor](join) refactor of hash join ( #27557 )
...
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table
Co-authored-by: HappenLee <happenlee@hotmail.com >
Co-authored-by: BiteTheDDDDt <pxl290@qq.com >
2023-11-28 19:46:00 +08:00
fe7ff6f113
[Opt](functions) Opt tvf number for performance regression framework ( #27582 )
...
Opt tvf number for performance regression framework
2023-11-28 10:43:51 +08:00
2ea33518b0
[Opt](load) use batching to optimize auto partition ( #26915 )
...
use batching to optimize auto partition
2023-11-23 19:12:28 +08:00
3ad865fef9
[refactor](storage) Expressing the types of computation layer and storage layer in PrimitiveTypeTraits ( #26191 )
2023-11-15 21:34:49 +08:00
fa3c7d98c8
[fix](map) the implementation of ColumnMap::replicate was incorrect" ( #26647 )
2023-11-13 12:17:14 +08:00
a5565f68b2
[Refactor](opentelemetry) Remove opentelemetry ( #26605 )
2023-11-09 18:05:34 +08:00
44b51bf0b9
[Feature](Variant) support variant load ( #26572 )
2023-11-08 00:37:57 -06:00
c1d64a7128
[Feature](datatype) Add IPv4/v6 data type for doris ( #24965 )
2023-10-26 17:33:28 +08:00
8a436d8ecc
[FIX](collectiontype) fix shrink char column in map/struct ( #25725 )
...
fix shrink char column in map/struct
before we has char with specific length defined in map or struct field
we select map or struct , the char column in which one has been padding if we just insert less than specific length chars
but in mysql here just show inserted chars not padding specific length chars
---------
Co-authored-by: yiguolei <676222867@qq.com >
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-10-25 17:16:13 +08:00
693982fd1a
[feature](decimal) support decimal256 ( #25386 )
2023-10-25 15:47:51 +08:00
9160834606
[FIX](resize) fix array and map offsets resize with default value ( #25669 )
2023-10-24 02:50:01 -05:00
6714966df2
[Chore](function) remove bit_cast/bit_helper ( #25700 )
...
remove bit_cast/bit_helper
2023-10-23 11:54:14 +08:00
