database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
16,163 Commits 1 Branch 0 Tags
cbcb81f3813934e72f4fe949f3d026429a216821
Commit Graph

277 Commits

Author SHA1 Message Date
amory
cbcb81f381 [FIX](complextype)fix compare_at base function support nested types (#29297) 2024-01-06 12:05:43 +08:00
lihangyu
5db496d844 [Improve](Variant) make output stable (#29389) 2024-01-02 20:29:17 +08:00
lihangyu
9490d5e9a2 [Debug](Variant) sanitize variant in write_column_to_mysql (#29380) 2024-01-02 20:28:59 +08:00
lihangyu
fcc4cfb900 [Fix](Variant) add more info before crash in serialization (#29344) 2023-12-31 11:17:36 +08:00
py023
e7d67e9411 [fix](be) resolves some unused-raii and used-after-moved issues (#29285) 2023-12-30 12:14:49 +08:00
HappenLee
411f819306 [Opt](join) opt the join copy column from build side (#29007) 2023-12-29 14:39:33 +08:00
TengJianPing
a525d5c5a3 [refactor](decimal) change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion (#29265) 
change type name Decimal128 to Decimal128V2, Decimal128I to Decimal128V3 to avoid confusion
 2023-12-29 10:11:44 +08:00
Jerry Hu
6440fbfab6 [feature](scan) Implement parallel scanning by dividing the tablets based on the row range (#28967) 
* [feature](scan) parallel scann on dup/mow mode

* fix bugs
 2023-12-26 17:18:41 +08:00
lihangyu
e9e1e2894b [performance](variant) support topn 2phase read for variant column (#28318) 
[performance](variant) support topn 2phase read for variant column
 2023-12-25 11:50:41 +08:00
amory
e51f75e424 [FIX](map)fix map with rowstore table (#28877) 2023-12-23 12:11:06 +08:00
TengJianPing
d75300f166 [fix](hash join) fix stack overflow caused by evaluate case expr on huge build block (#28851) 2023-12-22 15:45:12 +08:00
lihangyu
007f152e5e [Improve](compile) add __AVX2__ macro for JsonbParser (#28754) 
* [Improve](compile) add `__AVX2__` macro for JsonbParser

* throw exception instead of CHECK
 2023-12-21 10:25:26 +08:00
TengJianPing
9ebacb1faa [fix](expr) fix performance problem caused by too many virtual function call (#28508) 2023-12-18 12:01:55 +08:00
TengJianPing
613b0bd552 [fix](decimal) fix decimal overflow caused by null value (#28260) 2023-12-13 14:53:39 +08:00
zclllyybb
d534cdf027 [compile](BE) let arm gcc know some function no return (#28157) 
let arm gcc know some function no return
 2023-12-08 11:32:08 +08:00
zclllyybb
81a0f8c041 [Feature](function) support generating const values from tvf numbers (#28051) 
If specified, got a column of constant. otherwise an incremental series like it always be.

mysql> select * from numbers("number" = "5", "const_value" = "-123");
+--------+
| number |
+--------+
|   -123 |
|   -123 |
|   -123 |
|   -123 |
|   -123 |
+--------+
5 rows in set (0.11 sec)
 2023-12-07 22:26:43 +08:00
lihangyu
942450a2e5 [Fix](Variant) ColumnObject need to be finalized when doing ColumnObject::update_hash_with_value (#28119) 
Otherwise accessing rows at `n` will lead to heap buffer overflow

```
 5# SipHash::update(char const*, unsigned long) at /home/zcp/repo_center/doris_master/doris/be/src/vec/common/sip_hash.h:132
 6# doris::vectorized::ColumnString::update_hash_with_value(unsigned long, SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/columns/column_string.h:452
 7# doris::vectorized::ColumnObject::update_hash_with_value(unsigned long, SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/columns/column_object.cpp:1433
 8# doris::vectorized::Block::update_hash(SipHash&) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/core/block.cpp:721
 9# doris::EngineChecksumTask::_compute_checksum() at
```
 2023-12-07 18:48:05 +08:00
zclllyybb
c98b80ae6a [Feature](functions) support ignore and nullable functions (#27848) 
support ignore and nullable functions
 2023-12-05 14:09:32 +08:00
Pxl
45a49ac059 Bug](column) support insert default for ColumnFixedLengthObject #27927 2023-12-04 12:52:50 +08:00
Pxl
e3d2425d47 [Improvement](join) remove insert_indices_from_join and special judge for -1 (#27779) 
remove insert_indices_from_join and special judge for -1
 2023-12-04 11:03:22 +08:00
lihangyu
7e3d6bc9f1 [Fix](Variant) Implement ColumnObject::update_hash_with_value (#27873) 2023-12-01 20:14:47 +08:00
lihangyu
f3a1abf20b [chore](compile) fix compile error in ColumnObject (#27739) 
This is issue is caused by the two PR merged without conflict
 2023-11-29 13:39:32 +08:00
lihangyu
7398c3daf1 [Feature-Variant](Variant Type) support variant type query and index (#27676) 2023-11-29 10:37:28 +08:00
Pxl
d969047b50 [Refactor](join) refactor of hash join (#27557) 
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table

Co-authored-by: HappenLee <happenlee@hotmail.com>
Co-authored-by: BiteTheDDDDt <pxl290@qq.com>
 2023-11-28 19:46:00 +08:00
zclllyybb
fe7ff6f113 [Opt](functions) Opt tvf number for performance regression framework (#27582) 
Opt tvf number for performance regression framework
 2023-11-28 10:43:51 +08:00
zclllyybb
2ea33518b0 [Opt](load) use batching to optimize auto partition (#26915) 
use batching to optimize auto partition
 2023-11-23 19:12:28 +08:00
Jerry Hu
3ad865fef9 [refactor](storage) Expressing the types of computation layer and storage layer in PrimitiveTypeTraits (#26191) 2023-11-15 21:34:49 +08:00
Jerry Hu
fa3c7d98c8 [fix](map) the implementation of ColumnMap::replicate was incorrect" (#26647) 2023-11-13 12:17:14 +08:00
zhiqiang
a5565f68b2 [Refactor](opentelemetry) Remove opentelemetry (#26605) 2023-11-09 18:05:34 +08:00
lihangyu
44b51bf0b9 [Feature](Variant) support variant load (#26572) 2023-11-08 00:37:57 -06:00
yangshijie
c1d64a7128 [Feature](datatype) Add IPv4/v6 data type for doris (#24965) 2023-10-26 17:33:28 +08:00
amory
8a436d8ecc [FIX](collectiontype) fix shrink char column in map/struct (#25725) 
fix shrink char column in map/struct
before we has char with specific length defined in map or struct field
we select map or struct , the char column in which one has been padding if we just insert less than specific length chars
but in mysql here just show inserted chars not padding specific length chars
---------

Co-authored-by: yiguolei <676222867@qq.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-10-25 17:16:13 +08:00
TengJianPing
693982fd1a [feature](decimal) support decimal256 (#25386) 2023-10-25 15:47:51 +08:00
amory
9160834606 [FIX](resize) fix array and map offsets resize with default value (#25669) 2023-10-24 02:50:01 -05:00
Pxl
6714966df2 [Chore](function) remove bit_cast/bit_helper (#25700) 
remove bit_cast/bit_helper
 2023-10-23 11:54:14 +08:00
Pxl
642c149e6a remove datetime_value and move vecdatetime_value to doris namespace (#25695) 
remove datetime_value and move vecdatetime_value to doris namespace
 2023-10-20 22:08:17 +08:00
Gabriel
b964ab76b3 [refactor](shuffle) Simplify hash partitioning strategy (#25596) 2023-10-19 19:28:22 +08:00
Gabriel
3d1206d325 [date](fix) modify push-down predicate for datev1 type (#25571) 
For comparison predicate, two arguments must be cast to datetime and push down to storage if either one is date type. This PR disables predicate push-down for this case.
 2023-10-19 14:18:27 +08:00
zzzxl
5f844486e3 [enhancement](invert index) read columns by index reduce seek time (#24735) 2023-10-17 10:34:33 +08:00
Pxl
f4e2eb6564 remove unused code and adjust clang-tidy checks (#25405) 
remove unused code and adjust clang-tidy checks
 2023-10-13 16:27:37 +08:00
Pxl
1a0344df16 [Improvement](hash) refactor of hash map context (#24966) 
refactor of hash map context
 2023-10-12 18:10:21 +08:00
Jerry Hu
2664d1cffb [chore](vec) Make this copy constructor of StringRef explicit (#25337) 2023-10-12 14:12:46 +08:00
lihangyu
913282b29b [refactor](column) remove get_data_type in IColumn (#25242) 2023-10-10 20:27:15 +08:00
Jerry Hu
f5b826b66d [fix](mark join) mark join column should be nullable (#24910) 2023-10-10 10:10:36 +08:00
amory
53b46b7e6c [FIX](filter) update for filter_by_select logic (#25007) 
this pr is aim to update for filter_by_select logic and change delete limit

only support scala type in delete statement where condition
only support column nullable and predict column support filter_by_select logic, because we can not push down non-scala type to storage layer to pack in predict column but do filter logic
 2023-10-09 21:27:40 +08:00
yiguolei
4de3df6a46 [refactor](column) remove unused method and column definitions (#25152) 
remove unused method and column definitions
using primitive type in predicate column to check datev1 and datev2
 2023-10-09 17:14:35 +08:00
yiguolei
b91335dbb8 [refactor](columndecimal) is_decimal_v2 member is useless because column decimal could detect by itself (#25110) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2023-10-08 18:09:19 +08:00
amory
10f0c63896 [FIX](complex-type) fix agg table with complex type with replace state (#24873) 
fix agg table with complex type with replace state
 2023-10-03 16:32:58 +08:00
bobhan1
642e5cdb69 [Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly (#23395) 2023-09-29 22:38:52 +08:00
Yongqiang YANG
7dcc68736d [enhancement](disk) refine io error and report bad when disk is abnormal (#24390) 2023-09-17 11:07:05 +08:00