87b414cdae
[Fix](query execution) Fix result sink fragment can't be cancelled in non-pipeline ( #25524 )
2023-10-24 11:30:29 +08:00
215c1625b2
[chore](fragmentid) rename fragment id to fragment instance id in thrift definition file ( #25787 )
...
* rename fragment id to fragment instance id in thrift definition file
* f
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-10-24 11:26:52 +08:00
0e73d061c3
[fix](regression) fix auth case for move-memtable streamload test ( #25659 )
...
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-10-24 10:54:48 +08:00
f9f539221f
[fix](datetime) Added datetime compatibility logic ( #25791 )
2023-10-24 10:37:57 +08:00
f23fdcbbef
[typo](doc)Adjust tablet_rowset_stale_sweep_time_sec parameter default value to 300 ( #25584 )
2023-10-24 10:32:08 +08:00
a4c9beba85
[fix](move-memtable) fallback if partial update ( #25801 )
2023-10-24 10:29:59 +08:00
5c9f3ab6ee
[fix](nereids)do not generate min-max runtime filter for A<=>B and A!=B #25676
2023-10-24 10:23:22 +08:00
d62e914205
[opt](profile) set datalake profile level as 1 ( #25686 )
...
Follow #25491 , only the profile marked as 1 will be shown in simplified profile.
2023-10-24 09:55:25 +08:00
0e0f8090f7
[refactor](text_convert)Use serde to replace text_convert. ( #25543 )
...
Remove text_convert and use serde to replace it.
2023-10-24 09:52:43 +08:00
08832d9f3a
[Fix](exec) Fix date dict dead loop. ( #25570 )
2023-10-24 02:51:43 +08:00
9006e2b8a5
[fix](prefetch-read) make prefetch range correct to accelerate S3 load and fix its speed unbalance ( #25775 )
2023-10-23 20:02:24 +08:00
5f6371bf0f
[Improve](datatype) change check_column to check data type ( #25466 )
...
* change check_column to check data type
* fix is_number contains is_decimal
* fix array element
2023-10-23 18:36:37 +08:00
28c799ce35
[Docs](partial update) Fix a typo in docs in partial update for insert statement ( #25776 )
2023-10-23 17:54:47 +08:00
206aeabe9a
[pipelineX](minor) remove unused timer ( #25766 )
2023-10-23 17:50:46 +08:00
267c11207b
[feature](paimon)paimon catalog supports complex types ( #25364 )
2023-10-23 17:32:13 +08:00
6a6e10c182
[fix](java udf) make executor class thread local ( #25758 )
2023-10-23 16:55:15 +08:00
b5ee4a9dbb
[enhancement](profilev2) add some fields for profile v2 ( #25611 )
...
Add 3 counters for ExecNode:
ExecTime - Total execution time(excluding the execution time of children).
OutputBytes - The total number of bytes output to parent.
BlockCount - The total count of blocks output to parent.
2023-10-23 15:55:40 +08:00
5cb5121cf6
[coverage](pipeline) Remove unless code and add call method for coverage ( #25552 )
...
Remove unless code and add call method for coverage
2023-10-23 15:52:43 +08:00
b8452812df
[bug](function) fix regexp_extract_all can't handle empty str ( #25717 )
2023-10-23 15:47:12 +08:00
2c3bc65fae
[feature](Nereids): generate left deep tree when stats is unknown ( #25620 )
...
generate left deep tree when stats is unknown
2023-10-23 15:41:55 +08:00
6f7f0a24c5
[doc])(sidebae)Update partial-update sidebars.json ( #25357 )
2023-10-23 15:15:59 +08:00
57340a4187
[feature](nereids) add function array_agg ( #25630 )
2023-10-23 02:05:54 -05:00
75000a5f6e
[enhancement](stmt-exec) make CTAS use insert timeout fix forward timeout ( #25731 )
2023-10-23 14:57:02 +08:00
ed85c441b7
[Fix](partial update) Fix wrong comment in .proto file ( #25742 )
...
1. remove deprecated comment on fields that is wrongly added in #25147 . These fields will be used when coordinator BE send infos to executor BEs. They will only be used during RPC and will not be persisted.
2. eliminate some unnecessary copys.
2023-10-23 14:39:54 +08:00
d0da94e22b
[refactor](streamload) refactor stream load executor ( #25615 )
2023-10-23 14:34:26 +08:00
09b2593035
[enhancement](Nereids): when rule return original plan, skip copyIn() ( #25730 )
2023-10-23 12:38:43 +08:00
6714966df2
[Chore](function) remove bit_cast/bit_helper ( #25700 )
...
remove bit_cast/bit_helper
2023-10-23 11:54:14 +08:00
cbc5c91aec
[fix](datetime) fix unstable str_to_date function result ( #25707 )
...
fix unstable str_to_date function result
2023-10-23 11:52:08 +08:00
4889841ff7
[thirdparty](import) import avx2neon library ( #25383 )
...
import avx2neon library
2023-10-23 11:51:54 +08:00
7de3d9882c
[regresstion-test](jdbc catalog)Mariadb compatible test ( #25664 )
2023-10-23 11:51:03 +08:00
144e12ae78
[fix](rpc) Rebuild failed channel to avoid connection refused ( #25688 )
2023-10-23 11:32:24 +08:00
e69b8abb86
[Feature](materialized-view) support delete stmt on materialized-view ( #25710 )
...
support delete stmt on materialized-view
2023-10-23 10:44:55 +08:00
c51146df10
[Fix](segment) need to rebuild col_id_to_predicates when true predicates encountered ( #25685 )
2023-10-22 21:26:52 -05:00
2e2d5bcba2
[Improvements](status) catch some error status ( #25677 )
...
catch some error status
2023-10-23 10:19:08 +08:00
305c884478
[fix](rf) fix minmax runtime filter ( #25720 )
...
Template arguments for decimalv3 type is wrong when creating MinMaxNumFunc, which result in wrong decimal type like vectorized::Decimal<doris::vectorized::Decimal128I> :
class MinmaxFunctionTraits {
public:
using BasePtr = MinMaxFuncBase*;
template <PrimitiveType type, size_t N>
static BasePtr get_function() {
return new MinMaxNumFunc<std::conditional_t<
type == TYPE_DECIMAL32 || type == TYPE_DECIMAL64 || type == TYPE_DECIMAL128I,
vectorized::Decimal<typename PrimitiveTypeTraits<type>::CppType>,
typename PrimitiveTypeTraits<type>::CppType>>();
}
};
(gdb) bt
#0 doris::vectorized::Decimal<__int128>::operator<=>(doris::vectorized::Decimal<__int128> const&) const (x=..., this=<optimized out>) at /mnt/disk2/user/doris-1.1/be/src/vec/core/types.h:381
#1 doris::vectorized::Decimal<doris::vectorized::Decimal128I>::operator<=>(doris::vectorized::Decimal<doris::vectorized::Decimal128I> const&) const (x=..., this=<optimized out>)
at /mnt/disk2/user/doris-1.1/be/src/vec/core/types.h:381
#2 doris::MinMaxNumFunc<doris::vectorized::Decimal<doris::vectorized::Decimal128I> >::insert (this=0x7ef19de903c0, data=0x7c612928d860) at /mnt/disk2/user/doris-1.1/be/src/exprs/minmax_predicate.h:61
#3 0x0000558465c2844a in doris::RuntimePredicateWrapper::insert (this=0x7f47a2e3d720, value=...) at /mnt/disk2/user/doris-1.1/be/src/exprs/runtime_filter.cpp:492
#4 doris::RuntimePredicateWrapper::insert_batch (this=0x7f47a2e3d720, column=..., rows=...) at /mnt/disk2/user/doris-1.1/be/src/exprs/runtime_filter.cpp:504
#5 0x0000558465c1f6c3 in doris::IRuntimeFilter::insert_batch (this=<optimized out>, column=..., rows=...) at /mnt/disk2/user/doris-1.1/be/src/exprs/runtime_filter.cpp:1060
#6 0x000055846883dafd in doris::VRuntimeFilterSlots::insert (this=0x7d7e767f4e70, datas=...) at /mnt/disk2/user/doris-1.1/be/src/exprs/runtime_filter_slots.h:188
#7 0x0000558468840535 in doris::vectorized::ProcessRuntimeFilterBuild::operator()<doris::vectorized::MethodOneNumber<doris::vectorized::UInt128, PartitionedHashMapTable<HashMapTable<doris::vectorized::UInt128, HashMapCell<doris::vectorized::UInt128, doris::vectorized::RowRefList, HashCRC32<doris::vectorized::UInt128>, HashTableNoState>, HashCRC32<doris::vectorized::UInt128>, PartitionedHashTableGrower<8ul>, Allocator<true, true, false> > > >, doris::vectorized::HashJoinNode> (
this=this@entry=0x7e7c6a5bee40, state=0x7ef19df00400, hash_table_ctx=..., parent=0x7ef19dee3c00) at /mnt/disk2/user/doris-1.1/be/src/vec/exec/join/vhash_join_node.h:92
2023-10-23 10:16:28 +08:00
9519d7ede9
[enhancement](be-ut)Add more indexed column reader be unit test ( #25652 )
...
Added more unit tests
1. key exists or does not exist in a single page
2. key exists or does not exist in multiple pages
3. key is between two pages.
2023-10-23 10:12:53 +08:00
17004c4a29
[ci](pipeline) add pipelinex_p0 ( #25638 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2023-10-23 10:01:08 +08:00
fbc448520a
[feature](ColdHeatSeperation) Support to upload cold data to HDFS ( #22048 )
2023-10-22 21:04:43 +08:00
13780e4827
[fix](nereids)(create-table) fix bug that replication num is not set when create table with no property ( #25651 )
...
When executing create partitioned table with Nereids, and replication_num property is not set,
the replication number will be 0, so the tablet will has no replica.
2023-10-21 23:15:08 +08:00
387a9c7448
[build](extension) Update build-extension.yml ( #25721 )
2023-10-21 16:52:55 +08:00
642c149e6a
remove datetime_value and move vecdatetime_value to doris namespace ( #25695 )
...
remove datetime_value and move vecdatetime_value to doris namespace
2023-10-20 22:08:17 +08:00
3ffc6f0835
[fix](Nereids) should do read lock on table being insert when analyze ( #25619 )
2023-10-20 08:09:19 -05:00
9fcee92a26
[regression-test](bloom filter) Add bloom filter hit test ( #24557 )
2023-10-20 20:14:23 +08:00
ea6309059b
[improvement](outfile)support underscore prefix when select outfile ( #25395 )
2023-10-20 19:56:55 +08:00
9b64286f2d
[enhancement](mow-ut)Add compaction commit delete bitmap unit test ( #25569 )
2023-10-20 19:54:12 +08:00
a45c0d7b4f
[fix](log) fix the problem of parameter mismatch when printing logs ( #25649 )
2023-10-20 19:51:41 +08:00
fe52988ef8
[improvement](tablet clone) tablet balance ignore deleted partitions ( #25499 )
2023-10-20 19:40:44 +08:00
f1b81fafd4
[improvement](tablet clone) partition balance should invalidate tablet move in cache when sched failed ( #25602 )
2023-10-20 19:35:16 +08:00
fded8ba824
[improvement](insert) Modify insert into table_id(xxx) to doris_inter… ( #25662 )
2023-10-20 19:31:37 +08:00
a6925cc0cf
Fix exchange operator can not aware end of file ( #25562 )
2023-10-20 18:56:01 +08:00
