57864e8554
[cherry-pick](branch-21) fix collect_set function core dump without arena pool ( #38234 ) ( #38307 )
...
## Proposed changes
cherry-pick from master #38234
<!--Describe your changes.-->
2024-07-25 12:05:52 +08:00
ebc178af23
[fix](nereids)acos function should return null literal instead of NaN value ( #37996 )
...
pick from master https://github.com/apache/doris/pull/37932
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-18 09:28:56 +08:00
90a4dd09f3
[Fix](func) CoreDump and Result Error in percentile function ( #36647 )
...
cherry pick #36643
2024-06-21 23:42:45 +08:00
0cff539810
[feature](function) support new function replace_empty ( #36283 ) ( #36656 )
...
#36283
2024-06-21 16:46:22 +08:00
f751ca4e04
[branch-2.1](functions) fix be crash for function random_bytes and mark_first/last_n ( #36003 )
...
pick #35884
2024-06-07 10:30:41 +08:00
fe7d2b8159
[Fix](nereids) ignore slot implements SlotNotFromChildren when check the slot from children in NormalizeAggregate ( #34171 )
2024-05-07 07:48:05 +08:00
f48a4680a8
[fix](test) remove array_intersect case since its result is not stable ( #33742 )
2024-04-17 23:42:14 +08:00
22a6b1d3f5
[feature](function) support hll functions hll_from_base64, hll_to_base64 ( #32089 )
...
Issue Number: #31320
Support two hll functions:
- hll_from_base64
Convert a base64 string(result of function hll_to_base64) into a hll.
- hll_to_base64
Convert an input hll to a base64 string.
2024-04-17 23:42:13 +08:00
3096150d1b
[feature](agg) support aggregate function group_array_intersect ( #33265 )
2024-04-17 23:42:13 +08:00
2746ee9d3a
[FIX](regresstest) fix array_range case for regress test ( #33337 )
2024-04-17 23:42:00 +08:00
bb8bc75af4
[feature](agg) add aggregate function sum0 ( #32541 )
2024-04-10 11:34:29 +08:00
df5ec16d7c
[Refactor](exectuor)Add schema type table active_queries ( #32057 )
...
* Add schema type table active_queries
2024-03-15 17:57:28 +08:00
7f3a666fac
[fix](planner) fix ifnull and nvl function with one parameters exception message anbugious ( #31808 )
...
When ifnull or nvl funtion have only one parameter, nereids planner would throw an exception and go back to
original planner/ Original planner get secend parameter directly without check, so it return unexpected error message
2024-03-06 13:08:30 +08:00
9c4708ee74
[function](random_bytes)add random_bytes function ( #31547 )
...
SELECT random_bytes(10);
random_bytes(10) |
----------------------+
0x9b8ea00b7d1084bc5b26|
2024-02-29 16:44:39 +08:00
f163d56a98
[feature](function) support sequence function(alias of array_range), enhance both to handle datetimev2 ( #30823 )
2024-02-27 10:12:19 +08:00
d70776af55
[feature](agg-func) support covar and covar_samp function ( #30983 )
2024-02-18 11:50:17 +08:00
e68019c10a
[Function](Exec) Support windows function cume_dist ( #30997 )
2024-02-16 10:16:40 +08:00
40e1326bc9
[feature](window-func) support percent_rank window function ( #30926 )
2024-02-16 10:12:25 +08:00
2bb477bae7
[feature](agg-func) support corr function #30822
2024-02-16 10:12:24 +08:00
1ed24117ac
[function](url_decode)add url_decode function ( #30667 )
2024-02-05 22:23:00 +08:00
6442663735
[Function](exec) upport atan2 math function ( #30672 )
...
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com >
2024-02-04 14:28:38 +08:00
19f57b544e
support cosh math function ( #30602 )
...
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com >
2024-01-31 23:53:39 +08:00
8b61b7c6cd
[exec](function) Add tanh func ( #30555 )
2024-01-31 23:53:39 +08:00
7e19224a6c
[fix](function) fix ipv4 funcs get failed error, improve an ipv6 func and exception message ( #30269 )
2024-01-28 18:25:31 +08:00
dfde10d4c8
[improvement](function) switch inet(6)_aton alias origin function ( #30196 )
2024-01-23 10:09:54 +08:00
ead3b4ac1d
[feature](function) support ip function is_ipv4_compat, is_ipv4_mapped ( #29954 )
2024-01-23 10:07:51 +08:00
2dcdf07dd4
[Feature](profile)Support active_queries TVF ( #29999 )
2024-01-16 21:25:02 +08:00
be56bf06cf
[feature](function) support ip function named is_ip_address_in_range(addr, cidr) ( #29681 )
2024-01-12 11:44:21 +08:00
eb4c389b0b
[feature](function) support ip functions isipv4string and isipv6string ( #28556 )
2024-01-07 13:03:11 +08:00
2c888667ed
[improvement](function) standardize some ip functions' signatures #29614
...
The signatures of functions in these PRs should be more standard:
#27342 ,
#25510 ,
#20936 ,
including the following:
ipv4numtostring,
ipv4stringtonum,
ipv4stringtonumordefault,
ipv4stringtonumornull,
ipv6numtostring.
This PR will add necessary underscores between the words of each of them,
like changing ipv4numtostring to ipv4_num_to_string.
2024-01-06 16:16:38 +08:00
7402fee1fc
[feature](function) support ip function ipv6_string_to_num(_or_default, _or_null), inet6_aton ( #28361 )
2024-01-05 19:24:45 +08:00
132ff6c6de
[opt](Nereids) add float type signature for sum aggregate function ( #29503 )
...
* [opt](Nereids) add float type signature for sum aggregate function
2024-01-05 18:06:16 +08:00
dee89d2c4a
[refactor](Nereids) let create table compatible with legacy planner ( #28078 )
2023-12-13 16:35:40 +08:00
65fc2e0438
[fix](Nereids) forbid two TVF in one fragment since the limit of coordinator ( #28114 )
2023-12-07 19:58:31 +08:00
2e1ce758f1
[feature](function) support ip function ipv6numtostring(alias inet6_ntoa) ( #27342 )
2023-12-02 11:48:19 +08:00
6a48abeb80
[feature](Nereids) support queries tvf ( #27138 )
2023-11-22 02:47:16 -06:00
334260dff7
[feature](function) support ip function ipv4stringtonum(ordefault, ornull), inet_aton ( #25510 )
2023-11-17 10:27:07 +08:00
9a4fd5be79
[nereids](datetime) fix wrong result type of datetime add with interval as first arg ( #26957 )
...
Incorrect result data type cause be cordump:
drop table if exists testaaa;
create table testaaa(k1 tinyint, k2 smallint, k3 int, k4 bigint, k5 decimal(9,3), k6 char(5), k10 date, k11 datetime, k7 varchar(20), k8 double max, k9 float sum) engine=olap distributed by hash(k1) buckets 5 properties("storage_type"="column","replication_num"="1") ;
insert into testaaa values(1,1,1,1,9.3, "k6", "2023-11-14", "2023-11-14", "k7", 9.99, 9.99);
select interval 10 year + k10 from testaaa;
The plan result type is DATE:
mysql [test]>explain verbose select interval 10 year + k10 from testaaa;
+-------------------------------------------------------------------------------------------------------+
| Explain String(Nereids Planner) |
+-------------------------------------------------------------------------------------------------------+
| PLAN FRAGMENT 0 |
| OUTPUT EXPRS: |
| years_add(k10, INTERVAL 10 YEAR)[#11 ] |
| PARTITION: UNPARTITIONED |
| |
| HAS_COLO_PLAN_NODE: false |
| |
| VRESULT SINK |
| MYSQL_PROTOCAL |
| |
| 64:VEXCHANGE |
| offset: 0 |
| tuple ids: 1N |
| |
| PLAN FRAGMENT 1 |
| |
| PARTITION: HASH_PARTITIONED: k1[#0 ] |
| |
| HAS_COLO_PLAN_NODE: false |
| |
| STREAM DATA SINK |
| EXCHANGE ID: 64 |
| UNPARTITIONED |
| |
| 58:VOlapScanNode |
| TABLE: default_cluster:test.testaaa(testaaa), PREAGGREGATION: OFF. Reason: No aggregate on scan. |
| partitions=1/1 (testaaa), tablets=5/5, tabletList=945025,945027,945029 ... |
| cardinality=1, avgRowSize=9885.0, numNodes=1 |
| pushAggOp=NONE |
| projections: years_add(k10[#6 ], INTERVAL 10 YEAR) |
| project output tuple id: 1 |
| tuple ids: 0 |
| |
| Tuples: |
| TupleDescriptor{id=0, tbl=testaaa, byteSize=8} |
| SlotDescriptor{id=6, col=k10, colUniqueId=6, type=DATEV2, nullable=true, isAutoIncrement=false} |
| |
| TupleDescriptor{id=1, tbl=testaaa, byteSize=32} |
| SlotDescriptor{id=11, col=null, colUniqueId=null, type=DATE, nullable=true, isAutoIncrement=false} |
+-------------------------------------------------------------------------------------------------------+
39 rows in set (1 min 31.50 sec)
coredump stack:
F1109 20:11:37.677680 323805 assert_cast.h:61] Bad cast from type:doris::vectorized::ColumnVector to doris::vectorized::ColumnVector
*** Check failure stack trace: ***
F1109 20:11:37.680608 323800 assert_cast.h:61] Bad cast from type:doris::vectorized::ColumnVector to doris::vectorized::ColumnVector
*** Check failure stack trace: ***
F1109 20:11:37.680608 323800 assert_cast.h:61] Bad cast from type:doris::vectorized::ColumnVector to doris::vectorized::ColumnVectorF1109 20:11:37.681102 323808 assert_cast.h:61] Bad cast from type:doris::vectorized::ColumnVector to doris::vectorized::ColumnVector
*** Check failure stack trace: ***
@ 0x56489d591d3d google::LogMessage::Fail()
@ 0x56489d591d3d google::LogMessage::Fail()
@ 0x56489d591d3d google::LogMessage::Fail()
@ 0x56489d594279 google::LogMessage::SendToLog()
@ 0x56489d594279 google::LogMessage::SendToLog()
@ 0x56489d594279 google::LogMessage::SendToLog()
@ 0x56489d5918a6 google::LogMessage::Flush()
@ 0x56489d5918a6 google::LogMessage::Flush()
@ 0x56489d5918a6 google::LogMessage::Flush()
@ 0x56489d5948e9 google::LogMessageFatal::~LogMessageFatal()
@ 0x56489d5948e9 google::LogMessageFatal::~LogMessageFatal()
@ 0x56489d5948e9 google::LogMessageFatal::~LogMessageFatal()
@ 0x56487a2a8a0c assert_cast<>()
@ 0x56487a2a8a0c assert_cast<>()
@ 0x56487a2a8a0c assert_cast<>()
@ 0x5648893d8312 doris::vectorized::ColumnVector<>::insert_range_from()
@ 0x5648893d8312 doris::vectorized::ColumnVector<>::insert_range_from()
@ 0x5648893d8312 doris::vectorized::ColumnVector<>::insert_range_from()
@ 0x56488924a670 doris::vectorized::ColumnNullable::insert_range_from()
@ 0x56488924a670 doris::vectorized::ColumnNullable::insert_range_from()
@ 0x56488924a670 doris::vectorized::ColumnNullable::insert_range_from()
@ 0x56487a454475 doris::ExecNode::do_projections()
@ 0x56487a454475 doris::ExecNode::do_projections()
@ 0x56487a454475 doris::ExecNode::do_projections()
@ 0x56487a454b89 doris::ExecNode::get_next_after_projects()
@ 0x56487a454b89 doris::ExecNode::get_next_after_projects()
*** Query id: a467995b35334741-b625042f56495aaf ***
*** tablet id: 0 ***
*** Aborted at 1699531898 (unix time) try "date -d @1699531898" if you are using GNU date ***
*** Current BE git commitID: 0d83327a7c ***
*** SIGABRT unknown detail explain (@0x190d64) received by PID 1641828 (TID 1642168 OR 0x7f6ff96c0700) from PID 1641828; stack trace: ***
@ 0x556ca2a3ab8f std::_Function_handler<>::_M_invoke()
@ 0x556c9f322787 std::function<>::operator()()
@ 0x556ca29da0b0 doris::Thread::supervise_thread()
@ 0x556c9f322787 std::function<>::operator()()
@ 0x7f71b9c38609 start_thread
@ 0x556ca29da0b0 doris::Thread::supervise_thread()
@ 0x7f71b9c38609 start_thread
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_branch-2.0/doris/be/src/common/signal_handler.h:417
1# 0x00007F71B9E09090 in /lib/x86_64-linux-gnu/libc.so.6
2# raise at ../sysdeps/unix/sysv/linux/raise.c:51
3# abort at /build/glibc-SzIz7B/glibc-2.31/stdlib/abort.c:81
4# 0x0000556CC51F3729 in /mnt/hdd01/ci/branch20-deploy/be/lib/doris_be
5# 0x0000556CC51E8D3D in /mnt/hdd01/ci/branch20-deploy/be/lib/doris_be
6# google::LogMessage::SendToLog() in /mnt/hdd01/ci/branch20-deploy/be/lib/doris_be
7# google::LogMessage::Flush() in /mnt/hdd01/ci/branch20-deploy/be/lib/doris_be
8# google::LogMessageFatal::~LogMessageFatal() in /mnt/hdd01/ci/branch20-deploy/be/lib/doris_be
9# doris::vectorized::ColumnVector const& assert_cast const&, doris::vectorized::IColumn const&>(doris::vectorized::IColumn const&) in /mnt/hdd01/ci/branch20-deploy/be/lib/doris_be
10# doris::vectorized::ColumnVector::insert_range_from(doris::vectorized::IColumn const&, unsigned long, unsigned long) at /home/zcp/repo_center/doris_branch-2.0/doris/be/src/vec/columns/column_vector.cpp:354
11# doris::vectorized::ColumnNullable::insert_range_from(doris::vectorized::IColumn const&, unsigned long, unsigned long) at /home/zcp/repo_center/doris_branch-2.0/doris/be/src/vec/columns/column_nullable.cpp:289
12# doris::ExecNode::do_projections(doris::vectorized::Block*, doris::vectorized::Block*) at /home/zcp/repo_center/doris_branch-2.0/doris/be/src/exec/exec_node.cpp:573
13# doris::ExecNode::get_next_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*, std::function const&, bool) at /home/zcp/repo_center/doris_branch-2.0/doris/be/src/exec/exec_node.cpp:592
14# doris::pipeline::SourceOperator::get_block(doris::RuntimeState*, doris::vectorized::Block*, doris::pipeline::SourceState&) at /home/zcp/repo_center/doris_branch-2.0/doris/be/src/pipeline/exec/operator.h:413
15# doris::pipeline::PipelineTask::execute(bool*) at /home/zcp/repo_center/doris_branch-2.0/doris/be/src/pipeline/pipeline_task.cpp:259
16# doris::pipeline::TaskScheduler::_do_work(unsigned
2023-11-14 20:28:41 +08:00
93a934e775
[Improve](map) support map cast with map literal and implicate nested scala cast ( #26126 )
2023-11-02 09:56:42 -05:00
c46fa339d0
[feature](Nereids): make count() avaliable for all data type ( #26180 )
...
make count() avaliable for all data type
2023-11-02 17:20:24 +08:00
57340a4187
[feature](nereids) add function array_agg ( #25630 )
2023-10-23 02:05:54 -05:00
e77b98be88
[fix](months_diff) fix wrong result of months_diff ( #25577 )
2023-10-19 14:29:47 +08:00
2ddd2e5079
[feature](Nereids) add map_agg function ( #25246 )
2023-10-18 06:44:36 -05:00
62d06584f1
[feature](fe) add function 'BitmapAgg' in nereids ( #25508 )
2023-10-18 14:24:27 +08:00
af8832389f
[feature](Nereids) add 4 array functions ( #25488 )
...
- array_concat
- array_pushback
- array_pushfront
- array_zip
2023-10-17 04:45:15 -05:00
4c57c31c5c
[fix](Nereids) count should not accept complex and json type ( #25354 )
2023-10-15 22:08:35 -05:00
42f8b253aa
[function](nereids) support array_apply/array_repeat/group_uniq_array/ipv4numtostring ( #25249 )
...
nereids support functions: array_apply/array_repeat/group_uniq_array/ipv4numtostring
2023-10-12 11:08:42 +08:00
b91bce8a62
[feature](Nereids) add array distance functions ( #25196 )
...
- l1_distance
- l2_distance
- cosine_distance
- inner_product
2023-10-10 21:35:06 -05:00
8b56ca84c7
[fix](Nereids) support AnyDataType in function signature ( #25173 )
...
1. support AnyDataType in function signature
2. update histogram signature
2023-10-10 06:09:47 -05:00
181c58c691
[fix](Nereids) count_by_enum signature is wrong ( #25167 )
2023-10-10 13:05:20 +08:00
