Commit Graph

17549 Commits

Author SHA1 Message Date
daa171ee3a [Update](cloud) add inverted index tmp dir support (#31484) 2024-03-02 01:08:51 +08:00
794d9405de [ci](jdk17) adjust fe.conf (#31683) 2024-03-02 01:08:51 +08:00
52025bfccd move 3 cases to p2, reducing regression pipeline runtime (#31663) 2024-03-02 01:08:51 +08:00
4654ec7226 [fix](profile)Fix load profile print by default (#31677)
only enable_profile is true, print profile.
2024-03-02 01:08:51 +08:00
874f4c693b [feat](nereids) support nullSafeEqual estimation (#31616) 2024-03-01 19:07:00 +08:00
38cb17567a [opt](plsql) Fix plsql exception and doris exception compatibility (#31647) 2024-03-01 19:07:00 +08:00
248ea20901 Revert "[test](regression) add regression test for schange change of complex …" (#31660)
This reverts commit dcd2afdb4e857791fed66a46f28ab3adc25494e1.
Reverts #31207
2024-03-01 19:06:59 +08:00
b26dcf2677 [opt](nereids) Composite predicate supports range predicate when rewritting by materialzied view (#31538)
It supports predicate composite as following:
materialized view define
>        select l_shipdate, o_orderdate, l_partkey, l_suppkey
>        from lineitem_1
>        left join orders_1
>        on lineitem_1.l_orderkey = orders_1.o_orderkey
>        where l_shipdate > '2023-10-19'


the query as following can be rewritten by the materialized view above
>        select l_shipdate, o_orderdate, l_partkey, l_suppkey
>        from lineitem_1
>        left join orders_1
>        on lineitem_1.l_orderkey = orders_1.o_orderkey
>        where l_shipdate > '2023-10-25'
2024-03-01 19:06:59 +08:00
493c9d49ea [fix](Nereids) check slot from children may produce wrong format err (#31638) 2024-03-01 17:00:13 +08:00
535e3b23ea [Fix](nereids) fix leading with left join without leftside condition (#31387)
When left join with no edge in outer side, we should add outer side to minimal require of left tables


Co-authored-by: libinfeng <libinfeng@selectdb.com>
2024-03-01 16:59:53 +08:00
4888b4405b [Chore](Docs)Update release guide (#31654) 2024-03-01 16:59:43 +08:00
2b85d9ac44 [Fix](test)Fix query queue regression test #31633 2024-03-01 16:59:43 +08:00
846246e90b [pipelineX](bug) cancel pipeline tasks if timeout (#31635) 2024-03-01 16:59:43 +08:00
a8e2652f78 [fix](planner) should not push down sink when last exchange do limit (#31622) 2024-03-01 14:21:36 +08:00
7d1db6cd1f [refactor](exception safe) Refactor delete handler and block column predicates to make sure exception safe (#31618) 2024-03-01 14:21:17 +08:00
8ac1adf183 [Fix](Variant) fix variant root may be emtpy in OlapColumnDataConvertorVariant::set_source_column (#31572)
When compaction, if some segments miss variant root, there is chance to get emtpy root variant.So add some defence
code in OlapColumnDataConvertorVariant to prevent from accessing null root

```
5# doris::vectorized::ColumnObject::Subcolumn::get_finalized_column_ptr() const at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/vec/columns/column_object.cpp:556
 6# doris::vectorized::OlapBlockDataConvertor::OlapColumnDataConvertorVariant::set_source_column(doris::vectorized::ColumnWithTypeAndName const&, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src
/vec/olap/olap_data_convertor.cpp:1076
 7# doris::vectorized::OlapBlockDataConvertor::set_source_content(doris::vectorized::Block const*, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/vec/olap/olap_data_convertor.cpp:207
 8# doris::segment_v2::SegmentWriter::append_block(doris::vectorized::Block const*, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/olap/rowset/segment_v2/segment_writer.cpp:727
 9# doris::VerticalBetaRowsetWriter::add_columns(doris::vectorized::Block const*, std::vector > const&, bool, unsigned int) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/olap/row
set/vertical_beta_rowset_writer.cpp:125
```
2024-03-01 14:19:28 +08:00
Pxl
ba07acadc2 [Bug](delete) ignore case on delete from command and add check on deletejob dispatch (#31593)
ignore case on delete from command and add check on deletejob dispatch
2024-03-01 14:19:28 +08:00
07224686ef [feature](jdbc catalog) support db2 jdbc catalog (#31627) 2024-03-01 14:19:28 +08:00
a912a420a9 [FIX](regression cases) fix regress exception for test_array_element_at_and_slice(#31621) 2024-03-01 14:19:28 +08:00
81a537ed78 [pipelineX](bug) Fix aggregate crash if open failed (#31625) 2024-03-01 14:19:28 +08:00
0d77fc4847 [nereids] explode function stats configurable (#31332)
---------

Co-authored-by: zhongjian.xzj <zhongjian.xzj@zhongjianxzjdeMacBook-Pro.local>
2024-03-01 04:25:43 +08:00
d8b9909675 [Fix](Status) Handle returned Status correctly #31434 2024-03-01 04:25:43 +08:00
b613de3e6d [fix](regression) set rf type to 4 to forbid fuzzy rf_type in shape check #31567 2024-03-01 04:25:43 +08:00
1398f11246 [improvement](group_commit) Empty wal should be deleted when replaying it (#31427)
* [improvement](group_commit) Corrupt wal should be deleted when replaying it

* edit
2024-03-01 04:25:43 +08:00
6b2af74a63 [doc](fix) add k8s operator doc for upgrade doris (#31586) 2024-03-01 04:25:43 +08:00
cb0ab6886b Test the unique model by modify a value type from BOOLEAN to other type (#31589) 2024-03-01 04:25:43 +08:00
05f525e922 [improvement](docs)add faq for flink-connector-doris (#31426) 2024-03-01 04:25:43 +08:00
07703633dd [pipelineX](conf) enable pipelineX by default (#29894)
* update

* update
2024-03-01 04:25:43 +08:00
336f82e426 [fix](test)Fix mtmv switch is false in incremtn case (#31584) 2024-03-01 04:25:43 +08:00
2047b9416f [Fix](nereids) Only rewrite the slots that appear both in trival-agg func and grouping sets (#31600)
* [Fix](nereids) Only rewrite the slots that appear both in trival-agg func and grouping sets

* [Fix](nereids) Only rewrite the slots that appear both in trival-agg func and grouping sets

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-03-01 04:25:43 +08:00
ae926d0d8c [pipelineX](bug) Fix core dump if union has no children (#31611) 2024-03-01 04:25:43 +08:00
1f825ee2d6 [improve](export) Support partition data consistency (#31290) 2024-03-01 04:25:43 +08:00
82faa7469b Support analyze rollup. (#31576) 2024-03-01 04:25:43 +08:00
819ab6fc00 [feature](sink) support paritition tablet sink shuffle (#30914)
Co-authored-by: morrySnow <morrysnow@126.com>
2024-03-01 04:25:43 +08:00
0aa7108ee2 [fix](merge-on-write) incorrect result caused by key range filter with pk (#31456) 2024-02-29 19:51:47 +08:00
54709ecf3b [improvement](plsql) Select statement supports insert into variables #31574 2024-02-29 19:51:18 +08:00
4a05e5a275 [fix](load) delete bytes_appended debug point which may cause bad page (#31602) 2024-02-29 19:51:18 +08:00
92e3b31f50 [feature](invert index) match_phrase_edge feature added (#31142) 2024-02-29 19:51:18 +08:00
c72e55d867 [enhancement](core) throw exception instead of core during insert_range_from method (#31592)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-02-29 19:51:18 +08:00
e7de2ba0ac [refactor](raw ptr) disable some raw pointer usage and some unused code (#31595)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-02-29 19:51:18 +08:00
c40c16b8b3 [improve](conf)refactor fuzzy mode in BE (#31412)
refactor the code of fuzzy in BE, and will be add more variables in it, then could test case at different mode.
2024-02-29 19:51:07 +08:00
de28d7cd2d [fix](Nereids): AssertNumRowsElement shouldn't be expression (#31581) 2024-02-29 19:51:07 +08:00
720b6e3d86 [fix](nereids) forbid create table with illegal auto partition expr (#31498) (#31604) 2024-02-29 18:08:37 +08:00
01e6798049 [fix](Neredis) Fix npe when plan node doesn't have expressions in materialized view (#31579) 2024-02-29 16:44:40 +08:00
34a31e9fb9 fix test_decimal256_index add wait build index (#31565) 2024-02-29 16:44:40 +08:00
12662e42de [fix](test) fix error messages in fault injection tests (follow-up) (#31577) 2024-02-29 16:44:40 +08:00
9988d6f9fb [Fix](executor)Fix insert select forward carry workload_group #31578 2024-02-29 16:44:40 +08:00
686938f5db [fix](nereids) window function with grouping sets work not well (#31475)
```sql        
select a, c, sum(sum(b)) over(partition by c order by c rows between unbounded preceding and current row) 
from test_window_table2 group by grouping sets((a),( c)) having a > 1 order by 1,2,3;
```
for this kind of case:
sum(sum(col)) over, nereids has cannot find slot problem.
the output slot of repeat and aggregate is computed wrongly.
Only collecting the trival-agg  in NormalizeRepeat can fix this problem.


Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-02-29 16:44:40 +08:00
a6ab6c1cb8 [fix](nereids) stats derive for "not equal“, avoid to derive zero ndv (#31566) 2024-02-29 16:44:40 +08:00
0b5b7175d6 [fix](multi-catalog) add max compute custom odps and tunnel url (#31390)
add max compute custom odps and tunnel url
2024-02-29 16:44:40 +08:00