Commit Graph

4098 Commits

Author SHA1 Message Date
e91d16854b [fix](function) fix date_format function execution error on fe (#31645) 2024-03-07 16:53:19 +08:00
21ce85dc14 [fix](money_format) fix money_format #31883 2024-03-07 16:53:19 +08:00
5905ffa1da [enhancement](nereids) allow reorder mark join (#30644) 2024-03-07 16:53:19 +08:00
9bf22a872a [Bug](fix) fix or and "<=>" cause coredump in query (#31884) 2024-03-07 16:53:19 +08:00
5b00f4fbeb [improvement](jdbc catalog) opt get db2 schema list & xml type mapping (#31856)
1. Trim Schema Names: Adapted the system to remove trailing spaces from DB2 schema names, ensuring compatibility without affecting query operations.
2. XML Mapping: Implemented a feature to directly map XML types to String.
2024-03-07 16:53:19 +08:00
561709451c [fix](Nereids) fix group_concat(distinct) failed (#31873) 2024-03-07 16:16:05 +08:00
1d9e9fc884 [regression test] Test the unique model by modify a value type from TINYINT to other type (#31682) 2024-03-07 16:16:05 +08:00
Pxl
3716f8a171 [Bug](partition) fix npe when prune partition with not exist partition column in mv #31860 2024-03-07 16:16:05 +08:00
Pxl
dc9de4b6b5 [Bug](load) fix wrong data in mv when routine load with function mapping (#31787) 2024-03-07 16:16:05 +08:00
2e4201e406 [opt](session variable) max_msg_size_of_result_receiver #31809 2024-03-07 16:13:19 +08:00
7e4cc1d177 [fix](storage medium) Fix show partition storage medium not right whe… (#30160) (#31642) 2024-03-06 13:11:57 +08:00
4f174c4fb9 [feature](function) Support for aggregate function foreach combiner (#31526) 2024-03-06 13:08:30 +08:00
7f3a666fac [fix](planner) fix ifnull and nvl function with one parameters exception message anbugious (#31808)
When ifnull or nvl funtion have only one parameter, nereids planner would throw an exception and go back to
original planner/ Original planner get secend parameter directly without check, so it return unexpected error message
2024-03-06 13:08:30 +08:00
9af64d848f [fix](pipelineX) fix error distribution in DistinctStreamingAggOperatorX (#31804) 2024-03-06 13:08:30 +08:00
3e1e6c8d76 [fix](cloud) Fix version_p0 run in cloud mode (#31810) 2024-03-06 13:08:04 +08:00
2e9bd268cd [improvement](jdbc catalog) support sqlserver timestamp type read (#31805) 2024-03-06 13:08:04 +08:00
aba58b0f7b [test](Nereids) add grouping sets test (#31675)
Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-03-06 13:08:04 +08:00
1d2d0bd411 [fix](update) Update set value should consider sequence column (#31626)
When using update command to set column value, if the column is sequence column, the column 'DORIS_SEQUENCE_COL' should also be set to the same value.
2024-03-06 13:08:04 +08:00
679c7657f6 [fix](cloud) Fix regression case test_dynamic_partition run in cloud mode (#31803) 2024-03-06 13:08:04 +08:00
1434d3983b [enhancement](test) Test the unique model by modify a key type from TINYINT to other type (#31713) 2024-03-06 13:07:59 +08:00
2d6e975d5a [fix](cast) fix wrong result while cast string to float (#31781)
Issue Number: close #31518
2024-03-06 13:07:59 +08:00
97640ee0e8 [test](leading) add leading tpc-ds regression test cases (#31681)
Co-authored-by: libinfeng <libinfeng@selectdb.com>
2024-03-06 13:07:49 +08:00
ad3308c8ab [fix](hive) support partition prune for _HIVE_DEFAULT_PARTITION_ (#31736)
This PR #23026 support the partition prune for hive table with `_HIVE_DEFAULT_PARTITION`,
but it will always select partition with `_HIVE_DEFAULT_PARTITION`.

This PR #31613 support null partition for olap table's list partition, so we can treat `_HIVE_DEFAULT_PARTITION`
as null partition of hive table.

So this PR change the partition prune logic
2024-03-06 13:07:49 +08:00
7998da4691 [fix](cast) wrong result while cast const to double then to string (#31657)
Issue Number: close #31514
2024-03-06 13:06:27 +08:00
7c30cb20fd [Fix](partial update) Fix partial update load false when schema includes auto increment column (#31725)
Problem:
When partially updating columns without specifying the auto-increment column, and the imported data contains new keys, an error stating the auto-increment column could not be found occurs.

Reason:
The logic for partial column updates does not account for new keys in auto-increment columns. Since auto-increment columns can be generated by the system, it's possible to omit this column data during import. However, partial column updates treat this as a regular column, expecting it to be nullable or have a default value for automatic filling, overlooking the fact that auto-increment columns can also be auto-filled. This oversight leads to the error.

Solution:
Incorporate a check for auto-increment columns into the partial column update logic, and include the logic for generating auto-increment column values in the process of completing partial updates.
2024-03-06 13:06:27 +08:00
cca0773261 [feature](function) round function defaults to rounding normally 2024-03-06 13:06:26 +08:00
231768db0d [Performance](exec) Support runtime filter in <=> join (#31754) 2024-03-06 13:06:26 +08:00
31a03e7183 [fix](cloud) Fix regression case test_nereids_row_policy run in cloud mode (#31726) 2024-03-06 13:06:06 +08:00
3777ffb43f [enhancement](nereids)support null partition for list partition (#31613) 2024-03-06 13:05:22 +08:00
e2ebf9d566 [feature](Nereids) parallel output file (#31623)
legacy planner impl PR: #6539
2024-03-06 13:04:30 +08:00
8198a31563 [fix](testcases) make all auto partition P2 cases nonConcurrent (#31708) (#31821)
make all auto partition P2 cases nonConcurrent
2024-03-06 09:12:02 +08:00
47d330c74d [enhancement](Nereids) New optimizer support check column privileges (#31700)
* [enhancement](Nereids) New optimizer support check column privileges (#31494)

(cherry picked from commit accfcfcae5a3343a9e2b7241453e56738255de1b)

* column privilege

* column privilege
2024-03-03 13:48:31 +08:00
de9b5f7b69 [improvement](statistics)Log one bdbje record for one load transaction. #31619 (#31697) 2024-03-02 23:04:26 +08:00
5e684c23ba [regression test]Test the unique model by modify a key type from BOOLEAN to other type (#31540)
* Test the unique model by modify a value type from BOOLEAN to other type

* Test the unique model by modify a key type from BOOLEAN to other type

* Test the unique model by modify a key type from BOOLEAN to other type
2024-03-02 17:12:34 +08:00
794d9405de [ci](jdk17) adjust fe.conf (#31683) 2024-03-02 01:08:51 +08:00
52025bfccd move 3 cases to p2, reducing regression pipeline runtime (#31663) 2024-03-02 01:08:51 +08:00
248ea20901 Revert "[test](regression) add regression test for schange change of complex …" (#31660)
This reverts commit dcd2afdb4e857791fed66a46f28ab3adc25494e1.
Reverts #31207
2024-03-01 19:06:59 +08:00
b26dcf2677 [opt](nereids) Composite predicate supports range predicate when rewritting by materialzied view (#31538)
It supports predicate composite as following:
materialized view define
>        select l_shipdate, o_orderdate, l_partkey, l_suppkey
>        from lineitem_1
>        left join orders_1
>        on lineitem_1.l_orderkey = orders_1.o_orderkey
>        where l_shipdate > '2023-10-19'


the query as following can be rewritten by the materialized view above
>        select l_shipdate, o_orderdate, l_partkey, l_suppkey
>        from lineitem_1
>        left join orders_1
>        on lineitem_1.l_orderkey = orders_1.o_orderkey
>        where l_shipdate > '2023-10-25'
2024-03-01 19:06:59 +08:00
493c9d49ea [fix](Nereids) check slot from children may produce wrong format err (#31638) 2024-03-01 17:00:13 +08:00
535e3b23ea [Fix](nereids) fix leading with left join without leftside condition (#31387)
When left join with no edge in outer side, we should add outer side to minimal require of left tables


Co-authored-by: libinfeng <libinfeng@selectdb.com>
2024-03-01 16:59:53 +08:00
2b85d9ac44 [Fix](test)Fix query queue regression test #31633 2024-03-01 16:59:43 +08:00
8ac1adf183 [Fix](Variant) fix variant root may be emtpy in OlapColumnDataConvertorVariant::set_source_column (#31572)
When compaction, if some segments miss variant root, there is chance to get emtpy root variant.So add some defence
code in OlapColumnDataConvertorVariant to prevent from accessing null root

```
5# doris::vectorized::ColumnObject::Subcolumn::get_finalized_column_ptr() const at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/vec/columns/column_object.cpp:556
 6# doris::vectorized::OlapBlockDataConvertor::OlapColumnDataConvertorVariant::set_source_column(doris::vectorized::ColumnWithTypeAndName const&, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src
/vec/olap/olap_data_convertor.cpp:1076
 7# doris::vectorized::OlapBlockDataConvertor::set_source_content(doris::vectorized::Block const*, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/vec/olap/olap_data_convertor.cpp:207
 8# doris::segment_v2::SegmentWriter::append_block(doris::vectorized::Block const*, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/olap/rowset/segment_v2/segment_writer.cpp:727
 9# doris::VerticalBetaRowsetWriter::add_columns(doris::vectorized::Block const*, std::vector > const&, bool, unsigned int) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/olap/row
set/vertical_beta_rowset_writer.cpp:125
```
2024-03-01 14:19:28 +08:00
Pxl
ba07acadc2 [Bug](delete) ignore case on delete from command and add check on deletejob dispatch (#31593)
ignore case on delete from command and add check on deletejob dispatch
2024-03-01 14:19:28 +08:00
07224686ef [feature](jdbc catalog) support db2 jdbc catalog (#31627) 2024-03-01 14:19:28 +08:00
a912a420a9 [FIX](regression cases) fix regress exception for test_array_element_at_and_slice(#31621) 2024-03-01 14:19:28 +08:00
b613de3e6d [fix](regression) set rf type to 4 to forbid fuzzy rf_type in shape check #31567 2024-03-01 04:25:43 +08:00
cb0ab6886b Test the unique model by modify a value type from BOOLEAN to other type (#31589) 2024-03-01 04:25:43 +08:00
07703633dd [pipelineX](conf) enable pipelineX by default (#29894)
* update

* update
2024-03-01 04:25:43 +08:00
336f82e426 [fix](test)Fix mtmv switch is false in incremtn case (#31584) 2024-03-01 04:25:43 +08:00
2047b9416f [Fix](nereids) Only rewrite the slots that appear both in trival-agg func and grouping sets (#31600)
* [Fix](nereids) Only rewrite the slots that appear both in trival-agg func and grouping sets

* [Fix](nereids) Only rewrite the slots that appear both in trival-agg func and grouping sets

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-03-01 04:25:43 +08:00