Commit Graph

4023 Commits

Author SHA1 Message Date
4de25ede85 [fix](Nereids): other cond should be kept for each anti join when expanding anti join such as (#31521) 2024-02-29 08:42:35 +08:00
ac38356058 [fix](test) fix error messages in fault injection tests (#31515) 2024-02-29 08:42:35 +08:00
06c80d8708 [Fix](regression) add disable_auto_compaction for show data (#31519) 2024-02-29 08:42:35 +08:00
3ca412efe3 Return UNKNOWN column stats if ndv is 0. (#31439) 2024-02-29 08:42:35 +08:00
fa020b6696 [Improvement](regression-test) generate user token by configured user and password rather than hard cord (#31345)
Co-authored-by: xy720 <22125576+xy720@users.noreply.github.com>
2024-02-28 17:51:32 +08:00
d88caca44a [fix](Nereids) push down topn distinct through join by mistake (#31396)
should not push down topn distinct through join when the output
columns of the corresponding child of join is more than
aggregate distinct columns.

for example for LEFT_OUTER_JOIN:

left child of join's output is: c1, c2, c3.
distinct columns is: c1, c2
topn: limit 2

if we push down topn distinct, we could get result of join like this:

```
c1    c2    c3, ...
1     2     1
1     2     2
```

and the final result we get is:

```
c1    c2
1     2
```

this is wrong, because we need 2 lines, but only return 1.
2024-02-28 17:51:32 +08:00
e3f03e10b2 [cases](regression) Add data reliability check meta cases (#31432) 2024-02-28 13:08:41 +08:00
d0a8a30998 [improvement](iceberg/paimon)add show table stats (#31473) 2024-02-28 13:08:36 +08:00
5824f8a4bc [Feat](nereids) support multi-leading (#30379)
support multi-leading in each query block
2024-02-28 13:07:47 +08:00
04de7aed40 [fix](case) fix testcase test_decimal256_index #31486 2024-02-28 13:07:47 +08:00
a371a10603 [fix](Nereids) let time type coercion same with legacy planner (#31472) 2024-02-28 13:07:47 +08:00
47d112e4e6 [fix](MySQL) implement SHOW CHARSET statement. (#31389) 2024-02-28 13:07:23 +08:00
6b4a756837 [Fix] Only datetime and datetimev2 types can use current_timestamp as column default value (#31395)
for this kind of sql:

create table test_default10(
  a int, 
  b varchar(100) default current_timestamp
)
distributed by hash(a)
properties('replication_num'="1");

add check:
 Types other than DATETIME and DATETIMEV2 cannot use current_timestamp as the default value
2024-02-27 16:06:26 +08:00
f039ec8cfb [debug](Variant) sanitize variant type and column in find_and_set_leave_value (#31436) 2024-02-27 13:58:13 +08:00
735184b264 [test](auto partition)increase max_auto_partition_num configure value of auto partition (#31410)
* [test](auto partition)increase auto partition max_auto_partition_num configure value

* fix bug
2024-02-27 13:58:13 +08:00
4fd00e3ad7 [Fix](test)Fix workload group query queue regression test #31419 2024-02-27 10:12:53 +08:00
481d94c3fc [feature](nereids) deal the slots that appear both in agg func and grouping sets (#31318)
this PR support slot appearing both in agg func and grouping sets.
sql like below:
select sum(a) from t group by grouping sets ((a)); 

Before this PR, Nereids throw exception like below:
col_int_undef_signed cannot both in select list and aggregate functions when using GROUPING SETS/CUBE/ROLLUP, please use union instead.

This PR removes the restriction and supports this situation.
2024-02-27 10:12:33 +08:00
dd229b77b1 [fix](inverted index)Remove the strong check for parser when creating a table with inverted index (#31391) 2024-02-27 10:12:33 +08:00
1127b0065a [Improment](executor)Add scanbytes/scanrows condition (#31364)
* Add scanbytes/scanrows condition

* fix reg
2024-02-27 10:12:33 +08:00
f163d56a98 [feature](function) support sequence function(alias of array_range), enhance both to handle datetimev2 (#30823) 2024-02-27 10:12:19 +08:00
22b6434054 [feature](doris compose) Add create cloud cluster (#31315) 2024-02-27 10:12:19 +08:00
3cee6c6722 [fix](function) fix unexpected be core in string search function (#31312)
Fix be core in multi_match_any/multi_search_all_positions functions.
2024-02-27 10:12:18 +08:00
5d4a2d93a6 [feature](nereids) support join with joinRelation (#30909) 2024-02-26 19:07:11 +08:00
Pxl
fcea2b964e [Chore](materialized-view) forbid create mv have calculations included outside aggregate functions (#31336)
forbid create mv have calculations included outside aggregate functions
2024-02-26 19:07:11 +08:00
Pxl
3acffaa205 [Feature](agg-state) support write_column_to_pb from DataTypeFixedLengthObjectSerDe (#31171) 2024-02-26 19:07:10 +08:00
Pxl
3b7261abe4 [Mv] check delete from column exists on mv (#31321) 2024-02-26 19:07:10 +08:00
3451cd6c23 [fix](datetime) fix hour 24 on be (#31304) 2024-02-26 19:07:10 +08:00
7a9fe5d275 [enhance](mtmv)MTMV supports Hive multi-level partitioning (#31060)
Issue Number: close #xxx

For example, the hive table is partitioned by `date` and `region`, with the following 6 partitions
```
20200101
        beijing
        shanghai
20200102
        beijing
        shanghai
20200103
        beijing
        shanghai
```

If the MTMV is partitioned by `date`, then the MTMV will have three partitions: 20200101, 202000102, 20200103

If the MTMV is partitioned by `region`, then the MTMV will have two partitions: beijing, shanghai
2024-02-25 18:08:19 +08:00
93cbc96141 [regression test]Opt Test UniqueModel Schema Key Change (#31262)
* Opt Test UniqueModel Schema Key Change

* Opt Test UniqueModel Schema key Change
2024-02-24 16:26:44 +08:00
09efc92d46 [Fix](regression) make test_index_compaction_with_multi_index_segments nonConcurrent to avoid concurrent be config modify (#31344) 2024-02-24 16:26:38 +08:00
db58104bc3 [fix](inverted index) Fix inverted index for MOR unique table #31051 (#31354) 2024-02-23 23:10:36 +08:00
57d604c48a Fix statistics p0 case. (#31330) 2024-02-23 20:44:43 +08:00
30ef9b70c3 [regression](cold_heat)add cold heat test for hdfs (#31074)
* add cold heat test for hdfs
2024-02-23 19:05:08 +08:00
3576304e3e [regression test]Test UniqueModel Schema Value Change (#31260)
* Test UniqueModel Schema Value Change

* Opt Test UniqueModel Schema value Change
2024-02-23 19:03:28 +08:00
b5ec1e7b7d [fix](Nereids) support check authorization for view but skip check in the view (#31289)
move UserAuthentication in BindRelation, support check authorization view but skip check in the view

relate pr: #23295
2024-02-23 19:03:28 +08:00
8f77e6363a [Feature](function) Support xxhash function like murmur hash function (#31193) 2024-02-23 19:03:28 +08:00
1456785aa1 [fix](join) incorrect result of mark join in nested loop join (#31280) 2024-02-23 19:03:28 +08:00
04c295c4c2 Improve show column stats performance. (#31298) 2024-02-23 19:03:28 +08:00
940fbd4dad [test](mtmv)add p0 filter case (#31271)
* [test](mtmv)add p0 filter case

* add same todo case
2024-02-23 19:03:16 +08:00
f65876d803 [Feature](explode) support explode map type (#30151) 2024-02-22 20:08:44 +08:00
100cea16d9 [fix](nereids)show error message if use wrong alias to bind the table (#31264) 2024-02-22 20:06:50 +08:00
22efb1cb7a [fix](Nereids) not equals and hashCode should contains generate flag (#31123) 2024-02-22 19:51:20 +08:00
9f8906269b [regression-test](VariantType) fix and disable unstable case (#31269) 2024-02-22 19:51:20 +08:00
a6c0be611c [fix](mtmv) fix mtmv workload group case failed (#31218) 2024-02-22 19:51:20 +08:00
260568db17 [update](hudi) update hudi version to 0.14.1 and compatible with flink hive catalog (#31181)
1. Update hudi version from 0.13.1 to .14.1
2. Compatible with the hudi table created by flink hive catalog
2024-02-22 19:51:20 +08:00
98c3cb825f [fix](Nereids) simplify airthmetic should not change return type (#31237) 2024-02-22 19:50:47 +08:00
e3b4b83bca [test](regression) add regression test for schange change of complex type (#31207)
Add regression test for #31128
2024-02-22 19:50:07 +08:00
ef22bd3318 [fix](txn insert) Txn insert can not write to table with mv (#31167) 2024-02-22 13:01:49 +08:00
ad07dec0ed [Improve](InPredict) enhance in predict with struct type (#30840) 2024-02-22 13:01:49 +08:00
98a1b12ac6 [Enhancement] [plsql] support drop store procedure (#30966) (#31001) 2024-02-22 13:01:48 +08:00