Commit Graph

4046 Commits

Author SHA1 Message Date
0aa7108ee2 [fix](merge-on-write) incorrect result caused by key range filter with pk (#31456) 2024-02-29 19:51:47 +08:00
4a05e5a275 [fix](load) delete bytes_appended debug point which may cause bad page (#31602) 2024-02-29 19:51:18 +08:00
92e3b31f50 [feature](invert index) match_phrase_edge feature added (#31142) 2024-02-29 19:51:18 +08:00
720b6e3d86 [fix](nereids) forbid create table with illegal auto partition expr (#31498) (#31604) 2024-02-29 18:08:37 +08:00
34a31e9fb9 fix test_decimal256_index add wait build index (#31565) 2024-02-29 16:44:40 +08:00
12662e42de [fix](test) fix error messages in fault injection tests (follow-up) (#31577) 2024-02-29 16:44:40 +08:00
686938f5db [fix](nereids) window function with grouping sets work not well (#31475)
```sql        
select a, c, sum(sum(b)) over(partition by c order by c rows between unbounded preceding and current row) 
from test_window_table2 group by grouping sets((a),( c)) having a > 1 order by 1,2,3;
```
for this kind of case:
sum(sum(col)) over, nereids has cannot find slot problem.
the output slot of repeat and aggregate is computed wrongly.
Only collecting the trival-agg  in NormalizeRepeat can fix this problem.


Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-02-29 16:44:40 +08:00
9c4708ee74 [function](random_bytes)add random_bytes function (#31547)
SELECT random_bytes(10);

random_bytes(10) |
----------------------+
0x9b8ea00b7d1084bc5b26|
2024-02-29 16:44:39 +08:00
5276cc4db6 [docker][fix] update routine load cases (#31553)
Co-authored-by: 胥剑旭 <xujianxu@xujianxudeMacBook-Pro.local>
2024-02-29 16:44:39 +08:00
95b1f76664 [Feature](executor)broker load support workload group (#30866) (#31580) 2024-02-29 15:09:10 +08:00
4636b6195b [Fix](JNI) fix BE core when using JNI to query the empty map type value (#31502) 2024-02-29 14:03:38 +08:00
17359d59a3 [fix](Nereids) reorder join generate plan is not stable (#31539) 2024-02-29 12:38:03 +08:00
d0aedaf98e [fix](regression test)Make index compaction caset nonCouncurrent (#31520)
Co-authored-by: Luennng <luennng@gmail.com>
2024-02-29 12:38:03 +08:00
ff3c7765d6 [Bug](Func) Fix negative number in bitmap return error result (#31563) 2024-02-29 12:38:03 +08:00
Pxl
6af6997f1d [Improvement](materialized-view) add approx_count_distinct/ndv to FunctionAlias rule (#31535)
add approx_count_distinct/ndv to FunctionAlias rule
2024-02-29 12:38:03 +08:00
Pxl
413d733255 [Bug](materialized-view) fix npe on create mv with star (#31554)
fix npe on create mv with star
2024-02-29 12:38:03 +08:00
1316ee4942 Add p1 debug log (#31560) 2024-02-29 12:38:03 +08:00
3c37fb085c [refactor](jdbc catalog) split jdbc executor for different data sources (step-1) (#31406) 2024-02-29 12:38:03 +08:00
32033d08c6 Fix hive p2 cases. (#31541) 2024-02-29 12:37:38 +08:00
afc105647a [fix](regression) fix ssb shape case rf type (#31529) 2024-02-29 12:37:38 +08:00
0fcdab468d [nereids] config global partition topn (#31476)
* [nereids] config global partition topn

* [nereids] config global partition topn

---------

Co-authored-by: zhongjian.xzj <zhongjian.xzj@zhongjianxzjdeMacBook-Pro.local>
2024-02-29 08:42:35 +08:00
153c775b37 [fix](Nereids) Make the case sensitivity of the result labels compatible with MySQL (#31510)
SQL: SELECT iD FROM t1
before the label was: id
after this PR the label will be: iD
2024-02-29 08:42:35 +08:00
ddb37d7371 Fix analyze mv from follower case bug. (#31523) 2024-02-29 08:42:35 +08:00
4de25ede85 [fix](Nereids): other cond should be kept for each anti join when expanding anti join such as (#31521) 2024-02-29 08:42:35 +08:00
ac38356058 [fix](test) fix error messages in fault injection tests (#31515) 2024-02-29 08:42:35 +08:00
06c80d8708 [Fix](regression) add disable_auto_compaction for show data (#31519) 2024-02-29 08:42:35 +08:00
3ca412efe3 Return UNKNOWN column stats if ndv is 0. (#31439) 2024-02-29 08:42:35 +08:00
fa020b6696 [Improvement](regression-test) generate user token by configured user and password rather than hard cord (#31345)
Co-authored-by: xy720 <22125576+xy720@users.noreply.github.com>
2024-02-28 17:51:32 +08:00
d88caca44a [fix](Nereids) push down topn distinct through join by mistake (#31396)
should not push down topn distinct through join when the output
columns of the corresponding child of join is more than
aggregate distinct columns.

for example for LEFT_OUTER_JOIN:

left child of join's output is: c1, c2, c3.
distinct columns is: c1, c2
topn: limit 2

if we push down topn distinct, we could get result of join like this:

```
c1    c2    c3, ...
1     2     1
1     2     2
```

and the final result we get is:

```
c1    c2
1     2
```

this is wrong, because we need 2 lines, but only return 1.
2024-02-28 17:51:32 +08:00
e3f03e10b2 [cases](regression) Add data reliability check meta cases (#31432) 2024-02-28 13:08:41 +08:00
d0a8a30998 [improvement](iceberg/paimon)add show table stats (#31473) 2024-02-28 13:08:36 +08:00
5824f8a4bc [Feat](nereids) support multi-leading (#30379)
support multi-leading in each query block
2024-02-28 13:07:47 +08:00
04de7aed40 [fix](case) fix testcase test_decimal256_index #31486 2024-02-28 13:07:47 +08:00
a371a10603 [fix](Nereids) let time type coercion same with legacy planner (#31472) 2024-02-28 13:07:47 +08:00
47d112e4e6 [fix](MySQL) implement SHOW CHARSET statement. (#31389) 2024-02-28 13:07:23 +08:00
6b4a756837 [Fix] Only datetime and datetimev2 types can use current_timestamp as column default value (#31395)
for this kind of sql:

create table test_default10(
  a int, 
  b varchar(100) default current_timestamp
)
distributed by hash(a)
properties('replication_num'="1");

add check:
 Types other than DATETIME and DATETIMEV2 cannot use current_timestamp as the default value
2024-02-27 16:06:26 +08:00
f039ec8cfb [debug](Variant) sanitize variant type and column in find_and_set_leave_value (#31436) 2024-02-27 13:58:13 +08:00
735184b264 [test](auto partition)increase max_auto_partition_num configure value of auto partition (#31410)
* [test](auto partition)increase auto partition max_auto_partition_num configure value

* fix bug
2024-02-27 13:58:13 +08:00
4fd00e3ad7 [Fix](test)Fix workload group query queue regression test #31419 2024-02-27 10:12:53 +08:00
481d94c3fc [feature](nereids) deal the slots that appear both in agg func and grouping sets (#31318)
this PR support slot appearing both in agg func and grouping sets.
sql like below:
select sum(a) from t group by grouping sets ((a)); 

Before this PR, Nereids throw exception like below:
col_int_undef_signed cannot both in select list and aggregate functions when using GROUPING SETS/CUBE/ROLLUP, please use union instead.

This PR removes the restriction and supports this situation.
2024-02-27 10:12:33 +08:00
dd229b77b1 [fix](inverted index)Remove the strong check for parser when creating a table with inverted index (#31391) 2024-02-27 10:12:33 +08:00
1127b0065a [Improment](executor)Add scanbytes/scanrows condition (#31364)
* Add scanbytes/scanrows condition

* fix reg
2024-02-27 10:12:33 +08:00
f163d56a98 [feature](function) support sequence function(alias of array_range), enhance both to handle datetimev2 (#30823) 2024-02-27 10:12:19 +08:00
22b6434054 [feature](doris compose) Add create cloud cluster (#31315) 2024-02-27 10:12:19 +08:00
3cee6c6722 [fix](function) fix unexpected be core in string search function (#31312)
Fix be core in multi_match_any/multi_search_all_positions functions.
2024-02-27 10:12:18 +08:00
5d4a2d93a6 [feature](nereids) support join with joinRelation (#30909) 2024-02-26 19:07:11 +08:00
Pxl
fcea2b964e [Chore](materialized-view) forbid create mv have calculations included outside aggregate functions (#31336)
forbid create mv have calculations included outside aggregate functions
2024-02-26 19:07:11 +08:00
Pxl
3acffaa205 [Feature](agg-state) support write_column_to_pb from DataTypeFixedLengthObjectSerDe (#31171) 2024-02-26 19:07:10 +08:00
Pxl
3b7261abe4 [Mv] check delete from column exists on mv (#31321) 2024-02-26 19:07:10 +08:00
3451cd6c23 [fix](datetime) fix hour 24 on be (#31304) 2024-02-26 19:07:10 +08:00