45b2dbab6a
[improve](group commit) Group commit support max filter ratio when rows is less than value in config ( #28139 )
2023-12-12 16:33:36 +08:00
d25cbdd4dc
[feature](Nereids): one side eager aggregation ( #28143 )
2023-12-12 15:38:31 +08:00
cd8885f63e
[fix](Nereids): support Chinese characters set ( #28256 )
2023-12-12 13:22:14 +08:00
e49ed3d885
[regression test](memtable) add case for aggregation memtable ( #28056 )
...
1. create aggregation table
2. insert some data
3. drop the table and create again
4. modify some parameters for some branch
5. insert some data
6. change the parameters back to its default
2023-12-12 11:14:59 +08:00
cd3d31ba13
[fix](statistics)Escape load stats sql ( #28117 )
...
Escape load stats sql, because column name may contain special characters.
2023-12-11 20:25:18 +08:00
f30cc1f6ef
[Bug](view) fix npe on create view with comment ( #28189 )
...
fix npe on create view with comment
2023-12-11 20:00:21 +08:00
d4f89389e3
[improve](group commit) Group commit support skip wal ( #27957 )
2023-12-11 19:38:32 +08:00
9b8de017df
[Regression test](inverted index) fix regression case for index_compound_directory_fault_injection ( #28232 )
2023-12-11 19:17:28 +08:00
3e1e8d2ebe
[fix](jdbc catalog) Fixed data conversion problem when all data is null ( #28230 )
2023-12-11 17:57:57 +08:00
ad483efca5
[regression-test](case) forbid group commit case first #28244
2023-12-11 16:06:59 +08:00
1bbc54d1b2
[regression-test](variant) change p2 case to s3 load ( #28193 )
2023-12-11 12:31:25 +08:00
ac167f493b
[fix](join) fix decimal overflow caused by left outer join ( #28221 )
...
For left outer join or full outer join, when build side data is empty, null data is output for build side, but nested column data of nullable column is not properly initialized, which may cause decimal arithmetic overflow
2023-12-11 11:51:05 +08:00
7c163fdf21
[test](decimal) add some cases about overflow ( #28198 )
2023-12-11 11:22:53 +08:00
f236261256
[fix](regression) compaction cases adapt force_olap_table_replica_num option ( #28136 )
2023-12-11 10:08:21 +08:00
1e5ff40e17
[refactor](group commit) remove future block ( #27720 )
...
Co-authored-by: huanghaibin <284824253@qq.com >
2023-12-11 08:41:51 +08:00
485d7db516
[fix](partial update) Fix missing rowsets during doing alignment when flushing memtable due to compaction ( #28062 )
2023-12-10 12:09:48 +08:00
61379b141e
[fix](insert) fix group commit regression test ( #28142 )
2023-12-09 16:24:20 +08:00
07336980f9
[fix](meta) show partitions with Limit for external HMS tables (27835) ( #27835 )
...
This enhancement shall extend existing logic for SHOW PARTITIONS FROM to include: -
Limit/Offset
Where [partition name only] [equal operator and like operator]
Order by [partition name only]
Issue Number: close #27834
2023-12-09 01:44:45 +08:00
027b06059a
[Feature](materialized-view) support count(1) on materialized view ( #28135 )
...
support count(1) on materialized view
fix match failed like select k1, sum(k1) from t group by k1
2023-12-09 01:36:46 +08:00
b6e72d57c5
[Improvement](hms catalog) support show_create_database for hms catalog ( #28145 )
...
* [Improvement](hms catalog) support show_create_database for hms catalog
* update
2023-12-09 01:34:21 +08:00
055b3885c9
[Fix](inverted index) fix compound directory flush buffer error ( #28191 )
2023-12-09 00:57:35 +08:00
baf85547ae
[feature](jdbc) support call function to pass sql directly to jdbc catalog #26492
...
Support a new stmt in Nereids:
`CALL EXECUTE_STMT("jdbc", "stmt")`
So that we can pass the origin stmt directly to the datasource of a jdbc catalog.
show case:
```
mysql> select * from mysql_catalog.db1.tbl1;
+------+------+
| k1 | k2 |
+------+------+
| 111 | 222 |
+------+------+
1 row in set (0.63 sec)
mysql> call execute("mysql_catalog", "insert into db1.tbl1 values(1,'abc')");
Query OK, 0 rows affected (0.01 sec)
mysql> select * from mysql_catalog.db1.tbl1;
+------+------+
| k1 | k2 |
+------+------+
| 111 | 222 |
| 1 | abc |
+------+------+
2 rows in set (0.03 sec)
mysql> call execute_stmt("mysql_catalog", "delete from db1.tbl1 where k1=111");
Query OK, 0 rows affected (0.01 sec)
mysql> select * from mysql_catalog.db1.tbl1;
+------+------+
| k1 | k2 |
+------+------+
| 1 | abc |
+------+------+
1 row in set (0.03 sec)
```
2023-12-08 23:06:05 +08:00
2b914aebb6
[opt](nereids)improve partition prune when Date function is used ( #27960 )
...
date func in partition prune
2023-12-08 21:53:39 +08:00
573b594df3
[improvement](Variant Type) Support displaying subcolumns expanded for the variant column ( #27764 )
2023-12-08 20:34:58 +08:00
51f320a606
[bug](function) fix array_apply function return wrong result ( #28133 )
2023-12-08 20:14:54 +08:00
75b55f8f2f
[enhance](session)check invalid value when set parallel instance variables ( #28141 )
...
in some case, if set incorrectly, will be cause BE core dump
10:18:19 *** SIGFPE integer divide by zero (@0x564853c204c8) received by PID 2132555
int max_scanners =
config::doris_scanner_thread_pool_thread_num / state->query_parallel_instance_num();
2023-12-08 17:38:48 +08:00
bc40025631
[opt](Nereids)Join cluster connectivity ( #27833 )
...
* estimation join stats by connectivity
2023-12-08 14:55:10 +08:00
61d556c718
[fix](nereids)runtime filter translator failed on set operator ( #28102 )
...
* runtime filter translator failed on set operator
2023-12-08 12:58:42 +08:00
341822ec05
[regression-test](Variant) add compaction case for variant and fix bugs ( #28066 )
2023-12-08 12:18:46 +08:00
59ec3da899
open workload group in PR pipeline ( #27744 )
2023-12-08 11:56:03 +08:00
cd108688c1
[Chore](docs)Fix job error docs ( #28127 )
2023-12-08 10:24:21 +08:00
25b90eb782
[Feature](function) support random int from specific range ( #28076 )
...
mysql> select rand(-20, -10);
+------------------+
| random(-20, -10) |
+------------------+
| -13 |
+------------------+
1 row in set (0.10 sec)
2023-12-08 10:15:25 +08:00
e75d91c91b
[regression-test](Variant) Add more cases related to schema changes ( #27958 )
...
* [regression-test](Variant) Add more cases related to schema changes
And fix bugs about schema change for variant:
fix bug schema change crash on doing schema change with tablet schema that contains extracted columns
2023-12-08 10:15:12 +08:00
1d345877ce
[fix](regression-test) load_to_single_tablet assertEquals usage ( #28128 )
2023-12-08 10:09:44 +08:00
66ed093410
[test](Nereids): fix test push_down_top_n ( #26937 )
2023-12-07 23:07:32 +08:00
81a0f8c041
[Feature](function) support generating const values from tvf numbers ( #28051 )
...
If specified, got a column of constant. otherwise an incremental series like it always be.
mysql> select * from numbers("number" = "5", "const_value" = "-123");
+--------+
| number |
+--------+
| -123 |
| -123 |
| -123 |
| -123 |
| -123 |
+--------+
5 rows in set (0.11 sec)
2023-12-07 22:26:43 +08:00
be81eb1a9b
[feature](nereids) Support inner join query rewrite by materialized view ( #27922 )
...
Work in process. Support inner join query rewrite by materialized view in some scene.
Such as an exmple as following:
> mv = "select lineitem.L_LINENUMBER, orders.O_CUSTKEY " +
> "from orders " +
> "inner join lineitem on lineitem.L_ORDERKEY = orders.O_ORDERKEY "
> query = "select lineitem.L_LINENUMBER " +
> "from lineitem " +
> "inner join orders on lineitem.L_ORDERKEY = orders.O_ORDERKEY "
2023-12-07 20:29:51 +08:00
65fc2e0438
[fix](Nereids) forbid two TVF in one fragment since the limit of coordinator ( #28114 )
2023-12-07 19:58:31 +08:00
cc9b4bcddb
[Fix](variant) fallback to none partial update for mow table ( #28116 )
2023-12-07 19:30:24 +08:00
3dcbf16404
[Fix](Outfile) The Struct type data exported from select outfile to the csv file format should contain a column name #28068
...
If the original data is：
```sql
+-----------------------------------------------------+
| s_info |
+-----------------------------------------------------+
| {"s_id": 2, "s_name": "nereids", "s_address": "20"} |
| {"s_id": 1, "s_name": "doris", "s_address": "18"} |
+-----------------------------------------------------+
```
In the original logic, the struct type data exported to a csv file format did not contain column names,like
```
{2, "nereids", "20"}
{1, "doris", "18"}
```
This pr do not need to be merged into branch-2.0
2023-12-07 18:23:36 +08:00
172747669e
[fix](Nereids)fix regression case：nereids_rules_p0/transposeJoin/transposeSemiJoinAgg #28111
2023-12-07 17:41:08 +08:00
bc12a05915
[fix](Nereids) explain graph insert-select NPE ( #28007 )
2023-12-07 17:25:44 +08:00
9c63dfd692
[improve](move-memtable) support variant in move-memtable ( #28084 )
...
* [improve](move-memtable) support variant in move-memtable
Pass the flush schema to the destination end of the sink.
2023-12-07 16:41:38 +08:00
1a46cf6fb5
[fix](split_by_string) Fix split by string core on column string ( #28030 )
2023-12-07 16:36:13 +08:00
8526b9ffbe
[imporvement](table property) support for alter table property disable_auto_compaction ( #27961 )
...
in some case, some tablets may cause coredump or OOM when compaction, and it is necessary to manually close the compaction of a specific table by 'disable_auto_compaction' to make be service available
This commit allow modify disable_auto_compaction table property in schema change.
---------
Signed-off-by: nextdreamblue <zxw520blue1@163.com >
2023-12-07 15:08:39 +08:00
3f3843fd4f
[fix](load) fix loaded rows error ( #28061 )
2023-12-07 14:43:51 +08:00
f2477a3fcc
[Regression](bitmap index) fix bitmap index test case ( #28109 )
2023-12-07 13:29:24 +08:00
8c79b86f5b
Revert "[feature](merge-on-write) enable merge-on-write by default ( #27188 )" ( #28096 )
...
This reverts commit 00c8bab84de8154052f9d323800b436cd0ad36e5.
2023-12-07 11:31:36 +08:00
b6722653cf
[test](Job)Delete the JOB show syntax (now we use TVF) and add tvf case ( #28058 )
2023-12-07 10:17:52 +08:00
630de740ea
[fix](meta) fix bug for using full name in show_full_columns stmt ( #28019 )
2023-12-07 10:17:25 +08:00
