Commit Graph

17549 Commits

Author SHA1 Message Date
f0eb23a496 [fix](insert-into) fix insert into lose data (#29802) 2024-01-12 11:58:55 +08:00
c7968480ac [fix](move-memtable) fix use-after-free in LoadStreamReplyHandler (#29791) 2024-01-12 11:57:16 +08:00
81680383e6 [UT](wal) Add wal dirs info be ut (#29759) 2024-01-12 11:57:16 +08:00
0d16ec7345 [improvement](cooldown) do not cooldown tablet without cold data (#29690) 2024-01-12 11:57:16 +08:00
7c7dbf15bc [feature](merge-cloud) Decouple Tablet/TabletManager/TxnManager from global StorageEngine instance (#29736) 2024-01-12 11:57:16 +08:00
81d6775b7b [Cleanup](Nereids): delete useless ddlSql to avoid wrong usage (#29788)
ddlSql is useless and some code use getDdlSql() wrong, so delete those code
2024-01-12 11:57:16 +08:00
2e90c457b6 [fix](move-memtable) don't fail if success tablets to one BE is less than quorum (#29754) 2024-01-12 11:57:16 +08:00
8fd1ce4a2e [Enhancement](inverted index) refact some inverted index writer code to make more effieciency (#29602) 2024-01-12 11:53:58 +08:00
99c8e47518 [fix](nereids) fix regression case "nereids_p0/runtimefilter" (#29776) 2024-01-12 11:53:58 +08:00
a244f11da2 [fix](statistics)Fix alter column stats not forward to master bug (#29786)
Alter column stats operation need to write bdbje, so it should be forwarded to master to execute. Otherwise, the operation on follower/observer will cause the FE crash.
2024-01-12 11:53:57 +08:00
f8d3b20911 [improve](fmt) use format_to and FMT_COMPILE to speed up write data #29682 2024-01-12 11:53:57 +08:00
697a6a4ba2 [Refactor](admin-stmt) rename some admin-show statestmt (#29492)
The `ADMIN SHOW` statement can not be executed with high version of mysql 8.x jdbc driver.
So I rename these statement, remove the `ADMIN` keywords.

1. ADMIN SHOW CONFIG -> SHOW CONFIG
2. ADMIN SHOW REPLICA -> SHOW REPLICA
3. ADMIN DIAGNOSE TABLET -> SHOW TABLET DIAGNOSIS
4. ADMIN SHOW TABLET -> SHOW TABLET

for compatibility, the old statements are still supported, but not recommend to use.
They will be removed in later version
2024-01-12 11:53:57 +08:00
5d0732fcf4 [typo](docker thirdparties) Modify script prompt information error (#29770) 2024-01-12 11:53:57 +08:00
ddf2e8d3dd [feature](Nereids): merge topNs (#28246)
merge topNs like 
```
TopN
|
TopN

merge ->

TopN
```
2024-01-12 11:53:42 +08:00
3e9cd3a8b9 [minor](jdbc) fix wrong log and add more info (#29557) 2024-01-12 11:53:21 +08:00
bd4ef638f1 [fix](invert index) fix match_phrase_prefix memory leak (#29774) 2024-01-12 11:53:12 +08:00
7db65f3f6c [tools] update tpcds tools query (#29745)
Co-authored-by: zhongjian.xzj <zhongjian.xzj@192.168.2.27>
2024-01-12 11:52:56 +08:00
542cfb37b0 [ci](perf) adjust performance pipeline (#29622)
remove old tpch trigger
branch-2.0 also run performance
2024-01-12 11:52:47 +08:00
38c225f76c [fix](nereids) generate correct order for runtime filter when contains NullSafeEquals hash condition (#29726)
Be do not support RF for NullSafeEquals, so fe not generate RF for them.
However, after we support NullSafeEquals as Hash join condition,
the order of RF is wrong when generating RF in FE. this PR fix it.
2024-01-12 11:49:09 +08:00
e17809a684 [fix](nereids)logicalhaving is in wrong place after logicalagg and logicalwindow (#29463) 2024-01-12 11:48:39 +08:00
883d6dfc73 [fix](planner)strip trailing zeros for decimal literal if the precision larger than max decimal precision in doris (#29737) 2024-01-12 11:48:39 +08:00
a94f2564e3 [fix] (schema change) ignore the error of repeatedly writing rowset during schema change (#29733) 2024-01-12 11:48:39 +08:00
ca75c9b8ab add more logs to debug timeout
Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-12 11:48:39 +08:00
fc4ca712ed [bugfix](core) using weak ptr in data stream receiver to avoid runtime state is deconstructed (#29410) 2024-01-12 11:48:39 +08:00
HB
ff7f09fe1f [fix](executor) Fe publish topic info tcp leak (#29739)
* [fix](executor) Fe publish topic info tcp leak

* enhancement
2024-01-12 11:48:39 +08:00
7287c0ca15 [Opt](exec)(multi-catalog) Opt date type reading. (#29571) 2024-01-12 11:48:39 +08:00
fe5b0e9880 [FIX](struct)fix struct literal in fe const fold with field name #29735 2024-01-12 11:48:39 +08:00
71b017efee [typo](docs) fix invalid url (#29471)
Co-authored-by: hechao <hechao@selectdb.com>
2024-01-12 11:46:29 +08:00
d531111922 [test](regression-test) forbid test_index_failure_injection (#29741) 2024-01-12 11:46:29 +08:00
2c44951543 [fix](planner)only allow null safe equal when both children are nullable (#29470) 2024-01-12 11:46:29 +08:00
94ebf9d7f6 [test](regression-test) forbid test_load_stream_stub_failure_injection #29728 2024-01-12 11:46:29 +08:00
463a7ab212 [Performance](exec) opt the exchange performance (#29579) 2024-01-12 11:46:29 +08:00
48f58510a8 [refactor](tabletwriter) make tablet writer's rpc callback safe, could exit any time (#29684)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-12 11:46:29 +08:00
c16a531513 [FIX](regresstest)delete replicate create table numbers #29722 2024-01-12 11:46:29 +08:00
f8aba3faae [Enhancement](index tool) refine inverted index tool code (#29717) 2024-01-12 11:46:29 +08:00
aa22698fe7 [fix](case) fix unstable case by add def before variable define (#29082)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-01-12 11:46:29 +08:00
2d04b72b5d [opt](case) Update test_hive_query_cache.groovy (#29694)
set longer timeout to avoid case fail
2024-01-12 11:46:29 +08:00
a5a63856be [chore](case) update regression-test README #29031 2024-01-12 11:46:29 +08:00
7a75cde77d [fix](schemachange) Fixed the issue of incorrect log information when distribution columns are compared inconsistently (#27013) 2024-01-12 11:46:29 +08:00
0a853be3d1 [fix](storage medium) show create table don't print empty storage medium #29650 2024-01-12 11:46:29 +08:00
b7a819bd24 [Fix](typo) Fix analyzeGroupCommitDataBytes typo #29640 2024-01-12 11:46:29 +08:00
Pxl
7738eca6da [Bug](stream-load) fix stream load failed on table with rollup (#29665)
fix stream load failed on table with rollup
2024-01-12 11:46:29 +08:00
9cbb55d49b [fix](Nereids) create double literal when create decimal literal failed (#28959)
FIX
1. remove float and double literal toString and getStringValue introduced by
  PR #23504 and PR #23271
  These functions lead to wrong cast result of double and float literal
2. fix compute signature for datetimev2 always produce scale 6
3. fix stats calculator failed when generate node stats with two same column
4. constant fold on fe failed when cast double to integral

TODO
after fix the first problem, some mv matching not work well, fix them later
- test_dup_mv_div
- test_dup_mv_json
- test_tcu
2024-01-12 11:46:29 +08:00
67986a8a6f [fix](case) external case, specify networks (#29699)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-01-12 11:46:29 +08:00
aec373e2a0 [fix](regression) remove a buggy fault-injection case which make BE crash (#29673)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
2024-01-12 11:46:29 +08:00
da182a8b6f [feature](nereids)print nereids node id in explain (#29238)
* print nereids id in explain
2024-01-12 11:44:21 +08:00
e4707154fa [opt](statistics) create or update table stats after alter column stats.
Create or update table stats after alter column stats.
Set flag to disable auto analyze for the table after user inject column stats.
2024-01-12 11:44:21 +08:00
abb7640d37 [debug](timeout) add more log in scanner ctx to find timeout problem #29704
Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-12 11:44:21 +08:00
fda001b6d3 [Improvement](nereids) Support join derivation when mv rewrite (#29609)
materialized view def is as following:
>            select l_linenumber, o_custkey
>           from orders
>            left join lineitem on lineitem.L_ORDERKEY = orders.O_ORDERKEY
>            where o_custkey = 1;

when query is as following, it can be rewritten by mv above
it requires that query has reject null filters on the join right input, 
current supported filter are  "=", "<", "<=", ">", ">=", "<=>" 
>            select IFNULL(orders.O_CUSTKEY, 0) as custkey_not_null,
>           case when l_linenumber in (1,2,3) then l_linenumber else o_custkey end as case_when
>            from orders
>            inner join lineitem on orders.O_ORDERKEY = lineitem.L_ORDERKEY
>            where o_custkey = 1 and l_linenumber > 0;
2024-01-12 11:44:21 +08:00
34fe5ee38b [feat](Nereids) support show constraint command (#29667)
show constraints from t1;
+------+-------------+-----------------------------------------+
| Name | Type        | Definition                              |
+------+-------------+-----------------------------------------+
| fk   | FOREIGN KEY | FOREIGN KEY (id) REFERENCES cir.t1 (id) |
| uk   | UNIQUE      | UNIQUE (id)                             |
| pk   | PRIMARY KEY | PRIMARY KEY (id)                        |
+------+-------------+-----------------------------------------+
2024-01-12 11:44:21 +08:00