Commit Graph

18370 Commits

Author SHA1 Message Date
a34ed4643a [fix](planner)date_add function should accept date type as its param (#34035) 2024-04-26 15:04:45 +08:00
5adc823b14 [fix](nereids)move ReplaceVariableByLiteral rule to analyze phase (#33997) 2024-04-26 15:04:45 +08:00
b7b87fbb95 [fix](planner)cast expr should do nothing in compactForLiteral method (#34047) 2024-04-26 15:04:45 +08:00
fdf91759b6 [fix](nereids)prevent null pointer access if translate expression fails (#33990) 2024-04-26 15:04:33 +08:00
60e20a3afe [fix](pipeline_x) Crc32HashPartitioner should use ShuffleChannelIds (#34147) 2024-04-26 15:03:11 +08:00
7f4b7b04ad [test](hive)add subnet for hive docker compose (#34000) (#34157)
bp #34000
Co-authored-by: 苏小刚 <suxiaogang223@icloud.com>
2024-04-26 13:49:33 +08:00
50f9d47e96 [test](hive) run suite cases both in hive2 and hive3 (#33874) (#34156)
bp #33874

Co-authored-by: 苏小刚 <suxiaogang223@icloud.com>
2024-04-26 13:48:09 +08:00
9aa08d8deb [improve](disk) Not add disk path to broken list if check status is not IO_ERROR (#34111) 2024-04-26 07:44:12 +08:00
7af5fc7321 [fix](Nereids) check after rewrite cannot handle agg in other opeator (#34114)
this is a stupid mistake. we import a same name class from another package
2024-04-26 07:43:40 +08:00
4f6b9db7a7 Update doris_main.cpp (#34128)
* Update doris_main.cpp

Log(FATAL) introduces a core dump, which is confusing for users. We should print error msg and exit without a core dump.

* Update doris_main.cpp
2024-04-26 07:43:40 +08:00
9f0a5690a6 [profile](scan) add projection time in scaner #34120 2024-04-26 07:43:40 +08:00
52031c86b7 [improvement](mtmv) Optimize the performance of nested materialized view rewriting (#34127)
Optimize the performance of nested materialized view rewriting gracefully, future performance optimzie base on this.
2024-04-26 07:43:25 +08:00
55d5ed9ab6 [test](streamload) add load empty file regression test (#34110) 2024-04-26 07:42:09 +08:00
Pxl
7fbca522b7 [Bug](runtime-filter) fix bloom filter size error on rf merge (#34082)
fix bloom filter size error on rf merge

W20240424 11:28:56.826277 3494287 ref_count_closure.h:80] RPC meet error status: [INVALID_ARGUMENT]PStatus: (172.21.0.15)[INVALID_ARGUMENT]bloom filter size not the same: already allocated bytes 65536, expected allocated bytes 32768
2024-04-26 07:41:56 +08:00
75644392f4 [fix](Nereids) support aggregate function only in having statement (#34086)
SQL like

> SELECT 1 AS c1 FROM t HAVING count(1) > 0 OR c1 IS NOT NULL
2024-04-26 07:41:45 +08:00
a237f7ec6e [feature](Nereids): add equal set in functional dependencies (#33642) 2024-04-26 07:41:45 +08:00
2b4f4ca796 [Fix](nereids) fix cases unstable of hint (#34101)
fix cases unstable of hint, remove unused cases and project nodes and use string contains in order to avoid unstable problem.
2024-04-26 07:41:30 +08:00
af9c885ae4 fix some unstable regression tests 2024-04-26 07:38:40 +08:00
47ded2c6a0 Revert "[fix](compile) fix two compile errors on MacOS (#33834) (#34005)"
This reverts commit 743fb62a2c42cc5cc662583c235f7336d5e6ddef.
2024-04-26 00:55:21 +08:00
9083bf7e14 revert "[Improvementation](join) empty_block shall be set true when build blo… (#33977)"
This reverts commit e3ed861e4b6a602ea874b6501998578952291f38.
2024-04-25 23:33:11 +08:00
50e9982729 [Enhancement](external catalog) Added status reset when jdbc name mapping is abnormal (#34129) 2024-04-25 20:40:25 +08:00
743fb62a2c [fix](compile) fix two compile errors on MacOS (#33834) (#34005) 2024-04-25 19:39:35 +08:00
b873be6588 [fix](routine-load) fix routine load lag is negative (#34113)
* [fix](routine-load) fix routine load lag is negative (#33846)

* fix merge error
2024-04-25 17:24:41 +08:00
Pxl
e3ed861e4b [Improvementation](join) empty_block shall be set true when build blo… (#33977)
empty_block shall be set true when build block only one row
2024-04-25 15:07:56 +08:00
987f755206 [Fix](nereids) fix rule SimplifyWindowExpression (#34099)
Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
2024-04-25 15:07:09 +08:00
f34fe46bfa [fix](scan) fix ignore expr exec when _non_predicate_columns is empty (#33934)
fix ignore expr exec when _non_predicate_columns is empty
2024-04-25 15:06:57 +08:00
c2e3defe56 [fix](tablet invert index) fix tablet invert index leaky caused by auto partition (#33973) 2024-04-25 15:06:43 +08:00
789a16ec6b [fix](fe) Fix SHOW CREATE TABLE with AUTO PARTITION (#34071)
AUTO PARTITION grammar has changed since #31585, but the output
of SHOW CREATE TABLE was left out to change, so the result is not
able to be recognized by the FE parser.
2024-04-25 15:05:58 +08:00
47b54d4bd5 Fix remote scan pool (#33976) 2024-04-25 15:04:43 +08:00
5f2d0e3d53 [Fix](executor)Fix when Fe send empty wg list to be may cause query failed. (#34074) 2024-04-25 12:01:44 +08:00
450f443413 [fix](decommission) fix cann't decommission mtmv (#33823) 2024-04-25 12:01:44 +08:00
a15a8e119f [fix](mtmv) Fix exception when create materialized view with cte (#33988)
Fix exception when create materialized view with cte, after this fix, can create materialized view with following
```
        CREATE MATERIALIZED VIEW mv_with_cte
            BUILD IMMEDIATE REFRESH AUTO ON MANUAL
            DISTRIBUTED BY RANDOM BUCKETS 2
            PROPERTIES ('replication_num' = '1')
            AS
            with `test_with` AS (
            select l_partkey, l_suppkey
            from lineitem
            union
            select
              ps_partkey, ps_suppkey
            from
            partsupp)
            select * from test_with;
```

this is brought from https://github.com/apache/doris/pull/28144
2024-04-25 12:01:44 +08:00
f4deb42a80 [pipeline](fix) Prevent re-cancel pipeline tasks (#34073) 2024-04-25 12:01:44 +08:00
eaacba644d [fix](auth)can not grant priv to __internal_schema (#34009)
mysql> grant SELECT_PRIV on `_internal_schema`.* to 'test'@'%'; ERROR 1102 (42000): errCode = 2, detailMessage = Incorrect database name '_internal_schema'
2024-04-25 12:01:44 +08:00
103987ebd8 [fix](parse) set origin stmt for select stmt generated from show stmt (#34015)
* [fix](parse) set origin stmt for select stmt generated from show stmt

* 2
2024-04-25 12:01:44 +08:00
fbd2c9db2d [upgrade](hive-shade)(paimon) upgrade hive shade to 2.0.0 and paimon to 0.7 (#34085)
* Adapt paimon 0.6.0 (#33943)

Version 2.0.0 of the shade package eliminates potential jar conflicts, resolves dependency component issues, and significantly reduces package size.
Utilize the directly-dependent guava library instead of relying on transitively included libraries.

* [chore](dependencies)Upgrade paimon to 0.7.0 (#33987)

---------

Co-authored-by: Calvin Kirs <kirs@apache.org>
2024-04-25 12:01:44 +08:00
ac038b3d4f [fix](auto bucket) Fix auto bucket regression case occasional fail (#34069) 2024-04-25 12:01:44 +08:00
a17524b427 [bugfix](core) close method should check if the pointer is nullptr (#34067)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-04-25 12:01:44 +08:00
7eb35c95f3 [refactor](errormessage) step1: unify the status usage in FE (#34062)
We should tell the user the correct error message when some thing wrong. But error message is in a mess. I will make it clear.

This is the first step: unify the error code usage in FE.
2024-04-25 12:01:44 +08:00
a720e03a02 [improvement](mtmv) Optimize the nested materialized view rewrite performance (#34050)
Optimize the nested materialized view rewrite performance when exists many join
This is brought by #33362
2024-04-25 12:01:44 +08:00
67b394f2b0 [feature](profile) sort pipelineX task by total time #34053 2024-04-25 12:01:44 +08:00
2c3e838971 [improvement](spill) improve config of spill thread pool (#33992) 2024-04-25 12:01:44 +08:00
0faae45537 [opt](nereids)project sub expression in other condition for nested loop join (#32697)
1. project sub expression in other condition for nested loop join
2. fix a bug in ut framework which may gennerate duplicated ExprId
2024-04-25 12:01:44 +08:00
ef73533e27 [Feat](nereids) add transform rule SimplifyWindowExpression (#33647)
rewrite func(para) over (partition by unique_keys)
1. func() is count(non-null) or rank/dense_rank/row_number -> 1
2. func(para) is min/max/sum/avg/first_value/last_value -> para
 e.g
select max(c1) over(partition by pk) from t1;
-> select c1 from t1;
2024-04-25 12:01:44 +08:00
800bb3d4ba [Feat](nereids) add expression rewrite rule LikeToEqualRewrite (#33803)
like expressions without fuzzy matching are rewritten into equivalent expressions
2024-04-25 12:01:44 +08:00
2f996a574f [Feat](nereids) nereids add alter view (#33970)
nereids support alter view stmt.
e.g. ALTER VIEW example_db.example_view
(
c1 COMMENT "column 1",
c2 COMMENT "column 2",
c3 COMMENT "column 3"
)
AS SELECT k1, k2, SUM(v1) FROM example_table
GROUP BY k1, k2
2024-04-25 12:01:44 +08:00
edff4137fe [fix](mtmv) Mv check name (#34016) 2024-04-25 12:01:44 +08:00
e54ae4519d [fix](bdb) Write OP_TIMESTAMP operation until it successed (#33967)
For now, it will reset the next journal id and return if the OP_TIMESTAMP
operation writes failed. Because BDBJE will replicate the committed txns (only
persisted in BDB log, but not replicated to other members) to FOLLOWERs after
the connection resumed, directly resetting the next journal id and returning
will cause subsequent txn written to the same journal ID not to be replayed by
the FOLLOWERS. So for OP_TIMESTAMP operation, try to write until it succeeds.
2024-04-25 11:59:52 +08:00
cc3decffa4 [bug](test) fix test case failed with fuuzy fold constatnt to false (#34052) 2024-04-24 19:42:08 +08:00
d5275c55b4 [bug](fold) fix fold date/datetime error as null (#33845)
the LocalDateTime/LocalDate value maybe null, so need check it firstly.
if it's null, could return NullLiteral directly.
2024-04-24 19:41:42 +08:00