Commit Graph

4404 Commits

Author SHA1 Message Date
f52067415b Improve analyze mv/mtmv wait row count report logic. (#33695) 2024-04-17 23:42:13 +08:00
11f7d11a96 [branch-2.1](regression-test) fix test_chema_change_fail (#33753) #33788 2024-04-17 23:42:13 +08:00
81f7c53bad [fix](Nereids) could not query variant that not from table (#33704) 2024-04-17 23:42:13 +08:00
1c025c0488 [docker](hive) add hive3 docker compose and modify scripts (#33115)
add hive3 docker compose from:
big-data-europe/docker-hive#56
2024-04-17 23:42:13 +08:00
22a6b1d3f5 [feature](function) support hll functions hll_from_base64, hll_to_base64 (#32089)
Issue Number: #31320 

Support two hll functions:

- hll_from_base64
Convert a base64 string(result of function hll_to_base64) into a hll.
- hll_to_base64
Convert an input hll to a base64 string.
2024-04-17 23:42:13 +08:00
3096150d1b [feature](agg) support aggregate function group_array_intersect (#33265) 2024-04-17 23:42:13 +08:00
3f267e36d1 [fix](nereids)InSubquery's withChildren method lost typeCoercionExpr (#33692) 2024-04-17 23:42:13 +08:00
b07e0a2f06 [FIX](cast)fix full/right out join for cast array (#33475)
in some case, we has code
```
        if (_join_op == TJoinOp::RIGHT_OUTER_JOIN || _join_op == TJoinOp::FULL_OUTER_JOIN) {
            _probe_column_convert_to_null = _convert_block_to_null(*input_block);
        }
```
then do next function like cast , but in function cast we assume block column is same with from_type.which will make status error
2024-04-17 23:42:13 +08:00
53a3d6c154 [fix](testcase) fix miss used global variables in index testcases (#33293) 2024-04-17 23:42:13 +08:00
d6a63b9789 [Update](cloud) skip show data size assertion in cloud mode (#33677) 2024-04-17 23:42:13 +08:00
d15981abd2 [Enhencement](Nereids) add rule of agg(case when) to agg(filter) (#33598) 2024-04-17 23:42:13 +08:00
fe3b6824b3 [case](regression) Add backup temp partition case (#33646) 2024-04-17 23:42:13 +08:00
8e38549a92 [fix](nereids) Use correct PREAGGREGATION in agg(filter(scan)) (#33454)
1. set `PreAggStatus` to `ON` when agg key column by max or min;
2. #28747 may change `PreAggStatus` of scan, inherit it from the previous one.
2024-04-17 23:42:13 +08:00
c15ac3ffca [testcases](auto-partition) fix data sync (#33635)
fix data sync
2024-04-17 23:42:12 +08:00
7b16cb5a4c [feature](inverted index) add slop functionality to match_phrase (#33225)
https://github.com/apache/doris-website/pull/553 doc
2024-04-17 23:42:12 +08:00
e53a76d75b [fix](planner) fix bug of InlineViewRef's tableNameToSql method (#33575) 2024-04-17 23:42:12 +08:00
d000658a9b [fix](nereids) ExtractAndNormalizeWindowExpression should only normalize alias in output (#33527) 2024-04-17 23:42:12 +08:00
46a258dc85 [improvement](binlog)Support inverted index format v2 in CCR (#33415) 2024-04-17 23:42:12 +08:00
06a155abb0 [branch-2.1](cherry-pick) Pick some partial-update PR from master (#33639)
* [Fix](partial-update) Fix partial update fail when the datetime default value is 'current_time' (#32926)

* Problem: When importing data that includes datetime with a default value of current time for partial column updates, the import fails.
Reason: Partial column updates do not handle the logic for datetime default values.
Solution: During partial column updates, when the default value is set to current time, read the current time from the runtime state and write it into the data.

* [Enhancement](partial update)Add timezone case for partial update timestamp #33177

* [fix](partial update) Support partial update when the date default value is 'current_date'. This PR is a extension of PR #32926. (#33394)
2024-04-17 23:42:12 +08:00
d0394b7f89 [fix](test) fix some unstable p2 test cases (#33637) (#33655)
bp #33637
2024-04-17 23:42:12 +08:00
ad82ed324e remove is cloud mode 2024-04-17 23:42:12 +08:00
55be6c6309 [fix](schema change) follow fe set sc fail replicas as bad (#33569) 2024-04-17 23:42:12 +08:00
75d0d8f2cc [fix](create table) Fix create table exception without cleaning the e… (#33574) 2024-04-17 23:42:12 +08:00
4740b22481 [fix](test) fix some p2 external table test cases (#33624)
bp #33621
Also fix a merge bug from #33245
2024-04-17 23:42:12 +08:00
a5db73070e [test](mtmv)Add column name case sensitive test (#33538) 2024-04-17 23:42:12 +08:00
1be753ed75 [enhancement](mysql compatible) add user and procs_priv tables to mysql db in all catalogs (#33058)
Issue Number: close #xxx

This PR aims to enhance the compatibility of BI tools (such as Dbeaver, DataGrip) when using the mysql connector to connect to Doris, because some BI tools query some tables in the mysql database. In our tests, the user and procs_priv tables were mainly queried. This PR adds these two tables and adds actual data to the user table. However, please note that most of the fields in the user table are in Doris' own format rather than mysql format, so it can only ensure that the BI tool is querying No error is reported when accessing these tables, which does not guarantee that the data is completely displayed, and the tables under Doris's mysql database do not support data modification.
Thanks to @liujiwen-up for assisting in testing
2024-04-17 23:42:12 +08:00
3decd850e2 [case](regression) Add backup restore test for hdfs repo (#33581) 2024-04-17 23:42:11 +08:00
48880c3e1a [Fix](timezone) fix miss of expected rounding of Date type with timezone #33553 2024-04-17 23:42:11 +08:00
1f5116f3c1 [testcases](auto-partition) Add and fix testcases in P0 #33588 2024-04-17 23:42:11 +08:00
e71b7513e1 [test](bi) add dbeaver and datagrip connect doris test (#33487) 2024-04-17 23:42:00 +08:00
379c2e0762 [Fix](Nereids) fix leading hint should have all tables in one query block (#33517) 2024-04-17 23:42:00 +08:00
aed3dd72a7 [chore](test) update one join case for nereids because ambiguous name (#33562) 2024-04-17 23:42:00 +08:00
ae4a7c93ac [feat](nereids) support create view in nereids (#32743) 2024-04-17 23:42:00 +08:00
249a9c9875 [Feature](Variant) support aggregation model for Variant type (#33493)
refactor use `insert_from` to replace `replace_column_data` for variable lengths columns
2024-04-17 23:42:00 +08:00
2746ee9d3a [FIX](regresstest) fix array_range case for regress test (#33337) 2024-04-17 23:42:00 +08:00
b2b385a4ff [improve](fold) support complex type for constant folding (#32867) 2024-04-17 23:41:59 +08:00
6bcf24b1f6 [bug](not in) if not in (null) could eos early (#33482)
* [bug](not in) if not in (null) could eos early
2024-04-17 23:41:59 +08:00
9dfc9665fb [Fix](inverted index) fix build index error status when batch_next (#33532) 2024-04-17 23:41:59 +08:00
09fb30c989 (Chore)[regression-test] fix unstable output variant case (#33520) 2024-04-17 23:41:59 +08:00
82d2bde3c7 [fix](nereids) do not transpose semi join agg when mark join (#32475) 2024-04-17 23:41:59 +08:00
272269f9c1 [Fix](inverted index) fix fast execute problem when need read data opt enabled (#33526) 2024-04-17 23:41:59 +08:00
ca59b25d59 [feat](nereids) add session var to turn on/off common sub expressoin extraction (branch-2.1) #33616 2024-04-17 23:41:43 +08:00
e26a53d8a6 [fix](nereids) SemiJoinSemiJoinTransposeProject rule didn't handle mark join correctly (#33401) 2024-04-12 15:09:25 +08:00
78b81d4150 [fix](test) remove distribute node of shape in some regression test (#33463) 2024-04-12 15:09:25 +08:00
d2f84229ec [chore](test) remove some outdated datetime test case (#33476) 2024-04-12 15:09:25 +08:00
b035c7ceb4 [fix](catalog) fix resource is not reopen when rename catalog (#33432)
During the renaming of `JdbcCatalog`, I noticed that the `jdbcClient` was being closed, 
resulting in exceptions during subsequent queries. This happens because the `removeCatalog` 
method is invoked when changing the name, which in turn calls the `onClose` method of the catalog. 
Ideally, the client should not be closed when renaming the catalog. 
However, to avoid extra checks in the `removeCatalog` method, we can simply execute `onRefresh` 
in the `addCatalog` method to address this issue.
2024-04-12 15:09:25 +08:00
53336d6170 [fix](routine-load) routine load date where expression rewrite should change over time (#33345) 2024-04-12 15:09:25 +08:00
031f1e6a65 [case](regression) Add backup restore with NGRAM bloom filter (#33479) 2024-04-12 15:09:25 +08:00
9b7af4c0cf [feature](schema change) unified schema change for parquet and orc reader (#32873)
Following #25138, unified schema change interface for parquet and orc reader, and can be applied to other format readers as well.
Unified schema change interface for all format readers:
- First, read the data according to the column type of the file into source column;
- Second, convert source column to the destination column with type planned by FE.
2024-04-12 15:09:25 +08:00
Pxl
ab4f8fafcd [Bug](materialized-view) forbid create mv with value column before key column (#33436)
forbid create mv with value column before key column
2024-04-12 15:09:25 +08:00