database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
20,364 Commits 1 Branch 0 Tags
01acd60e2b3f24fbd18689feead2183f255490e1
Commit Graph

81 Commits

Author SHA1 Message Date
seawinde
aebc70d75a revert [improvement](mv) Support to use cast when create sync materialized view #38008 (#39378) 
## Proposed changes

this is brought by https://github.com/apache/doris/pull/38008
if use cast(FLOOR(MINUTE(time) / 15) as decimal(9, 0)) in group by
clause when sync materialized view. if downgrade from 2.1.6 to 2.1.5 or
upgrade 2.1.6 to 3.0.0
this may cause fe can not run. So revert the function.
 2024-08-15 14:16:57 +08:00
amory
78d6e318fb [fix](ip)pick ip rowstore (#39345) 
## Proposed changes
backport: https://github.com/apache/doris/pull/39258
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-08-14 18:51:58 +08:00
Pxl
33220109f7 [Bug](materialized-view) fix analyze where clause failed on mv (#39061) (#39209) 
## Proposed changes
pick from #39061
fix analyze where clause failed on mv
do not analyze slot after replaceSlot to avoid duplicate columns in desc
 2024-08-13 16:08:20 +08:00
morrySnow
3c535e80dd [fix](compatibility) type toSql should return lowercase string (#38012) (#38517) 
pick from master #38012

revert #25951
 2024-08-09 11:35:42 +08:00
seawinde
2b1aa05370 pick some pr from to branch21 #38115 #38008 #37929 (#38940) 
## Proposed changes

pr: https://github.com/apache/doris/pull/38115
commitId: 2b29288c

pr: https://github.com/apache/doris/pull/38008
commitId: c6b924da

pr: https://github.com/apache/doris/pull/37929
commitId: d44fcdc5
 2024-08-07 10:19:41 +08:00
Pxl
d1fc4e2e60 [Bug](query) fix meet invalid column when direct scan on mow mv (#37806) 
pick from #36483
 2024-07-15 18:29:30 +08:00
Pxl
87c90094a7 [Bug](materialized-view) fix unmatch mv coz table name (#35444) 
fix unmatch mv coz table name
 2024-05-28 13:17:33 +08:00
morrySnow
845732b440 [WIP](test) remove enable_nereids_planner in regression cases (part 3) (#34558) 
previous PR:
part 1: #34417
part 2: #34490
 2024-05-10 22:11:01 +08:00
Pxl
e66dcd0e72 [Bug](materialized-view) change nvl to ifnull when create mv (#34272) 
change nvl to ifnull when create mv
 2024-05-07 07:45:33 +08:00
Pxl
8c535c51b5 [Improvement](materialized-view) support multiple agg function have same base table slot (#33774) 
support multiple agg function have same base table slot
 2024-04-18 19:02:49 +08:00
Pxl
3070eda58c [Bug](load) fix stream load file on hll type mv column (#33373) 
fix stream load file on hll type mv column
 2024-04-11 09:31:50 +08:00
Pxl
6462264e77 [Improvement](materialized-view) adjust priority of materialized view match rule (#33305) 
adjust priority of materialized view match rule
 2024-04-10 16:23:04 +08:00
Pxl
2092a862fc [Bug](materialized-view) fix wrong result when salias name same with base slot on mv (#33198) 
fix wrong result when salias name same with base slot on mv
 2024-04-10 16:00:05 +08:00
Pxl
09db427eed [Feature](materialized-view) support ignore not slot is null when count(slot) not has key in mv (#32912) 
support ignore not slot is null when count(slot) not has key in mv
 2024-04-10 11:59:36 +08:00
Pxl
5b162a80f2 [Improvement](materialized-view) The materialized view can not involved auto increment column (#32885) 
The materialized view can not involved auto increment column
 2024-04-10 11:34:30 +08:00
Pxl
ca64fa7954 [Bug](materialized-view) do not check key/value column when index is dup or mow (#32695) 
do not check key/value column when index is dup or mow
 2024-03-27 02:56:11 +08:00
Pxl
fdf6b8fe8d [Bug](repeat) fix core dump coz output slot'order on repeat node not match with pre repeat exprs (#32662) 
fix core dump coz output slot'order on repeat node not match with pre repeat exprs
 2024-03-26 20:22:20 +08:00
Pxl
19e6ebd09c [Feature](materialized-view) support mv with bitmap_union(bitmap_from_array()) case (#31962) 
support mv with bitmap_union(bitmap_from_array()) case
 2024-03-09 19:45:03 +08:00
Pxl
3716f8a171 [Bug](partition) fix npe when prune partition with not exist partition column in mv #31860 2024-03-07 16:16:05 +08:00
Pxl
dc9de4b6b5 [Bug](load) fix wrong data in mv when routine load with function mapping (#31787) 2024-03-07 16:16:05 +08:00
Pxl
6af6997f1d [Improvement](materialized-view) add approx_count_distinct/ndv to FunctionAlias rule (#31535) 
add approx_count_distinct/ndv to FunctionAlias rule
 2024-02-29 12:38:03 +08:00
Pxl
3b7261abe4 [Mv] check delete from column exists on mv (#31321) 2024-02-26 19:07:10 +08:00
Pxl
5b462194d1 [Feature](materialized-view) support rewrite case when to if on legacy planner to make mv work (#30320) 
support rewrite case when to if on legacy planner to make mv work
 2024-01-25 13:24:52 +08:00
Pxl
7e60369ba2 [Feature](materialized-view) support create mv with count(*) (#30313) 
support create mv with count(*)
 2024-01-25 13:24:09 +08:00
Pxl
1e74ad3f3b [Feature](materialized-view) support predicate apprear both on key and value mv column (#30215) 
support predicate apprear both on key and value mv column
 2024-01-23 13:22:14 +08:00
Pxl
2ccb69dbed [Feature](materialized-view) support some case unmached to materialized-view (#30036) 
same column appears in key and value like select id,count(id) group by id;
complex expr in sum select sum(if(xxx));
 2024-01-18 12:03:07 +08:00
Pxl
b0c49024cb [Feature](materialized-view) support match function with alias in materialized-view (#30025) 
support match function with alias in materialized-view
 2024-01-18 10:04:21 +08:00
Pxl
441fb49345 [Bug](load) fix load failed on stream load tvf into agg state (#28420) 
fix load failed on stream load tvf into agg state
 2024-01-04 17:38:31 +08:00
Pxl
d474d4e701 [Bug](rollup) fallback and disable tulpe when rollup select failed on old planner (#29226) 
* fallback and disable tulpe when rollup select failed on old planner

* add case
 2024-01-02 17:54:56 +08:00
Pxl
c98489fc09 [Feature](materialized-view) support visitBitmapUnion mv rewrite (#29200) 
* support visitBitmapUnion rewrite

* add case
 2023-12-28 14:56:33 +08:00
Pxl
e4a58b7407 [Feature](materialized-view) support match logicalAggregate(logicalProject(logicalFilter(logicalOlapScan())) without agg (#28747) 
support match logicalAggregate(logicalProject(logicalFilter(logicalOlapScan())) without agg
 2023-12-21 10:27:33 +08:00
Pxl
027b06059a [Feature](materialized-view) support count(1) on materialized view (#28135) 
support count(1) on materialized view
fix match failed like select k1, sum(k1) from t group by k1
 2023-12-09 01:36:46 +08:00
Pxl
299fcc443e [Bug](agg-state) fix stream load failed on agg-state column (#28050) 2023-12-06 20:41:29 +08:00
Pxl
8a761dff84 [Bug](materialized-view) fix create mv failed on unique table (#27971) 
fix create mv failed on unique table
 2023-12-05 14:53:09 +08:00
Pxl
b541de7a03 do not push down agg on aggregate column (#27356) 
do not push down agg on aggregate column
 2023-11-22 10:53:29 +08:00
Pxl
cee8cc44e2 [Bug](insert)fix insert wrong data on mv when stmt have multiple values (#27297) 
fix insert wrong data on mv when stmt have multiple values
 2023-11-21 12:55:30 +08:00
LiBinfeng
0a9d71ebd2 [Fix](Planner) fix varchar does not show real length (#25171) 
Problem:
when we create table with datatype varchar(), we regard it to be max length by default. But when we desc, it does not show
real length but show varchar()
Reason:
when we upgrade version from 2.0.1 to 2.0.2, we support new feature of creating varchar(), and it shows the same way with
ddl schema. So user would confuse of the length of varchar
Solved:
change the showing of varchar() to varchar(65533), which in compatible with hive
 2023-11-14 10:49:21 +08:00
Pxl
c02c00974f [Bug](agg-state) fix file load insert wrong data to agg_state (#26581) 
fix file load insert wrong data to agg_state
 2023-11-10 11:03:13 +08:00
Pxl
3cdbb6e637 [Bug](materialized-view) fix some bugs on create mv with percentile_approx (#26528) 
1. percentile_approx have wrong symbol
2. fnCall.getParams() get obsolete childrens
 2023-11-08 10:09:37 +08:00
Pxl
3004dbbc78 [Bug](materialized-view) SelectMaterializedIndexWithAggregate do not … (#26192) 
SelectMaterializedIndexWithAggregate do not change plan when match base index
 2023-11-02 14:12:22 +08:00
morrySnow
18dabe7386 [fix](compile) fe compile failed when generate doc and FE UT failed (#26164) 
1. FE could not compile because below error. Intro by PR #25933
```
[INFO] --- exec:3.1.0:java (doc) @ fe-core ---
...
Failed to generate doc for ignoreRuntimeFilterIds
```

2. fix UT bugs intro by below PRs
> - #25951
> - #26031

3. because fe could not compile, FE UT CI do not work well. So, some UT failed be introduced by the PRs merged after PR #25933 merged. So this PR revert them to fix FE UT

> - Revert "[Bug](materialized-view) SelectMaterializedIndexWithAggregate do not change plan > when match ba… (#26145)"
> This reverts commit 8d7abf60f94d2d1208b71e96b9290ea02122b8d8.

> - Revert "[enhancement](Nereids): optimize GroupExpressionMatching (#26130)"
> This reverts commit 19122b55cd95af097b4ef7b6eb809f37db29765f.

> - Revert "[Performance](Nereids): optimize GroupExpressionMatching (#26084)"
> This reverts commit 0d956e90cf920039b8baa79c170a298be56a128d.
 2023-10-31 20:50:44 -05:00
Pxl
8d7abf60f9 [Bug](materialized-view) SelectMaterializedIndexWithAggregate do not change plan when match ba… (#26145) 
* SelectMaterializedIndexWithAggregate do not change plan when match base index

* forbid table withh alias
 2023-10-31 14:11:08 +08:00
Pxl
091cb0ce37 [Bug](materialized-view) add limit for group by with float/double on create mv (#25823) 
doris do not support float/double key type on storage engine.
 2023-10-24 17:06:45 +08:00
Pxl
e69b8abb86 [Feature](materialized-view) support delete stmt on materialized-view (#25710) 
support delete stmt on materialized-view
 2023-10-23 10:44:55 +08:00
Pxl
72920fbd1d [Improvement](materialized-view) set job failed when toAgentTaskRequest meet error (#25358) 
set job failed when toAgentTaskRequest meet error
 2023-10-16 20:10:52 +08:00
Pxl
a0d2b1ec56 [Bug](materialized-view) fix not match mv when some alias on agg (#25321) 
fix not match mv when some alias on agg
 2023-10-12 11:02:55 +08:00
Pxl
18b5f70a7c [Bug](materialized-view) enable rewrite on select materialized index with aggregate mode (#24691) 
enable rewrite on select materialized index with aggregate mode
 2023-09-27 11:30:36 +08:00
Pxl
01b7cb8db7 [Bug](materialized-view) fix failed insert into mv meet default null (#24545) 
fix failed insert into mv meet default null
 2023-09-21 10:47:29 +08:00
Pxl
bb3fadc5d3 [Bug](materialized-view) fix mv not match because cast and alias name (#23580) 
fix mv not match because cast and alias name
 2023-09-04 12:46:33 +08:00
Pxl
7f4f39551a [Bug](materialized-view) fix change base schema when create mv (#23607) 
* fix change base schema when create mv

* fix

* fix
 2023-08-30 21:00:12 +08:00