database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
17,549 Commits 1 Branch 0 Tags
ea2fbfaffaf9cd09c3cfa8eabbde415dfdbeeade
Commit Graph

64 Commits

Author SHA1 Message Date
Pxl
19e6ebd09c [Feature](materialized-view) support mv with bitmap_union(bitmap_from_array()) case (#31962) 
support mv with bitmap_union(bitmap_from_array()) case
 2024-03-09 19:45:03 +08:00
Pxl
3716f8a171 [Bug](partition) fix npe when prune partition with not exist partition column in mv #31860 2024-03-07 16:16:05 +08:00
Pxl
dc9de4b6b5 [Bug](load) fix wrong data in mv when routine load with function mapping (#31787) 2024-03-07 16:16:05 +08:00
Pxl
6af6997f1d [Improvement](materialized-view) add approx_count_distinct/ndv to FunctionAlias rule (#31535) 
add approx_count_distinct/ndv to FunctionAlias rule
 2024-02-29 12:38:03 +08:00
Pxl
3b7261abe4 [Mv] check delete from column exists on mv (#31321) 2024-02-26 19:07:10 +08:00
Pxl
5b462194d1 [Feature](materialized-view) support rewrite case when to if on legacy planner to make mv work (#30320) 
support rewrite case when to if on legacy planner to make mv work
 2024-01-25 13:24:52 +08:00
Pxl
7e60369ba2 [Feature](materialized-view) support create mv with count(*) (#30313) 
support create mv with count(*)
 2024-01-25 13:24:09 +08:00
Pxl
1e74ad3f3b [Feature](materialized-view) support predicate apprear both on key and value mv column (#30215) 
support predicate apprear both on key and value mv column
 2024-01-23 13:22:14 +08:00
Pxl
2ccb69dbed [Feature](materialized-view) support some case unmached to materialized-view (#30036) 
same column appears in key and value like select id,count(id) group by id;
complex expr in sum select sum(if(xxx));
 2024-01-18 12:03:07 +08:00
Pxl
b0c49024cb [Feature](materialized-view) support match function with alias in materialized-view (#30025) 
support match function with alias in materialized-view
 2024-01-18 10:04:21 +08:00
Pxl
441fb49345 [Bug](load) fix load failed on stream load tvf into agg state (#28420) 
fix load failed on stream load tvf into agg state
 2024-01-04 17:38:31 +08:00
Pxl
d474d4e701 [Bug](rollup) fallback and disable tulpe when rollup select failed on old planner (#29226) 
* fallback and disable tulpe when rollup select failed on old planner

* add case
 2024-01-02 17:54:56 +08:00
Pxl
c98489fc09 [Feature](materialized-view) support visitBitmapUnion mv rewrite (#29200) 
* support visitBitmapUnion rewrite

* add case
 2023-12-28 14:56:33 +08:00
Pxl
e4a58b7407 [Feature](materialized-view) support match logicalAggregate(logicalProject(logicalFilter(logicalOlapScan())) without agg (#28747) 
support match logicalAggregate(logicalProject(logicalFilter(logicalOlapScan())) without agg
 2023-12-21 10:27:33 +08:00
Pxl
027b06059a [Feature](materialized-view) support count(1) on materialized view (#28135) 
support count(1) on materialized view
fix match failed like select k1, sum(k1) from t group by k1
 2023-12-09 01:36:46 +08:00
Pxl
299fcc443e [Bug](agg-state) fix stream load failed on agg-state column (#28050) 2023-12-06 20:41:29 +08:00
Pxl
8a761dff84 [Bug](materialized-view) fix create mv failed on unique table (#27971) 
fix create mv failed on unique table
 2023-12-05 14:53:09 +08:00
Pxl
b541de7a03 do not push down agg on aggregate column (#27356) 
do not push down agg on aggregate column
 2023-11-22 10:53:29 +08:00
Pxl
cee8cc44e2 [Bug](insert)fix insert wrong data on mv when stmt have multiple values (#27297) 
fix insert wrong data on mv when stmt have multiple values
 2023-11-21 12:55:30 +08:00
LiBinfeng
0a9d71ebd2 [Fix](Planner) fix varchar does not show real length (#25171) 
Problem:
when we create table with datatype varchar(), we regard it to be max length by default. But when we desc, it does not show
real length but show varchar()
Reason:
when we upgrade version from 2.0.1 to 2.0.2, we support new feature of creating varchar(), and it shows the same way with
ddl schema. So user would confuse of the length of varchar
Solved:
change the showing of varchar() to varchar(65533), which in compatible with hive
 2023-11-14 10:49:21 +08:00
Pxl
c02c00974f [Bug](agg-state) fix file load insert wrong data to agg_state (#26581) 
fix file load insert wrong data to agg_state
 2023-11-10 11:03:13 +08:00
Pxl
3cdbb6e637 [Bug](materialized-view) fix some bugs on create mv with percentile_approx (#26528) 
1. percentile_approx have wrong symbol
2. fnCall.getParams() get obsolete childrens
 2023-11-08 10:09:37 +08:00
Pxl
3004dbbc78 [Bug](materialized-view) SelectMaterializedIndexWithAggregate do not … (#26192) 
SelectMaterializedIndexWithAggregate do not change plan when match base index
 2023-11-02 14:12:22 +08:00
morrySnow
18dabe7386 [fix](compile) fe compile failed when generate doc and FE UT failed (#26164) 
1. FE could not compile because below error. Intro by PR #25933
```
[INFO] --- exec:3.1.0:java (doc) @ fe-core ---
...
Failed to generate doc for ignoreRuntimeFilterIds
```

2. fix UT bugs intro by below PRs
> - #25951
> - #26031

3. because fe could not compile, FE UT CI do not work well. So, some UT failed be introduced by the PRs merged after PR #25933 merged. So this PR revert them to fix FE UT

> - Revert "[Bug](materialized-view) SelectMaterializedIndexWithAggregate do not change plan > when match ba… (#26145)"
> This reverts commit 8d7abf60f94d2d1208b71e96b9290ea02122b8d8.

> - Revert "[enhancement](Nereids): optimize GroupExpressionMatching (#26130)"
> This reverts commit 19122b55cd95af097b4ef7b6eb809f37db29765f.

> - Revert "[Performance](Nereids): optimize GroupExpressionMatching (#26084)"
> This reverts commit 0d956e90cf920039b8baa79c170a298be56a128d.
 2023-10-31 20:50:44 -05:00
Pxl
8d7abf60f9 [Bug](materialized-view) SelectMaterializedIndexWithAggregate do not change plan when match ba… (#26145) 
* SelectMaterializedIndexWithAggregate do not change plan when match base index

* forbid table withh alias
 2023-10-31 14:11:08 +08:00
Pxl
091cb0ce37 [Bug](materialized-view) add limit for group by with float/double on create mv (#25823) 
doris do not support float/double key type on storage engine.
 2023-10-24 17:06:45 +08:00
Pxl
e69b8abb86 [Feature](materialized-view) support delete stmt on materialized-view (#25710) 
support delete stmt on materialized-view
 2023-10-23 10:44:55 +08:00
Pxl
72920fbd1d [Improvement](materialized-view) set job failed when toAgentTaskRequest meet error (#25358) 
set job failed when toAgentTaskRequest meet error
 2023-10-16 20:10:52 +08:00
Pxl
a0d2b1ec56 [Bug](materialized-view) fix not match mv when some alias on agg (#25321) 
fix not match mv when some alias on agg
 2023-10-12 11:02:55 +08:00
Pxl
18b5f70a7c [Bug](materialized-view) enable rewrite on select materialized index with aggregate mode (#24691) 
enable rewrite on select materialized index with aggregate mode
 2023-09-27 11:30:36 +08:00
Pxl
01b7cb8db7 [Bug](materialized-view) fix failed insert into mv meet default null (#24545) 
fix failed insert into mv meet default null
 2023-09-21 10:47:29 +08:00
Pxl
bb3fadc5d3 [Bug](materialized-view) fix mv not match because cast and alias name (#23580) 
fix mv not match because cast and alias name
 2023-09-04 12:46:33 +08:00
Pxl
7f4f39551a [Bug](materialized-view) fix change base schema when create mv (#23607) 
* fix change base schema when create mv

* fix

* fix
 2023-08-30 21:00:12 +08:00
Pxl
8e4c0d1e81 [Bug](materialized-view) fix divide double can not match mv (#23504) 
* fix divide double can not match mv

* fix

* fix
 2023-08-28 18:01:08 +08:00
Pxl
3049533e63 [Bug](materialized-view) fix core dump on create materialized view when diffrent mv column have same reference base column (#23425) 
* Remove redundant predicates on scan node

update

fix core dump on create materialized view when diffrent mv column have same reference base column

Revert "update"

This reverts commit d9ef8dca123b281dc8f1c936ae5130267dff2964.

Revert "Remove redundant predicates on scan node"

This reverts commit f24931758163f59bfc47ee10509634ca97358676.

* update

* fix

* update

* update
 2023-08-28 14:40:51 +08:00
Pxl
89dc1f73b2 [Bug](materialized-view) make mv matched when preagg have value column predicate contained in mv'where clause (#22779) 
1. make mv matched when preagg have value column predicate contained in mv
'where clause
2. fix `org.apache.doris.common.AnalysisException: errCode = 2, detailMessage = BITMAP_UNION need input a bitmap column, but input INVALID_TYPE`
3. make the error message more detailed when create mv stmt parse failed
 2023-08-09 19:17:55 +08:00
Pxl
8d16f1bb09 [Chore](materialized-view) update documentation about materialized-view and update test (#22350) 
update documentation about materialized-view and update test
 2023-08-01 15:13:34 +08:00
Pxl
ae809fbeba [Bug](storage )fix dead lock when create_tablet need lock two tablet && update mv_p0… (#21969) 
fix dead lock when create_tablet need lock two tablet && update mv_p0/ssb case
 2023-07-22 15:27:05 +08:00
Pxl
0de94e857f [Bug](materialized view) fix wrong match mv when mv have where clause (#21797) 2023-07-19 01:11:39 +08:00
Pxl
86841d8653 [Bug](materialized-view) fix some problems of mv and make ssb mv work on nereids (#21559) 
fix some problems of mv and make ssb mv work on nereids
 2023-07-17 10:08:25 +08:00
Pxl
4d44cea784 [Bug](materialized-view) check group expr at create mv (#21798) 
check group expr at create mv
 2023-07-14 15:39:38 +08:00
Pxl
77336bff44 [Bug](materialized-view) adjust limit for create materialized view on uniq/agg table (#21580) 
adjust limit for create materialized view on uniq/agg table
 2023-07-10 10:04:17 +08:00
Pxl
59c1bbd163 [Feature](materialized view) support query match mv with agg_state on nereids planner (#21067) 
* support create mv contain aggstate column

* update

* update

* update

* support query match mv with agg_state on nereids planner

update

* update

* update
 2023-07-03 10:19:31 +08:00
Pxl
88cbea2b56 [Bug](agg-state) fix core dump on not nullable argument for aggstate's nested argument (#21331) 
fix core dump on not nullable argument for aggstate's nested argument
 2023-06-30 18:20:25 +08:00
Pxl
87e64115ae [Chore](materialized-view) add case about insert data imidiately after create mv(#21281) 
add case about insert data imidiately after create mv
 2023-06-29 11:17:38 +08:00
Pxl
5f0bb49d46 [Feature](materialized-view) support create mv contain aggstate column (#20812) 
support create mv contain aggstate column
 2023-06-21 13:06:52 +08:00
Pxl
85c5d7c6a9 [Chore](materialized-view) add ssb_flat mv test case (#20869) 
add ssb_flat mv test case
 2023-06-19 10:51:50 +08:00
Pxl
01e53f4e67 [Bug](materialized-view) fix problems about create mv on ssb_flat q4.1 failed (#20658) 
fix problems about create mv on ssb_flat q4.1 failed
 2023-06-15 14:38:21 +08:00
nanfeng
da4de37dec [feature-wip](mv lifecycle) separate life cycle of base table and its materialized views (#19210) 
support related syntax and add:regress-test case

---------

Co-authored-by: yzy <yzy@nanfeng_yzy@163.com>
 2023-04-30 17:42:02 +08:00
Pxl
1f9450e0f7 [Chore](case) add some regression-test case about materialized-view #18946 2023-04-24 11:36:56 +08:00