database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
18,429 Commits 1 Branch 0 Tags
3cb0deae9ceef92c71c35444c495bc5b94de6c7c
Commit Graph

8289 Commits

Author SHA1 Message Date
zhengyu
6d401451cc [fix](stats) sort partitions when do sample analyze (#32185) 2024-03-21 14:07:49 +08:00
LiBinfeng
4b21c5c1cf [Enhencement](Nereids) add eliminate distinct constant rule (#32307) 
select distinct 1,2,3 from tbl
=>
select 1,2,3 from (select 1, 2, 3 from tbl limit 1) as tmp
 2024-03-21 14:07:24 +08:00
Jerry Hu
e892774c9a [improvement](agg) streaming agg should not take too much memory when spilling enabled (#32426) 2024-03-21 14:07:24 +08:00
meiyi
7484a7ba5f [fix](broker load) improve the checking of overlapping partitions of same table (#32254) 2024-03-21 14:07:24 +08:00
meiyi
3c377a8957 [fix](group commit) Fix group commit connect to observer fe (#32222) 2024-03-21 14:07:24 +08:00
minghong
66fe61b591 [fix](nereids)support topn-filter for non pipeline engine #32397 2024-03-21 14:07:24 +08:00
Calvin Kirs
e541ca9f11 [Fix](Job)When jobname is the do keyword, parsing errors will occur when executing SQL. (#32379) 2024-03-21 14:07:24 +08:00
Mingyu Chen
73de61ed84 [opt](hive) skip hidden file and dir (#32412) 
When query hive table, we should skip all hidden dirs and files, like:
```
/visible/.hidden/path
/visible/.hidden.txt
```
 2024-03-21 14:07:24 +08:00
lihangyu
a0a3a2a2ce [Fix](Variant) fix variant with not null (#32248) 
ignore null bitmap for not null and make subcolumn access slots always nullable
 2024-03-21 14:07:23 +08:00
starocean999
6aec479013 [fix](planner)decimalv3 literal's precision and scale is not correctly set (#32288) 2024-03-21 14:07:23 +08:00
Mingyu Chen
6c8b5bb26f [fix](feut) comment out doc gen execution (#32413) 
Followup #32384
After doc is removed, the doc generator should be skipped, or FE ut can not run
 2024-03-21 14:07:23 +08:00
zhangstar333
a4151e022e [bug](fold) fix fold constant rule can't handle variable expr (#32313) 2024-03-21 14:07:23 +08:00
zy-kkk
26ed4b69b1 [opt](jdbc catalog) filter jdbc datasource internal database (#32294) 2024-03-21 14:07:23 +08:00
zy-kkk
e952b5ef5b [opt](jdbc catalog) Refine the jdbc_connector close logic and actively clear the jvm occupied by jdbcexecutor (#32300) 2024-03-21 14:07:23 +08:00
gnehil
f132c9b2c6 [Improve](spark-load)update spark version for spark load to resolve cve problem (#30368) 2024-03-21 14:07:23 +08:00
LiBinfeng
4d4cd43458 [Fix](Nereids) fix leading syntax problems and data mismatched problem (#32286) 
- fix syntax problems of only one table used in leading or mistake usage of brace
  example: leading(t1),leading(t1 {t2})
- fix cte used in subquery of using leading
  example: with cte as (select c1 from t1) select count(*) from t1 join (select /*+ leading(cte t2) */ c2 from t2 join cte on c2 = cte.c1) as alias on t1.c1 = alias.c2;
  which cte used in subquery and subquery also have leading
- fix data mismatched with original plan cause of on predicate push to nullable side
  example: select count(*) from t1 left join t2 on c1 > 500 and c2 > 500 can not change to select count(*) from t1 left join t2 on c2 > 500 where c1 > 500
 2024-03-21 14:07:23 +08:00
starocean999
fab48f54b1 [enhancement](nereids)simplify OneRowRelation scalar subquery (#32276) 
select count() from t where dt > (select '2024-02-02 00:00:00');
-->
select count() from t where dt > '2024-02-02 00:00:00';
 2024-03-21 14:07:23 +08:00
xy720
403820599d [bug](inverted index) fix npe of InvertedIndexStorageFormat in table property (#32357) 
Fix problem that if fe upgrade from a older version, it has error like:

```
MySQL [test]> show full tables;
ERROR 1105 (HY000): NullPointerException, msg: java.lang.NullPointerException: Cannot invoke "org.apache.doris.thrift.TInvertedIndexStorageFormat.toString()" because the return value of "org.apache.doris.catalog.OlapTable.getInvertedIndexStorageFormat()" is null
```
 2024-03-21 14:07:22 +08:00
Mingyu Chen
279ea2f366 [feature](proxy-protocol) Support proxy protocol v1 (#32338) 
Enable proxy protocol to support IP transparency.
See: `IP Transparency` in f57387b502/docs/en/docs/admin-manual/cluster-management/load-balancing.md
for details
 2024-03-21 14:07:22 +08:00
yiguolei
85b2c42f76 [Enhancement](jdbc catalog) Add a property to test the connection when creating a Jdbc catalog (#32125) (#32531) 2024-03-21 14:05:59 +08:00
slothever
fc2588c786 [fix](insert)fix sink user name (#32465) 2024-03-19 16:04:09 +08:00
slothever
93fe9521bf [feature](insert)fix implement hive table sink plan (#32430) 
introduced by #32386
 2024-03-19 09:55:16 +08:00
airborne12
ecadb60bcd [Pick 2.1](inverted index) support inverted index format v2 (#30145) (#32418) 2024-03-19 08:11:33 +08:00
slothever
711c0cd55c [feature](insert)implement hive table sink plan (#31765) (#32386) 
from #31765
 2024-03-18 22:49:30 +08:00
Mingyu Chen
a444e84be6 [feature](hive)add 'HmsCommiter' to support inserting data into hive table (#32283) (#32362) 
bp #32283
Co-authored-by: wuwenchi <wuwenchihdu@hotmail.com>
 2024-03-18 10:59:32 +08:00
Mingyu Chen
1645f2e0a7 [feature](insert)add hive table sink definition (#31662) (#32347) 
bp #31662
Co-authored-by: slothever <18522955+wsjz@users.noreply.github.com>
 2024-03-17 20:52:44 +08:00
Mingyu Chen
4732aae628 [Refactor](insert) refactor insert command to support other type of table (#31610) (#32345) 
bp #31610
 2024-03-17 20:46:07 +08:00
seawinde
47019133c0 [improvement](Nereids) Support to remove sort which is under table sink (#31751) (#32337) 2024-03-17 15:45:53 +08:00
yiguolei
c34f5045c8 fix compile 2024-03-16 21:37:02 +08:00
wangbo
83ab61ad22 Add QUEUE_START_TIME/QUEUE_END_TIME/QUERY_STATUS column for active_queries (#32259) 2024-03-16 20:53:46 +08:00
feiniaofeiafei
a15bf3057f [Fix](nereids) remove duplicate expr in grouping set (#32290) 
db reported a error " expression duplicate in grouping set" when there are duplicate expression in grouping set.
e.g.select a from mal_test1 group by grouping sets((a,a))
This pr removes duplicate expr in grouping set :
select a from mal_test1 group by grouping sets((a))
 2024-03-16 20:53:46 +08:00
Calvin Kirs
bf82030270 [Chore](FE)Remove unused components (#32295) 
The tomcat-embed-el dependency is primarily used for standardizing EL functionality, which we don't require in our application. Therefore, we can safely remove it.
 2024-03-16 20:53:46 +08:00
deardeng
844a1b53b7 [fix](retry) Set query encounter rpc exception default retry times to 3 (#28555) 2024-03-16 20:53:46 +08:00
谢健
f64a9a33f8 [fix](Nereids): don't pushdown project when project contains both side of join (#32214) 2024-03-16 20:53:46 +08:00
yiguolei
a90a1a76f1 [bugfix](profile) support multi execution profile for brokerload (#32280) 
The bug is introduced by #27184
Profile Format is :
Summary
MergedProfile
ExecutionProfile1
ExecutionProfile2
...

There maybe multiple execution profiles for broker load.
 2024-03-16 20:53:43 +08:00
yiguolei
9ad196f189 Revert "[fix](cloud) ignore some case in cloud mode (#32261)" 
This reverts commit c0776c7c0756d602204edba76642cafa92e67cd8.
 2024-03-16 14:11:22 +08:00
wangbo
258dcfca97 [Refactor](executor)Add information_schema.workload_groups (#32195) (#32314) 2024-03-15 20:46:54 +08:00
wangbo
b5a322297b Refactor active queries (#31742) (#32312) 2024-03-15 19:39:54 +08:00
koarz
e3bb499cc6 [fix](function)revert function REPEAT nullable mode #32226 2024-03-15 18:06:28 +08:00
starocean999
97b35d6830 [fix](nereids)AssertNumRow node's output should be nullable (#32136) 
Co-authored-by: Co-Author Jerry Hu <mrhhsg@gmail.com>
 2024-03-15 18:06:28 +08:00
yujun
c0776c7c07 [fix](cloud) ignore some case in cloud mode (#32261) 2024-03-15 18:06:20 +08:00
HappenLee
9c1888e7ec [RuntimeFilter](exec) support min max runtime filter and do refactor (#32210) 2024-03-15 18:06:20 +08:00
lihangyu
5478193002 [Fix](Variant) support view for accessing variant subcolumns and temp… (#32225) 2024-03-15 18:06:20 +08:00
feiniaofeiafei
9e014cfb8a [fix](nereids) fix bug when grouping has same grouping set (#32235) 2024-03-15 18:06:20 +08:00
feiniaofeiafei
afa9f6e5d6 [Feat](nereids) support column default value current_date (#32268) 2024-03-15 18:06:15 +08:00
xzj7019
5a460eefc8 [opt](Nereids) remove group by key eliminate rule option (#32238) 2024-03-15 18:06:15 +08:00
morrySnow
41ca09ab21 [opt](Nereids) opt distinct agg without group by key plan #32236 2024-03-15 18:05:35 +08:00
HappenLee
c8f3643890 [exec](runtimefilter) support null aware in runtime filter (#32152) 
null aware in runtime filter
 2024-03-15 18:05:13 +08:00
morrySnow
ea2fbfaffa [feature](Nereids) support agg state type in create table (#32171) 
this PR introduce a behavior change, syntax of create table with agg_state type is changed.
 2024-03-15 18:04:49 +08:00
morrySnow
7205f267cc [opt](Nereids) support cast agg state type as legacy planner (#32198) 2024-03-15 18:02:01 +08:00