database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
16,587 Commits 1 Branch 0 Tags
df504df47519bbd602985bcdec10af5cd6f0be63
Commit Graph

16587 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Guangdong Liu
df504df475 [regression test](schema change) add case for partition (#30195) 2024-01-25 13:24:09 +08:00
Gabriel
e94683fffb [pipelineX](refactor) refine relationship between shared state and dependency (#30294) 2024-01-25 13:24:09 +08:00
谢健
2951f9a2c7 [fix](Nereids) relation in constraints should be multi parts (#30293) 2024-01-25 13:24:09 +08:00
谢健
7e1a986fa1 [feat](Nereids): eliminate left outer join by unique when comparing mv (#30228) 2024-01-25 13:24:09 +08:00
Nitin-Kashyap
cd70f45ce2 [test](ut) added UT cases for show build index (#29561) 
Added UT case for show build index flow
 2024-01-25 13:24:09 +08:00
koarz
ca5a314765 [fix](function) make STRLEFT and STRRIGHT and SUBSTR function DEPEND_ON_ARGUMENT (#28352) 
make STRLEFT and STRRIGHT function DEPEND_ON_ARGUMENT
 2024-01-25 13:23:59 +08:00
zy-kkk
88fdb2677d [fix](catalog) fix Uninitialized connection pool parameters in hmsjdbcclient (#30262) 2024-01-25 13:23:59 +08:00
seawinde
2f68aac885 [Improvement](Nereids) Support to query rewrite by materialized view when join input has aggregate (#30230) 
Support to query rewrite by materialized view when join input has aggregate, the aggregate should be simple
For example as following:
The materialized view def is 
>            select
>              l_linenumber,
>              count(distinct l_orderkey),
>              sum(case when l_orderkey in (1,2,3) then l_suppkey * l_linenumber else 0 end),
>              max(case when l_orderkey in (4, 5) then (l_quantity *2 + part_supp_a.qty_max) * 0.88 else 100 end),
>              avg(case when l_partkey in (2, 3, 4) then l_discount + o_totalprice + part_supp_a.qty_sum else 50 end)
>            from lineitem
>            left join orders on l_orderkey = o_orderkey
>            left join 
>              (select ps_partkey, ps_suppkey, sum(ps_availqty) qty_sum, max(ps_availqty) qty_max,
>                min(ps_availqty) qty_min,
>                avg(ps_supplycost) cost_avg
>                from partsupp
>                group by ps_partkey,ps_suppkey) part_supp_a
>              on l_partkey = part_supp_a.ps_partkey
>                and l_suppkey = part_supp_a.ps_suppkey
>            group by l_linenumber;

when query is like following, it can be rewritten by mv above
>            select
>              l_linenumber,
>              sum(case when l_orderkey in (1,2,3) then l_suppkey * l_linenumber else 0 end),
>              avg(case when l_partkey in (2, 3, 4) then l_discount + o_totalprice + part_supp_a.qty_sum else 50 end)
>            from lineitem
>            left join orders on l_orderkey = o_orderkey
>            left join 
>              (select ps_partkey, ps_suppkey, sum(ps_availqty) qty_sum, max(ps_availqty) qty_max,
>                min(ps_availqty) qty_min,
>                avg(ps_supplycost) cost_avg
>                from partsupp
>                group by ps_partkey,ps_suppkey) part_supp_a
>              on l_partkey = part_supp_a.ps_partkey
>                and l_suppkey = part_supp_a.ps_suppkey
>            group by l_linenumber;
 2024-01-25 13:23:59 +08:00
Nitin-Kashyap
f85b04c2c6 [fix](datatype) fixed decimal type implicit cast handling in BinaryPredicate (#30181) 2024-01-25 13:23:12 +08:00
Nitin-Kashyap
79d178ca54 [test](ut) added UT cases for show create materialized view (#29563) 2024-01-25 13:23:12 +08:00
nanfeng
c7360fd014 [feature](function) support ip function named ipv4_cidr_to_range(addr, cidr) (#29819) 
* support ip function ipv4_cidr_to_range

* fix ipv4_cidr_to_range function only support ipv4 type
 2024-01-24 10:02:03 +08:00
Jack Drogon
dde5ed5231 [fix](fe-memory) Fix fe schema change high memory usage (#30231) 
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
 2024-01-24 10:02:03 +08:00
AlexYue
5213f941dd [improvement](cooldown) print the cooldown version when follow cooldown version (#30239) 2024-01-24 10:02:03 +08:00
morrySnow
040ace126c [fix](Nereids) group by key should be required (#30273) 2024-01-24 10:01:14 +08:00
starocean999
2b3e7589b7 [fix](nereids)group by expr may be lost in EliminateGroupByConstant rule (#30274) 2024-01-24 10:01:14 +08:00
minghong
4af3fd2a2e [fix](Nereids) fix bug in case-when/if stats estimation (#30265) 2024-01-24 10:00:25 +08:00
Kaijie Chen
1a51d04cb8 [fix](move-memtable) fix schema use-after-free in delta writer v2 (#30254) 2024-01-24 10:00:25 +08:00
zhangstar333
5e66e2519d [improve](column) support append_data_by_selector function in const column (#29996) 
support append_data_by_selector function in const column
 2024-01-24 09:59:45 +08:00
Pxl
02a27a587a remove some unused member function of IFunctionBase (#30260) 2024-01-24 09:59:45 +08:00
ZhangJian He
72f4e7e2d1 [security] Don't print token (#30227) 2024-01-24 09:59:45 +08:00
zhangdong
b98acf2d90 [fix](mtmv)mtmv default open enableNereidsDML #30235 2024-01-24 09:59:45 +08:00
zxealous
4cbacb5b39 [enhancement](recover) Support skipping bad tablet in select by session variable (#30241) 
In some scenarios, user has a huge amount of data and only a single replica was specified when creating the table, if one of the tablet is damaged, the table will not be able to be select. If the user does not care about the integrity of the data, they can use this variable to temporarily skip the bad tablet for querying and load the remaining data into a new table.
 2024-01-24 09:59:43 +08:00
jakevin
1b9f1f6483 [feature](Planner): Push down TopNDistinct through Join (#30216) 
Push down TopNDistinct through Outer/Cross Join
 2024-01-24 09:59:13 +08:00
谢健
f4a10c3fbc [enhancement](Nereids): add builder for hyper graph (#30061) 2024-01-24 09:58:31 +08:00
Dongyang Li
8c6e5202d4 [chore](ci) remove some unused code (#30253) 
Co-authored-by: stephen <hello-stephen@qq.com>
 2024-01-24 09:58:31 +08:00
Gabriel
3d22543add [pipelineX](fix) Fix coredump if prepare failed (#30250) 2024-01-24 09:58:31 +08:00
HappenLee
92a9e8265b [Imporve](RF) Support remote broadcast join build bf exactly (#30247) 2024-01-23 14:11:54 +08:00
morrySnow
9a8bcf2b1b [fix](planner) row policy rewriter generate wrong plan on join table ref (#30233) 2024-01-23 14:11:54 +08:00
wangbo
8a8c0ec992 Add 2.1 version workload group document (#30212) 2024-01-23 14:11:17 +08:00
yiguolei
ce5ba61640 [refactor](close)Full refactor async writer (#30082) 
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-01-23 13:22:15 +08:00
zy-kkk
bc03354be8 [improvement](jdbc catalog) Optimize the Close logic of JDBC client (#30236) 
Optimize the Close logic of the JDBC client so that the Jdbc Catalog can correctly cancel the running query when the query is cancelled.
 2024-01-23 13:22:14 +08:00
lihangyu
d964f873d5 [doc](Variant) fix doc rendering and add version bar (#30249) 2024-01-23 13:22:14 +08:00
Xujian Duan
2499ca6d89 [Enhancement](plan) Optimize preagg for aggregate function (#28886) 2024-01-23 13:22:14 +08:00
zclllyybb
d61974db14 [chore](docs) fix some docs wrong & add important comment & fe start config for old machine (#29742) 
fix some docs wrong & add important comment & fe start config for old machine
 2024-01-23 13:22:14 +08:00
wuwenchi
8308bc96b9 [fix](paimon)set timestamp's scale for parquet which has no logical type (#30119) 2024-01-23 13:22:14 +08:00
Pxl
1e74ad3f3b [Feature](materialized-view) support predicate apprear both on key and value mv column (#30215) 
support predicate apprear both on key and value mv column
 2024-01-23 13:22:14 +08:00
Gabriel
0e5d56fc2e [pipelineX](fix) Fix use-after-free MultiCastSourceDependency (#30199) 2024-01-23 13:22:14 +08:00
Petrichor
7be9301360 [improvement](docs) add faq for flink-connector-doris (#30043) 2024-01-23 13:22:13 +08:00
Lei Zhang
fb2145fe96 [fix](fe) Upgrade mariadb client version from 3.0.4 to 3.0.9 (#30242) 
mariadb-java-client 3.0.4 has two serious problems:
* https://jira.mariadb.org/browse/CONJ-972
* https://jira.mariadb.org/browse/CONJ-973
 2024-01-23 10:12:37 +08:00
zhangdong
510d88f315 [fix](mtmv)return MTMV with at least one available partition #30156 2024-01-23 10:12:37 +08:00
Kaijie Chen
bb6fff3455 [fix](move-memtable) make sure index descriptor is set when creating delta writer (#30157) 
---------

Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
Co-authored-by: Xin Liao <liaoxinbit@126.com>
 2024-01-23 10:12:37 +08:00
HHoflittlefish777
32c5153999 [fix](routine-load) pause job when json path is invalid #30197 
If jsonpaths is set wrong, routine load job will report error but running all time.For example:

CREATE ROUTINE LOAD jobName ON tableName
PROPERTIES
(
    "format" = "json",
    "max_batch_interval" = "5",
    "max_batch_rows" = "300000",
    "max_batch_size" = "209715200",
    "jsonpaths" = "[\'t\',\'a\']"
)
FROM KAFKA
(
    "kafka_broker_list" = "$IP:PORT",
    "kafka_topic" = "XXX",
    "property.kafka_default_offsets" = "OFFSET_BEGINNING"
);
Jsonpaths ['t','a'] is invalid, but job will running all time.
 2024-01-23 10:12:37 +08:00
meiyi
9c742d46a2 [fix](group commit) abort txn should use label if replay wal failed (#30219) 2024-01-23 10:12:35 +08:00
wangbo
9e0c518aaf [Feature](executor)Workload Group support Non-Pipeline Execution (#30164) 2024-01-23 10:11:25 +08:00
morrySnow
b3296a2a16 [fix](Nereids) user identify syntax is wrong (#30226) 2024-01-23 10:09:55 +08:00
zclllyybb
24ed3e4103 [Fix](Expr&code-style) check prepare&open before every VExpr execute (#26673) 2024-01-23 10:09:54 +08:00
morrySnow
ce47354d59 [fix](Nereids) result nullable of sum distinct in scalar agg is wrong (#30221) 2024-01-23 10:09:54 +08:00
zclllyybb
60ce22f15e [fix](auto-partition) Fix a concurrent bug (#30086) 
when incremental opening, it may be a mistake to send new packet from sender to reciever cuz' re-constructed send closure.
now fixed it.
 2024-01-23 10:09:54 +08:00
yangshijie
d5d0e5e611 [feature](function) support ip functions named to_ipv4[or_default, or_null](string) and to_ipv6[or_default, or_null](string) (#29838) 2024-01-23 10:09:54 +08:00
Petrichor
68e67470c0 [Improvement](doc) add table-buckets doc for flink connector (#29672) 2024-01-23 10:09:54 +08:00