database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
18,429 Commits 1 Branch 0 Tags
3cb0deae9ceef92c71c35444c495bc5b94de6c7c
Commit Graph

18429 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kaijie Chen
7938531d1e [feature](load) enable memtable on sink node by default (#30372) 2024-01-25 21:37:33 +08:00
Kaijie Chen
90ed663eb0 [fix](move-memtable) all sinks wait stream close for load timeout (#30356) 2024-01-25 21:37:33 +08:00
yiguolei
007a489f46 [memoryleak](execontext) dctor should be virtual to avoid memory leak (#30359) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-01-25 21:37:33 +08:00
Lei Zhang
ce0b4fed6d [feat](log) Update RestApiExceptionHandler log level from debug to warn (#30306) 
* When meeting RestApiExceptionHandler, we have insufficient information
  for finding out the call stack
 2024-01-25 21:37:33 +08:00
qiye
2ecc6ed0d4 [opt](inverted index)Add RAM directory null cases (#30353) 2024-01-25 21:37:33 +08:00
wudi
4452f5df19 [doc](release) fix connector release doc (#30362) 2024-01-25 21:37:10 +08:00
morrySnow
3ffd5b8e9a [fix](Nereids) some special expression should not be constant (#30305) 2024-01-25 21:37:10 +08:00
yujun
4681958cf7 [improvement](replica) set replica drop write editlog (#30345) 
* set replica drop write editlog

* update test
 2024-01-25 21:37:10 +08:00
Mingyu Chen
e8a20d8899 [fix](meta) remove default_cluster prefix in recover db log (#30350) 2024-01-25 21:33:51 +08:00
Jibing-Li
9174ac921b Fix statistics p0. (#30351) 2024-01-25 21:33:50 +08:00
HHoflittlefish777
92d4ce31ae [improve](routine-load) optimize error msg when failed to fetch Kafka info #30298 2024-01-25 21:33:50 +08:00
谢健
0f81ecf415 [feat](Nereids): eliminate inner join by pk fk when comparing mv (#30258) 2024-01-25 21:33:50 +08:00
谢健
0a5c375068 [fix](Nereids): when predicate contains right output, don't convert outer to anti join (#30276) 2024-01-25 21:33:50 +08:00
Lei Zhang
bb021668c9 [feat](log) Add more log about cost time for dropTable (#30284) 
* In some p0 test cases we have found dropTable cost more than
  5 seconds, so add more time cost log
 2024-01-25 14:32:39 +08:00
AlexYue
ccde65b942 [fix](Cooldown) Enhance calculate logic of _has_data_to_cooldown (#30244) (#30299) 2024-01-25 13:25:34 +08:00
morrySnow
f87484d6b3 [fix](Nereids) fix create array function type coercion (#30329) 2024-01-25 13:24:52 +08:00
HappenLee
b60a272be0 [Bug](pipeline) Fix pipeline load lose data use wrong var check order (#30341) 2024-01-25 13:24:52 +08:00
yiguolei
6614d40dad [bugfix](core) fix core due to send rpc and request is deconstructed (#30344) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-01-25 13:24:52 +08:00
xy
b1722231c4 [Fix](doc) Modify some default values in the documentation (#30304) 
Co-authored-by: xingying01 <xingying01@corp.netease.com>
 2024-01-25 13:24:52 +08:00
qiye
01c394acc2 [fix](inverted index)support merge null_bitmap during index compaction (#30326) 
`null_bitmap` file is not considered in index compaction process. This will lead wrong query result when doc is contain `NULL` values.
 2024-01-25 13:24:52 +08:00
Lei Zhang
081da1299a [fix](fe) Fix FrontendHbResponse serialization compatibility problem (#30337) 
* Between branch-1.2-lts and branch-2.1, `FrontendHbResponse` has upgrade
  compatiblity problem, because `arrowFlightSqlPort` field, only metaVerserion
  less than FeMetaVersion.VERSION_121 will call `FrontendHbResponse.readField`

* Introduced by https://github.com/apache/doris/pull/24314
 2024-01-25 13:24:52 +08:00
catpineapple
ff47c69bf9 [doc](fix) K8s doc modify and add pvc network docs (#30307) 2024-01-25 13:24:52 +08:00
airborne12
61bab1f1c0 [Fix](inverted index) fix data size when drop inverted index (#30327) 2024-01-25 13:24:52 +08:00
Pxl
1d7d7ee9b6 [Chore](join) split out join hash map from hash map (#30280) 
split out join hash map from hash map
 2024-01-25 13:24:52 +08:00
Pxl
5b462194d1 [Feature](materialized-view) support rewrite case when to if on legacy planner to make mv work (#30320) 
support rewrite case when to if on legacy planner to make mv work
 2024-01-25 13:24:52 +08:00
wangbo
5ba9987d3a [Fix](executor)Release resource correctly when drop workload group (#30279) 2024-01-25 13:24:52 +08:00
yujun
3d22f9cfc8 [feature](replica) Add drop replica safely on backend (#30303) 2024-01-25 13:24:52 +08:00
Guangdong Liu
49f879f8fd [regression test](framework) add waitFor action (#30289) 2024-01-25 13:24:52 +08:00
jakevin
bee6ae73c7 [minor](Nereids): enable PushDownTopNDistinctThroughJoin (#30275) 2024-01-25 13:24:52 +08:00
HHoflittlefish777
15728756e2 [improve](streamload) do not print stack trace when get data from pipe meet cancel (#30297) 2024-01-25 13:24:52 +08:00
zclllyybb
2e6a00690f [Fix](smooth-upgrade) fix unnecessary high version of smooth upgrade (#30283) 
fix unnecessary high version of smooth upgrade
 2024-01-25 13:24:09 +08:00
zclllyybb
825fe1470f [Docs](arm) update arm compilation and auto partition (#30311) 
update arm compilation and auto partition
 2024-01-25 13:24:09 +08:00
wangbo
1322c813d3 [Fix](executor)Fix return stack to fe #30316 2024-01-25 13:24:09 +08:00
xueweizhang
0287651114 [fix](char) fix char column type not check lenght (#30266) 2024-01-25 13:24:09 +08:00
Jibing-Li
86d7a8be44 [improvement](statistics nereids)Nereids support select mv. (#30267) 2024-01-25 13:24:09 +08:00
Liqf
67051318a2 [docs](fix)fix max_filter_ratio default value #30318 2024-01-25 13:24:09 +08:00
Jibing-Li
63cf2777f9 [improvement](statistics)Catch load column stats exception, avoid print too much stack info to fe.out #30315 2024-01-25 13:24:09 +08:00
jakevin
83ea486b15 [fix](Nereids): Except just can merge with left deep shape (#30270) 2024-01-25 13:24:09 +08:00
Dongyang Li
1aa006c80f [fix](ci) add single quote to the value of the session variables when setting it (#30295) 
Co-authored-by: stephen <hello-stephen@qq.com>
 2024-01-25 13:24:09 +08:00
zxealous
72026778fe [optimize](inverted index) Use inverted index filter null field (#30237) 2024-01-25 13:24:09 +08:00
Pxl
7e60369ba2 [Feature](materialized-view) support create mv with count(*) (#30313) 
support create mv with count(*)
 2024-01-25 13:24:09 +08:00
Guangdong Liu
101b2593fc [regression test](schema change) add case for tinyint/smallint/int/bigint/float/double type in agg (#30193) 2024-01-25 13:24:09 +08:00
Guangdong Liu
df504df475 [regression test](schema change) add case for partition (#30195) 2024-01-25 13:24:09 +08:00
Gabriel
e94683fffb [pipelineX](refactor) refine relationship between shared state and dependency (#30294) 2024-01-25 13:24:09 +08:00
谢健
2951f9a2c7 [fix](Nereids) relation in constraints should be multi parts (#30293) 2024-01-25 13:24:09 +08:00
谢健
7e1a986fa1 [feat](Nereids): eliminate left outer join by unique when comparing mv (#30228) 2024-01-25 13:24:09 +08:00
Nitin-Kashyap
cd70f45ce2 [test](ut) added UT cases for show build index (#29561) 
Added UT case for show build index flow
 2024-01-25 13:24:09 +08:00
koarz
ca5a314765 [fix](function) make STRLEFT and STRRIGHT and SUBSTR function DEPEND_ON_ARGUMENT (#28352) 
make STRLEFT and STRRIGHT function DEPEND_ON_ARGUMENT
 2024-01-25 13:23:59 +08:00
zy-kkk
88fdb2677d [fix](catalog) fix Uninitialized connection pool parameters in hmsjdbcclient (#30262) 2024-01-25 13:23:59 +08:00
seawinde
2f68aac885 [Improvement](Nereids) Support to query rewrite by materialized view when join input has aggregate (#30230) 
Support to query rewrite by materialized view when join input has aggregate, the aggregate should be simple
For example as following:
The materialized view def is 
>            select
>              l_linenumber,
>              count(distinct l_orderkey),
>              sum(case when l_orderkey in (1,2,3) then l_suppkey * l_linenumber else 0 end),
>              max(case when l_orderkey in (4, 5) then (l_quantity *2 + part_supp_a.qty_max) * 0.88 else 100 end),
>              avg(case when l_partkey in (2, 3, 4) then l_discount + o_totalprice + part_supp_a.qty_sum else 50 end)
>            from lineitem
>            left join orders on l_orderkey = o_orderkey
>            left join 
>              (select ps_partkey, ps_suppkey, sum(ps_availqty) qty_sum, max(ps_availqty) qty_max,
>                min(ps_availqty) qty_min,
>                avg(ps_supplycost) cost_avg
>                from partsupp
>                group by ps_partkey,ps_suppkey) part_supp_a
>              on l_partkey = part_supp_a.ps_partkey
>                and l_suppkey = part_supp_a.ps_suppkey
>            group by l_linenumber;

when query is like following, it can be rewritten by mv above
>            select
>              l_linenumber,
>              sum(case when l_orderkey in (1,2,3) then l_suppkey * l_linenumber else 0 end),
>              avg(case when l_partkey in (2, 3, 4) then l_discount + o_totalprice + part_supp_a.qty_sum else 50 end)
>            from lineitem
>            left join orders on l_orderkey = o_orderkey
>            left join 
>              (select ps_partkey, ps_suppkey, sum(ps_availqty) qty_sum, max(ps_availqty) qty_max,
>                min(ps_availqty) qty_min,
>                avg(ps_supplycost) cost_avg
>                from partsupp
>                group by ps_partkey,ps_suppkey) part_supp_a
>              on l_partkey = part_supp_a.ps_partkey
>                and l_suppkey = part_supp_a.ps_suppkey
>            group by l_linenumber;
 2024-01-25 13:23:59 +08:00