database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
20,944 Commits 1 Branch 0 Tags
44fa86040fbdb7d7a408f41dcf106908e3156c63
Commit Graph

20944 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
github-actions[bot]
44fa86040f branch-2.1: [Enhancement](compaction)Optimize compaction task permit allocation #45197 (#45243) 
Cherry-picked from #45197

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
 2024-12-11 14:35:07 +08:00
Tiewei Fang
f54502960c [fix](branch-2.1) Cacel the export job when the ring buffer have no enough slot (#45245) 2024-12-11 14:34:14 +08:00
Sun Chenyang
ca85238ccf [fix] (inverted index) Disallow variant columns from using inverted index format v1 (#43599) (#45179) 
pick from master #43599
 2024-12-11 10:05:54 +08:00
abmdocrt
d0737c45f8 [cherry-pick](branch-2.1) Pick "[Fix](Rowset Id) Use a randomly generated rowset ID to handle memory write failures (#42949)" (#44086) 2024-12-10 15:48:02 +08:00
Mingyu Chen (Rayner)
e29d125200 [fix](planner) query should be cancelled if limit reached (#44338) (#45222) 
cherry-pick #44338
 2024-12-09 22:22:24 -08:00
Mingyu Chen (Rayner)
5d3f0a267a [opt](scan) unify the local and remote scan bytes stats for all scanners for 2.1 (#45167) 
pick part of #40493

TODO: not working with s3 reader
 2024-12-10 14:19:19 +08:00
Mryange
938ca71604 [fix](profile) do not merge fragment_level profile (#45200) 2024-12-10 09:58:21 +08:00
Kaijie Chen
da3c56d311 [test](move-memtable) fix false positives in sinkv2 injection tests (#44552) (#45193) 
backport #44552
 2024-12-10 09:57:43 +08:00
github-actions[bot]
a8b5125a25 branch-2.1: [fix](third party) fix hang when destroy of rdkafka instances #44913 (#44951) 
Cherry-picked from #44913

Co-authored-by: hui lai <laihui@selectdb.com>
Co-authored-by: Dongyang Li <lidongyang@selectdb.com>
 2024-12-09 19:20:52 +08:00
wangbo
0bcb99710b [branch-2.1]Add customStdAllocator for vector/map (#41193) (#45124) 2024-12-09 18:33:51 +08:00
github-actions[bot]
2234217e82 branch-2.1: [fix](sql) Fix error for show create table column comment #44958 (#45172) 
Cherry-picked from #44958

Co-authored-by: Uniqueyou <134280716+wyxxxcat@users.noreply.github.com>
 2024-12-09 18:32:59 +08:00
github-actions[bot]
f3dbd4800f branch-2.1: [Audit](fix) fix audit log lost for npe #44145 (#45189) 
Cherry-picked from #44145

Co-authored-by: shee <13843187+qzsee@users.noreply.github.com>
Co-authored-by: garenshi <garenshi@tencent.com>
 2024-12-09 18:32:14 +08:00
minghong
b2637e4bda [feat](nereids)set runtime filter wait time according to table row count and table type #42640 branch-2.1 (#45114) 
### What problem does this PR solve?
pick#42640
 2024-12-09 14:51:10 +08:00
wangbo
977da5ca28 [branch-2.1]count tablet meta's static memory load from disk (#41429) (#45128) 
pick #41429
 2024-12-09 14:44:20 +08:00
Dongyang Li
b4db543eaa [chore](ci) macOS-12 environment is deprecated, switch to macOS-13 (#45185) 2024-12-09 14:37:02 +08:00
github-actions[bot]
95a12acbe6 branch-2.1: [fix](regression-test) Fix potential multi FE desc table result not refresh after schema change #44989 (#45009) 
Cherry-picked from #44989

Co-authored-by: Siyang Tang <tangsiyang@selectdb.com>
 2024-12-09 12:10:32 +08:00
seawinde
1662e4709a Pick some pr to 21 #43010 #43030 #43785 #44779 #44786 #44857 (#45129) 2024-12-09 11:46:48 +08:00
zhangdong
99e51ae4d2 [fix](auth) Prohibit deleting admin user (#44751) (#45083) 
pick: https://github.com/apache/doris/pull/44751
 2024-12-08 10:31:09 -08:00
Xinyi Zou
17bcc208e9 branch-2.1: [fix](arrow-flight-sql) Revert arrow_flight_sql group from regression test #44992 (#45089) 2024-12-08 11:37:02 +08:00
github-actions[bot]
cf2e2113db branch-2.1: [fix](move-memtable) tolerate non-open streams in close wait #44680 (#45154) 
Cherry-picked from #44680

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
 2024-12-08 11:35:30 +08:00
daidai
b332217584 [enchement](mc)mc catalog append netowrk config (#44194) (#45149) 
bp #44194
 2024-12-07 09:52:19 -08:00
924060929
2543af8d3b [feature](function) support orthogonal_bitmap_expr_calculate & orthogonal_bitmap_expr_calculate_count for nereids (#44991) (#45012) 
support orthogonal_bitmap_expr_calculate & orthogonal_bitmap_expr_calculate_count for nereids
 2024-12-07 15:27:48 +08:00
github-actions[bot]
358bceaf57 branch-2.1: [fix](case)fix manager show proc case unstable. #45040 (#45140) 
Cherry-picked from #45040

Co-authored-by: daidai <changyuwei@selectdb.com>
 2024-12-06 22:18:11 -08:00
github-actions[bot]
3714063975 branch-2.1: [feat](catalog)Replace HadoopUGI with HadoopKerberosAuthenticator to Support Kerberos Ticket Auto-Renewal #44916 (#45138) 
Cherry-picked from #44916

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-06 22:13:31 -08:00
github-actions[bot]
a44ac56352 branch-2.1: [chore](job-test)Add comments to the job's test cases #44627 (#45142) 
Cherry-picked from #44627

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-06 22:11:48 -08:00
github-actions[bot]
02840a98ff branch-2.1: [bugfix](hive)Fix split assignment leak. releated to issue (#40683). #44845 (#45144) 
Cherry-picked from #44845

Co-authored-by: sparrow <38098988+biohazard4321@users.noreply.github.com>
 2024-12-06 22:10:50 -08:00
github-actions[bot]
8f0276809a branch-2.1: [fix](compaction) tablet is not removed in compaction queue if dropped #45085 (#45136) 
Cherry-picked from #45085

Co-authored-by: meiyi <meiyi@selectdb.com>
 2024-12-07 12:15:20 +08:00
wuwenchi
9bb9a56a48 [opt](paimon)Remove unnecessary fields for 2.1 (#44906) (#45118) 
bp:#44906
 2024-12-06 14:45:53 -08:00
github-actions[bot]
b4e2e2cf78 branch-2.1: [fix](hudi)Add hudi catalog read partition table partition prune #44669 (#45113) 
Cherry-picked from #44669

Co-authored-by: daidai <changyuwei@selectdb.com>
 2024-12-06 14:41:27 -08:00
bobhan1
6ddc45b3fd branch-2.1: [opt](auto-inc) Allow to miss auto-increment column and other value columns in partial update #44528 (#45073) 
pick https://github.com/apache/doris/pull/44528
 2024-12-06 22:40:44 +08:00
github-actions[bot]
bd14d864ef branch-2.1: [fix](editlog) Fix replay BatchDropInfo #45077 (#45102) 
Cherry-picked from #45077

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-06 22:36:40 +08:00
Mingyu Chen (Rayner)
d4a6fd1850 Revert #43255 & #44615 (#45096) 
Revert "branch-2.1: [enhance](orc) Optimize ORC Predicate Pushdown for
OR-connected Predicate #43255 (#44438)"
Revert "[fix](orc) check all the cases before build_search_argument
(#44615) (#44801)"
 2024-12-06 21:14:13 +08:00
zhangdong
4f45fefea2 [enhance](mtmv)Optimize MTMV lock logic (#44967) (#45076) 
pick: https://github.com/apache/doris/pull/44967
 2024-12-06 17:17:32 +08:00
bobhan1
ebb21ef031 branch-2.1: [Fix](merge-on-write) Add defensive check before partial update #44687 (#45086) 
pick https://github.com/apache/doris/pull/44687
 2024-12-06 17:16:42 +08:00
github-actions[bot]
bea9564e38 branch-2.1: [fix](Export) Fix the problem of exporting stuck #44944 (#45094) 
Cherry-picked from #44944

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-06 17:01:45 +08:00
github-actions[bot]
3018e9af4c branch-2.1: [fix](routine load) fix invalid EOF tasks scheduling delay #44949 (#45088) 
Cherry-picked from #44949

Co-authored-by: hui lai <laihui@selectdb.com>
 2024-12-06 17:01:17 +08:00
github-actions[bot]
08c8a416ea branch-2.1: [fix](runtime_profile) fix race condition in to_thrift #45047 (#45099) 
Cherry-picked from #45047

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
 2024-12-06 16:25:33 +08:00
Socrates
53291bd040 branch-2.1: [fix](hudi) upgrade hudi to 0.15.0 (#44267)(#44995) (#45041) 
cherry-pick pr: #44267 #44995
 2024-12-05 23:18:37 -08:00
github-actions[bot]
f0324e2a56 branch-2.1: [improvement](information_schema)Support show default value in information_schema. #44849 (#45080) 
Cherry-picked from #44849

Co-authored-by: James <lijibing@selectdb.com>
 2024-12-06 14:54:09 +08:00
MoanasDaddyXu
ea24410faf [enhancement][docker] fix kafka docker issue (#45091) 2024-12-06 14:36:57 +08:00
Xinyi Zou
2ed306d0b1 [pick](branch-2.1) pick #44286 (#45055) 2024-12-06 14:33:47 +08:00
github-actions[bot]
d3c10f01e3 branch-2.1: [Chore](Job)Add scheduling logs for periodic jobs. #44843 (#45071) 
Cherry-picked from #44843

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-06 14:09:15 +08:00
github-actions[bot]
f038f28682 branch-2.1: [fix](mtmv) Fixed an error in setting variables in nested materialize views #44960 (#45038) 
Cherry-picked from #44960
 2024-12-06 14:04:13 +08:00
hui lai
682cec9b9a [test](stream load) add cases to ensure the correctness of the document (#43016) (#44385) 
pick #43016
 2024-12-06 11:04:51 +08:00
github-actions[bot]
94746b764d branch-2.1: [fix](memory) Fix UT ThreadMemTrackerMgrTest #44147 (#44936) 
Cherry-picked from #44147

Co-authored-by: Xinyi Zou <zouxinyi@selectdb.com>
 2024-12-06 10:54:12 +08:00
Mryange
21e21f5e3b [opt](exec) Use PASSTHROUGH to improve the concurrency of the ADAPTIV… (#44971) 
…E_PASSTHROUGH SINK. (#44925)
https://github.com/apache/doris/pull/44925
before
```
op -> local sink(1) -> local source (n)
```
now
```
op -> local passthrough(1) -> local passthrough(n) ->  local sink(n) -> local source (n)
```

profile
```
                  Pipeline  :  1(instance_num=3):
                      AGGREGATION_SINK_OPERATOR  (id=4  ,  nereids_id=255):
                          CROSS_JOIN_OPERATOR  (id=3  ,  nereids_id=245):
                              LOCAL_EXCHANGE_OPERATOR  (ADAPTIVE_PASSTHROUGH)  (id=-5):
                  Pipeline  :  2(instance_num=3):
                      LOCAL_EXCHANGE_SINK_OPERATOR  (ADAPTIVE_PASSTHROUGH)  (id=-5):
                          LOCAL_EXCHANGE_OPERATOR  (PASSTHROUGH)  (id=-6):
                  Pipeline  :  3(instance_num=1):
                      LOCAL_EXCHANGE_SINK_OPERATOR  (PASSTHROUGH)  (id=-6):
                          OLAP_SCAN_OPERATOR  (id=2.  nereids_id=234.  table  name  =  nums1(nums1)):
```
 2024-12-06 09:57:31 +08:00
daidai
0c3bc1bcd0 [fix](auth)fix be enable http auth, some request link never return. (#44959) (#45063) 
bp #44959

if you `enable_all_http_auth = true` in be.conf, then restart be, and
keep using `curl -u "xxxx:xxxx" http://127.0.0.1:8040/api/health` while
be is starting. You may encounter a situation where the link does not
return.
Reason:
When be is still starting, there is no information about fe master. When
you make an api request to be http port, be needs to request
authentication information from fe, which will cause it to request a
machine with empty ip and port 0. This rpc call will definitely fail
(this is not equivalent to a password error). After receiving this
failure, be does not `send_reply` to the api requester, so this api
request cannot be returned.
 2024-12-06 09:39:13 +08:00
github-actions[bot]
a67bbf3c58 branch-2.1: [Fix](job)Fix CAS competition failure leading to message publishing failure. #45018 (#45030) 
Cherry-picked from #45018

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-06 09:32:15 +08:00
yujun
041a1fe095 branch-2.1: [fix](nereids) fix compare with long min for simplify comparison rule (#44922) 2024-12-06 09:31:02 +08:00
github-actions[bot]
a98cb8c8bf branch-2.1: [fix](arrow-flight-sql) Fix query result is empty and not return query error message #45023 (#45053) 
Cherry-picked from #45023

Co-authored-by: Xinyi Zou <zouxinyi@selectdb.com>
 2024-12-06 09:27:35 +08:00