database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,096 Commits 1 Branch 0 Tags
25edcd2f375a510fcffae8a203c91a4856184f09
Commit Graph

21096 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
James
25edcd2f37 [fix](regression)Fix paimon row count case. (#45994) (#46012) 
backport: https://github.com/apache/doris/pull/45994
 2024-12-27 07:18:00 +08:00
github-actions[bot]
a93ae03ecb branch-2.1: [fix](case)fix manager regression case. #45993 (#46033) 
Cherry-picked from #45993

Co-authored-by: daidai <changyuwei@selectdb.com>
 2024-12-26 22:32:28 +08:00
shuke
8b9167cac9 [regression-test](fix) fix two case use same table (#46053) 2024-12-26 21:58:30 +08:00
James
4a07efe119 [improvement](statistics)Async drop table stats while doing truncate and schema change(#45923) (#46010) 
backport: https://github.com/apache/doris/pull/45923
 2024-12-26 21:57:18 +08:00
shuke
0c13cf84d0 [regression-test](fix) fix regression-test/suites/schema_change_p0/test_uniq_mv_schema_change.groovy bug (#46050) 2024-12-26 21:28:36 +08:00
github-actions[bot]
6f8d2bfa88 branch-2.1: [enchement](mc)opt maxcompute read arrow skip repeated check of isNull #45989 (#46023) 
Cherry-picked from #45989

Co-authored-by: daidai <changyuwei@selectdb.com>
 2024-12-26 20:54:19 +08:00
zhangdong
7d5e8a13bb [enhance](mtmv)When drop MTMV, no longer wait for task cancel to complete (#45995) (#46025) 
pick: https://github.com/apache/doris/pull/45995
 2024-12-26 18:52:14 +08:00
shuke
3a8df5fe00 [regression-test](fix) fix global var bug (#46013) 2024-12-26 15:28:55 +08:00
daidai
f951c6aed0 [fix](case)fix acid regression case. (#45999) 
### What problem does this PR solve?

Problem Summary:
just fix error case.
 2024-12-26 15:23:25 +08:00
github-actions[bot]
df8bc8f23d branch-2.1: [fix](parquet) impl has_dict_page to replace old logic and fix write empty parquet row group bug #45740 (#45954) 
Cherry-picked from #45740

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2024-12-26 15:17:49 +08:00
zy-kkk
02519c37ea branch-2.1: [test](mysql catalog) fix mysql jdbc catalog test case (#45988) 2024-12-26 15:06:24 +08:00
zy-kkk
bceebfcf38 branch-2.1: [test](jdbc catalog) add some jdbc query tvf test (#45991) 
cherry-pick #45938
 2024-12-26 15:05:50 +08:00
github-actions[bot]
7addefbfe8 branch-2.1: [fix](mem leak) fe non_heap mem leak while use jdbc catalog #45806 (#45980) 
Cherry-picked from #45806

Co-authored-by: camby <cambyzhu@tencent.com>
 2024-12-26 15:05:28 +08:00
zy-kkk
1396f5a950 [2.1][improvement](jdbc catalog) Optimize JdbcCatalog case mapping stability (#43256) 
cherry-pick #41510
 2024-12-26 14:57:56 +08:00
shuke
879bb79655 [regression-test](fix) fix two case bug (#45974) 2024-12-26 10:25:32 +08:00
James
289d621faa [improvement](information_schema)Show view definition in information_schema.views. (#45857) (#45930) 
backport: https://github.com/apache/doris/pull/45857
 2024-12-26 10:11:13 +08:00
Xinyi Zou
1cf6986cea [pick](branch-2.1) pick #44092 (#45836) 2024-12-25 23:11:19 +08:00
github-actions[bot]
a65adcaa49 branch-2.1: [fix](Outfile) optimize the error message of SELECT INTO OUTFILE #45859 (#45951) 
Cherry-picked from #45859

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-25 23:10:43 +08:00
github-actions[bot]
bccfb04436 branch-2.1: [fix](parser) Syntax error for add partition with null null #45865 (#45913) 
Cherry-picked from #45865

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2024-12-25 22:15:20 +08:00
Socrates
c94ac6c9f8 [branch-2.1](ORC) fix predicate filter failed when use hive 1.x version (#45809) 
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #43185 

Pick the pr to branch-2.1 to fix predicate filter failed when use hive
1.x version

Co-authored-by: fantasy12345zsq <1575033031@qq.com>
 2024-12-25 18:56:57 +08:00
github-actions[bot]
a3ec8621a4 branch-2.1: [improvement](log)Reduce stats log. #45900 (#45916) 
Cherry-picked from #45900

Co-authored-by: James <lijibing@selectdb.com>
 2024-12-25 16:35:08 +08:00
shuke
20c49c3638 [regression-test](fix) fix global var (#45917) 2024-12-25 15:29:40 +08:00
py023
303f6bd849 [test](regression-test) use unified trigger_and_wait_compaction metho… (#45908) 2024-12-25 13:59:51 +08:00
zzzxl
a6e4497811 [opt](inverted index) Add troubleshooting logs (#44182) (#45777) 
https://github.com/apache/doris/pull/44182
 2024-12-25 13:58:01 +08:00
FreeOnePlus
e8be023b35 [typo](docker) Adjust the indentation format of the init_be and entry_point scripts, as well as the duration of loop execution(Merge-2.1). (#45860) 
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Master PR: #45308 

Problem Summary:

Adjust the indentation format of the `init_be` and `entry_point`
scripts, as well as the duration of loop execution.
Adjust the smallest unit of all indentations to a single tab character,
and modify the loop duration when checking the BE startup status,
changing both from 300 seconds to 30 seconds to speed up the overall
Docker startup time.
 2024-12-25 12:16:42 +08:00
FreeOnePlus
980f28f9e2 [feat](docker)Modify the init_be and start_be scripts to meet the requirements for rapid Docker startup(Merge 2.1). (#45858) 
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #45267

Master PR: #45269

Problem Summary:

To meet the needs of rapid Docker startup, I have made adjustments to
two related scripts in the Docker startup process. First, I added a env
`SKIP_CHECK_ULIMIT` to the `start_be.sh` script, which will skip the
size checks for `swap`, `ulimit`, and `max_map_count`. At the same time,
I used `--console` to start the process and print logs. The reason why I
did not use the `--daemon` daemon command to execute is that starting
with a foreground log printing method in a Docker container is the
correct and reliable approach.

At the same time, I added a check logic for a `be.conf` configuration
item in the `init_be.sh` script: if it is the first time starting,
append the export `SKIP_CHECK_ULIMIT=true` to skip the `ulimit` value
check in the BE process. In summary, these adjustments can meet the
basic requirements for rapid Docker startup usage.
 2024-12-25 12:11:14 +08:00
github-actions[bot]
547e88b1ee branch-2.1: [fix](csv reader) fix core dump when parsing csv with enclose #45485 (#45889) 
Cherry-picked from #45485

Co-authored-by: hui lai <laihui@selectdb.com>
 2024-12-25 12:09:20 +08:00
zhangdong
fdb65197e7 [feat](mtmv)mtmv support paimon partition refresh(#43959,#44911) (#45878) 
pick: #44911 #43959

only pick code about paimon, not pick some code about MTMV REFRESH
 2024-12-25 12:08:27 +08:00
minghong
6c2107788c [fix](nereids) support one phase DeferMaterializeTopN #45693-branch-2.1 (#45845) 2024-12-25 12:00:58 +08:00
github-actions[bot]
4c2abc7ba8 branch-2.1: [opt](pick_pr) add branch name to title for manual pick pr tool #45902 (#45911) 
Cherry-picked from #45902

Co-authored-by: yujun <yujun@selectdb.com>
 2024-12-25 11:53:43 +08:00
zhiqiang
64195d79ee [refactor](metrics) Remove IntAtomicCounter & CoreLocal #45742 (#45870) 
cherry pick from #45742
 2024-12-24 23:13:48 +08:00
github-actions[bot]
6d6473efae branch-2.1: [fix](tabletScheduler) Fix addTablet dead lock in tabletScheduler #45298 (#45769) 
Cherry-picked from #45298

Co-authored-by: deardeng <dengxin@selectdb.com>
 2024-12-24 21:44:30 +08:00
yujun
1314a2b942 branch-2.1: [test](nereids) add test simplify comparison predicate #44886 (#45804) 
cherry pick from #44886
 2024-12-24 21:43:15 +08:00
zhangstar333
f0031d9954 [cherry-pick](branch-21)support posexplode table function (#43221) (#45783) 
cherry-pick from master #43221
 2024-12-24 21:42:30 +08:00
github-actions[bot]
0b41c927e3 branch-2.1: [case](auth)Add case for auth #45478 (#45819) 
Cherry-picked from #45478

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2024-12-24 21:41:48 +08:00
924060929
2bfc72e173 [fix](nereids) fix illegal import of guava's Throwables (#45876) 
fix illegal import of guava's Throwables
 2024-12-24 21:36:52 +08:00
seawinde
0a64cea3bf [fix](mtmv) Fix mv is deleted in nested mv causing query err and fix some test (#45744) (#45862) 
pr: 
https://github.com/apache/doris/pull/45744

commitId: 067643df
 2024-12-24 20:03:24 +08:00
feiniaofeiafei
bcc2c155df [test] fix partition prune unstable cases (#44976) (#45846) 
cherry-pick #44976 to branch-2.1
 2024-12-24 19:06:26 +08:00
yiguolei
956138da5c [enhancement](blacklist) ignore shutdown message to avoid add the backend to blacklist (#45875) 
### What problem does this PR solve?

1. If one request failed to send fragment to BE then it will call
removeProxy;
2. removeProxy will call shutdown and shutdown will cancel all requests
related with this client.
3. Other request will get exception when receive data from be and will
add this be to blacklist.

Should avoid this scenario.

None
 2024-12-24 19:03:51 +08:00
shuke
c9d3f1122b [regression-test](framework) disable defining global variable in test… (#45840) 2024-12-24 17:21:27 +08:00
amory
8b35b0e477 branch-2.1: [fix](function) fixed some nested type func's param type which is not suitable and make result wrong #44923 (#45798) 
Cherry-picked from #44923
 2024-12-24 14:57:33 +08:00
yiguolei
69704df447 [enhancement](blacklist) print the detail stack that the client is shutdown (#45850) 2024-12-24 14:52:58 +08:00
feiniaofeiafei
9c7280bd58 [test](case) add partition prune cases (#44722) (#45823) 
cherry-pick #44722 to branch-2.1
 2024-12-24 14:25:58 +08:00
zhiqiang
4514652aa2 [fix](profile) Fix clean profile (#45838) 
### What problem does this PR solve?
Clean all profile command does not clean runtime profile. Makes runtime
profile leak, and memory can not be released.

Problem Summary:

![img_v3_02hs_62c4ed81-fe1f-423f-ba92-a1762af5162g](https://github.com/user-attachments/assets/4cec62a5-9077-4e36-91a8-29e5fedd4560)
After clean all profile, summary profile is clear, but runtime profile
and counter still exists.

![img_v3_02hs_4de10ca2-b878-4722-9b6e-9738270e6a8g](https://github.com/user-attachments/assets/b30754f2-a401-4127-aa5f-ed053d9f5c75)

After fix:

![img_v3_02hs_750960cf-9ebd-41e1-8f13-b41e5bc094dg](https://github.com/user-attachments/assets/5a5edb0b-bd7d-439e-92c2-0ed69589a7b5)

![img_v3_02hs_7e111a74-bacb-43e0-8acb-ec406ce68d8g](https://github.com/user-attachments/assets/556af476-7ea0-4924-880e-183f2cf9e870)
 2024-12-24 14:25:03 +08:00
zzzxl
02f15a8ef0 [fix](inverted index) Fix Null Pointer Exception in function match(#45456)(#45774) 
pick: https://github.com/apache/doris/pull/45456
 2024-12-24 11:27:13 +08:00
shuke
1c47f5cf57 [regression-test](fix) fix case with invalid grammer (#45211) (#45791) 
Problem Summary:
Defining global variables in a test suite can easily introduce errors,
such as variable conflicts in concurrent scenarios. In #44576 , a method
for detecting global variables was introduced.

That approach conflicts with the function calling like
connect(user=user, password="pwd"). Furthermore, the connect(user=user,
password="pwd") method cannot specify assignments to parameters with
default values; values still need to be assigned according to the order
of parameters. Therefore, modifying these calling method.
 2024-12-24 11:10:28 +08:00
xzj7019
aa728aef66 [Improvement](tools) refine tools schema (#45825) 
pick from master #45778
 2024-12-24 10:27:08 +08:00
James
536ca0bfe6 [fix](auditlog)Fix auditlog NPE (#45772) (#45808) 
backport: https://github.com/apache/doris/pull/45772
 2024-12-23 21:22:41 +08:00
meiyi
3de3c6ff44 [fix](group commit) fix group commit session (#45800) 
if connect to observer, enable group commit and do insert overwrite,
will get:
```
ERROR 1105 (HY000): errCode = 2, detailMessage = errCode = 2, detailMessage = Nereids does not support group commit insert
```
 2024-12-23 19:09:54 +08:00
Mingyu Chen (Rayner)
901b93264c branch-2.1: [opt](log) add more info in nereids timeout log #45705 (#45793) 
cherry-pick #45705
 2024-12-23 17:57:38 +08:00