database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,155 Commits 1 Branch 0 Tags
7e615afbcee40a3e4e6907af300a551b71496f03
Commit Graph

9720 Commits

Author SHA1 Message Date
github-actions[bot]
b5beaf4eb1 branch-2.1: [fix](mtmv)The refresh method for MTMV is commit. If the status is PAUSED, no more tasks should be generated #46020 (#46265) 
Cherry-picked from #46020

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-01-02 14:03:28 +08:00
github-actions[bot]
9e45c70923 branch-2.1: [chore](restore) log the table name and partition info when partition type is different #46213 (#46234) 
Cherry-picked from #46213

Co-authored-by: walter <maochuan@selectdb.com>
 2025-01-01 08:09:11 +08:00
github-actions[bot]
a6fc852ce7 branch-2.1: [opt](catalog) use table in db object return get db #46211 (#46229) 
Cherry-picked from #46211

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
Co-authored-by: morningman <yunyou@selectdb.com>
 2025-01-01 08:00:49 +08:00
github-actions[bot]
9593a7bfc3 branch-2.1: [fix](split)Fixed the bug that batch mode split could not query data in multiple be scenarios. #46218 (#46227) 
Cherry-picked from #46218

Co-authored-by: daidai <changyuwei@selectdb.com>
 2025-01-01 00:34:48 +08:00
shee
28960b7b7d [Improve](nereids) use hash set replace three set in DiscreteValue to improve in predicate performance (#45181) (#46220) 
### What problem does this PR solve?

cp #45181
 2024-12-31 23:04:57 +08:00
github-actions[bot]
1d8b3a0bcc branch-2.1: [fix](audit) fix the delay in loading audit log #46175 (#46193) 
Cherry-picked from #46175

Co-authored-by: shee <13843187+qzsee@users.noreply.github.com>
 2024-12-31 22:56:12 +08:00
github-actions[bot]
f59c285538 branch-2.1: [fix](index)Add duplicated indexes check in add index #46155 (#46210) 
Cherry-picked from #46155

Co-authored-by: qiye <luen@selectdb.com>
 2024-12-31 22:46:29 +08:00
Calvin Kirs
9eb07e578e branch-2.1 [Fix](catalog)Remove the fs.disable.cache parameter to prevent excessive FS-associated objects and memory leaks (#46184) (#46191) 
…

#46184
(cherry picked from commit 17667aeb92efc5580b8615e53a3ef4f514a27204)
 2024-12-31 16:54:10 +08:00
zhangdong
fa20529dd9 [enhance](auth)Optimize the authentication logic of Ranger Doris(#41207) (#46179) 
pick: https://github.com/apache/doris/pull/41207

only pick Performance optimization related
 2024-12-31 11:54:27 +08:00
Uniqueyou
aa8c93cfe2 branch-2.1: [fix](sql) Wrong result for alter set property #46028 (#46141) 
pick https://github.com/apache/doris/pull/46028
 2024-12-31 09:52:43 +08:00
lide
1af18d0211 [fix](audit-loader) Fix the bug that causes audit loader to fail. (#46119) 
Fix the bug that causes audit loader to fail.
Related PR: #45167 #40493

The bug causes audit loader fail as following errors in audit.log.
```
2024-12-27 11:47:47,001 [stream_load] |Label=audit_log_20241227_114552_856_127_0_0_1_8030|Db=__internal_schema|Table=audit_log|User=|ClientIp=10.0.1.3|Status=Success|Message=OK|Url=http://10.0.1.4:8040/api/_load_error_log?file=__shard_7/error_log_insert_stmt_c24ed0d941f59867-ec08b8542bc2a4a1_c24ed0d941f59867_ec08b8542bc2a4a1|TotalRows=34|LoadedRows=0|FilteredRows=34|UnselectedRows=0|LoadBytes=6887|StartTime=2024-12-27 11:45:52.858|FinishTime=2024-12-27 11:45:52.888
```
The detail error is:
```
curl http://10.0.1.4:8040/api/_load_error_log?file=__shard_7/error_log_insert_stmt_c24ed0d941f59867-ec08b8542bc2a4a1_c24ed0d941f59867_ec08b8542bc2a4a1

Reason: actual column number in csv file is  more than  schema column number.actual number: 29, schema column number: 27; line delimiter: [
], column separator: [  ], result values:
```

Co-authored-by: derenli <derenli@tencent.com>
 2024-12-31 07:30:00 +08:00
github-actions[bot]
c8fb934bc1 branch-2.1: [chore](config) disable restore_reset_index_id by default #46104 (#46127) 
Cherry-picked from #46104

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-30 11:52:58 +08:00
github-actions[bot]
5425e4686b branch-2.1: [fix](auth) fix use database stmt access unauthorized catalog #45720 (#45978) 
Cherry-picked from #45720

Co-authored-by: Petrichor <xiaowenli@selectdb.com>
 2024-12-30 10:43:28 +08:00
github-actions[bot]
9b91a4a560 branch-2.1: [test](nereids) add test for normalize sort #45890 (#46112) 
Cherry-picked from #45890

Co-authored-by: yujun <yujun@selectdb.com>
 2024-12-30 10:19:40 +08:00
github-actions[bot]
b085e94a5e branch-2.1: [fix](sql) Wrong result for partition item tosql #45918 (#45960) 
Cherry-picked from #45918

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2024-12-30 10:09:58 +08:00
James
a490a366e4 [improvement](statistics)Support get oracle jdbc row count. (#45214) (#46133) 
backport: https://github.com/apache/doris/pull/45214
 2024-12-29 22:17:57 +08:00
James
6dd92be33d [feature](statistics)Support get row count for pg and sql server. (#42674) (#46131) 
backport: https://github.com/apache/doris/pull/42674
 2024-12-29 19:37:21 +08:00
daidai
a380f5d222 [enchement](utf8)import enable_text_validate_utf8 session var (#45537) (#46070) 
bp #45537
 2024-12-28 10:05:03 +08:00
github-actions[bot]
829d9b3454 branch-2.1: [Fix](PreparedStatement) nondeterministic functions in prepared statement should not be short circuited #46003 (#46109) 
Cherry-picked from #46003

Co-authored-by: lihangyu <lihangyu@selectdb.com>
 2024-12-27 21:02:36 +08:00
zy-kkk
75e9aa3fb4 branch-2.1: [fix](jdbc catalog) Get statistics using remote name #46040 (#46116) 
Cherry-picked from https://github.com/apache/doris/pull/46040
 2024-12-27 20:59:18 +08:00
Calvin Kirs
8ac54b63c5 branch-2.1 [Fix](Catalog)Standardize the use of authentication attributes in the Catalog to avoid creating a large number of Authenticator objects. (#46106) 
…utes in the Catalog to avoid creating a large number of Authenticator
objects.

#46052
 2024-12-27 20:36:12 +08:00
github-actions[bot]
fab89c199e branch-2.1: [chore](binlog) Add table type to getMeta method #45942 (#45972) 
Cherry-picked from #45942

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-27 20:03:53 +08:00
github-actions[bot]
6cee95540d branch-2.1: [fix](variant) disable column name with dot character for variant type #45927 (#45992) 
Cherry-picked from #45927

Co-authored-by: camby <cambyzhu@tencent.com>
 2024-12-27 19:12:44 +08:00
wuwenchi
69961a3c1b [opt](hms table)Some optimizations for hms external table for 2.1 (#44909) (#46084) 
bp: #44909
 2024-12-27 16:42:42 +08:00
yujun
ae68580866 branch-2.1: [test](nereids) add arthmetic comparison ut #45690 (#45893) 
cherry pick from #45690
 2024-12-27 14:54:52 +08:00
yujun
60d3c1e31d branch-2.1: [fix](nereids) fix compare with date like overflow #45868 (#45929) 
cherry pick from #45868
 2024-12-27 10:55:42 +08:00
github-actions[bot]
8d3e8feb6e branch-2.1: [fix](show)show tables should be case insensitive when lowerCaseTableNames is 1 or 2. #46030 (#46058) 
Cherry-picked from #46030

Co-authored-by: James <lijibing@selectdb.com>
 2024-12-27 07:18:41 +08:00
James
4a07efe119 [improvement](statistics)Async drop table stats while doing truncate and schema change(#45923) (#46010) 
backport: https://github.com/apache/doris/pull/45923
 2024-12-26 21:57:18 +08:00
github-actions[bot]
6f8d2bfa88 branch-2.1: [enchement](mc)opt maxcompute read arrow skip repeated check of isNull #45989 (#46023) 
Cherry-picked from #45989

Co-authored-by: daidai <changyuwei@selectdb.com>
 2024-12-26 20:54:19 +08:00
zhangdong
7d5e8a13bb [enhance](mtmv)When drop MTMV, no longer wait for task cancel to complete (#45995) (#46025) 
pick: https://github.com/apache/doris/pull/45995
 2024-12-26 18:52:14 +08:00
github-actions[bot]
7addefbfe8 branch-2.1: [fix](mem leak) fe non_heap mem leak while use jdbc catalog #45806 (#45980) 
Cherry-picked from #45806

Co-authored-by: camby <cambyzhu@tencent.com>
 2024-12-26 15:05:28 +08:00
zy-kkk
1396f5a950 [2.1][improvement](jdbc catalog) Optimize JdbcCatalog case mapping stability (#43256) 
cherry-pick #41510
 2024-12-26 14:57:56 +08:00
James
289d621faa [improvement](information_schema)Show view definition in information_schema.views. (#45857) (#45930) 
backport: https://github.com/apache/doris/pull/45857
 2024-12-26 10:11:13 +08:00
github-actions[bot]
a65adcaa49 branch-2.1: [fix](Outfile) optimize the error message of SELECT INTO OUTFILE #45859 (#45951) 
Cherry-picked from #45859

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-25 23:10:43 +08:00
github-actions[bot]
bccfb04436 branch-2.1: [fix](parser) Syntax error for add partition with null null #45865 (#45913) 
Cherry-picked from #45865

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2024-12-25 22:15:20 +08:00
github-actions[bot]
a3ec8621a4 branch-2.1: [improvement](log)Reduce stats log. #45900 (#45916) 
Cherry-picked from #45900

Co-authored-by: James <lijibing@selectdb.com>
 2024-12-25 16:35:08 +08:00
zhangdong
fdb65197e7 [feat](mtmv)mtmv support paimon partition refresh(#43959,#44911) (#45878) 
pick: #44911 #43959

only pick code about paimon, not pick some code about MTMV REFRESH
 2024-12-25 12:08:27 +08:00
minghong
6c2107788c [fix](nereids) support one phase DeferMaterializeTopN #45693-branch-2.1 (#45845) 2024-12-25 12:00:58 +08:00
github-actions[bot]
6d6473efae branch-2.1: [fix](tabletScheduler) Fix addTablet dead lock in tabletScheduler #45298 (#45769) 
Cherry-picked from #45298

Co-authored-by: deardeng <dengxin@selectdb.com>
 2024-12-24 21:44:30 +08:00
yujun
1314a2b942 branch-2.1: [test](nereids) add test simplify comparison predicate #44886 (#45804) 
cherry pick from #44886
 2024-12-24 21:43:15 +08:00
zhangstar333
f0031d9954 [cherry-pick](branch-21)support posexplode table function (#43221) (#45783) 
cherry-pick from master #43221
 2024-12-24 21:42:30 +08:00
924060929
2bfc72e173 [fix](nereids) fix illegal import of guava's Throwables (#45876) 
fix illegal import of guava's Throwables
 2024-12-24 21:36:52 +08:00
seawinde
0a64cea3bf [fix](mtmv) Fix mv is deleted in nested mv causing query err and fix some test (#45744) (#45862) 
pr: 
https://github.com/apache/doris/pull/45744

commitId: 067643df
 2024-12-24 20:03:24 +08:00
yiguolei
956138da5c [enhancement](blacklist) ignore shutdown message to avoid add the backend to blacklist (#45875) 
### What problem does this PR solve?

1. If one request failed to send fragment to BE then it will call
removeProxy;
2. removeProxy will call shutdown and shutdown will cancel all requests
related with this client.
3. Other request will get exception when receive data from be and will
add this be to blacklist.

Should avoid this scenario.

None
 2024-12-24 19:03:51 +08:00
amory
8b35b0e477 branch-2.1: [fix](function) fixed some nested type func's param type which is not suitable and make result wrong #44923 (#45798) 
Cherry-picked from #44923
 2024-12-24 14:57:33 +08:00
yiguolei
69704df447 [enhancement](blacklist) print the detail stack that the client is shutdown (#45850) 2024-12-24 14:52:58 +08:00
zhiqiang
4514652aa2 [fix](profile) Fix clean profile (#45838) 
### What problem does this PR solve?
Clean all profile command does not clean runtime profile. Makes runtime
profile leak, and memory can not be released.

Problem Summary:

![img_v3_02hs_62c4ed81-fe1f-423f-ba92-a1762af5162g](https://github.com/user-attachments/assets/4cec62a5-9077-4e36-91a8-29e5fedd4560)
After clean all profile, summary profile is clear, but runtime profile
and counter still exists.

![img_v3_02hs_4de10ca2-b878-4722-9b6e-9738270e6a8g](https://github.com/user-attachments/assets/b30754f2-a401-4127-aa5f-ed053d9f5c75)

After fix:

![img_v3_02hs_750960cf-9ebd-41e1-8f13-b41e5bc094dg](https://github.com/user-attachments/assets/5a5edb0b-bd7d-439e-92c2-0ed69589a7b5)

![img_v3_02hs_7e111a74-bacb-43e0-8acb-ec406ce68d8g](https://github.com/user-attachments/assets/556af476-7ea0-4924-880e-183f2cf9e870)
 2024-12-24 14:25:03 +08:00
James
536ca0bfe6 [fix](auditlog)Fix auditlog NPE (#45772) (#45808) 
backport: https://github.com/apache/doris/pull/45772
 2024-12-23 21:22:41 +08:00
meiyi
3de3c6ff44 [fix](group commit) fix group commit session (#45800) 
if connect to observer, enable group commit and do insert overwrite,
will get:
```
ERROR 1105 (HY000): errCode = 2, detailMessage = errCode = 2, detailMessage = Nereids does not support group commit insert
```
 2024-12-23 19:09:54 +08:00
Mingyu Chen (Rayner)
901b93264c branch-2.1: [opt](log) add more info in nereids timeout log #45705 (#45793) 
cherry-pick #45705
 2024-12-23 17:57:38 +08:00