Commit Graph

9709 Commits

Author SHA1 Message Date
c8fb934bc1 branch-2.1: [chore](config) disable restore_reset_index_id by default #46104 (#46127)
Cherry-picked from #46104

Co-authored-by: walter <maochuan@selectdb.com>
2024-12-30 11:52:58 +08:00
5425e4686b branch-2.1: [fix](auth) fix use database stmt access unauthorized catalog #45720 (#45978)
Cherry-picked from #45720

Co-authored-by: Petrichor <xiaowenli@selectdb.com>
2024-12-30 10:43:28 +08:00
9b91a4a560 branch-2.1: [test](nereids) add test for normalize sort #45890 (#46112)
Cherry-picked from #45890

Co-authored-by: yujun <yujun@selectdb.com>
2024-12-30 10:19:40 +08:00
b085e94a5e branch-2.1: [fix](sql) Wrong result for partition item tosql #45918 (#45960)
Cherry-picked from #45918

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2024-12-30 10:09:58 +08:00
a490a366e4 [improvement](statistics)Support get oracle jdbc row count. (#45214) (#46133)
backport: https://github.com/apache/doris/pull/45214
2024-12-29 22:17:57 +08:00
6dd92be33d [feature](statistics)Support get row count for pg and sql server. (#42674) (#46131)
backport: https://github.com/apache/doris/pull/42674
2024-12-29 19:37:21 +08:00
a380f5d222 [enchement](utf8)import enable_text_validate_utf8 session var (#45537) (#46070)
bp #45537
2024-12-28 10:05:03 +08:00
829d9b3454 branch-2.1: [Fix](PreparedStatement) nondeterministic functions in prepared statement should not be short circuited #46003 (#46109)
Cherry-picked from #46003

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2024-12-27 21:02:36 +08:00
75e9aa3fb4 branch-2.1: [fix](jdbc catalog) Get statistics using remote name #46040 (#46116)
Cherry-picked from https://github.com/apache/doris/pull/46040
2024-12-27 20:59:18 +08:00
8ac54b63c5 branch-2.1 [Fix](Catalog)Standardize the use of authentication attributes in the Catalog to avoid creating a large number of Authenticator objects. (#46106)
…utes in the Catalog to avoid creating a large number of Authenticator
objects.

#46052
2024-12-27 20:36:12 +08:00
fab89c199e branch-2.1: [chore](binlog) Add table type to getMeta method #45942 (#45972)
Cherry-picked from #45942

Co-authored-by: walter <maochuan@selectdb.com>
2024-12-27 20:03:53 +08:00
6cee95540d branch-2.1: [fix](variant) disable column name with dot character for variant type #45927 (#45992)
Cherry-picked from #45927

Co-authored-by: camby <cambyzhu@tencent.com>
2024-12-27 19:12:44 +08:00
69961a3c1b [opt](hms table)Some optimizations for hms external table for 2.1 (#44909) (#46084)
bp: #44909
2024-12-27 16:42:42 +08:00
ae68580866 branch-2.1: [test](nereids) add arthmetic comparison ut #45690 (#45893)
cherry pick from #45690
2024-12-27 14:54:52 +08:00
60d3c1e31d branch-2.1: [fix](nereids) fix compare with date like overflow #45868 (#45929)
cherry pick from #45868
2024-12-27 10:55:42 +08:00
8d3e8feb6e branch-2.1: [fix](show)show tables should be case insensitive when lowerCaseTableNames is 1 or 2. #46030 (#46058)
Cherry-picked from #46030

Co-authored-by: James <lijibing@selectdb.com>
2024-12-27 07:18:41 +08:00
4a07efe119 [improvement](statistics)Async drop table stats while doing truncate and schema change(#45923) (#46010)
backport: https://github.com/apache/doris/pull/45923
2024-12-26 21:57:18 +08:00
6f8d2bfa88 branch-2.1: [enchement](mc)opt maxcompute read arrow skip repeated check of isNull #45989 (#46023)
Cherry-picked from #45989

Co-authored-by: daidai <changyuwei@selectdb.com>
2024-12-26 20:54:19 +08:00
7d5e8a13bb [enhance](mtmv)When drop MTMV, no longer wait for task cancel to complete (#45995) (#46025)
pick: https://github.com/apache/doris/pull/45995
2024-12-26 18:52:14 +08:00
7addefbfe8 branch-2.1: [fix](mem leak) fe non_heap mem leak while use jdbc catalog #45806 (#45980)
Cherry-picked from #45806

Co-authored-by: camby <cambyzhu@tencent.com>
2024-12-26 15:05:28 +08:00
1396f5a950 [2.1][improvement](jdbc catalog) Optimize JdbcCatalog case mapping stability (#43256)
cherry-pick #41510
2024-12-26 14:57:56 +08:00
289d621faa [improvement](information_schema)Show view definition in information_schema.views. (#45857) (#45930)
backport: https://github.com/apache/doris/pull/45857
2024-12-26 10:11:13 +08:00
a65adcaa49 branch-2.1: [fix](Outfile) optimize the error message of SELECT INTO OUTFILE #45859 (#45951)
Cherry-picked from #45859

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
2024-12-25 23:10:43 +08:00
bccfb04436 branch-2.1: [fix](parser) Syntax error for add partition with null null #45865 (#45913)
Cherry-picked from #45865

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2024-12-25 22:15:20 +08:00
a3ec8621a4 branch-2.1: [improvement](log)Reduce stats log. #45900 (#45916)
Cherry-picked from #45900

Co-authored-by: James <lijibing@selectdb.com>
2024-12-25 16:35:08 +08:00
fdb65197e7 [feat](mtmv)mtmv support paimon partition refresh(#43959,#44911) (#45878)
pick: #44911 #43959

only pick code about paimon, not pick some code about MTMV REFRESH
2024-12-25 12:08:27 +08:00
6c2107788c [fix](nereids) support one phase DeferMaterializeTopN #45693-branch-2.1 (#45845) 2024-12-25 12:00:58 +08:00
6d6473efae branch-2.1: [fix](tabletScheduler) Fix addTablet dead lock in tabletScheduler #45298 (#45769)
Cherry-picked from #45298

Co-authored-by: deardeng <dengxin@selectdb.com>
2024-12-24 21:44:30 +08:00
1314a2b942 branch-2.1: [test](nereids) add test simplify comparison predicate #44886 (#45804)
cherry pick from #44886
2024-12-24 21:43:15 +08:00
f0031d9954 [cherry-pick](branch-21)support posexplode table function (#43221) (#45783)
cherry-pick from master #43221
2024-12-24 21:42:30 +08:00
2bfc72e173 [fix](nereids) fix illegal import of guava's Throwables (#45876)
fix illegal import of guava's Throwables
2024-12-24 21:36:52 +08:00
0a64cea3bf [fix](mtmv) Fix mv is deleted in nested mv causing query err and fix some test (#45744) (#45862)
pr: 
https://github.com/apache/doris/pull/45744

commitId: 067643df
2024-12-24 20:03:24 +08:00
956138da5c [enhancement](blacklist) ignore shutdown message to avoid add the backend to blacklist (#45875)
### What problem does this PR solve?

1. If one request failed to send fragment to BE then it will call
removeProxy;
2. removeProxy will call shutdown and shutdown will cancel all requests
related with this client.
3. Other request will get exception when receive data from be and will
add this be to blacklist.

Should avoid this scenario.

None
2024-12-24 19:03:51 +08:00
8b35b0e477 branch-2.1: [fix](function) fixed some nested type func's param type which is not suitable and make result wrong #44923 (#45798)
Cherry-picked from #44923
2024-12-24 14:57:33 +08:00
69704df447 [enhancement](blacklist) print the detail stack that the client is shutdown (#45850) 2024-12-24 14:52:58 +08:00
4514652aa2 [fix](profile) Fix clean profile (#45838)
### What problem does this PR solve?
Clean all profile command does not clean runtime profile. Makes runtime
profile leak, and memory can not be released.

Problem Summary:

![img_v3_02hs_62c4ed81-fe1f-423f-ba92-a1762af5162g](https://github.com/user-attachments/assets/4cec62a5-9077-4e36-91a8-29e5fedd4560)
After clean all profile, summary profile is clear, but runtime profile
and counter still exists.

![img_v3_02hs_4de10ca2-b878-4722-9b6e-9738270e6a8g](https://github.com/user-attachments/assets/b30754f2-a401-4127-aa5f-ed053d9f5c75)

After fix:

![img_v3_02hs_750960cf-9ebd-41e1-8f13-b41e5bc094dg](https://github.com/user-attachments/assets/5a5edb0b-bd7d-439e-92c2-0ed69589a7b5)

![img_v3_02hs_7e111a74-bacb-43e0-8acb-ec406ce68d8g](https://github.com/user-attachments/assets/556af476-7ea0-4924-880e-183f2cf9e870)
2024-12-24 14:25:03 +08:00
536ca0bfe6 [fix](auditlog)Fix auditlog NPE (#45772) (#45808)
backport: https://github.com/apache/doris/pull/45772
2024-12-23 21:22:41 +08:00
3de3c6ff44 [fix](group commit) fix group commit session (#45800)
if connect to observer, enable group commit and do insert overwrite,
will get:
```
ERROR 1105 (HY000): errCode = 2, detailMessage = errCode = 2, detailMessage = Nereids does not support group commit insert
```
2024-12-23 19:09:54 +08:00
901b93264c branch-2.1: [opt](log) add more info in nereids timeout log #45705 (#45793)
cherry-pick #45705
2024-12-23 17:57:38 +08:00
6454ee6589 branch-2.1: [Fix](ccr) Incorrectly generated sql with NONE aggregate type #45452 (#45489)
Cherry-picked from #45452

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2024-12-23 16:48:29 +08:00
412355b749 branch-2.1: [fix](nereids) fix comparison with date like #45735 (#45781)
Cherry-picked from #45735

Co-authored-by: yujun <yujun@selectdb.com>
2024-12-23 15:21:08 +08:00
3006eea5cc branch-2.1: [Improve](Variant) pick random backend as coordinator #45754 (#45771)
Cherry-picked from #45754

Co-authored-by: lihangyu <lihangyu@selectdb.com>
2024-12-23 14:02:18 +08:00
fe3632aa02 branch-2.1: [Fix](ccr) Wrong result of tosql for add column with comment #45319 (#45727)
pick: https://github.com/apache/doris/pull/45319
2024-12-23 11:20:05 +08:00
b845813e6f [opt](fs)add local file support for 2.1 (#45632) (#45702)
bp: #45632
2024-12-23 10:25:34 +08:00
4a7e2911c7 branch-2.1: [fix](catelog) Unifies partition items string #45669 (#45700)
Cherry-picked from #45669

---------

Co-authored-by: walter <maochuan@selectdb.com>
2024-12-23 10:04:33 +08:00
ca9f0ade25 [Fix](ShortCircuit) fix prepared statement with partial arguments prepared (#45371) (#45732)
(#45371)
2024-12-23 10:03:34 +08:00
608000b8ce branch-2.1: [enhance](mtmv)Change the way to verify the existence of partition names when refreshing MTMV #45290 (#45725)
Cherry-picked from #45290

Co-authored-by: zhangdong <zhangdong@selectdb.com>
2024-12-23 10:01:02 +08:00
35bdd0019e branch-2.1: [fix](routine load) make routine load delay eof schedule work #45528 (#45724)
Cherry-picked from #45528

Co-authored-by: hui lai <laihui@selectdb.com>
2024-12-23 09:59:03 +08:00
b612468ec8 branch-2.1: [fix](hudi) remove session variable field in HudiScanNode #45762 (#45764)
cherry-pick #45762
2024-12-22 21:45:59 +08:00
303557ac70 [fix](hive)fix hive insert only translaction table. (#45753)
### What problem does this PR solve?
bp #44001 , but no hive4 acid table.

Problem Summary:
1. Fixed the issue that when reading insert translaction only tables,
there was no acid check, which caused multiple data reads (i.e., reading
data from the previous base_n).
2. Forbidden to create, insert data, and delete aicd tables.
2024-12-22 21:23:21 +08:00