Commit Graph

21646 Commits

Author SHA1 Message Date
abc535a9e7 branch-2.1: [fix](hudi) Fix Memory Leak in BitCaskDiskMap Due to Circular Reference #48955 (#49115)
Cherry-picked from #48955

Co-authored-by: Socrates <suyiteng@selectdb.com>
2025-03-21 22:44:35 +08:00
5aa715db03 branch-2.1: [fix](regression) Avoid defined global variables in backup-restore case script (#49331) 2025-03-21 20:13:07 +08:00
71824569a9 [fix](Index)Make column unique ids in index dynamically computed (#48988) (#49300)
bp #48988
2025-03-21 19:51:00 +08:00
3e894994d4 [Fix](branch-2.1) Fix unstable case "test_base_compaction" (#49349) 2025-03-21 18:06:43 +08:00
7b28e33815 [improvement](statistics)Remove read lock when doing db analyze. (#49250) (#49320)
backport: https://github.com/apache/doris/pull/49250
2025-03-21 18:04:38 +08:00
b130500203 [fix](Nereids) initcap constant folding should upper first character in all words (#49061) (#49342) 2025-03-21 18:03:28 +08:00
54b3000de5 [fix](auth)create view check select_priv of table instead of column (#49268) 2025-03-20 23:08:58 +08:00
2560a8ec56 [test](auth)add grant show_view_priv to new user (#49307) 2025-03-20 23:04:43 +08:00
ce49f37a5e branch-2.1: [fix](core) fix subreplace when inputting a large number of empty strings #49241 (#49303)
Cherry-picked from #49241

Co-authored-by: Mryange <yanxuecheng@selectdb.com>
2025-03-20 22:56:44 +08:00
3f9e989d05 branch-2.1: [fix](arrow-flight-sql) Fix fetch_arrow_flight_schema thread pool (#49291) 2025-03-20 17:07:37 +08:00
df26c6fc51 [fix](case)Fix statics case for 2.1 (#49272)
Modify the catalog name to prevent it from being deleted by other cases.

bp: #41346
2025-03-20 17:03:54 +08:00
5ecfee56b5 [cherry-pick](branch-2.1) Pick "[Fix](compaction) Fix nullptr when executing cold compaction (#48329)" (#48886) 2025-03-20 16:49:54 +08:00
7e6adcf765 branch-2.1: [chore](ci) rm unused file #48326 (#49290)
Cherry-picked from #48326

Co-authored-by: Dongyang Li <lidongyang@selectdb.com>
2025-03-20 16:48:17 +08:00
17ffd301fb [fix](mtmv) Fix collecting mv candidates when dml controlled by enable_dml_materialized_view_rewrite switch #48374 (#49263)
### What problem does this PR solve?
pr: https://github.com/apache/doris/pull/48374
commitId: 0c9ce720
2025-03-20 10:01:04 +08:00
8f79742f7d branch-2.1: [fix](arrow) Fix Arrow serialization and deserialization of Date/Datetime/Array/Map/Struct/Bitmap/HLL/Decimal256 types (#49244)
### What problem does this PR solve?

pick #48944 [fix](arrow) Fix UT DataTypeSerDeArrowTest of
Array/Map/Struct/Bitmap/HLL/Decimal256 types
pick #48398  [fix](arrow) Fix UT DataTypeSerDeArrowTest of Date type
2025-03-20 09:57:04 +08:00
f771a422a9 branch-2.1: [fix](column) fix ColumnWithTypeAndName::get_nested use-after-free when input Const(Nullable) column #48288 (#49258) 2025-03-20 09:53:20 +08:00
c67bbe77ef [test](mtmv) Fix regression test not stable and add log for debug (#48483) (#49234) 2025-03-19 17:42:00 +08:00
e4d6460b3c branch-2.1-pick: [Fix](SC) Prevent the values of __DORIS_VERSION_COL__ be wrongly replaced by fake version when merging tmp rowset in sort SC #49193 (#49222)
pick https://github.com/apache/doris/pull/49193
2025-03-19 17:33:25 +08:00
3b61f840f4 [fix](function) Undefined behavior in parse_url (#49149) (#49226) 2025-03-19 17:32:47 +08:00
cc41d61eec [fix](nereids)Fix dlog1, trim, extract_url_parameter and parse_url FE constant calculate bug. (#49074) (#49224)
backport: https://github.com/apache/doris/pull/49074
2025-03-19 10:05:01 +08:00
a32a7ba5eb branch-2.1: [fix](Nereids) deep copy for LogicalWindow is wrong #48861 (#49014)
Cherry-picked from #48861

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2025-03-19 09:57:15 +08:00
13c174df4b branch-2.1: [fix](Nereids) fix substring with only one parameter #48957 (#49030)
Cherry-picked from #48957

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
2025-03-19 09:56:13 +08:00
1822120c13 branch-2.1: [fix](multi table load) error URL does not depend on the value of _number_filtered_rows #49111 (#49131)
Cherry-picked from #49111

Co-authored-by: hui lai <laihui@selectdb.com>
2025-03-19 09:54:36 +08:00
Pxl
7355cfe8b6 [Chore](runtime-filter) remove wrong check and set disable when SyncSizeClosure meet eof status (#49186) 2025-03-18 18:16:51 +08:00
44b868de6b branch-2.1: [fix](nereids) fix to_monday('1970-01-04 23:59:59') #49153 (#49176)
Cherry-picked from #49153

Co-authored-by: yujun <yujun@selectdb.com>
2025-03-18 18:07:26 +08:00
6430ff365d [Bug](partition) should not do reset for the partition_sorts (#49148)
### What problem does this PR solve?
Problem Summary:

the partition_sorts is unique_ptr,could release after destroy.
and when some extreme case like cancel, if source reset the sorter
early, the sink operator will coredump still use it.
2025-03-18 18:03:29 +08:00
16e348b189 [fix](array/map) Fix BE crash in lambda functions (#49139) 2025-03-18 11:51:38 +08:00
bd5d0ca741 branch-2.1: [fix](Nereids) fold str_to_date to wrong result when parameter out of range #49033 (#49150) 2025-03-18 11:01:49 +08:00
68f50b569b branch-2.1: [fix](group commit)Fix replay wal fail problem on agg state type #49081 (#49143)
Cherry-picked from #49081

Co-authored-by: huanghaibin <huanghaibin@selectdb.com>
2025-03-18 10:57:20 +08:00
98a59f914a branch-2.1: [chore](binlog) GetMeta returns dropped partition/table/index commit seq #48852 (#48900)
Cherry-picked from #48852

Co-authored-by: walter <maochuan@selectdb.com>
2025-03-17 14:03:09 +08:00
cf88db4938 branch-2.1: [improvement](ccr) Add and adjust result for get_lag #48953 (#49055)
Cherry-picked from #48953

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
2025-03-17 10:50:07 +08:00
e7d4dda3c8 branch-2.1: [Fix](function) Fix wrong FE fold constant implementation of function date_format #49032 (#49086)
Cherry-picked from #49032

Co-authored-by: zclllyybb <zhaochangle@selectdb.com>
2025-03-16 20:16:40 +08:00
be3e2f36d0 branch-2.1: [fix](nereids)fix the cascadesContext.getMemo()==null #48771 (#49095)
Cherry-picked from #48771

Co-authored-by: zhangm365 <mzhang2048@gmail.com>
2025-03-15 12:20:02 +08:00
afb143c1e8 [improve](binlog) Add config to control whether enable persistent connection during ingesting (#49005)
Cherry-pick #48467, #48761
2025-03-15 10:45:53 +08:00
1eff4538aa branch-2.1: [fix](nereids) fix convert to date literal throw exception #48980 (#48985) 2025-03-15 10:44:40 +08:00
3b70606c4f [improvement](statistics)Improve analyze partition column and key column corner case. (#48757) (#49101)
backport: https://github.com/apache/doris/pull/48757
2025-03-15 10:23:36 +08:00
8589db3ec3 Revert "branch-2.1: [fix](nereids) fix distinct window compute wrong result (#48987) (#49010)" (#49079)
Revert "branch-2.1: [fix](nereids) fix distinct window compute wrong
result (#48987) (#49010)"
2025-03-15 00:02:10 +08:00
d0f6edd212 branch-2.1: [improvement](statistics)Add session variable for partition sample count. #48218 (#49092)
Cherry-picked from #48218

Co-authored-by: James <lijibing@selectdb.com>
2025-03-14 20:43:00 +08:00
ed3a979904 [feature](statistics)Support enable/disable auto analyze for table. (#39532) (#48863)
backport: https://github.com/apache/doris/pull/39532
2025-03-14 17:43:13 +08:00
e5a2b0eea8 Revert "[cherry-pick](jsonb) add a check for jsonb value to avoid invalid jsonb value write into segment file " (#49058)
Reverts apache/doris#48729
temp revert this pr for
PartialUpdateInfo::_generate_default_values_for_missing_cids using empty
string , which will make this check fail.
2025-03-14 17:41:06 +08:00
b5c85e0962 branch-2.1: [fix](hudi) replace non thread safe SimpleDateFormat #48923 (#49022)
Cherry-picked from #48923

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
2025-03-14 17:31:04 +08:00
5988495576 [fix](statistics)Control memory use for sample partition column and key column. (#46534) (#48927)
backport: https://github.com/apache/doris/pull/46534
2025-03-14 17:18:19 +08:00
ad6cf63a28 branch-2.1: [opt](inverted index) uniform profile naming convention #48826 (#48975)
Cherry-picked from #48826

Co-authored-by: zzzxl <yangsiyu@selectdb.com>
2025-03-14 14:04:46 +08:00
79595ad62f [fix](minor) Reorder incorrect logging (#49001) 2025-03-14 12:03:34 +08:00
c989ac9467 branch-2.1: [chore](binlog) add ingesting/downloading binlog latency metrics #48599 (#49002)
cherry pick from #48599
2025-03-14 11:22:23 +08:00
2febf0de1b branch-2.1: [fix](udf) alias udf skip check enable_java_udf #48843 (#48914) 2025-03-14 11:21:01 +08:00
7d521ce288 branch-2.1: [fix](binlog) avoid adding acqurie_md5 param when enable_download_md5… #48573 (#49004)
cherry pick from #48573
2025-03-14 11:18:51 +08:00
7123bbfecb branch-2.1: [fix](nereids) fix distinct window compute wrong result (#48987) (#49010)
cherry pick from #48987
2025-03-14 10:38:16 +08:00
ed2e1ac34a branch-2.1: [fix](variant) update least common type in ColumnObject::pop_back #48935 (#48979)
Cherry-picked from #48935

Co-authored-by: Sun Chenyang <sunchenyang@selectdb.com>
2025-03-13 17:41:17 +08:00
6d2abf9df3 branch-2.1: [Improvement]Add query start datetime #48906 (#48992)
Cherry-picked from #48906

Co-authored-by: wangbo <wangbo@selectdb.com>
2025-03-13 17:40:25 +08:00