fa3d6f0ffd
[feat](binlog) Add replace table binlog #44263 ( #44589 )
...
cherry pick from #44263
Co-authored-by: Dongyang Li <lidongyang@selectdb.com >
2024-11-26 17:38:17 +08:00
bdca9cce3e
[branch-2.1]add internal workload group ( #42006 ) ( #44592 )
...
Add an internal workload group when Doris started, currently it mainly
used to manage compaction workload cpu usage.
pick #42006
2024-11-26 17:09:55 +08:00
e9f4615ddc
branch-2.1: [Bug](function)window funnel function should support datetimev2 type get scale info #44420 ( #44524 )
...
Cherry-picked from #44420
Co-authored-by: zhangstar333 <zhangsida@selectdb.com >
2024-11-26 12:24:30 +08:00
550aa9c3ae
[cherry-pick](branch-2.1) Pick "[Fix](full compaction) Full compaction should not do ordered data compaction ( #44359 )" ( #44529 )
2024-11-26 12:21:30 +08:00
07c81a6362
branch-2.1: [fix](nereids)lag and lead function's nullability is wrong #44050 ( #44558 )
...
Cherry-picked from #44050
Co-authored-by: starocean999 <lichi@selectdb.com >
2024-11-26 12:19:11 +08:00
cf2ee23e68
Revert "[fix] (compaction) fix compaction score in time series policy ( #40242 )" ( #44527 )
...
revert #40242
2024-11-26 12:18:59 +08:00
37f4bf865f
branch-2.1: [fix](mtmv)When compatibility fails, null pointers should not be reported #44464 ( #44542 )
...
Cherry-picked from #44464
Co-authored-by: zhangdong <zhangdong@selectdb.com >
2024-11-26 11:59:29 +08:00
b1393150a4
[opt] (binlog) Support Modify ViewDef binlog #41167 ( #44519 )
...
cherry pick from #41167
---------
Co-authored-by: yanmingfu <133083714+xiaoming12306@users.noreply.github.com >
Co-authored-by: yanmingfu <yanmingfu@baidu.com >
2024-11-26 10:34:12 +08:00
5eb433e7aa
[branch-2.1] pick some pr from master ( #44556 )
...
pick #40468 #40535 #40763 #40855
2024-11-25 20:43:07 +08:00
c720e59763
branch-2.1: [fix](readme) remove contributor graph and change to contributor wall #44534 ( #44536 )
...
Cherry-picked from #44534
Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com >
2024-11-25 14:37:50 +08:00
9e0ece2452
branch-2.1: [enhance](mtmv)MTMV no longer generate cache when replaying logs #44283 ( #44308 )
...
Cherry-picked from #44283
Co-authored-by: zhangdong <zhangdong@selectdb.com >
2024-11-25 11:06:07 +08:00
766f964f74
[branch-2.1](cases) Make auto&dynamic cases sleep long enough ( #44228 ) ( #44477 )
...
pick https://github.com/apache/doris/pull/44228
2024-11-25 11:05:14 +08:00
a233343fe3
branch-2.1: [fix](jvm)fix jvm metrics memory leak. #44311 ( #44399 )
...
Cherry-picked from #44311
Co-authored-by: daidai <changyuwei@selectdb.com >
2024-11-23 03:30:28 +08:00
6678088767
[cherry-pick](branch-21) reuse the join block to reduce malloc memory ( #43738 ) ( #44349 )
...
cherry-pick from master https://github.com/apache/doris/pull/43738/
2024-11-23 03:29:52 +08:00
5e9bda678c
Pick some pr to branch 21 #42279 #44164 ( #44369 )
2024-11-23 03:28:38 +08:00
92a0919e9c
branch-2.1: [Bug](function)fix json_object function check null nums error as return bool #44321 ( #44381 )
...
Cherry-picked from #44321
Co-authored-by: zhangstar333 <zhangsida@selectdb.com >
2024-11-22 23:51:33 +08:00
28d7e9f357
branch-2.1: [fix](config) fe config sync_image_timeout_second should not be masterOnly #43954 ( #44384 )
...
Cherry-picked from #43954
Co-authored-by: nsn_huang <38585669+nsnhuang@users.noreply.github.com >
Co-authored-by: huangwenbo04 <huangwenbo04@meituan.com >
2024-11-22 23:14:45 +08:00
d21940ee1c
branch-2.1: [fix](move-memtable) immediately return error when close wait failed #44344 ( #44387 )
...
Cherry-picked from #44344
Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com >
2024-11-22 22:56:51 +08:00
e7095cea0b
branch-2.1: [improvement](jdbc catalog) Optimize JDBC driver property settings #42923 ( #44405 )
...
Cherry-picked from #42923
Co-authored-by: zy-kkk <zhongyongkang@selectdb.com >
2024-11-22 22:53:35 +08:00
dceaf97381
branch-2.1: [enhance](orc) Optimize ORC Predicate Pushdown for OR-connected Predicate #43255 ( #44438 )
...
Cherry-picked from #43255
Co-authored-by: Socrates <suyiteng@selectdb.com >
2024-11-22 22:52:53 +08:00
964b40ae1c
[fix](bloom filter)Fix drop column with bloom filter index ( #44361 ) ( #44478 )
...
pick #44361
2024-11-22 22:50:01 +08:00
090a2a48a1
branch-2.1: [Fix](Job)The INSERT execution failed, but the task record status is marked as successful. #44292 ( #44443 )
...
Cherry-picked from #44292
Co-authored-by: Calvin Kirs <guoqiang@selectdb.com >
2024-11-22 22:49:28 +08:00
c1a2aabd5a
[fix](regression) Fix the issue of duplicate names of HDFS resource ( #44441 )
2024-11-22 22:49:04 +08:00
3b2650c26d
[fix-2.1](auto-partition) Fix unintended partition creation when insert overwrite auto detect for auto partition table ( #44449 )
2024-11-22 22:46:40 +08:00
33389ce691
branch-2.1: [enhance](regression-test) fix hudi incremental query bug and add hudi p2 cases #44003 ( #44460 )
...
Cherry-picked from #44003
Co-authored-by: Socrates <suyiteng@selectdb.com >
2024-11-22 22:42:59 +08:00
ec068049c7
branch-2.1: [fix](meta-cache) fix refreshOnlyCatalogCache when use_meta_cache = false #44363 ( #44461 )
...
Cherry-picked from #44363
Co-authored-by: Socrates <suyiteng@selectdb.com >
2024-11-22 22:41:10 +08:00
6af6d4a5ef
branch-2.1: [refactor](regression) Re-arrange cases for data-partitioning doc ( #44248 )
...
pick https://github.com/apache/doris/pull/43373
2024-11-22 19:49:07 +08:00
7d123edcf8
[fix](filesystem)Use simple authentication directly in S3FileSystem for 2.1 ( #43636 ) ( #44238 )
...
bp: #43636
2024-11-22 11:45:56 +08:00
cd223327c8
[bug](auto partition)Fix insert failed because partition exprs of table is empty ( #44391 )
...
Fix insert failed because partition exprs of table is empty.
Revert PR: #43274
2024-11-22 11:16:23 +08:00
702abbff0f
[Opt](orc)Optimize the merge io when orc reader read multiple tiny stripes. ( #42004 ) ( #44239 )
...
bp #42004
Co-authored-by: kaka11chen <kaka11.chen@gmail.com >
2024-11-22 11:01:41 +08:00
75f8323f45
[opt](regression-test) move some cases to p2 to accelerate the testing speed of p0 ( #37590 ) ( #44389 )
...
pick #37590
move some cases to p2 to accelerate the testing speed of p0
2024-11-21 23:07:57 +08:00
88c258c218
[test](routine load) fix some unstable routine load cases ( #42252 ) ( #44388 )
...
pick #42252
Fix some unstable routine load case.
2024-11-21 23:07:01 +08:00
4ae4833bdc
[test](routine load) add routine load doc case ( #43230 ) ( #44382 )
...
pick #43230
Add routine load doc case.
2024-11-21 23:06:14 +08:00
346b89e683
[improve](routine load) adjust default values to make routine load more convenient to use ( #42491 ) ( #44377 )
...
pick (#42491 )
For a routine load job, it will be divided into many tasks, each of
which is a transaction. Currently, the default time
consumed(max_batch_interval) is 10 seconds. The benefits of increasing
this value are:
1. Larger batch consumption can lead to better performance.
2. Reducing the number of transactions can alleviate the pressure of
compaction and the conflicts of concurrent transaction submissions.
related doc: https://github.com/apache/doris-website/pull/1236/files
2024-11-21 23:05:11 +08:00
a258915e22
branch-2.1: [Fix](Job)Fix the Calculation of the First Trigger Time and Add a Single-Time Scheduling Compensation Logic #44268 ( #44403 )
...
Cherry-picked from #44268
Co-authored-by: Calvin Kirs <guoqiang@selectdb.com >
2024-11-21 18:24:36 +08:00
eb975f7846
[improvement](statistics)Change auto analyze max width to 300 and health threshold to 90. ( #42104 ) ( #44379 )
...
backport: https://github.com/apache/doris/pull/42104
2024-11-21 17:35:41 +08:00
936417e6f9
[cherry-pick][test](doc) add table design example in doris's doc to regression test ( #42444 ) ( #44313 )
...
(cherry picked from commit 051128f172a0e6c26109160752293d95746e29f8)
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #42444
Problem Summary:
2024-11-21 14:58:42 +08:00
fbf573f8c8
[fix](hive)fix hive catalog miss partition that have special characters. #42906 ( #44152 )
...
cherry pick from #42906
---------
Co-authored-by: daidai <2017501503@qq.com >
2024-11-21 14:11:22 +08:00
9664b50eb6
[improve](load) do not block delta writer if memtable memory is low ( #42649 ) ( #44305 )
...
backport #42649
2024-11-21 11:17:35 +08:00
3c1ac52f6a
[fix](nereids)should set isForwardedToMaster and redirectStatus to null before fallback to legacy planner ( #44332 )
...
pick from master https://github.com/apache/doris/pull/44163
2024-11-21 10:25:35 +08:00
fb163b55c2
branch-2.1: [Fix](merge-on-write) Fix MergeIndexDeleteBitmapCalculator::calculate_one() coredump #44284 ( #44330 )
...
Cherry-picked from #44284
Co-authored-by: bobhan1 <baohan@selectdb.com >
2024-11-20 21:07:43 +08:00
b63b97af25
[fix](create table) Enhance the robustness of time zone handling during table creation #41926 ( #44281 )
...
cherry pick from #41926
2024-11-20 10:37:54 +08:00
dc67086d97
[fix](scan) Avoid memory allocated by buffered_reader from being traced ( #41921 ) ( #44253 )
...
Use OwnedSlice to replace `char*` in BufferedReader
## Proposed changes
pick #41921
2024-11-20 10:37:06 +08:00
a666b5e0c9
[fix](case) Enhance the robustness of set_config_temporary_action #42306 ( #44282 )
...
cherry pick from #42306
2024-11-20 10:35:44 +08:00
e0261ffb9c
[fix](auth)Fix all priv not contain Show_view_priv ( #43605 ) ( #44289 )
...
pick: https://github.com/apache/doris/pull/43605
2024-11-20 10:33:49 +08:00
0ddf2958b3
[fix](trash) Fix clean_trash docker regression case #40925 ( #44280 )
...
cherry pick from #40925
2024-11-20 09:41:45 +08:00
1913e4e78d
branch-2.1: [fix](mtmv) Fix partition track column fail when 'select *' used in related partition side #43531 ( #43941 )
...
Cherry-picked from #43531
Co-authored-by: seawinde <wusi@selectdb.com >
2024-11-19 20:27:13 +08:00
3136fa48a6
branch-2.1: [chore](ci) adjust some invalid url #44261 ( #44270 )
...
Cherry-picked from #44261
Co-authored-by: Dongyang Li <lidongyang@selectdb.com >
2024-11-19 19:28:04 +08:00
1b1e2e8a29
branch-2.1: [fix](profile) only printed for non-sink nodes in the merge profile. #44040 ( #44252 )
...
Cherry-picked from #44040
Co-authored-by: Mryange <yanxuecheng@selectdb.com >
2024-11-19 17:34:38 +08:00
2eb66c2609
[Fix](PaimonCatalog) fix the problem that paimon catalog can not access to OSS-HDFS #42585 ( #44149 )
...
cherry pick from #42585
Co-authored-by: Tiewei Fang <43782773+BePPPower@users.noreply.github.com >
2024-11-19 17:31:42 +08:00
