00a5718541
[fix](test) fix test typo ( #37741 )
2024-07-13 20:00:56 +08:00
5162789234
[Refactor](Variant) make many insterfaces exception safe ( #37640 ) ( #37719 )
2024-07-13 16:52:10 +08:00
8930df3b31
[Feature](iceberg-writer) Implements iceberg partition transform. ( #37692 )
...
## Proposed changes
Cherry-pick iceberg partition transform functionality. #36289 #36889
---------
Co-authored-by: kang <35803862+ghkang98@users.noreply.github.com >
Co-authored-by: lik40 <lik40@chinatelecom.cn >
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mingyu Chen <morningman@163.com >
2024-07-13 16:07:50 +08:00
56a207c3f0
[case](paimon/iceberg)move cases from p2 to p0 ( #37276 ) ( #37738 )
...
bp #37276
Co-authored-by: wuwenchi <wuwenchihdu@hotmail.com >
2024-07-13 10:01:05 +08:00
d91376cd52
[bugfix](paimon)adding dependencies for clang #37512 ( #37737 )
...
cherry pick from #37512
Co-authored-by: wuwenchi <wuwenchihdu@hotmail.com >
2024-07-13 09:59:35 +08:00
7887f51e9b
[fix](partial update) fix a mem leak issue ( #37706 ) ( #37730 )
...
cherry-pick #37706
2024-07-13 09:20:01 +08:00
20758576b2
[fix](split) remove retry when fetch split batch failed ( #37637 )
...
bp: #37636
2024-07-12 22:46:03 +08:00
019cd9b4ec
[fix](hudi) return empty if there is no commit implemented ( #37703 )
...
bp: #37702
2024-07-12 22:44:58 +08:00
f2556ba182
[feature](insert)support external hive truncate table DDL ( #37659 )
...
pick: #36801
2024-07-12 22:37:47 +08:00
326b40cde2
[branch-2.1](memory) Add HTTP API to clear data cache ( #37704 )
...
pick #36599
Co-authored-by: Gabriel <gabrielleebuaa@gmail.com >
2024-07-12 17:21:52 +08:00
a61030215e
[branch-2.1](memory) Support make all memory snapshots ( #37705 )
...
pick #36679
2024-07-12 16:21:37 +08:00
ab8204b33b
[fix](regression) fix multi replica case not executed ( #37425 ) ( #37698 )
...
cherry-pick #37425
2024-07-12 15:53:20 +08:00
035027f831
[fix](query cancel) Fix query is cancelled when it comes from follower FE #37662 ( #37707 )
...
cherry pick from #37662
2024-07-12 15:50:45 +08:00
259d28407e
[improvement](statistics)Enable estimate hive table row count using file size. ( #37218 ) ( #37694 )
...
backport: https://github.com/apache/doris/pull/37218
2024-07-12 13:47:27 +08:00
37583d2d0a
[test](statistics)Add test case for set global variables. ( #37582 ) ( #37691 )
...
backport: https://github.com/apache/doris/pull/37582
2024-07-12 13:46:53 +08:00
ef031c5fb2
[branch-2.1](memory) Fix reserve memory compatible with memory GC and logging ( #37682 )
...
pick
#36307
#36412
2024-07-12 11:43:26 +08:00
ffa9e49bc7
[feature](mtmv) pick some mtmv pr from master ( #37651 )
...
cherry-pick from master
pr: #36318
commitId: c1999479
pr: #36111
commitId: 35ebef62
pr: #36175
commitId: 4c8e66b4
pr: #36414
commitId: 5e009b5a
pr: #36770
commitId: 19e2126c
pr: #36567
commitId: 3da83514
2024-07-12 10:35:54 +08:00
6214d6421f
[Fix](planner) fix bug of char(255) toSql ( #37340 ) ( #37671 )
...
cherry-pick #37340 from master
2024-07-12 10:33:24 +08:00
4dc933bb28
[cherry-pick] (branch-2.1) fix query errors caused by ignore_above ( #37685 )
...
## Proposed changes
pick from master #37679
2024-07-12 09:31:45 +08:00
87912de93f
[fix](scan) catch exceptions thrown in scanner ( #36101 ) ( #37408 )
...
## Proposed changes
pick #36101
The uncaught exceptions thrown in the scanner will cause the BE to
crash.
2024-07-12 08:49:39 +08:00
79a208259e
[cherry-pick] (branch-2.1) Remove the check for inverted index file exists #36945 ( #37423 )
2024-07-11 21:35:52 +08:00
217eac790b
[pick](Variant) pick some refactor and fix #34925 #36317 #36201 #36793 ( #37526 )
2024-07-11 21:25:34 +08:00
cf2fb6945a
[branch-2.1](memory) Refactor LRU cache policy memory tracking ( #37658 )
...
pick
#36235
#35965
2024-07-11 21:04:01 +08:00
62e0230523
[branch-2.1](memory) Add ThreadMemTrackerMgr BE UT ( #37654 )
...
## Proposed changes
pick #35518
2024-07-11 21:03:49 +08:00
fed632bf4a
[fix](move-memtable) check segment num when closing each tablet ( #36753 ) ( #37536 )
...
cherry-pick #36753 and #37660
2024-07-11 20:33:44 +08:00
fdf21ec251
[fix](readconsistency) avoid table not exist error ( #37593 ) ( #37641 )
...
Query following createting table would throw table not exist error.
For example.
t1: client issue create table to master fe
t2: client issue query sql to observer fe, the query would fail due to
not exist table in plan phase.
t3: observer fe receive editlog creating the table from the master fe
After the pr:
query at t2 would wait until latest edit log is received from master fe
in the observer fe.
pick #37593
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-11 18:57:53 +08:00
cee3cf8499
[fix](statistics)Fix column cached stats size bug. ( #37545 ) ( #37667 )
...
backport: https://github.com/apache/doris/pull/37545
2024-07-11 18:53:12 +08:00
d7cae940d2
[fix](test) fix case conflict between test_tvf_based_broker_load and test_broker_load #37622 ( #37631 )
...
cherry pick from #37622
2024-07-11 17:52:21 +08:00
8a0d940914
[fix](publish) Pick Fix publish failed because because task is null ( #37546 )
...
## Proposed changes
Pick https://github.com/apache/doris/pull/37531
This pr catch the exception to make the failed txn does not block the
other txns.
2024-07-11 15:22:04 +08:00
39ded1f649
[branch-2.1][improvement](jdbc catalog) Change JdbcExecutor's error reporting from UDF to JDBC ( #37635 )
...
pick (#35692 )
In the initial version, JdbcExecutor directly used UdfRuntimeException,
which could lead to misunderstanding of the exception. Therefore, I
created a separate Exception for JdbcExecutor to help us view the
exception more clearly.
2024-07-11 15:11:41 +08:00
ef754487d9
[branch-2.1][improvement](jdbc catalog) Catch AbstractMethodError in getColumnValue Method and Suggest Updating to ojdbc8+ ( #37634 )
...
pick (#37608 )
Catch AbstractMethodError in getColumnValue method. Provide a clear
error message suggesting the use of ojdbc8 or higher versions to avoid
compatibility issues.
2024-07-11 15:10:47 +08:00
e66ffc1b6d
[branch-2.1](arrow-flight-sql) Fix pipelineX Unknown result sink type ( #37540 )
...
pick ##35804
2024-07-11 12:30:46 +08:00
1eb04cf538
[feature](mtmv) Support query rewrite by materialized view when query is aggregate and materialized view has no aggregate ( #36278 ) ( #37497 )
...
cherry-pick from master
pr: #36278
commitId: 649f9bc6
2024-07-11 10:54:50 +08:00
e6b8ebc847
[Fix](Short Circuit) fix no project list in OlapScanNode ( #37121 ) ( #37504 )
...
pick from #37121
2024-07-11 10:04:28 +08:00
e1cb568d11
[Optimize] Add session variable `max_fetch_remote_schema_tablet_count… ( #37505 )
...
pick from #37217
2024-07-11 10:04:20 +08:00
9f4e7346fb
[fix](compaction) fixing the inaccurate statistics of concurrent compaction tasks ( #37318 ) ( #37496 )
2024-07-10 22:23:25 +08:00
741807bb22
[performance](move-memtable) only call _select_streams when necessary ( #35576 ) ( #37406 )
...
cherry-pick #35576
2024-07-10 22:20:23 +08:00
f58032f1da
[fix](dynamic partition) drop partition exclude history_partition_num #37539 ( #37570 )
...
cherry pick from #37539
---------
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com >
2024-07-10 22:09:00 +08:00
a54ba2ea63
[fix](partition) Fix test partition regression case unstabitily #37439 ( #37583 )
...
cherry pick from #37439
2024-07-10 22:08:15 +08:00
3d4ec81eeb
[fix](regression test) fix unstable test_alter_colocate_group #37544 ( #37609 )
...
cherry-pick: #37544
2024-07-10 21:51:46 +08:00
0a95757a4d
[opt](test) Optimize execution time of test_s3_load case #37562 ( #37612 )
...
cherry pick from #37562
2024-07-10 19:09:46 +08:00
a7416f6ff9
[fix](dump) do not report success if dumping fails ( #37510 )
...
## Proposed changes
pick https://github.com/apache/doris/pull/37508
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-10 16:26:14 +08:00
afcc6170f6
[fix](txn_manager) Add ingested rowsets to unused rowsets when removing txn ( #37417 )
...
Generally speaking, as long as a rowset has a version, it can be
considered not to be in a pending state. However, if the rowset was
created through ingesting binlogs, it will have a version but should
still be considered in a pending state because the ingesting txn has not
yet been committed.
This PR updates the condition for determining the pending state. If a
rowset is COMMITTED, the txn should be allowed to roll back even if a
version exists.
Cherry-pick #36551
2024-07-10 14:25:44 +08:00
f65d1c4011
[chore](ci) rm repeat function name ( #37579 )
...
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-10 11:44:32 +08:00
0cdb371624
[branch-2.1](memory) Disable Arrow Jemalloc step 2 ( #37556 )
...
pick #37533
2024-07-10 11:34:18 +08:00
a4aaace481
[Fix](branch-2.1) Fix partial update regression test ( #37560 )
...
Version 2.1 does not support partial update for variant type data, so we
delete this case.
2024-07-10 10:44:24 +08:00
87cd366636
[chore](dependencies)Remove Unnecessary Dependencies ( #37469 ) ( #37555 )
...
bp #37469
2024-07-10 09:33:43 +08:00
770e7d21a4
[dependencies](fe)upgrade paimon to 0.8.1 ( #37205 ) ( #37554 )
...
bp #37205
2024-07-10 09:32:33 +08:00
27283b2915
[branch-2.1](memory) Disable Arrow Jemalloc ( #37529 )
...
pick ##37528
2024-07-09 23:48:27 +08:00
90757a9283
[test](auth)add upgrade and downgrade compatibility test case ( #37523 )
...
## Proposed changes
[test](auth)add upgrade and downgrade compatibility test case
2024-07-09 21:13:54 +08:00
