ef031c5fb2
[branch-2.1](memory) Fix reserve memory compatible with memory GC and logging ( #37682 )
...
pick
#36307
#36412
2024-07-12 11:43:26 +08:00
ffa9e49bc7
[feature](mtmv) pick some mtmv pr from master ( #37651 )
...
cherry-pick from master
pr: #36318
commitId: c1999479
pr: #36111
commitId: 35ebef62
pr: #36175
commitId: 4c8e66b4
pr: #36414
commitId: 5e009b5a
pr: #36770
commitId: 19e2126c
pr: #36567
commitId: 3da83514
2024-07-12 10:35:54 +08:00
6214d6421f
[Fix](planner) fix bug of char(255) toSql ( #37340 ) ( #37671 )
...
cherry-pick #37340 from master
2024-07-12 10:33:24 +08:00
4dc933bb28
[cherry-pick] (branch-2.1) fix query errors caused by ignore_above ( #37685 )
...
## Proposed changes
pick from master #37679
2024-07-12 09:31:45 +08:00
87912de93f
[fix](scan) catch exceptions thrown in scanner ( #36101 ) ( #37408 )
...
## Proposed changes
pick #36101
The uncaught exceptions thrown in the scanner will cause the BE to
crash.
2024-07-12 08:49:39 +08:00
79a208259e
[cherry-pick] (branch-2.1) Remove the check for inverted index file exists #36945 ( #37423 )
2024-07-11 21:35:52 +08:00
217eac790b
[pick](Variant) pick some refactor and fix #34925 #36317 #36201 #36793 ( #37526 )
2024-07-11 21:25:34 +08:00
cf2fb6945a
[branch-2.1](memory) Refactor LRU cache policy memory tracking ( #37658 )
...
pick
#36235
#35965
2024-07-11 21:04:01 +08:00
62e0230523
[branch-2.1](memory) Add ThreadMemTrackerMgr BE UT ( #37654 )
...
## Proposed changes
pick #35518
2024-07-11 21:03:49 +08:00
fed632bf4a
[fix](move-memtable) check segment num when closing each tablet ( #36753 ) ( #37536 )
...
cherry-pick #36753 and #37660
2024-07-11 20:33:44 +08:00
fdf21ec251
[fix](readconsistency) avoid table not exist error ( #37593 ) ( #37641 )
...
Query following createting table would throw table not exist error.
For example.
t1: client issue create table to master fe
t2: client issue query sql to observer fe, the query would fail due to
not exist table in plan phase.
t3: observer fe receive editlog creating the table from the master fe
After the pr:
query at t2 would wait until latest edit log is received from master fe
in the observer fe.
pick #37593
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-11 18:57:53 +08:00
cee3cf8499
[fix](statistics)Fix column cached stats size bug. ( #37545 ) ( #37667 )
...
backport: https://github.com/apache/doris/pull/37545
2024-07-11 18:53:12 +08:00
d7cae940d2
[fix](test) fix case conflict between test_tvf_based_broker_load and test_broker_load #37622 ( #37631 )
...
cherry pick from #37622
2024-07-11 17:52:21 +08:00
8a0d940914
[fix](publish) Pick Fix publish failed because because task is null ( #37546 )
...
## Proposed changes
Pick https://github.com/apache/doris/pull/37531
This pr catch the exception to make the failed txn does not block the
other txns.
2024-07-11 15:22:04 +08:00
39ded1f649
[branch-2.1][improvement](jdbc catalog) Change JdbcExecutor's error reporting from UDF to JDBC ( #37635 )
...
pick (#35692 )
In the initial version, JdbcExecutor directly used UdfRuntimeException,
which could lead to misunderstanding of the exception. Therefore, I
created a separate Exception for JdbcExecutor to help us view the
exception more clearly.
2024-07-11 15:11:41 +08:00
ef754487d9
[branch-2.1][improvement](jdbc catalog) Catch AbstractMethodError in getColumnValue Method and Suggest Updating to ojdbc8+ ( #37634 )
...
pick (#37608 )
Catch AbstractMethodError in getColumnValue method. Provide a clear
error message suggesting the use of ojdbc8 or higher versions to avoid
compatibility issues.
2024-07-11 15:10:47 +08:00
e66ffc1b6d
[branch-2.1](arrow-flight-sql) Fix pipelineX Unknown result sink type ( #37540 )
...
pick ##35804
2024-07-11 12:30:46 +08:00
1eb04cf538
[feature](mtmv) Support query rewrite by materialized view when query is aggregate and materialized view has no aggregate ( #36278 ) ( #37497 )
...
cherry-pick from master
pr: #36278
commitId: 649f9bc6
2024-07-11 10:54:50 +08:00
e6b8ebc847
[Fix](Short Circuit) fix no project list in OlapScanNode ( #37121 ) ( #37504 )
...
pick from #37121
2024-07-11 10:04:28 +08:00
e1cb568d11
[Optimize] Add session variable `max_fetch_remote_schema_tablet_count… ( #37505 )
...
pick from #37217
2024-07-11 10:04:20 +08:00
9f4e7346fb
[fix](compaction) fixing the inaccurate statistics of concurrent compaction tasks ( #37318 ) ( #37496 )
2024-07-10 22:23:25 +08:00
741807bb22
[performance](move-memtable) only call _select_streams when necessary ( #35576 ) ( #37406 )
...
cherry-pick #35576
2024-07-10 22:20:23 +08:00
f58032f1da
[fix](dynamic partition) drop partition exclude history_partition_num #37539 ( #37570 )
...
cherry pick from #37539
---------
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com >
2024-07-10 22:09:00 +08:00
a54ba2ea63
[fix](partition) Fix test partition regression case unstabitily #37439 ( #37583 )
...
cherry pick from #37439
2024-07-10 22:08:15 +08:00
3d4ec81eeb
[fix](regression test) fix unstable test_alter_colocate_group #37544 ( #37609 )
...
cherry-pick: #37544
2024-07-10 21:51:46 +08:00
0a95757a4d
[opt](test) Optimize execution time of test_s3_load case #37562 ( #37612 )
...
cherry pick from #37562
2024-07-10 19:09:46 +08:00
a7416f6ff9
[fix](dump) do not report success if dumping fails ( #37510 )
...
## Proposed changes
pick https://github.com/apache/doris/pull/37508
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-10 16:26:14 +08:00
afcc6170f6
[fix](txn_manager) Add ingested rowsets to unused rowsets when removing txn ( #37417 )
...
Generally speaking, as long as a rowset has a version, it can be
considered not to be in a pending state. However, if the rowset was
created through ingesting binlogs, it will have a version but should
still be considered in a pending state because the ingesting txn has not
yet been committed.
This PR updates the condition for determining the pending state. If a
rowset is COMMITTED, the txn should be allowed to roll back even if a
version exists.
Cherry-pick #36551
2024-07-10 14:25:44 +08:00
f65d1c4011
[chore](ci) rm repeat function name ( #37579 )
...
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-10 11:44:32 +08:00
0cdb371624
[branch-2.1](memory) Disable Arrow Jemalloc step 2 ( #37556 )
...
pick #37533
2024-07-10 11:34:18 +08:00
a4aaace481
[Fix](branch-2.1) Fix partial update regression test ( #37560 )
...
Version 2.1 does not support partial update for variant type data, so we
delete this case.
2024-07-10 10:44:24 +08:00
87cd366636
[chore](dependencies)Remove Unnecessary Dependencies ( #37469 ) ( #37555 )
...
bp #37469
2024-07-10 09:33:43 +08:00
770e7d21a4
[dependencies](fe)upgrade paimon to 0.8.1 ( #37205 ) ( #37554 )
...
bp #37205
2024-07-10 09:32:33 +08:00
27283b2915
[branch-2.1](memory) Disable Arrow Jemalloc ( #37529 )
...
pick ##37528
2024-07-09 23:48:27 +08:00
90757a9283
[test](auth)add upgrade and downgrade compatibility test case ( #37523 )
...
## Proposed changes
[test](auth)add upgrade and downgrade compatibility test case
2024-07-09 21:13:54 +08:00
08b3b73c3a
[fix](regression) Fix regression run in cloud use non-root user #34340 ( #37279 )
...
cherry pick from #34340
2024-07-09 20:48:30 +08:00
db4d061a68
[fix](Nereids) null type result with alias name should keep alias name ( #37457 ) ( #37524 )
...
pick from master #37457
2024-07-09 20:46:51 +08:00
8ef83259ff
[fix](planner) fix bug of select stmt toSql( #37274 ) ( #37344 )
...
cherry-pick from master #37274
2024-07-09 20:34:57 +08:00
9b075bc873
[fix](nereids) derive column stats for 'expr and A is not null' ( #37235 ) ( #37498 )
...
pick from #37235
the algorithm for computing stats for "expr1 and expr2" predicate is as
following:
1. compute output stats of expr1 based on input stats. the result stats
is denoted by leftStats
2. compute stats of expr2 based on leftStats after step1, leftStats
should be normalized to avoid abnormal cases, such as ndv > rowCount or
numNulls > rowCount
Issue Number: close #xxx
<!--Describe your changes.-->
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-09 17:46:57 +08:00
5247e0ff3a
[fix](clone) Increase robustness for clone #36642 ( #37413 )
...
cherry pick from #36642
2024-07-09 17:18:14 +08:00
7f6b846f58
[improve](fe) Add a counter metric for recording large editlog write ( #37328 ) ( #37474 )
2024-07-09 17:16:31 +08:00
7cda8db020
[fix](load) The NodeChannel should be canceled when failed to add block #37500 ( #37527 )
...
cherry pick from #37500
2024-07-09 17:01:04 +08:00
f7f0c20f00
[branch-2.1](cgroup memory) Correct cgroup mem info cache ( #37440 )
...
pick #36966
Co-authored-by: Hongkun Xu <xuhongkun666@163.com >
2024-07-09 16:19:37 +08:00
005304953e
[performance](load) do not copy input_block in memtable ( #36939 ) ( #37407 )
...
cherry-pick #36939
2024-07-09 15:59:44 +08:00
81360cf897
[opt](test) shorten the external p0 running time ( #37320 ) ( #37473 )
...
bp #37320
2024-07-09 15:35:15 +08:00
19eb9decba
[chore](ci) add isCloudMode ( #37518 )
...
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
Co-authored-by: stephen <hello-stephen@qq.com >
2024-07-09 14:09:16 +08:00
9b500faa0c
[fix](create table) create table fail not write drop table editlog #37488 ( #37506 )
...
cherry pick from #37488
2024-07-09 13:44:43 +08:00
2d5eb55310
[cherry-pick](branch-2.1) Pick "[Enhancement](partial update) Add some partial update case ( #36385 )" ( #37382 )
...
#36385
2024-07-09 10:52:04 +08:00
8d46f0e138
[fix](manager)fix manager insterface case.( #37082 ) ( #37317 )
...
bp #37082
2024-07-09 10:42:22 +08:00
4426d6d80f
[fix](fe) Add check editlog size mechanism for backupJob ( #35653 ) ( #37466 )
...
* When creating a backupJob with huge of tables in a database, it can
cause backupJob editlog size over 2GB and bdbje will throw exception
because of ByteBuffer overflow
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
2024-07-09 10:33:28 +08:00
