d667df2d06
[improvement](spill) avoid unnecessary spilling in hash join build phase ( #33277 )
2024-04-10 16:21:50 +08:00
5e73d7a281
[fix](compaction) fix incorrect grouping of vertical compaction columns in tables only with key columns ( #32896 ) ( #33470 )
2024-04-10 16:04:33 +08:00
f8d1fa2be3
[chore](multi-table-load) add context info in log when using single-stream-multi-table load ( #33317 )
2024-04-10 16:03:05 +08:00
6412753517
[improve](exec) reduce copy on store_string_ref ( #33232 )
2024-04-10 16:00:12 +08:00
e6e2099256
[fix](spill) fix hash join error 'invalid slot id' ( #33273 )
2024-04-10 16:00:12 +08:00
7fae123b01
[FIX](inverted_index) fix inverted index write array with _doc is empty ( #33170 )
2024-04-10 15:26:09 +08:00
2b1ab89b5b
[fix](memory) Fix memory log compile by ASAN ( #33162 )
...
ASAN compiles BE, add markers in memory logs
2024-04-10 15:26:09 +08:00
9670422d61
[fix](inverted index) fix the incorrect result issue of COUNT_ON_INDEX for key columns ( #33164 )
2024-04-10 15:26:09 +08:00
2e40e39584
[chore](spill) add timers for performance tuning ( #33185 )
2024-04-10 15:26:08 +08:00
8fd6d4c41b
[Chore](build) add -Wconversion and remove some unused code ( #33127 )
...
add -Wconversion and remove some unused code
2024-04-10 15:26:08 +08:00
cc363f26c2
[fix](Nereids) fix group concat ( #33091 )
...
Fix failed in regression_test/suites/query_p0/group_concat/test_group_concat.groovy
select
group_concat( distinct b1, '?'), group_concat( distinct b3, '?')
from
table_group_concat
group by
b2
exception:
lowestCostPlans with physicalProperties(GATHER) doesn't exist in root group
The root cause is '?' is push down to slot by NormalizeAggregate, AggregateStrategies treat the slot as a distinct parameter and generate a invalid PhysicalHashAggregate, and then reject by ChildOutputPropertyDeriver.
I fix this bug by avoid push down literal to slot in NormalizeAggregate, and forbidden generate stream aggregate node when group by slots is empty
2024-04-10 14:59:46 +08:00
6c5dd820c0
[improvement](spill) improve spill timers ( #33156 )
2024-04-10 14:55:11 +08:00
7f2fdf78ac
[Enhancement](inverted index) set need to read data only when delete predicate contains the column ( #33172 )
2024-04-10 14:53:56 +08:00
c61d6ad1e2
[Feature] support function uuid_to_int and int_to_uuid #33005
2024-04-10 14:53:56 +08:00
bf022f9d8d
[enhancement](function truncate) truncate can use column as scale argument ( #32746 )
...
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-04-10 14:53:56 +08:00
8b1d174b13
[Optimize] Move strings_pool from individual tree nodes to the tree itself ( #33089 )
...
Previously, strings_pool was allocated within each tree node. However, due to the Arena's alignment of allocated chunks to at least 4K, this allocation size was excessively large for a single tree node. Consequently, when there are numerous nodes within the SubcolumnTree, a significant portion of memory was wasted. Moving strings_pool to the tree itself optimizes memory usage and reduces wastage, improving overall efficiency.
2024-04-10 14:53:56 +08:00
1b3a11a02b
[Enhancement](merge-on-write) Support dynamic delete bitmap cache ( #32991 )
...
* The default delete bitmap cache is set to 100MB, which can be insufficient and cause performance issues when the amount of user data is large. To mitigate the problem of an inadequate cache, we will take the larger of 5% of the total memory and 100MB as the delete bitmap cache size.
2024-04-10 14:53:56 +08:00
3b42dc73af
[improvement](spill) avoid spill if memory is enough ( #33075 )
2024-04-10 14:53:27 +08:00
517c12478f
[improvement](spill) spill trigger improvement ( #32641 )
2024-04-10 14:52:46 +08:00
b0b5f84e40
[feature](load) support compressed JSON format data for broker load ( #30809 )
2024-04-10 14:20:53 +08:00
1d0908e80d
[feature](profile) make WaitForLocalExchangeBuffer timer merge ( #32946 )
...
make WaitForLocalExchangeBuffer timer merge
2024-04-10 11:57:57 +08:00
e4993a19e5
[Chore](column) remove ColumnVectorHelper ( #33036 )
...
remove ColumnVectorHelper
2024-04-10 11:56:41 +08:00
8e19cdd745
[featrue](expr) support common subexpression elimination be part ( #32673 )
2024-04-10 11:56:21 +08:00
5116724494
[Fix](hive-writer) Fix the issue of block was not copied to do filtering when hive partition writer write block to file. ( #32775 ) ( #33447 )
...
backport #32775
2024-04-10 11:42:23 +08:00
4963d60a07
[Fix](multi-catalog)Fix the issue of not initializing the writer caused by refactoring and add hive writing regression test. ( #32721 ) ( #33446 )
...
backport #32721 .
2024-04-10 11:42:22 +08:00
cf7595d423
[opt](memory) Optimize mem tracker accuracy ( #32039 ) ( #33140 )
2024-04-10 11:42:19 +08:00
39fba884fb
[fix](typo) typo fix for 'delete bimap' changing to 'delete bitmap' ( #32341 )
2024-04-10 11:34:30 +08:00
3243053fcd
[fix](memory) Fix MemTableWriter flush_async attach task in thread context ( #33071 )
2024-04-10 11:34:30 +08:00
285e2fcb5a
[fix] (vectorization) regexp all_pass string ( #32515 )
2024-04-10 11:34:30 +08:00
c5a3af5c27
[partitionsort](fix) Fix DCHECK failure ( #33035 )
2024-04-10 11:34:30 +08:00
59aa923bce
[bug](function) fix milliseconds_diff function return wrong result ( #32897 )
...
* [bug](function) fix milliseconds_diff function return wrong result
2024-04-10 11:34:30 +08:00
3b7d75fb4b
[fix](inverted index) Clear the index cache corresponding to the table after deleting the table. ( #32921 )
2024-04-10 11:34:30 +08:00
193600ad9d
[Performance](sink) opt mysql result writer ( #31816 )
2024-04-10 11:34:30 +08:00
7b26feb6de
[fix](invert index) Fix the issue of high memory usage. ( #31739 )
2024-04-10 11:34:30 +08:00
528a889077
[Fix](hive-writer) Fix correct num when hive writing data to an unpartitioned table if size large than hive_sink_max_file_size. ( #32959 )
2024-04-10 11:34:29 +08:00
97a2977f2a
[improvement](executor)Add tag property for workload group #32874
2024-04-10 11:34:29 +08:00
f1ee7f5767
[fix](merge-iterator) fix NOT_IMPLEMENTED_ERROR when read next block view ( #32961 )
2024-04-10 11:34:29 +08:00
3a6c37c6d5
[exec](column) change some complex column move to noexcept ( #32954 )
2024-04-10 11:34:29 +08:00
bb8bc75af4
[feature](agg) add aggregate function sum0 ( #32541 )
2024-04-10 11:34:29 +08:00
e3bd2311b1
[Performance](exec) replace SipHash in function by XXHash ( #32919 )
2024-04-10 11:34:29 +08:00
28e2d89ce3
[Improve](inverted_index) update clucene and improve array inverted index writer ( #32436 )
2024-04-10 11:34:29 +08:00
8e6ed80692
[improvement](spill) Disable DistinctStreamingAgg when spill is enabled ( #32932 )
2024-04-10 11:34:29 +08:00
830d4c14c1
[fix](spill) SpillStream's writer maybe may not have been finalized ( #32931 )
2024-04-10 11:34:29 +08:00
06e5c6c966
[fix](grace-exit) Stop incorrectly of reportwork cause heap use after free #32929
2024-04-10 11:34:28 +08:00
f23a72b937
[chore](log) print query id before logging profile in be.INFO ( #32922 )
2024-04-10 11:34:28 +08:00
87f99271e1
[fix](spill) Avoid releasing resources while spill tasks are executing ( #32783 )
2024-04-10 11:34:28 +08:00
96b995504c
[enhancement](statistics) excluded delta rows num for rollup&mv tablets ( #32568 )
...
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
Co-authored-by: tsy <tangsiyang2001@foxmail.com >
2024-04-10 11:34:28 +08:00
005f7af21f
[bugfix](deadlock) should not use query cancelled in fragment mgr
2024-04-09 16:09:01 +08:00
e574b35833
[Enhancement](partition) Refine some auto partition behaviours ( #32737 ) ( #33412 )
...
fix legacy planner grammer
fix nereids planner parsing
fix cases
forbid auto range partition with null column
fix CreateTableStmt with auto partition and some partition items.
1 and 2 are about #31585
doc pr: apache/doris-website#488
2024-04-09 15:51:02 +08:00
97850cf2bb
[fix](cooldown) Fix hdfs path ( #33315 )
2024-04-09 12:55:53 +08:00
