02ef02402a
[pipelineX](debug) Add debug logs for long-running load task ( #32534 )
2024-03-21 14:07:50 +08:00
2c87238504
[enhance](S3) Print the oss request id for each error s3 request ( #32491 )
2024-03-21 14:07:50 +08:00
60a673979e
[case](Cloud) Add ssb case for hdfs vault ( #32567 )
2024-03-21 14:07:50 +08:00
02430e6e53
[enhance](S3) Print the oss request id for each error s3 request ( #32499 )
2024-03-21 14:07:50 +08:00
d2968dcf99
[fix](jdbc catalog) Fixed the problem that the metadata_refresh_interval_sec properties cannot be set ( #32516 )
2024-03-21 14:07:49 +08:00
085696744d
[Enhancement] when partition column is datetime, date can work in create table command ( #32335 )
2024-03-21 14:07:49 +08:00
7486e96b12
[improve](function) add error msg if exceeded maximum default value in repeat function ( #32219 )
...
add some error msg from repeat function, so the user could know the count is greater than default value.
2024-03-21 14:07:49 +08:00
8e3d28b93a
[Feature] Support Array Type compare function for nereids planner ( #31701 )
...
Support Array Type compare function for nereids planner
2024-03-21 14:07:49 +08:00
6d076f9947
[improvement](group_comit) Add bvar to monitor the total wal count on disk ( #31646 )
2024-03-21 14:07:49 +08:00
09be4dc7ee
[fix](random-bucket) tabletindex when there is no cached value in memory ( #32336 )
...
1. In cloud mode, get visible version is a rpc to metaservice, while
loads would get visible version for all partitions.
2. VunionNode should follow batch size.
2024-03-21 14:07:49 +08:00
06bf5541f2
[pipelineX](fix) Fix running tasks API core dump ( #32503 )
2024-03-21 14:07:49 +08:00
0db402e154
[expr](fix) Not to throw exception when close failed ( #32287 )
2024-03-21 14:07:49 +08:00
a40463617e
[feature](cpu cores) get the cores when running within a cgroup. ( #32370 )
...
get the cores when running within a cgroup
2024-03-21 14:07:49 +08:00
95322e2ebe
[opt](variable) user variable support expression rather than literal ( #32492 )
2024-03-21 14:07:49 +08:00
2a1d2ad647
[fix](Nereids) decimalv2 and int/date bit arithmetic need cast to bigint ( #32311 )
2024-03-21 14:07:49 +08:00
b92a764665
[feature](function) Support for aggregate function foreach combiner for some error function ( #31913 )
...
Support for aggregate function foreach combiner for some error function
2024-03-21 14:07:49 +08:00
b6a35d68b0
[code](Refactor) Del unless filter id in runtime filter func ( #32502 )
...
Del unless filter id in runtime filter func
2024-03-21 14:07:49 +08:00
0e493add69
[regression-test](case) forbid test_stream_stub_fault_injection ( #32540 )
2024-03-21 14:07:49 +08:00
22782fec92
[opt](routine-load) optimize allocate task to be algorithm for load balance ( #32021 )
2024-03-21 14:07:49 +08:00
6871c964af
[fix](nereids)NullSafeEqualToEqual rule only change to equal if both children are not nullable ( #32374 )
...
NullSafeEqualToEqual rule only change to equal if both children are not nullable
2024-03-21 14:07:49 +08:00
1b0c4d3aa2
[chor](log) Change log4j rollover strategy to 'max' ( #32116 )
...
The log file names are in the format fe.log.${date}-${index}, e.g.
```
fe.log.20240311-1
fe.log.20240311-2
fe.log.20240311-3
...
```
In the previous, fe.log/fe.audit.log will be renamed to fe.log.xxx-1/fe.audit.log.xxx-1
with the minimum index `1` when they reach rotation size. e.g.
```
fe.log.20240311-1 -> fe.log.20240311-2
fe.log.20240311-2 -> fe.log.20240311-3
fe.log.20240311-3 -> fe.log.20240311-4
fe.log -> fe.log.20240311-1
```
there are some drawbacks
1. log4j needs to rename all existing rotated log to spare the
index `1`
2. it's hard to deal with the duplicated names, because every time the
log rotates, it starts from index `1`
After this change, the log will rename to a file name with larger index
instead of `1`. e.g. when rotate
```
fe.log.20240311-1
fe.log.20240311-2
fe.log.20240311-3
fe.log -> fe.log.20240311-4
```
2024-03-21 14:07:49 +08:00
6d401451cc
[fix](stats) sort partitions when do sample analyze ( #32185 )
2024-03-21 14:07:49 +08:00
9f98200f27
[case](mtmv)MTMV external catalog case ( #32390 )
2024-03-21 14:07:24 +08:00
4b21c5c1cf
[Enhencement](Nereids) add eliminate distinct constant rule ( #32307 )
...
select distinct 1,2,3 from tbl
=>
select 1,2,3 from (select 1, 2, 3 from tbl limit 1) as tmp
2024-03-21 14:07:24 +08:00
4efeb6618a
[Fix](inverted index) fix inappropriate use of macro in inverted index fs directory error process ( #32472 )
2024-03-21 14:07:24 +08:00
ea8d4f2d0b
[fix][regression]update ccr test project ( #32445 )
2024-03-21 14:07:24 +08:00
50c247e08c
[fix](snapshot-loader) Fix be crash caused by deref end() iterator ( #32489 )
...
The standard said that the input parameter `pos` of std::vector::erase
must be valid and dereferenceable, the `end()` iterator cannot be used
as a value of `pos`. I did some tests and the crash only occurs when the
vector is empty. Fortunately `local_files` is usually not empty.
2024-03-21 14:07:24 +08:00
612d3595e4
[improvement](spill) optimize the spilling logic of hash join operator ( #32202 )
2024-03-21 14:07:24 +08:00
e892774c9a
[improvement](agg) streaming agg should not take too much memory when spilling enabled ( #32426 )
2024-03-21 14:07:24 +08:00
7484a7ba5f
[fix](broker load) improve the checking of overlapping partitions of same table ( #32254 )
2024-03-21 14:07:24 +08:00
2196c534e8
[fix](group commit) Fix compatibility issues on serializing and deserializing wal file ( #32299 )
2024-03-21 14:07:24 +08:00
2057886d30
[fix](group commit) Fix invalid function problem on p2 regression-test ( #32481 )
2024-03-21 14:07:24 +08:00
3c377a8957
[fix](group commit) Fix group commit connect to observer fe ( #32222 )
2024-03-21 14:07:24 +08:00
14c9537679
[fix](decimal) fix Arithmetic Overflow error of converting string to decimal ( #32246 )
2024-03-21 14:07:24 +08:00
ab512f935c
[pipelineX](api) Add api for long-running tasks ( #32459 )
2024-03-21 14:07:24 +08:00
66fe61b591
[fix](nereids)support topn-filter for non pipeline engine #32397
2024-03-21 14:07:24 +08:00
f99db38998
[fix](ParquetReader) Fix Parquet Reader to read int96 parquet type problem ( #32394 )
...
`hi - JULIAN_EPOCH_OFFSET_DAYS` could be negative, so we can't all use unsigned int.
2024-03-21 14:07:24 +08:00
e541ca9f11
[Fix](Job)When jobname is the do keyword, parsing errors will occur when executing SQL. ( #32379 )
2024-03-21 14:07:24 +08:00
725f86a27b
[fix](group commit) Fix p2 regression-test ( #32270 )
2024-03-21 14:07:24 +08:00
0635a8716c
[improve](group commit) Group commit support chunked stream load in flink ( #32135 )
2024-03-21 14:07:24 +08:00
d640c54b80
[fix](regression) prepare_insert failed when connect to observer fe ( #32223 )
2024-03-21 14:07:24 +08:00
7422f185da
[Fix](smooth-upgrade) Fix incompatibility when upgrade from 2.0 to 2.1 ( #32444 )
2024-03-21 14:07:24 +08:00
715eed0748
[opt](like) opt LIKE and REGEXP clause with concat(col, pattern_str) ( #32333 )
...
opt LIKE and REGEXP clause with concat(col, pattern_str)
2024-03-21 14:07:24 +08:00
c45e2f3e6f
fix routine load regression test fail ( #32406 )
2024-03-21 14:07:24 +08:00
6ea8e51261
[Performance](join) speed up the colocate and bucket shuffle join by change rf size ( #32421 )
2024-03-21 14:07:24 +08:00
73de61ed84
[opt](hive) skip hidden file and dir ( #32412 )
...
When query hive table, we should skip all hidden dirs and files, like:
```
/visible/.hidden/path
/visible/.hidden.txt
```
2024-03-21 14:07:24 +08:00
a5f3611b88
[Fix](Regression) DCHECK failed in runtime filter wrapper ( #32446 )
2024-03-21 14:07:23 +08:00
7a0b591b8f
[FIX](array_agg) fix array agg with other agg function ( #32387 )
...
fix array agg with other agg function
2024-03-21 14:07:23 +08:00
a0a3a2a2ce
[Fix](Variant) fix variant with not null ( #32248 )
...
ignore null bitmap for not null and make subcolumn access slots always nullable
2024-03-21 14:07:23 +08:00
6aec479013
[fix](planner)decimalv3 literal's precision and scale is not correctly set ( #32288 )
2024-03-21 14:07:23 +08:00
