2a1d2ad647
[fix](Nereids) decimalv2 and int/date bit arithmetic need cast to bigint ( #32311 )
2024-03-21 14:07:49 +08:00
b92a764665
[feature](function) Support for aggregate function foreach combiner for some error function ( #31913 )
...
Support for aggregate function foreach combiner for some error function
2024-03-21 14:07:49 +08:00
b6a35d68b0
[code](Refactor) Del unless filter id in runtime filter func ( #32502 )
...
Del unless filter id in runtime filter func
2024-03-21 14:07:49 +08:00
0e493add69
[regression-test](case) forbid test_stream_stub_fault_injection ( #32540 )
2024-03-21 14:07:49 +08:00
22782fec92
[opt](routine-load) optimize allocate task to be algorithm for load balance ( #32021 )
2024-03-21 14:07:49 +08:00
6871c964af
[fix](nereids)NullSafeEqualToEqual rule only change to equal if both children are not nullable ( #32374 )
...
NullSafeEqualToEqual rule only change to equal if both children are not nullable
2024-03-21 14:07:49 +08:00
1b0c4d3aa2
[chor](log) Change log4j rollover strategy to 'max' ( #32116 )
...
The log file names are in the format fe.log.${date}-${index}, e.g.
```
fe.log.20240311-1
fe.log.20240311-2
fe.log.20240311-3
...
```
In the previous, fe.log/fe.audit.log will be renamed to fe.log.xxx-1/fe.audit.log.xxx-1
with the minimum index `1` when they reach rotation size. e.g.
```
fe.log.20240311-1 -> fe.log.20240311-2
fe.log.20240311-2 -> fe.log.20240311-3
fe.log.20240311-3 -> fe.log.20240311-4
fe.log -> fe.log.20240311-1
```
there are some drawbacks
1. log4j needs to rename all existing rotated log to spare the
index `1`
2. it's hard to deal with the duplicated names, because every time the
log rotates, it starts from index `1`
After this change, the log will rename to a file name with larger index
instead of `1`. e.g. when rotate
```
fe.log.20240311-1
fe.log.20240311-2
fe.log.20240311-3
fe.log -> fe.log.20240311-4
```
2024-03-21 14:07:49 +08:00
6d401451cc
[fix](stats) sort partitions when do sample analyze ( #32185 )
2024-03-21 14:07:49 +08:00
9f98200f27
[case](mtmv)MTMV external catalog case ( #32390 )
2024-03-21 14:07:24 +08:00
4b21c5c1cf
[Enhencement](Nereids) add eliminate distinct constant rule ( #32307 )
...
select distinct 1,2,3 from tbl
=>
select 1,2,3 from (select 1, 2, 3 from tbl limit 1) as tmp
2024-03-21 14:07:24 +08:00
4efeb6618a
[Fix](inverted index) fix inappropriate use of macro in inverted index fs directory error process ( #32472 )
2024-03-21 14:07:24 +08:00
ea8d4f2d0b
[fix][regression]update ccr test project ( #32445 )
2024-03-21 14:07:24 +08:00
50c247e08c
[fix](snapshot-loader) Fix be crash caused by deref end() iterator ( #32489 )
...
The standard said that the input parameter `pos` of std::vector::erase
must be valid and dereferenceable, the `end()` iterator cannot be used
as a value of `pos`. I did some tests and the crash only occurs when the
vector is empty. Fortunately `local_files` is usually not empty.
2024-03-21 14:07:24 +08:00
612d3595e4
[improvement](spill) optimize the spilling logic of hash join operator ( #32202 )
2024-03-21 14:07:24 +08:00
e892774c9a
[improvement](agg) streaming agg should not take too much memory when spilling enabled ( #32426 )
2024-03-21 14:07:24 +08:00
7484a7ba5f
[fix](broker load) improve the checking of overlapping partitions of same table ( #32254 )
2024-03-21 14:07:24 +08:00
2196c534e8
[fix](group commit) Fix compatibility issues on serializing and deserializing wal file ( #32299 )
2024-03-21 14:07:24 +08:00
2057886d30
[fix](group commit) Fix invalid function problem on p2 regression-test ( #32481 )
2024-03-21 14:07:24 +08:00
3c377a8957
[fix](group commit) Fix group commit connect to observer fe ( #32222 )
2024-03-21 14:07:24 +08:00
14c9537679
[fix](decimal) fix Arithmetic Overflow error of converting string to decimal ( #32246 )
2024-03-21 14:07:24 +08:00
ab512f935c
[pipelineX](api) Add api for long-running tasks ( #32459 )
2024-03-21 14:07:24 +08:00
66fe61b591
[fix](nereids)support topn-filter for non pipeline engine #32397
2024-03-21 14:07:24 +08:00
f99db38998
[fix](ParquetReader) Fix Parquet Reader to read int96 parquet type problem ( #32394 )
...
`hi - JULIAN_EPOCH_OFFSET_DAYS` could be negative, so we can't all use unsigned int.
2024-03-21 14:07:24 +08:00
e541ca9f11
[Fix](Job)When jobname is the do keyword, parsing errors will occur when executing SQL. ( #32379 )
2024-03-21 14:07:24 +08:00
725f86a27b
[fix](group commit) Fix p2 regression-test ( #32270 )
2024-03-21 14:07:24 +08:00
0635a8716c
[improve](group commit) Group commit support chunked stream load in flink ( #32135 )
2024-03-21 14:07:24 +08:00
d640c54b80
[fix](regression) prepare_insert failed when connect to observer fe ( #32223 )
2024-03-21 14:07:24 +08:00
7422f185da
[Fix](smooth-upgrade) Fix incompatibility when upgrade from 2.0 to 2.1 ( #32444 )
2024-03-21 14:07:24 +08:00
715eed0748
[opt](like) opt LIKE and REGEXP clause with concat(col, pattern_str) ( #32333 )
...
opt LIKE and REGEXP clause with concat(col, pattern_str)
2024-03-21 14:07:24 +08:00
c45e2f3e6f
fix routine load regression test fail ( #32406 )
2024-03-21 14:07:24 +08:00
6ea8e51261
[Performance](join) speed up the colocate and bucket shuffle join by change rf size ( #32421 )
2024-03-21 14:07:24 +08:00
73de61ed84
[opt](hive) skip hidden file and dir ( #32412 )
...
When query hive table, we should skip all hidden dirs and files, like:
```
/visible/.hidden/path
/visible/.hidden.txt
```
2024-03-21 14:07:24 +08:00
a5f3611b88
[Fix](Regression) DCHECK failed in runtime filter wrapper ( #32446 )
2024-03-21 14:07:23 +08:00
7a0b591b8f
[FIX](array_agg) fix array agg with other agg function ( #32387 )
...
fix array agg with other agg function
2024-03-21 14:07:23 +08:00
a0a3a2a2ce
[Fix](Variant) fix variant with not null ( #32248 )
...
ignore null bitmap for not null and make subcolumn access slots always nullable
2024-03-21 14:07:23 +08:00
6aec479013
[fix](planner)decimalv3 literal's precision and scale is not correctly set ( #32288 )
2024-03-21 14:07:23 +08:00
353add74db
[chore](ci) fix script ( #32420 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2024-03-21 14:07:23 +08:00
590e1d52ec
[pipelineX](streaming agg) Fix wrong columns produced by streaming agg ( #32411 )
...
* [pipelineX](streaming agg) Fix wrong columns produced by streaming agg
* update
2024-03-21 14:07:23 +08:00
6c8b5bb26f
[fix](feut) comment out doc gen execution ( #32413 )
...
Followup #32384
After doc is removed, the doc generator should be skipped, or FE ut can not run
2024-03-21 14:07:23 +08:00
99b8db5f9d
[Chore](tools) update ssb tools ( #32308 )
2024-03-21 14:07:23 +08:00
4bf5a21ba3
[pipelineX](cancel) Remove lock for mapping query ctx to fragment ( #32346 )
2024-03-21 14:07:23 +08:00
32f7f0b50c
[enhancement](test)unique model by modify a value type from SMALLINT to other type ( #32348 )
...
* [enhancement](test)unique model by modify a key type from SMALLINT to other type
* [enhancement](test)unique model by modify a value type from SMALLINT to other type
2024-03-21 14:07:23 +08:00
b66840efd7
[Fix](regression test) Fix <=> rf cause regresion test failed ( #32377 )
2024-03-21 14:07:23 +08:00
e8475a527b
[regression-test]( fix case ) fix case that using same table in one db with another case ( #32380 )
2024-03-21 14:07:23 +08:00
a4151e022e
[bug](fold) fix fold constant rule can't handle variable expr ( #32313 )
2024-03-21 14:07:23 +08:00
74445065ab
[docs](MoveRepo) Update .asf.yaml ( #32391 )
2024-03-21 14:07:23 +08:00
fdcf5b7d34
[enhancement](dict) check valid of offset in page ( #32349 )
2024-03-21 14:07:23 +08:00
26ed4b69b1
[opt](jdbc catalog) filter jdbc datasource internal database ( #32294 )
2024-03-21 14:07:23 +08:00
e952b5ef5b
[opt](jdbc catalog) Refine the jdbc_connector close logic and actively clear the jvm occupied by jdbcexecutor ( #32300 )
2024-03-21 14:07:23 +08:00
f132c9b2c6
[Improve](spark-load)update spark version for spark load to resolve cve problem ( #30368 )
2024-03-21 14:07:23 +08:00
