Commit Graph

17687 Commits

Author SHA1 Message Date
fd62af82d2 [enhancement](mow) Add bvar for bloom filter and segment (#32355) 2024-03-22 08:52:12 +08:00
b727fd6594 (kerberos)fix hive keberos principal usage 2024-03-22 08:16:59 +08:00
4e653b0baa (Nereids): remove test infer_set_operator_distinct(CBO) 2024-03-22 08:16:49 +08:00
0cde0cbf19 (invert index) modify of time series compaction policy 2024-03-22 08:16:30 +08:00
4c8aaa156a [fix](jni) remove 'push_down_predicates' and fix BE crash with decimal predicate (#32253) (#32599) 2024-03-21 14:07:50 +08:00
a7fa9f290c [fix](test)change stream load of auto partition (#32544) 2024-03-21 14:07:50 +08:00
48d7585d85 [enhancement](test) unique model by modify a value type from INT or BIGINT to other type (#32553) 2024-03-21 14:07:50 +08:00
dea6859e0d [refactor](jdbc catalog) refactor jdbc catalog get databases logic (#32579) 2024-03-21 14:07:50 +08:00
043113c89e [enhancement](test) unique model by modify a key type from SMALLINT to other type (#32033) 2024-03-21 14:07:50 +08:00
617cc667fe [Fix](Variant) fix variant serialize root node (#31769) 2024-03-21 14:07:50 +08:00
02ef02402a [pipelineX](debug) Add debug logs for long-running load task (#32534) 2024-03-21 14:07:50 +08:00
2c87238504 [enhance](S3) Print the oss request id for each error s3 request (#32491) 2024-03-21 14:07:50 +08:00
60a673979e [case](Cloud) Add ssb case for hdfs vault (#32567) 2024-03-21 14:07:50 +08:00
02430e6e53 [enhance](S3) Print the oss request id for each error s3 request (#32499) 2024-03-21 14:07:50 +08:00
d2968dcf99 [fix](jdbc catalog) Fixed the problem that the metadata_refresh_interval_sec properties cannot be set (#32516) 2024-03-21 14:07:49 +08:00
085696744d [Enhancement] when partition column is datetime, date can work in create table command (#32335) 2024-03-21 14:07:49 +08:00
7486e96b12 [improve](function) add error msg if exceeded maximum default value in repeat function (#32219)
add some error msg from repeat function, so the user could know the count is greater than default value.
2024-03-21 14:07:49 +08:00
8e3d28b93a [Feature] Support Array Type compare function for nereids planner (#31701)
Support Array Type compare function for nereids planner
2024-03-21 14:07:49 +08:00
6d076f9947 [improvement](group_comit) Add bvar to monitor the total wal count on disk (#31646) 2024-03-21 14:07:49 +08:00
09be4dc7ee [fix](random-bucket) tabletindex when there is no cached value in memory (#32336)
1. In cloud mode, get visible version is a rpc to metaservice, while
loads would get visible version for all partitions.
2. VunionNode should follow batch size.
2024-03-21 14:07:49 +08:00
06bf5541f2 [pipelineX](fix) Fix running tasks API core dump (#32503) 2024-03-21 14:07:49 +08:00
0db402e154 [expr](fix) Not to throw exception when close failed (#32287) 2024-03-21 14:07:49 +08:00
a40463617e [feature](cpu cores) get the cores when running within a cgroup. (#32370)
get the cores when running within a cgroup
2024-03-21 14:07:49 +08:00
95322e2ebe [opt](variable) user variable support expression rather than literal (#32492) 2024-03-21 14:07:49 +08:00
2a1d2ad647 [fix](Nereids) decimalv2 and int/date bit arithmetic need cast to bigint (#32311) 2024-03-21 14:07:49 +08:00
b92a764665 [feature](function) Support for aggregate function foreach combiner for some error function (#31913)
Support for aggregate function foreach combiner for some error function
2024-03-21 14:07:49 +08:00
b6a35d68b0 [code](Refactor) Del unless filter id in runtime filter func (#32502)
Del unless filter id in runtime filter func
2024-03-21 14:07:49 +08:00
0e493add69 [regression-test](case) forbid test_stream_stub_fault_injection (#32540) 2024-03-21 14:07:49 +08:00
22782fec92 [opt](routine-load) optimize allocate task to be algorithm for load balance (#32021) 2024-03-21 14:07:49 +08:00
6871c964af [fix](nereids)NullSafeEqualToEqual rule only change to equal if both children are not nullable (#32374)
NullSafeEqualToEqual rule only change to equal if both children are not nullable
2024-03-21 14:07:49 +08:00
1b0c4d3aa2 [chor](log) Change log4j rollover strategy to 'max' (#32116)
The log file names are in the format fe.log.${date}-${index}, e.g.
```
fe.log.20240311-1
fe.log.20240311-2
fe.log.20240311-3
...
```
In the previous, fe.log/fe.audit.log will be renamed to fe.log.xxx-1/fe.audit.log.xxx-1
with the minimum index `1` when they reach rotation size. e.g.
```
fe.log.20240311-1 -> fe.log.20240311-2
fe.log.20240311-2 -> fe.log.20240311-3
fe.log.20240311-3 -> fe.log.20240311-4
fe.log            -> fe.log.20240311-1
```

there are some drawbacks
1. log4j needs to rename all existing rotated log to spare the
   index `1`
2. it's hard to deal with the duplicated names, because every time the
   log rotates, it starts from index `1`

After this change, the log will rename to a file name with larger index
instead of `1`. e.g. when rotate
```
fe.log.20240311-1
fe.log.20240311-2
fe.log.20240311-3
fe.log -> fe.log.20240311-4
```
2024-03-21 14:07:49 +08:00
6d401451cc [fix](stats) sort partitions when do sample analyze (#32185) 2024-03-21 14:07:49 +08:00
9f98200f27 [case](mtmv)MTMV external catalog case (#32390) 2024-03-21 14:07:24 +08:00
4b21c5c1cf [Enhencement](Nereids) add eliminate distinct constant rule (#32307)
select distinct 1,2,3 from tbl
=>
select 1,2,3 from (select 1, 2, 3 from tbl limit 1) as tmp
2024-03-21 14:07:24 +08:00
4efeb6618a [Fix](inverted index) fix inappropriate use of macro in inverted index fs directory error process (#32472) 2024-03-21 14:07:24 +08:00
ea8d4f2d0b [fix][regression]update ccr test project (#32445) 2024-03-21 14:07:24 +08:00
50c247e08c [fix](snapshot-loader) Fix be crash caused by deref end() iterator (#32489)
The standard said that the input parameter `pos` of std::vector::erase
must be valid and dereferenceable, the `end()` iterator cannot be used
as a value of `pos`. I did some tests and the crash only occurs when the
vector is empty. Fortunately `local_files` is usually not empty.
2024-03-21 14:07:24 +08:00
612d3595e4 [improvement](spill) optimize the spilling logic of hash join operator (#32202) 2024-03-21 14:07:24 +08:00
e892774c9a [improvement](agg) streaming agg should not take too much memory when spilling enabled (#32426) 2024-03-21 14:07:24 +08:00
7484a7ba5f [fix](broker load) improve the checking of overlapping partitions of same table (#32254) 2024-03-21 14:07:24 +08:00
2196c534e8 [fix](group commit) Fix compatibility issues on serializing and deserializing wal file (#32299) 2024-03-21 14:07:24 +08:00
2057886d30 [fix](group commit) Fix invalid function problem on p2 regression-test (#32481) 2024-03-21 14:07:24 +08:00
3c377a8957 [fix](group commit) Fix group commit connect to observer fe (#32222) 2024-03-21 14:07:24 +08:00
14c9537679 [fix](decimal) fix Arithmetic Overflow error of converting string to decimal (#32246) 2024-03-21 14:07:24 +08:00
ab512f935c [pipelineX](api) Add api for long-running tasks (#32459) 2024-03-21 14:07:24 +08:00
66fe61b591 [fix](nereids)support topn-filter for non pipeline engine #32397 2024-03-21 14:07:24 +08:00
f99db38998 [fix](ParquetReader) Fix Parquet Reader to read int96 parquet type problem (#32394)
`hi - JULIAN_EPOCH_OFFSET_DAYS` could be negative, so we can't all use unsigned int.
2024-03-21 14:07:24 +08:00
e541ca9f11 [Fix](Job)When jobname is the do keyword, parsing errors will occur when executing SQL. (#32379) 2024-03-21 14:07:24 +08:00
725f86a27b [fix](group commit) Fix p2 regression-test (#32270) 2024-03-21 14:07:24 +08:00
0635a8716c [improve](group commit) Group commit support chunked stream load in flink (#32135) 2024-03-21 14:07:24 +08:00