f951ca2efb
[refactor](stats) Remove useless async loader code. ( #31380 )
2024-02-26 19:07:10 +08:00
3acffaa205
[Feature](agg-state) support write_column_to_pb from DataTypeFixedLengthObjectSerDe ( #31171 )
2024-02-26 19:07:10 +08:00
3b7261abe4
[Mv] check delete from column exists on mv ( #31321 )
2024-02-26 19:07:10 +08:00
48804a978a
[Fix](group commit) Fix group commit flink error message ( #31350 )
...
* When using stream processing frameworks like Flink with group commit mode enabled, the uncertain size of imported data makes such behavior prohibitive. Previously, to simplify the process, the error message for excessive data volume during streamload was combined with the one for group commit mode, leading to confusion for users when encountering errors indicating the data volume is too large during Flink imports. To address this issue, we are adjusting the logic: if a user employs stream processing imports like Flink with group commit mode enabled, we will automatically disable group commit mode, switching to the standard import mode instead. This is the essence of this PR.
2024-02-26 19:07:10 +08:00
3451cd6c23
[fix](datetime) fix hour 24 on be ( #31304 )
2024-02-26 19:07:10 +08:00
e48f4f38d0
[Fix](fe-common) Fix the Pair.java code about the hidden danger of NullPointException ( #31371 )
...
* 修复Pair类 first 或 second 为null时，调用equals和toString 抛NullPointException问题
* add license
2024-02-26 19:07:10 +08:00
41a67fc218
change to 2.1.0-rc10
2024-02-26 01:36:54 +08:00
859e56ac16
[bugfix](wg) should set task group down after thread pool stopped
2024-02-25 18:09:39 +08:00
7a9fe5d275
[enhance](mtmv)MTMV supports Hive multi-level partitioning ( #31060 )
...
Issue Number: close #xxx
For example, the hive table is partitioned by `date` and `region`, with the following 6 partitions
```
20200101
beijing
shanghai
20200102
beijing
shanghai
20200103
beijing
shanghai
```
If the MTMV is partitioned by `date`, then the MTMV will have three partitions: 20200101, 202000102, 20200103
If the MTMV is partitioned by `region`, then the MTMV will have two partitions: beijing, shanghai
2024-02-25 18:08:19 +08:00
7a1caf4718
[refactor](wg) enable wg by default and init normal wg in constructor ( #31373 )
...
should always enable workload group because other operations depend on it for example MTMV, and spill to disk.
the normal workload group should be created in constructor.
2024-02-25 18:08:19 +08:00
4e5147c6a4
[fix](parquet) Fix possible memory leak if ParquetReader::parse_thrift_footer failed ( #31375 )
2024-02-25 18:08:19 +08:00
93cbc96141
[regression test]Opt Test UniqueModel Schema Key Change ( #31262 )
...
* Opt Test UniqueModel Schema Key Change
* Opt Test UniqueModel Schema key Change
2024-02-24 16:26:44 +08:00
09efc92d46
[Fix](regression) make test_index_compaction_with_multi_index_segments nonConcurrent to avoid concurrent be config modify ( #31344 )
2024-02-24 16:26:38 +08:00
8001f73e52
[pipelineX](file scan) Improve parallel tasks if ignore data distribution ( #31328 )
2024-02-24 11:45:05 +08:00
aee49adf1e
[opt](compute-node) refactor compute node doc and opt some default config ( #31325 )
...
* [opt](compute-node) refactor compute node doc and opt some default config
* 1
* 1
2024-02-24 11:44:53 +08:00
8d1221aa65
[doc](community) update team and release doc ( #31358 )
2024-02-24 11:44:53 +08:00
dcbba9a013
fix compile
2024-02-24 08:26:57 +08:00
70304bffd2
[refactor](wg) move memory gc logic to workload group ( #31334 )
...
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2024-02-23 23:12:09 +08:00
db58104bc3
[fix](inverted index) Fix inverted index for MOR unique table #31051 ( #31354 )
2024-02-23 23:10:36 +08:00
481517ac6a
[fix](plan) only scan node with limit and no predicate can reduce to 1 instance ( #31342 )
...
This PR #25952 introduce a opt that if a scan node has limit and predicates, use only 1 instance to save cup and memory.
But this is wrong because we can not guarantee that the predicates can truly help to prune the data.
So I modify the logic to remove this opt.
Now, only scan node with limit and NO predicate can reduce to only 1 instance.
2024-02-23 21:09:14 +08:00
49842eecc5
[Fix](multi-catalog) Fix NPE when refreshing catalog on Slave FE. ( #31335 )
...
---------
Co-authored-by: wangxiangyu <wangxiangyu@360shuke.com >
2024-02-23 20:59:07 +08:00
b6ca76e7d4
fix routine load job throw exception after commit ( #31303 )
2024-02-23 20:57:03 +08:00
db2f0b3574
[docs](stats) add sidebars for stats docs #31309
2024-02-23 20:57:03 +08:00
1c443661c1
[Fix](rf) fix multi thread init error in RuntimeFilterMergeControllerEntity ( #31337 )
2024-02-23 20:44:43 +08:00
e50a427113
[improvment](doc) add FAQ for Jdbc catalog ( #31338 )
2024-02-23 20:44:43 +08:00
57d604c48a
Fix statistics p0 case. ( #31330 )
2024-02-23 20:44:43 +08:00
4085657a28
[doc](group commit) Add group commit performance ( #31343 )
2024-02-23 20:44:43 +08:00
bb31f4adb6
[fix](mtmv)fix generate partition name illegality when partition value contains colon ( #31282 )
2024-02-23 19:05:20 +08:00
30ef9b70c3
[regression](cold_heat)add cold heat test for hdfs ( #31074 )
...
* add cold heat test for hdfs
2024-02-23 19:05:08 +08:00
52c45e38af
[Refactor](RF) refactor the profile of rf and pipeline-x support local ignore ( #31287 )
...
* [Refactor](RF) refactor the profile of rf and pipeline-x support local ignore
* fix local merge filter
2024-02-23 19:05:06 +08:00
3576304e3e
[regression test]Test UniqueModel Schema Value Change ( #31260 )
...
* Test UniqueModel Schema Value Change
* Opt Test UniqueModel Schema value Change
2024-02-23 19:03:28 +08:00
b5ec1e7b7d
[fix](Nereids) support check authorization for view but skip check in the view ( #31289 )
...
move UserAuthentication in BindRelation, support check authorization view but skip check in the view
relate pr: #23295
2024-02-23 19:03:28 +08:00
9a40b6c978
Refactor get row count related interface, add row count cache for external table. ( #31276 )
2024-02-23 19:03:28 +08:00
9508546cc8
[fix](script) Fix start_fe.sh missing METADATA_FAILURE_RECOVERY with foreground ( #31258 )
2024-02-23 19:03:28 +08:00
8f77e6363a
[Feature](function) Support xxhash function like murmur hash function ( #31193 )
2024-02-23 19:03:28 +08:00
1456785aa1
[fix](join) incorrect result of mark join in nested loop join ( #31280 )
2024-02-23 19:03:28 +08:00
04c295c4c2
Improve show column stats performance. ( #31298 )
2024-02-23 19:03:28 +08:00
0bf13525d7
[opt](cancel) Cancel get result future immediately if query is cancelled ( #31228 )
2024-02-23 19:03:16 +08:00
940fbd4dad
[test](mtmv)add p0 filter case ( #31271 )
...
* [test](mtmv)add p0 filter case
* add same todo case
2024-02-23 19:03:16 +08:00
d68067630a
[docs](fix) modify identity in DROP-USER.md ( #30891 )
2024-02-23 19:03:16 +08:00
7bb276d071
change to rc09
2024-02-22 22:23:01 +08:00
e56fe682c9
fix total task exec time is far more than actual ( #31279 )
2024-02-22 22:22:29 +08:00
18f9ca9242
[fix](jdbc catalog) Fix Resource Closing Logic After Connection Abort ( #31219 )
...
* [improvement](jdbc catalog) Optimize the closing logic of Jdbc connection after abort
* [improvement](jdbc catalog) Optimize the closing logic of Jdbc connection after abort
* fix
2024-02-22 20:35:10 +08:00
f42935560d
[tools] remove useless conf ( #31295 )
...
Co-authored-by: zhongjian.xzj <zhongjian.xzj@zhongjianxzjdeMacBook-Pro.local >
2024-02-22 20:35:10 +08:00
7fd53a92b8
fix partial-update doc ( #30612 )
2024-02-22 20:35:10 +08:00
f65876d803
[Feature](explode) support explode map type ( #30151 )
2024-02-22 20:08:44 +08:00
caf68f3f60
[enhancement](fe) Accelerate replay journal when meta out of date ( #31161 )
2024-02-22 20:06:50 +08:00
100cea16d9
[fix](nereids)show error message if use wrong alias to bind the table ( #31264 )
2024-02-22 20:06:50 +08:00
9481728b37
[tools] update tools script ( #31286 )
2024-02-22 19:51:51 +08:00
22efb1cb7a
[fix](Nereids) not equals and hashCode should contains generate flag ( #31123 )
2024-02-22 19:51:20 +08:00
