e4f7d77c5c
[Optimize](parquet-reader) Opt by filtering null count statistics in rowgroup and page level. ( #19106 )
...
Issue Number: About #19038 , we found in this case, l_orderkey has many nulls,
so we can filter it by null count statistics in the row group and page level,
then it can improve a lot of performance in this case.
2023-04-27 21:21:30 +08:00
95d91e7010
[bugfix](txn_manager) use write lock to protect txn_tablet_map ( #19161 )
2023-04-27 20:21:20 +08:00
7cf1ffa0b4
[fix](planner) ctas should not clone queryStmt after parse ( #19114 )
...
Remove redundant clone in the constructor of CTAS stmt
Error message:
```
NullPointerException, msg: java.lang.NullPointerException: null
```
2023-04-27 20:09:11 +08:00
8288494e8e
[fix](planner) AnalyticEvalNode should call child's getOutputTupleIds method to get the correct output tuple id ( #19163 )
2023-04-27 20:04:51 +08:00
9e2b118288
[RegressTest](Exec) Add DCHECK null_aware_left_anti_join in mark join ( #19149 )
2023-04-27 17:52:03 +08:00
f3f0496b99
[feature](multi-catalog) support oceanbase jdbc catalog and jdbc external table ( #18943 )
...
* [feature](multi-catalog) support oceanbase jdbc catalog and jdbc external table
2023-04-27 17:14:48 +08:00
7d89b57706
[enhancement](stats) Optimize stats pre-load logic #19138
...
1. Don't do pre-load until stats table gets ready
2. Don't put pre-loaded unknown stats to cache
2023-04-27 16:01:31 +08:00
a9480bdcf3
[doc](fix)Unified JSON format ( #19147 )
2023-04-27 14:59:18 +08:00
f23c93b3c6
[fix](memory) Fix AggFunc memory leak due to incorrect destroy ( #19126 )
2023-04-27 14:58:32 +08:00
30f2f67ca1
[fix](Hive bitmap udf) NPE error when mapreduce task only has map task ( #19140 )
...
Issue Number: close #17539
2023-04-27 14:52:26 +08:00
98a975b013
[fix](memory) Fix SchemaChange memory leak due to incorrect aggfunc destroy ( #19130 )
2023-04-27 14:44:00 +08:00
8412571030
[fix](memleak) avoid memleak due to race condition ( #19071 )
2023-04-27 14:22:09 +08:00
2727ad14cd
[typo](docs)Optimize the query acceleration directory structure ( #19113 )
2023-04-27 14:08:48 +08:00
ce5dd43a6a
[doc](fix)load json doc add through S3 table function load #19141
2023-04-27 14:08:21 +08:00
68d3111629
[bugfix](topn) fix memory leak in topn AcceptNullPredicate ( #19060 )
...
fix the memory leak reported by ASAN as follows.
2023-04-27 14:07:57 +08:00
0ffb91fd6e
[Chore](CI)Scheduling cycles should use standard crontab ( #19144 )
2023-04-27 13:59:51 +08:00
7b02fa5cd6
[optimization](conf) optimization JAVA_OPTS for be conf and be bin ( #19029 )
2023-04-27 13:48:46 +08:00
9de2ec5aa5
[fix](Nereids) topn two phase read do not process child correct ( #19136 )
2023-04-27 13:23:15 +08:00
30b737059c
[typo](docs)release 1.2.4.1 ( #19139 )
2023-04-27 13:13:18 +08:00
b9855a6e29
[Fix](inverted index) fix memory leak for inverted index ( #19008 )
...
forget to delete handler->_shared_lock
2023-04-27 11:53:55 +08:00
484612a0af
[opt](statistics) optimize Incremental statistics collection and statistics cleaning ( #18971 )
...
This pr mainly optimizes the following items:
- the collection of statistics: clear up invalid historical statistics before collecting them, so as not to affect the final table statistics.
- the incremental collection of statistics: in the case of incremental collection, only the corresponding partition statistics need to be collected.
TODO: Supports incremental collection of materialized view statistics.
2023-04-27 11:51:47 +08:00
708c1850d9
[test](hll) add test case for hll_raw_agg ( #19127 )
2023-04-27 11:33:49 +08:00
bab34e9e7c
[fix](test) change to strong pwd to avoid test failure ( #19042 )
...
Some other test case may set password policy to "strong",
which may cause this case fail.
2023-04-27 11:19:07 +08:00
e76b3a316f
[Bug](mysql proto) fix binary proto with dynamic mode ( #19055 )
...
Dynamic mode used in array type when serialize it to mysql row buffer using dynamic mode, when combine binary row format with dynamic mode,something goes wrong, and lead to invalid binary row format.
2023-04-27 11:18:01 +08:00
ab8adea39f
[fix](load-profile) fix show load profile return emoty result ( #19125 )
...
Fix 2 bugs of show load profile:
For broker load, the second level should be the sub task' id.
show load profile stmt should be forwarded to master FE to execute.
2023-04-27 11:05:00 +08:00
908518915d
[Feature](resource-group) Support alter resource group ( #18990 )
2023-04-27 10:48:17 +08:00
971018c0f1
[Chore](CI)Increase Sonar check frequency ( #19131 )
2023-04-27 10:10:19 +08:00
f9f5bbde6f
[feature-wip](duplicate_no_keys) add create duplicate table without keys ( #18758 )
2023-04-27 09:59:56 +08:00
84d040bdbf
[fix](heartbeat) fix update BE last start time ( #18962 )
...
Sometimes the LastStartTime info in show backends result is unchanged even if BE restart.
This PR fix it
2023-04-27 09:59:04 +08:00
20395ce501
[feature](array_function): add support for array_cum_sum function ( #18231 )
2023-04-27 09:57:13 +08:00
6eb12640a1
[fix](segment_iter) do not init segment_iterator twice ( #18337 )
...
* [fix](segment_iter) do not init segment_iterator twice
SegmentIterator::init is called by Segment::new_iterator and
BetaRowsetReader::get_segment_iterators twice.
2023-04-27 09:51:57 +08:00
32fa9e09f4
[feature](Nereids): enable OuterJoinAssoc ( #19111 )
2023-04-27 09:50:15 +08:00
a262f42a28
[refactor](exceptionsafe) make scanner and scancontext exception safe ( #19057 )
2023-04-27 09:23:01 +08:00
1afa7c786f
[test](regression) add test case for bucket shuffle of datetime column ( #19088 )
2023-04-27 09:05:32 +08:00
d12fe4a7d2
[bug](fix)fix Geo memory leak ( #19116 )
2023-04-27 09:04:10 +08:00
b5140bc9b4
[fix](fe)hll_raw_agg function's return type should be always not nullable ( #19115 )
2023-04-27 08:00:49 +08:00
ae252d1cfa
[opt](Nereids) simplify decimalv3 comparison predicate ( #18975 )
...
1. fix constant folding failed on decimalv3 type
2. support reduce decimalv3 literal precision in comparison predicate
3. support fe config enable_decimal_conversion
2023-04-26 23:57:09 +08:00
925efc1902
[bug](map-type)fix some bugs in map and map element function ( #18935 )
...
fix some bugs in map and map element function.
2023-04-26 22:10:15 +08:00
aacc075f09
[fix](planner) SetOperationNode's slots' nullability calculation is wrong ( #19108 )
...
SetOperationNode's slots' nullability should consider slots info from all children, even some children have EmptyResultSet
2023-04-26 21:18:37 +08:00
965682542d
[typo](docs)add hive catalog faq ( #19081 )
...
* add hive catalog faq
add hive catalog faq
* fix
2023-04-26 21:13:46 +08:00
55d7c5e147
[fix](nereids) column prune should use slots from children ( #19112 )
...
the slots' nullable property may different between parent and children. So column prune should always use slots of children
2023-04-26 21:10:29 +08:00
aabcab9dbe
[Improvement](runtime filter) Improve merge phase ( #18828 )
2023-04-26 21:01:20 +08:00
0271886c36
[Chore](thirdparty) update clucene from 2.4.9 to 2.4.11 ( #18876 )
2023-04-26 20:11:35 +08:00
b3b261e052
[fix](colocate) prohibit dead backend as destination backend in colocate balance ( #18970 )
2023-04-26 20:09:01 +08:00
e83d0d9b6a
[opt](Nereids) forbid some bad pattern aggregate in AggregateStrategy ( #18877 )
...
since we cannot do stats derive and cost estimate on agg very good.
this PR remove some aggregate pattern that usually not good.
1. one stage agg after exchange. this pattern is good only when process very few rows.
2. three stage distinct agg with gather middle merge.
2023-04-26 20:01:35 +08:00
4a6e65c172
[Fix](Planner) fix throw NPE when parse error ( #19097 )
...
some syntax error will cause unclear msg: NPE，because symbol.value is null and cause NPE when call toLowerCase(), we fix it by check if the value is null and return early.
2023-04-26 19:19:55 +08:00
1ccbdee757
[FIX](map-type)fix map regress test & create mapTypeInfo without delete #19033
2023-04-26 19:03:55 +08:00
a32fa219ec
Revert "[Enhancement](compaction) stop tablet compaction when table dropped ( #18702 )" ( #19086 )
...
This reverts commit 296b0c92f702675b92eee3c8af219f3862802fb2.
we can use drop table force stmt to fast drop tablets, no need to check tablet dropped state in every report
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2023-04-26 18:27:46 +08:00
a7f7a42b9c
[community](release) change 1.2.4 download link to 1.2.4.1 ( #19105 )
2023-04-26 18:27:23 +08:00
0c60f0e266
fe conf action spec item ( #18916 )
2023-04-26 17:54:00 +08:00
