8c6ccc092a
[fix](test) fix 2 unstable test ( #19220 )
2023-04-29 14:42:47 +08:00
fc3728c6ab
[fix](dynamic-partition) create HOUR unit partition with DATEV2 throw exception ( #19213 )
...
Need to forbid create HOUR unit partition with partition column type DATEV2
```
Unexpected exception: String index out of range: 10
```
2023-04-29 08:23:06 +08:00
c74c2a4f8e
[fix](Metadata tvf) Metadata TVF supports read the specified columns from Fe ( #19110 )
2023-04-29 00:06:08 +08:00
d006143330
[fix](multi-catalog) when endpoint has no region, need a suggestion ( #19203 )
...
solve the problem
```
mysql> CREATE CATALOG iceberg PROPERTIES (
'type'='iceberg',
'iceberg.catalog.type'='rest',
'uri' = 'http://0.0.0.0:8888 ,
"AWS_ACCESS_KEY" = "admin",
"AWS_SECRET_KEY" = "password",
"AWS_REGION" = "us-east-1",
"AWS_ENDPOINT" = "http://minio:9000 "
);
show databases;
ERROR 1105 (HY000): IllegalArgumentException, msg: java.lang.IllegalArgumentException: The value of property fs.s3a.endpoint.region must not be null
```
2023-04-29 00:05:41 +08:00
4a10d146bf
[pipeline](exec) fix regression prepare failed cause query core dump ( #19208 )
...
fix regression prepare failed cause query core dump
2023-04-28 20:46:39 +08:00
bee3aa3007
be conf action supports specify item ( #19159 )
2023-04-28 19:12:51 +08:00
a324ee794c
[fix](memory) Fix Aggregation null key memory leak due to incorrect aggfunc destroy #19201
2023-04-28 18:41:41 +08:00
b87d21d836
[doc](spark-load)add spark load ha EN docs ( #19194 )
...
* 15000-doc-spark-ha english doc
* Update spark-load-manual.md format
---------
Co-authored-by: liujh <liujh@t3go.cn >
Co-authored-by: Luzhijing <82810928+luzhijing@users.noreply.github.com >
2023-04-28 18:18:42 +08:00
fd3c132d91
[enhancement](test) split large data of p2 cases ( #19186 )
2023-04-28 18:18:25 +08:00
1379d7f3e0
[fix](memory) mmap threshold can be modified in conf, Increase to 128M
2023-04-28 18:17:22 +08:00
43e70ab252
[chore](recover) add a config to recover remaining data in emergency ( #18986 )
2023-04-28 17:42:00 +08:00
365ac54102
[doc](fqdn)fqdn doc cn ( #19179 )
...
* fqdn doc cn
* Update fqdn.md format
---------
Co-authored-by: Luzhijing <82810928+luzhijing@users.noreply.github.com >
2023-04-28 17:26:49 +08:00
6626f26506
[optimize](string) optimize char_length function by SIMD ( #18925 )
...
Optimize char_length function by SIMD
(1) optimize utf8_len compute
(2) 840% up
2023-04-28 17:22:35 +08:00
aef9355cd3
[feature-wip](partial update) PART1: support basic partial write ( #17542 )
2023-04-28 17:17:57 +08:00
718297d3c1
[test](statistics) add p0 test of sampling statistics ( #19176 )
...
1. Added test p0 for sampling collection statistics
2. Modify the uniqueKeys of table analysis_jobs for deletion based on relevant conditions
3. Solve the problem that incremental statistics p0 is less stable
2023-04-28 15:50:05 +08:00
f0852f2ac9
[fix](fe)fix bug if left table is empty and there are multiple right tables need do bucket shuffle to left side ( #19169 )
...
* [fix](fe)fix bug if left table is empty and there are multiple right tables need do bucket shuffle to left side
* fix bug
* fix test cases
2023-04-28 15:06:38 +08:00
48c4679019
[doc] fix broken link in docs ( #19175 )
2023-04-28 14:29:14 +08:00
ec517a53a8
[Chore](build) upgrade clang-format version to 16 && move thrift to fe-common ( #19155 )
...
upgrade clang-format version to 16
move thrift to fe-common
fix core dump on pipeline engine when operator canceled and not prepared
2023-04-28 14:14:51 +08:00
ffe27baeaf
[FAQ](docs) add a FAQ about hive catalog occurring UnknownHostException ( #19182 )
...
[FAQ](docs) add a FAQ about hive catalog occurring UnknownHostException (#19182 )
2023-04-28 13:50:24 +08:00
52b1bd2c81
[clone](download) fix be clone action download tablet content length overflow ( #18851 )
2023-04-28 11:35:17 +08:00
5e9c0c3500
[Enhancement](data-type) add FE config to prohibit create date and decimalv2 type ( #19077 )
...
* prohibits date and decimal type
* add config in test
2023-04-28 11:31:51 +08:00
65a82a0b57
[opt](FileReader) turn off prefetch data in parquet page reader when using MergeRangeFileReader ( #19102 )
...
Using both `MergeRangeFileReader` and `BufferedStreamReader` simultaneously would waste a lot of memory,
so turn off prefetch data in `BufferedStreamReader` when using MergeRangeFileReader.
2023-04-28 09:27:56 +08:00
86be6d27e7
[Enhencement](Cancel Export) Cancel export support to cancel IN_QUEUE state export job ( #19058 )
2023-04-28 09:27:23 +08:00
3082ed806f
[chore](branch-1.1) remove some checks on branch-1.1-lts ( #19145 )
...
The compilation env for branch 1.1 lts is no longer supported.
So remove the required github checks to let PR merged
2023-04-28 09:12:32 +08:00
28016c53f0
[profile](rf) refactor profile of runtime filters ( #19134 )
...
* [profile](rf) refactor profile of runtime filters
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-28 08:46:42 +08:00
31c1ebc165
[Chore](thirdparty) update clucene from 2.4.11 to 2.4.12 ( #19150 )
...
fix memory leak in Standard Analyzer
2023-04-27 23:33:26 +08:00
745f29f557
[typo](doc) add version label ( #19148 )
2023-04-27 23:22:24 +08:00
dfa3fd1bcf
Update CHAR.md ( #19154 )
2023-04-27 23:22:09 +08:00
4aa4abebe7
15000-doc-spark-ha ( #19153 )
...
Co-authored-by: liujh <liujh@t3go.cn >
2023-04-27 23:21:41 +08:00
e0ca4e061b
Update CHAR.md ( #19156 )
2023-04-27 23:21:26 +08:00
72799622e1
[typo](docs) Supplementary explanation on the hint section of insertSupplementary explanation on the hint section of INSERT.md ( #19171 )
2023-04-27 23:21:01 +08:00
a35fc02bd4
[enhance](Nereids): handle project of OuterJoin in Reorder. ( #19137 )
2023-04-27 22:17:03 +08:00
0f895640d9
[opt](Nereids)(WIP) optimize agg and window normalization step 1 ( #19168 )
...
1. move SimplifyAggGroupBy behind NormalizeAggregate
2. fix project to agg rule for the project containing window expression
2023-04-27 21:42:23 +08:00
027bd3f998
doc style fix ( #19158 )
2023-04-27 21:30:03 +08:00
3ed5cf8350
[Optimize] add has_filter template param in get_next_run() to decrease _has_filter condition checking count in the loop. ( #19043 )
2023-04-27 21:23:36 +08:00
e4f7d77c5c
[Optimize](parquet-reader) Opt by filtering null count statistics in rowgroup and page level. ( #19106 )
...
Issue Number: About #19038 , we found in this case, l_orderkey has many nulls,
so we can filter it by null count statistics in the row group and page level,
then it can improve a lot of performance in this case.
2023-04-27 21:21:30 +08:00
95d91e7010
[bugfix](txn_manager) use write lock to protect txn_tablet_map ( #19161 )
2023-04-27 20:21:20 +08:00
7cf1ffa0b4
[fix](planner) ctas should not clone queryStmt after parse ( #19114 )
...
Remove redundant clone in the constructor of CTAS stmt
Error message:
```
NullPointerException, msg: java.lang.NullPointerException: null
```
2023-04-27 20:09:11 +08:00
8288494e8e
[fix](planner) AnalyticEvalNode should call child's getOutputTupleIds method to get the correct output tuple id ( #19163 )
2023-04-27 20:04:51 +08:00
9e2b118288
[RegressTest](Exec) Add DCHECK null_aware_left_anti_join in mark join ( #19149 )
2023-04-27 17:52:03 +08:00
f3f0496b99
[feature](multi-catalog) support oceanbase jdbc catalog and jdbc external table ( #18943 )
...
* [feature](multi-catalog) support oceanbase jdbc catalog and jdbc external table
2023-04-27 17:14:48 +08:00
7d89b57706
[enhancement](stats) Optimize stats pre-load logic #19138
...
1. Don't do pre-load until stats table gets ready
2. Don't put pre-loaded unknown stats to cache
2023-04-27 16:01:31 +08:00
a9480bdcf3
[doc](fix)Unified JSON format ( #19147 )
2023-04-27 14:59:18 +08:00
f23c93b3c6
[fix](memory) Fix AggFunc memory leak due to incorrect destroy ( #19126 )
2023-04-27 14:58:32 +08:00
30f2f67ca1
[fix](Hive bitmap udf) NPE error when mapreduce task only has map task ( #19140 )
...
Issue Number: close #17539
2023-04-27 14:52:26 +08:00
98a975b013
[fix](memory) Fix SchemaChange memory leak due to incorrect aggfunc destroy ( #19130 )
2023-04-27 14:44:00 +08:00
8412571030
[fix](memleak) avoid memleak due to race condition ( #19071 )
2023-04-27 14:22:09 +08:00
2727ad14cd
[typo](docs)Optimize the query acceleration directory structure ( #19113 )
2023-04-27 14:08:48 +08:00
ce5dd43a6a
[doc](fix)load json doc add through S3 table function load #19141
2023-04-27 14:08:21 +08:00
68d3111629
[bugfix](topn) fix memory leak in topn AcceptNullPredicate ( #19060 )
...
fix the memory leak reported by ASAN as follows.
2023-04-27 14:07:57 +08:00
