ce68d24e95
[Bug](function) fix current_date not equal to curdate ( #11463 )
...
* fix current_date not equal to curdate
2022-08-04 09:25:50 +08:00
33053ad1fe
[improvement](outfile) support multibyte separator in outfile clause ( #11487 )
2022-08-04 09:06:06 +08:00
838fdc1354
[Bug](httpserver) Fix bug that http server should not be stoped in destructor if it not running
...
Co-authored-by: weizuo <weizuo@xiaomi.com >
2022-08-03 19:44:46 +08:00
4ba2422039
[improvement](fe) Remove constant keys in aggregation ( #11434 )
2022-08-03 19:43:35 +08:00
7366f187d7
[doc](schema change) Correct Schema Change error description ( #11456 )
...
Correct Schema Change error description
2022-08-03 18:35:55 +08:00
e1b878fe10
[Improvement](datev2) apply time LUT to datev2/datetimev2 ( #11401 )
...
* [Improvement](datev2) apply time LUT to datev2/datetimev2
2022-08-03 17:15:09 +08:00
a47eff1e46
[enhancement](Nereids) support all join type in Nereids that could do join by HashJoinNode ( #11446 )
...
add and test join type:
1. inner join
2. left outer join
3. right outer join
4. left semi join
5. right semi join
6. left anti join
7. right anti join
2022-08-03 12:14:17 +08:00
30e7f76def
[regression](unique-key-merge)add tpch_sf1_p1 test ( #11442 )
2022-08-03 11:22:50 +08:00
4864a83f04
[regression](unique-key-merge-test) add ssb_sf1_p1 test ( #11447 )
2022-08-03 11:22:24 +08:00
5b9b6c9065
[WIP](decimalv3) WIP ( #11443 )
...
* [feature-WIP](decimalv3) fix some bugs of decimalv3
2022-08-03 11:21:36 +08:00
77d82bb292
[Bug](MaterializedView) Fix bug of light schema change do not set right unique id cause MV coredump ( #11396 )
...
Fix bug of light schema change do not set right unique id cause MV coredump
2022-08-03 11:21:28 +08:00
b892dfdbbd
[Improvement](regresstion test) Fix regression test case failure for ASAN build ( #11400 )
...
* [improvement](regresstion test) Improve performance of ASAN build by using -O3 and fix mem limit exceed error for nereids test cases
* exclude tpcds_sf1 q72 for ASAN build because this query takes too long time
2022-08-03 11:19:50 +08:00
573ebf235e
[enhancement](build) Support customizing extra compile flags ( #11444 )
2022-08-03 11:02:17 +08:00
4ae4909a2b
[refactor](tvf) table-valued-function table ( #11452 )
2022-08-03 10:39:16 +08:00
1b4d6a620a
(feature-wip)[parquet-reader] support page index serde ( #11415 )
2022-08-03 10:36:06 +08:00
c581855a41
[fix](hive-table) fix bug that hive external table can not query table created by Tez ( #11345 )
...
* [fix](hive-table) fix bug that hive external table can not query table created by Tez
If the hive is created by Tez, the location of the table is a second-level director, eg:
/user/hive/warehouse/region_tmp_union_all/
---/user/hive/warehouse/region_tmp_union_all/1
---/user/hive/warehouse/region_tmp_union_all/2
We should recursive traverse the directory to get the real files.
2022-08-03 09:07:47 +08:00
db3ba02993
[fix](planner) Fix an issue where outputSmap's size could grow exponentially ( #11378 )
...
* [fix](planner) Fix an issue where outputSmap'size could grow exponentially
2022-08-03 09:07:00 +08:00
71ea3f2906
fix(typo): in docs(zh-CN) how to be a committer ( #11445 )
2022-08-03 08:45:22 +08:00
1e59c4054a
[minor](log) add some log to observe the change of table's state. ( #11448 )
...
When upgrading to 1.x, some table's state may change to ROLLUP,
Resulting in not able to create/drop/modify partition.
I haven't find the root cause yet, so I add some log to observe
the change of table's state.
2022-08-03 08:43:14 +08:00
de4466624d
[refactor](schema change)Remove delete from sc ( #11441 )
...
* not need call delete handler to filter rows since they are filtered in rowset reader
* need not call delete eval in schema change and remove related code
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-08-03 03:29:41 +08:00
7148e3dfaa
[Community](readme)Update README.md ( #11388 )
...
add technical overview and fix some typo.
2022-08-02 22:27:22 +08:00
4850873f66
[doc](sql-block-rule) add more example ( #11416 )
...
sql-block-rule ： add more example
2022-08-02 18:39:13 +08:00
6e684c695d
fix-doc ( #11436 )
...
fe-config fix
2022-08-02 18:38:30 +08:00
d6149e4777
[Enhancement](TabletInvertIndex) use StampLock to instead of ReentranReadWriteLock to get better performance ( #11422 )
...
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-08-02 17:53:30 +08:00
842a5b8e24
[refactor](agg) Abstract the hash operation into a method" ( #11399 )
2022-08-02 17:27:19 +08:00
1db8a2d136
[bugfix](runtimefilter)fix runtimefilter access violation when stub is nullptr ( #11180 )
2022-08-02 16:57:17 +08:00
945256f6a6
[regression](Nereids) add nereids syntax regression suite ( #11423 )
...
add a new regression suite for test nereids syntax. It load data only and has no test case now.
2022-08-02 16:45:53 +08:00
ff8a4ec2f2
[WIP][feature] support create,alter,refresh,drop stmt syntax for multi table materialized view ( #11218 )
...
* [WIP][feature] support `create`,`alter`,`refresh`,`drop` stmt for multi
table materialized view
2022-08-02 16:03:36 +08:00
cd6fbd09bf
[feature] (Nereids) add rule to merge consecutive project nodes ( #11262 )
...
Merge consecutive project nodes. For example:
logical plan tree:
```
project(a)
|
project(a,b)
|
project(a, b, c)
|
scan
```
transformed to:
```
project(a)
|
scan
```
2022-08-02 15:58:55 +08:00
38ffe685b5
[Bug](ODBC) fix vectorized null value error report in odbc scan node ( #11420 )
...
* [Bug](ODBC) fix vectorized null value error report in odbc scan node
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-08-02 15:44:12 +08:00
e41bfd8149
[Bug] Update Stmt Fail use in predicate query ( #11414 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-08-02 15:14:36 +08:00
fcfc76f4a9
[Bug](date function) from_unixtime return wrong result ( #11410 )
...
* [Bug](date function) `from_unixtime` return wrong result
2022-08-02 14:23:54 +08:00
ac62c9507e
[improvement](script)Audit build script ( #11411 )
2022-08-02 12:06:44 +08:00
f730a048b1
[feature-wip](load) Support single replica load ( #10298 )
...
During load process, the same operation are performed on all replicas such as sort and aggregation,
which are resource-intensive.
Concurrent data load would consume much CPU and memory resources.
It's better to perform write process (writing data into MemTable and then data flush) on single replica
and synchronize data files to other replicas before transaction finished.
2022-08-02 11:44:18 +08:00
abbf75d302
[doc][refactor](metrics) Reorganize FE and BE metrics and add document ( #11307 )
2022-08-02 11:34:06 +08:00
60b5ed16a8
[improvement](test) move correctness and account suites to p0 while tpcds_sf1 t0 p1 ( #11350 )
2022-08-02 11:23:01 +08:00
8e3979b3d1
FIX: audit user ( #11408 )
2022-08-02 11:19:02 +08:00
f8f63874a3
[docs](routine-load)modify config name ( #11394 )
...
modify config name
2022-08-02 11:17:37 +08:00
8537ec6c02
[doc] Add missing ADMIN DIAGNOSE TABLET doc ( #11273 )
...
Add missing ADMIN DIAGNOSE TABLET doc
2022-08-02 11:13:57 +08:00
cee4e767b5
fix document ( #11383 )
...
fix document : en/get-starting
2022-08-02 11:12:57 +08:00
22f5dedf8a
[doc]Doc fix ( #11384 )
...
* fix document，pull-request and get-starting
2022-08-02 11:12:11 +08:00
0ac5228c05
[feature-wip][multi-catalog]Support prefetch for orc file format ( #11292 )
...
Refactor the prefetch code in parquet and support prefetch for orc file format
2022-08-02 11:01:15 +08:00
bd6e3cf132
[improvement]lock_times_limit ( #11404 )
...
Co-authored-by: songning03 <songning03@meituan.com >
2022-08-02 10:59:58 +08:00
44a1a20e65
[feature-wip](parquet-reader)parse parquet schema ( #11381 )
...
Analyze schema elements in parquet FileMetaData, and generate the hierarchy of nested fields.
For exmpale:
1. primitive type
```
// thrift:
optional int32 <column-name>;
// sql definition:
<column-name> int32;
```
2. nested type
```
// thrift:
optional group <column-name> (LIST) {
repeated group bag {
optional group array_element (LIST) {
repeated group bag {
optional int32 array_element
}
}
}
}
// sql definition:
<column-name> array<array<int32>>
```
2022-08-02 10:56:13 +08:00
003335c1c5
[refactor](schema change) spark dpp need not call convert rowset during load process ( #11397 )
...
* remove unused schema change logic in push handler
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-08-02 10:18:00 +08:00
6af35a8eb7
[fix](TabletInvertedIndex) fix potential deadlock between ForkJoinPool and TabletInvertedIndex ( #11365 )
...
* [fix](TabletInvertedIndex) fix potential deadlock between ForkJoinPool and TabletInvertedIndex
The default ForkJoinPool is shared by all parallelStream by default, and we obtain read lock outside the ForkJoinPool in TabletInvertIndex while we obtain read lock inside the same ForkJoinPool in TabletStatMgr which may cause deadlock
2022-08-02 10:08:05 +08:00
5c1cd058f2
[Feature] Add interface to check tablet segment lost ( #10711 )
...
Co-authored-by: weizuo <weizuo@xiaomi.com >
2022-08-02 09:40:04 +08:00
edf92f10ff
[fix](build) The nproc command does not exist in macos by default, use sysctl -n hw.logicalcpu instead to get the number of logical cores available ( #11379 )
2022-08-02 09:11:14 +08:00
27a19118dd
[Community](about)Update .asf.yaml ( #11390 )
2022-08-01 23:15:37 +08:00
27be5e8667
[feature-wip](decimalv3) Fix UTs when decimalv3 is enabled ( #11380 )
2022-08-01 23:07:38 +08:00
