842ff2b1e2
[refactor] Refactor time LUT ( #10982 )
2022-07-19 08:23:29 +08:00
68b9a2936a
[improvement](doe) Step1: Fe generates the DSL and is used to explain ( #9895 )
...
For the first step, I will only change FE and then change BE once I make sure the DSL is ok.
2022-07-18 23:20:58 +08:00
e769597fd2
[Improvement] (datetime) support microsecond for date literal ( #10917 )
...
* [Improvement] (datetime) support microsecond for date literal
* remove joda dependency
2022-07-18 21:39:39 +08:00
8a366c9ba2
[feature](multi-catalog) read parquet file by start/offset ( #10843 )
...
To avoid reading the repeat row group, we should align offsets
2022-07-18 20:51:08 +08:00
60dd322aba
[feature-wip](multi-catalog) Optimize threads and thrift interface of FileScanNode ( #10942 )
...
FileScanNode in be will launch as many threads as the number of splits.
The thrift interface of FileScanNode is excessive redundant.
2022-07-18 20:50:34 +08:00
a849f5be71
[feature](Nereids): hashCode(), equals() and UT. ( #10870 )
...
Add hashCode(), equals() for operator.
Add basic UT for them(need more detail test).
**future ticket**: add hashCode(), equals() and UT for `Expression`
2022-07-18 20:33:10 +08:00
4c161b7e2c
[regression-test] add tpch_sf1 test ( #10846 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2022-07-18 20:00:02 +08:00
b185545243
[refactor](Nereids)remove generic type from Rule and Job ( #10897 )
2022-07-18 19:35:16 +08:00
afc1d0c05c
[Chore][Compile] fix compile fail on clang ( #10837 )
...
fix compile fail on clang because of output int128
2022-07-18 19:21:01 +08:00
899acb6564
[improvement][agg]import sub hashmap ( #10937 )
2022-07-18 18:36:45 +08:00
b037aca4fd
[improvement](dynamic-partition) add replication allocation check for dynamic partition when creating table( #10892 )
2022-07-18 18:02:33 +08:00
a2ed4b5c78
[improvement] improvement for light weight schema change ( #10860 )
...
* improvement for dynamic schema
not use schema as lru cache key any more.
load segment just use the rowset's original schema not the current read schema.
generate column reader and column iterator using the original schema, using the read schema if it is a new column.
using column unique id as key instead of column ordinals.
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-07-18 17:53:31 +08:00
ba04c983ae
[regression-test]Add order by for qt_select1 in test_aggregate_all_functions ( #10951 )
2022-07-18 17:44:23 +08:00
890fd70620
[improvement] dynamically calculate max rows to read in a batch to avoid oom ( #10972 )
2022-07-18 17:43:53 +08:00
6736e06679
[feature](udf) Vectorization support remote udaf #10683 ( #10685 )
2022-07-18 17:15:34 +08:00
9adbd8abbd
[feature](resource-tag) support multi tag for a single Backend ( #10901 )
2022-07-18 16:50:45 +08:00
091e17ecab
fix(fe): add , with json_root property in stmt show create routine load for xx_job ( #10929 )
...
Fix issue: https://github.com/apache/doris/issues/10928
2022-07-18 16:44:40 +08:00
216a55c12c
[regression] Add ssb sf1 test under unique table with zstd ( #10957 )
...
* Add ssb sf1 test under unique table with zstd
Co-authored-by: smallhibiscus <844981280>
2022-07-18 16:35:14 +08:00
d9095922d9
[Enhancement] [Memory] add strict memory usage compile option STRICT_MEMORY_USE ( #10936 )
...
In the strict memory usage mode of STRICT_MEMORY_USE=ON, when the capacity of the vectorized Hash Table is greater than 2G, it starts to grow when 75% of the capacity is satisfied, the memory usage of the vectorized Join becomes 50% of the previous value.
STRICT_MEMORY_USE=ON` expects BE to use less memory, and gives priority to ensuring stability when the cluster memory is limited.
2022-07-18 16:16:43 +08:00
d199283df0
[Docs] add doc of tablet local debug ( #10944 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-07-18 16:02:29 +08:00
006d7c9225
[fix]The spring boot startup banner is lost, and the maven package does not package the pictures in the resources directory ( #10955 )
2022-07-18 16:00:14 +08:00
234e822b36
[Regression](Array) add more array test ( #10770 )
2022-07-18 15:27:13 +08:00
16866e3c55
[doc] Add compression properties to the create table document ( #10829 )
...
Co-authored-by: smallhibiscus <844981280>
2022-07-18 15:25:53 +08:00
108e6207b1
[doc] fix sequence_column_manual.md ( #10907 )
...
Co-authored-by: yixiutt <yixiu@selectdb.com >
2022-07-18 15:24:15 +08:00
cc7c31b080
[Bug](be) fix be coredump when receive singal( #10903 ). ( #10953 )
2022-07-18 15:23:51 +08:00
dc01ea7ad9
[fix](nereids) Fix the substring compilation error caused by merge ( #10965 )
...
Compilation error after merging due to Literal refactoring.
Compilation failure:
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/Substring.java:[40,38] org.apache.doris.nereids.trees.expressions.Literal is abstract; cannot be instantiated
2022-07-18 15:20:25 +08:00
238395e282
[Bug] fix decimal arithmetic calculations ( #10963 )
2022-07-18 14:35:07 +08:00
8c544b6e13
fix show storage policy null pointer and redundant log ( #10906 )
...
* fix show storage policy null pointer and redundant log
2022-07-18 14:08:54 +08:00
77ef19dbcd
[BugFix](Array)Fix using Array aggregate function caused be coredump ( #10649 )
2022-07-18 13:47:17 +08:00
0b177669d9
[feature](nereids) support substring ( #10847 )
...
support substring, for example:
select substr(a, 2), substring(b ,3 ,4) from test1;
2022-07-18 12:38:56 +08:00
bf95440c13
[Refactor](nereids)Refactor Literal to an inheritance hierarchy ( #10771 )
...
Use inheritance hierarchy instead of combination to make the framework more clear
2022-07-18 12:01:30 +08:00
d0dc93654e
[doc] update proxy_connect_timeout and proxy_timeout from 30s to 300s ( #10753 )
2022-07-18 10:55:41 +08:00
2d5aca18fb
[feature-wip](array) add the array_sort function ( #10598 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-07-18 10:52:42 +08:00
e3c19ded44
[enhancement](thirdparty) Support building thirdparty on macOS ( #10677 )
2022-07-18 10:50:30 +08:00
5c88a74792
[Enhancement] generate runtime filter only for tuples with conjunct ( #8745 )
...
Remove useless runtime filter in some primary-foreign key join scenario in TPCH case.
2022-07-18 09:37:45 +08:00
2b6cdcf599
[improvement] add an option to let regression stop when a failure happen ( #10939 )
...
For community pipeline, it is a waste of resource to run tests with errors.
2022-07-18 08:53:17 +08:00
ec5996f1f8
[improvement]do not acquire mutex in metric hook ( #10941 )
2022-07-18 08:52:24 +08:00
2e94674cb5
[fix](alter) fix bug that fe crash because npe on rollupBatchTask ( #10943 )
...
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-07-18 08:47:25 +08:00
523d395527
[refactor] Remove alpha rowset meta ( #10933 )
...
* remove alpha_rowset_meta
* remove alpha rowset related codes in compaction
* remove alpha rowset related codes in RowsetMeta
* fix be ut because some ut use alpha rowsetmeta
2022-07-18 08:45:46 +08:00
50cb26d599
revert sc case ( #10945 )
...
schema change cases leads to failure of creating partition.
2022-07-17 21:45:23 +08:00
6b1408ce41
[fix](planner) fix create view when using union ( #10849 )
2022-07-17 20:54:40 +08:00
c3e1b73d15
revert cast_to_string ( #10940 )
...
It leads schema change p0 tests to failure.
2022-07-17 18:34:39 +08:00
09d19e3f0f
[feature-wip](array-type) explode support more sub types ( #10673 )
...
1. explode support more sub types;
2. explode support nullable elements;
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-07-17 18:08:30 +08:00
5793cb11d0
[feature-wip] (array-type) function concat_ws support array ( #10749 )
...
Issue #10052
function concat_ws support array
2022-07-17 17:50:39 +08:00
3bc6655069
[refactor] remove BlockManager ( #10913 )
...
* remove BlockManager
* remove deprecated field in tablet meta
2022-07-17 14:10:06 +08:00
464830437a
[doc] add cloudcanal docs ( #10813 )
2022-07-17 11:50:40 +08:00
eec142ae90
[Enhancement] Use shared file reader when read a segment ( #10896 )
...
* readers under a segment use a shared FileReader
* no need to cache fd in LocalFileReader
2022-07-17 07:54:58 +08:00
c45a98d4c0
[Bug] Fix invalid nullmap ( #10925 )
2022-07-17 07:53:11 +08:00
02460ab4a9
change date to int, good for performance ( #10889 )
2022-07-16 22:35:43 +08:00
0381cdc989
[Bug] fix core for min/max runtime filter ( #10899 )
2022-07-16 22:22:51 +08:00
