284a3351f4
[Refactor](exec) refactor the code of datasink eos logic ( #15009 )
2022-12-13 15:33:08 +08:00
73ee352705
[fix](multi catalog)Fix convert_to_doris_type missing break for some cases ( #14992 )
2022-12-13 13:34:55 +08:00
e7a84e4a16
[fix](multi-catalog)fix page index thrift deserialize ( #15001 )
...
fix the err when parse page index: Couldn't deserialize thrift msg.
use two buffer to store column index and offset index msg, avoid parse them in a buffer
2022-12-13 13:33:19 +08:00
8fe0729835
[fix](multi catalog)Check orc file reader is not null before using it. ( #14988 )
...
The external table file path cache may out of date, which will cause orc reader to visit non-exist files.
In this case, orc file reader is nullptr.
This pr is to check the reader before using it to avoid core dump of visiting nullptr.
2022-12-13 11:27:51 +08:00
5e26ba98bd
[enhancement](compaction) exist safely ( #15021 )
2022-12-13 10:57:27 +08:00
decabbb933
[Chore](s2geo) upgrade s2geo to 0.10.0 ( #15002 )
...
upgrade s2geo to 0.10.0
2022-12-13 10:34:51 +08:00
1200b22fd2
[function](round) compute accurate round value by decimal ( #14946 )
2022-12-13 09:53:43 +08:00
0d5291801d
[fix](load) fix that flush memtable concurrently may cause data inconsistency ( #15005 )
2022-12-13 09:27:35 +08:00
c25a7235f9
[Pipeline](load) support pipeline broker load ( #14940 )
...
support pipeline broker load
2022-12-13 00:28:36 +08:00
1f56279fd8
[Vectorized] Use SIMD to skip batches of null data in aggregation ( #10392 )
2022-12-12 23:40:31 +08:00
c8551e0cad
[Bug](compile) Fix compiling error if set ENABLE_STACKTRACE ( #15004 )
2022-12-12 20:41:10 +08:00
b5c0d4870d
[fix](nereids)fix bug of elt and sub_replace function ( #14971 )
2022-12-12 17:37:36 +08:00
affc57bee7
[enhancement](pipeline) support jdbc scan, jdbc sink, odbc scan and odbc sink node for pipeline. ( #14986 )
...
support jdbc scan, jdbc sink, odbc scan and odbc sink node for pipeline.
2022-12-12 17:03:22 +08:00
38570312dd
[feature](split_by_string)support split by string function ( #13741 )
2022-12-12 15:22:30 +08:00
75d88b5a8f
[improvement](vertical_compaction) reduce segments load in vertical merger ( #14900 )
2022-12-12 15:06:46 +08:00
7c242fe03e
[Chore](phmap) upgrade phmap to 1.3.8 ( #14965 )
...
upgrade phmap to 1.3.8
2022-12-12 11:44:41 +08:00
33349c3419
[feature](function)Support negative index for function split_part ( #13914 )
2022-12-12 09:56:09 +08:00
f3aea7f0f0
[Enhancement](status) Unify error code and enable customed err msg for BE internal errors ( #14744 )
2022-12-11 23:33:18 +08:00
7fb695b51d
[Pipeline](select node) Support select node on pipeline engine ( #14928 )
2022-12-11 21:31:32 +08:00
afcacc0a13
[bugfix](compaction) fix compaction trigger ( #14981 )
...
fix bug that when disable_auto_compaction=true but still trigger compaction
2022-12-11 18:26:00 +08:00
8c406c5e59
[Bug](DictoryColumn) reverse the _codes.size() replace _reserve_size ( #14984 )
2022-12-11 18:25:18 +08:00
ef46b580d0
[Vectorized](operator) support analytic eval operator ( #14774 )
2022-12-10 19:32:11 +08:00
0b945e4ee3
[fix](csv-reader) fix be crash when reading invalid value ( #14951 )
2022-12-10 18:45:47 +08:00
b7453f6f09
[pipeline](mysqlsink) support mysql table sink ( #14982 )
2022-12-10 13:16:53 +08:00
68092fe514
[pipeline](NLJ) support nested loop join for pipeline ( #14966 )
2022-12-10 00:20:16 +08:00
af50461211
[fix](statistics) fix CpuTimeMS in audit log when enable_vectorized_engine=true. ( #14853 )
...
Co-authored-by: wangxiangyu@360shuke.com <wangxiangyu@360shuke.com >
2022-12-09 21:13:05 +08:00
9eeb8b8711
[Bugfix](Jsonb) fix jsonb load in unique key model ( #14958 )
...
* [Bugfix](Jsonb) fix jsonb load in unique key model
Register JSONB to `replace_load` agg function
* fix test
2022-12-09 21:10:14 +08:00
4c27ee2584
[Bug](predicate) fix undefined behavior on in list predicate #14961
2022-12-09 21:09:54 +08:00
0c8fdc90fb
[pipeline](union) support union operator ( #14963 )
2022-12-09 19:55:40 +08:00
4611947920
[Pipeline](Operator) Add schema scan node operator ( #14955 )
2022-12-09 19:55:03 +08:00
0ec218108d
[enhancement](remote) support local cache GC at the granularity of cache files ( #14920 )
...
* [enhancement](remote) support local cache GC at the granularity of cache files
* update
* update
* update
2022-12-09 17:35:23 +08:00
8d17eea22b
[pipeline](mysqlscan) support mysql scan node ( #14949 )
2022-12-09 16:25:29 +08:00
b213ce6ffd
[Bug](pipeline) Fix double prepare on pipeline engine ( #14959 )
2022-12-09 14:35:34 +08:00
873b128fde
[feature](pipeline) add inersect/except operators ( #14868 )
2022-12-09 14:13:48 +08:00
5a1c7f6314
[improvement](analytic) improve memory counter ( #14890 )
2022-12-09 14:13:17 +08:00
ec24a56956
[Exec][Pipeline] Remove AggContext's lock ( #14901 )
...
* [Exec][Pipeline] Remove AggContext's lock
* fix lock location
2022-12-09 14:11:28 +08:00
9d36931038
[Refactor](NLJ) refactor the nested loop join node ( #14911 )
...
* [Refactor](NLJ) refactor the nested loop join node
* change the logic of alloc/release resource
2022-12-09 14:10:26 +08:00
dffa3c0db2
[enhancement](memory) Support query memroy overcommit #14948
...
Add conf enable_query_memroy_overcommit
If true, when the process does not exceed the soft mem limit, the query memory will not be limited; when the process memory exceeds the soft mem limit, the query with the largest ratio between the currently used memory and the exec_mem_limit will be canceled.
If false, cancel query when the memory used exceeds exec_mem_limit, same as before.
2022-12-09 14:09:05 +08:00
00f44257e2
[feature-wip](file-reader) Merge hdfs reader to the new file reader ( #14875 )
2022-12-09 13:21:59 +08:00
20f2abb3d4
[vectorized](pipeline) support assert num rows operator ( #14923 )
2022-12-09 09:39:29 +08:00
b311ebef6c
[pipeline](refactor) do some refactor for code and comments ( #14934 )
2022-12-09 09:08:28 +08:00
41eafa5e9d
[fix](aggregate) agg table and unique table get different result when… ( #14822 )
...
Signed-off-by: nextdreamblue <zxw520blue1@163.com >
2022-12-08 22:54:36 +08:00
375e0e08ca
[Bug](predicate) fix ccore dump on varchar with in list predicate ( #14881 )
...
* fix ccore dump on varchar with in list predicate
* update case
* Update sqlsmith01.sql
2022-12-08 17:14:23 +08:00
0c817e6b3a
[Pipeline](hashjoin) Support hash join on pipeline engine ( #14898 )
2022-12-08 15:43:02 +08:00
dbaa02d3a0
[Pipeline](fix) fix enable_pipeline_engine variable not work ( #14909 )
2022-12-08 14:52:52 +08:00
4c5ddf70db
[bugfix](conf) remove useless conf ( #14918 )
2022-12-08 14:11:15 +08:00
962810b973
[Vectorized](jdbc) add check type for jdbc table ( #14501 )
2022-12-08 10:27:47 +08:00
6a26435e8d
[bugfix](compaction) fix promotion size bug ( #14836 )
2022-12-07 18:54:30 +08:00
204ab4c951
[enhancement](compaction) add some trigger and delete useless log ( #14796 )
...
1.add a vertical compaction segment file size config, make it more
flexible to set segment file size
2.add a config to close skip tablet compaction. If current skip logic
has some bug so we can still use old logic
3.delete some useless log
2022-12-07 18:53:55 +08:00
dfa58e7985
[improvement](config) update high_priority_flush_thread_num_per_store default value to 6 ( #14775 )
2022-12-07 15:31:00 +08:00
