Commit Graph

7640 Commits

Author SHA1 Message Date
21c2e485ae [improvment](function) add new function substring_index (#15024) 2022-12-15 09:54:34 +08:00
46030d786a [Bug](datetimev2) Fix wrong result after insertion (#15052) 2022-12-15 09:54:18 +08:00
03847b6a3a [Feature](Api) Support operate node(fe/be). (#14904)
Support operate node(fe/be) via http
2022-12-14 23:18:56 +08:00
5cf88a5339 [improvement](config) opt the message when missing JAVA_HOME for BE (#15045)
Make the error message easy to understand
2022-12-14 23:17:46 +08:00
f1b2668a62 [typo](doc) Indicates that the order by feature in group_concat function is supported from version 1.2 (#15083) 2022-12-14 21:24:06 +08:00
05805a1632 [typo](docs)Add fe config enable_new_load_scan_node (#15075) 2022-12-14 18:09:53 +08:00
48a70212ac [bugfix](BE)fix broker file compile error (#15070) 2022-12-14 15:46:01 +08:00
41838e6acb [fix](string-type) rectify string type' len to MAX_STRING_LENGTH (#14985)
cherry pick from #14587
2022-12-14 15:41:08 +08:00
83e81c60a2 [fix](regression) Nereids' const by constant case is unstable (#15062) 2022-12-14 15:03:35 +08:00
9d6a81d1e3 [improvement](query)optimize select stmt with limit 0 (#14956) 2022-12-14 13:48:09 +08:00
b8f93681eb [feature-wip](file reader) Merge broker reader to the new file reader (#14980)
Currently, there are two sets of file readers in Doris, this pr rewrites the old broker reader with the new file reader.

TODO:
1. rewrite stream load pipe and kafka consumer pipe
2022-12-14 12:48:02 +08:00
f17b138cbd [BugFix](regression) don't use sf1DataPath when stream load (#15060)
don't use sf1DataPath when stream load
2022-12-14 12:39:56 +08:00
Pxl
30406ef580 [Chore](s2geo) add with gflags on s2geo (#15059)
add with gflags on s2geo
2022-12-14 12:19:01 +08:00
7854e9ae5a [thirdparty](libgsasl) set include dir to enable to find gssapi.h (#15037)
If not set, it can't find gssapi.h, which is generated by krb5.
This will cause the libhdfs3 failed to visit hdfs with kerberos authentication
2022-12-14 12:07:13 +08:00
wxy
bbf3a5420d [fix](statistics) fix missing scanBytes and scanRows in query statist… (#14828)
A patch for PR-14750. There's one modification missing in ISSUE-14750.
2022-12-14 09:37:05 +08:00
03e69d863e [fix](nereids) Use precison and scale of decimal type column (#15025) 2022-12-13 23:39:04 +08:00
bc3a35d962 [typo](doc): modify the installation file (#15036) 2022-12-13 23:37:33 +08:00
271c28472a [typo](docs)Fix doc (#15051) 2022-12-13 23:17:41 +08:00
04e5047674 [feature](Nereids): binder support bind join function. (#15010) 2022-12-13 21:31:44 +08:00
wxy
3d1be664b1 [feature](multi-catalog) support connecting to hive metastore with ke… (#15026)
Support kerberos authentication on hive external catalog
2022-12-13 16:48:46 +08:00
99c339d5cb [refactor](regression) make nereids case in a separate dir (#14990)
add DateV2 and DateTimeV2 for Literal.uncheckCastTo()
move nereids tpch cases into suite nereids_tpch_p1
move nereids datav2 cases into suite nereids_datav2_p1
2022-12-13 16:28:41 +08:00
98ddb86ea2 [typo](doc)Update install-faq.md (#15029)
* [typo](doc) 1.2 set java home variable
2022-12-13 15:38:25 +08:00
284a3351f4 [Refactor](exec) refactor the code of datasink eos logic (#15009) 2022-12-13 15:33:08 +08:00
73ee352705 [fix](multi catalog)Fix convert_to_doris_type missing break for some cases (#14992) 2022-12-13 13:34:55 +08:00
e7a84e4a16 [fix](multi-catalog)fix page index thrift deserialize (#15001)
fix the err when parse page index: Couldn't deserialize thrift msg.
use two buffer to store column index and offset index msg, avoid parse them in a buffer
2022-12-13 13:33:19 +08:00
c767e0bc74 [fix](nereids) create select node for standalone PhysicalFilter node (#14939)
The PhysicalFilter can't be assigned to ExchangeNode, SortNode and UnionNode. The nereids would create a standalone SelectNode to do the filter work properly.
2022-12-13 13:29:45 +08:00
3caa9a19cc [feature](Nereids) add binary & unary arithmetic expression (#14867)
binary arithmetic expression: div, ^, |, &, %
unary arithmetic expression: ~, +1
2022-12-13 12:58:40 +08:00
414566b56d [feature](nereids) Support orderby and groupby int literal as ordinal of the select list expr (#14862) 2022-12-13 12:48:09 +08:00
d9fc46382b [samples](java udf demo)Java udf demo aes (#15011)
* add java udf function demo
2022-12-13 12:09:03 +08:00
8fe0729835 [fix](multi catalog)Check orc file reader is not null before using it. (#14988)
The external table file path cache may out of date, which will cause orc reader to visit non-exist files.
In this case, orc file reader is nullptr.
This pr is to check the reader before using it to avoid core dump of visiting nullptr.
2022-12-13 11:27:51 +08:00
21676b8d81 [Fix](Table Valued function) fix the problem that can not catchthe exception thrown by the TableValuedFunctionRef constructor (#14983)
Put the generation of TableValuedFunctionIf in the analyze function, instead of the generation in the 
TableValuedFunctionRef constructor.
2022-12-13 11:26:04 +08:00
5e26ba98bd [enhancement](compaction) exist safely (#15021) 2022-12-13 10:57:27 +08:00
Pxl
decabbb933 [Chore](s2geo) upgrade s2geo to 0.10.0 (#15002)
upgrade s2geo to 0.10.0
2022-12-13 10:34:51 +08:00
1200b22fd2 [function](round) compute accurate round value by decimal (#14946) 2022-12-13 09:53:43 +08:00
0d5291801d [fix](load) fix that flush memtable concurrently may cause data inconsistency (#15005) 2022-12-13 09:27:35 +08:00
dcede52964 [typo](docs)add be config doris_scanner_row_bytes (#15016) 2022-12-13 09:25:28 +08:00
Pxl
c25a7235f9 [Pipeline](load) support pipeline broker load (#14940)
support pipeline broker load
2022-12-13 00:28:36 +08:00
1f56279fd8 [Vectorized] Use SIMD to skip batches of null data in aggregation (#10392) 2022-12-12 23:40:31 +08:00
ad8ec809b0 [fix](nereids) FoldConstantRuleOnFe throw npe if function do not have child (#15008)
FoldConstantRuleOnFe missed one type of function, which do not have input arguments, like current_date
2022-12-12 22:48:21 +08:00
a5a092ab9f [feature](nereids)support 'ISNULL' expression (#14967) 2022-12-12 22:38:54 +08:00
281d47434a [fix](nereids) having with no group by is not parsed correctly (#14883)
SQL: SELECT * FROM tbl HAVING c1 > 10;
2022-12-12 22:03:37 +08:00
e57419fc9e [feature](nereids) Date add and Date sub related functions (#14753)
## date_add series
- DATE_ADD
- DAYS_ADD
- ADDDATE
- TIMESTAMPADD

## date_sub series
- DATE_SUB
- DAYS_SUB
- SUBDATE

## NOTE
1. For DAYS_XXX, time unit is omissible, by default the time unit is DAY
2. no TIMESTAMPSUB
2022-12-12 21:34:30 +08:00
c8551e0cad [Bug](compile) Fix compiling error if set ENABLE_STACKTRACE (#15004) 2022-12-12 20:41:10 +08:00
9886fcbc62 [ehancement](nereids) Waits read lock up to 1 minute (#15012) 2022-12-12 20:32:26 +08:00
b5c0d4870d [fix](nereids)fix bug of elt and sub_replace function (#14971) 2022-12-12 17:37:36 +08:00
33bd9eb85e [fix](nereids) Support syntax of nested CTE (#14962) 2022-12-12 17:03:44 +08:00
affc57bee7 [enhancement](pipeline) support jdbc scan, jdbc sink, odbc scan and odbc sink node for pipeline. (#14986)
support jdbc scan, jdbc sink, odbc scan and odbc sink node for pipeline.
2022-12-12 17:03:22 +08:00
0a16f11435 [enhancement](Nereids) add RelationId to unboundRelation (#14693)
add RelationId to unboundRelation and refactor some ut used RelationUtil to allocate next RelationId.
2022-12-12 16:24:08 +08:00
38570312dd [feature](split_by_string)support split by string function (#13741) 2022-12-12 15:22:30 +08:00
75d88b5a8f [improvement](vertical_compaction) reduce segments load in vertical merger (#14900) 2022-12-12 15:06:46 +08:00