33abe11dea
[regression-test](query) Add regression case of error could not be changed to nullabl when exe… ( #15123 )
...
* Add regression case of error could not be changed to nullabl when exeing sql
* add out file
Co-authored-by: smallhibiscus <844981280>
2022-12-16 21:57:36 +08:00
4530b531e7
[fix](type) forbid time type when creating table ( #15093 )
2022-12-16 21:54:35 +08:00
67b9d469c1
[Bug](datev2) Fix compatible problems caused by datev2 ( #15131 )
...
This bug is introduced by #15094
2022-12-16 21:52:39 +08:00
be2f1df3f1
[typo](doc) fix doc ( #15132 )
2022-12-16 21:50:21 +08:00
63d2e85372
multi-catalog_doc ( #15139 )
2022-12-16 21:49:50 +08:00
66422fc351
change datatypes order in document sidebar ( #15117 )
2022-12-16 21:28:37 +08:00
874acdf68f
[vectorized](join) add try catch in create thread ( #15065 )
2022-12-16 19:55:09 +08:00
ef21eea2e8
[fix](pipeline) _valid_element_in_hash_tbl was not set correctly ( #15072 )
2022-12-16 18:06:49 +08:00
03d40ad019
change version tag in jsonb doc ( #15115 )
2022-12-16 17:50:21 +08:00
4dbe30d37b
[regression](vectorized) delete vectorized config in regression tests ( #15126 )
2022-12-16 17:08:29 +08:00
b2438b076d
[Bug](case function) do not crash if prepare failed ( #15113 )
2022-12-16 11:02:05 +08:00
219489ca0e
[Bug](s2geo) avoid some core dump on s2geo && enable ut of s2geo #15068
2022-12-16 10:56:02 +08:00
3909970ce9
[fix](explain) fix explain output format problem ( #15019 )
2022-12-16 10:53:05 +08:00
728a238564
[vectorized](jdbc) fix external table of oracle with condition about … ( #15092 )
...
* [vectorized](jdbc) fix external table of oracle with condition about datetime report error
* formatter
2022-12-16 10:48:17 +08:00
c16cc5c602
[fix](memtracker) Fix load channel memory tracker are not refreshed in time ( #15048 )
2022-12-16 10:43:03 +08:00
0e1e5a802b
[config](load) enable new load scan node by default ( #14808 )
...
Set FE `enable_new_load_scan_node` to true by default.
So that all load tasks(broker load, stream load, routine load, insert into) will use FileScanNode instead of BrokerScanNode
to read data
1. Support loading parquet file in stream load with new load scan node.
2. Fix bug that new parquet reader can not read column without logical or converted type.
3. Change jsonb parser function to "jsonb_parse_error_to_null"
So that if the input string is not a valid json string, it will return null for jsonb column in load task.
2022-12-16 09:41:43 +08:00
e0d528980f
[fix](multi catalog)Return emtpy block while external table scanner couldn't find the file ( #14997 )
...
FE file path cache for external table may out of date. In this case, BE may fail to find the not exist file from FE cache.
This pr is to handle this case: instead of throw an error message to the user, we return empty result set to the user.
2022-12-16 09:36:35 +08:00
52e09e6b04
[fix](nereids) add hashcode and equal to TVFProperties to avoid duplicated error.( #15054 )
2022-12-16 03:23:27 +08:00
5e0d44ff25
[fix](nereids) fix bug of expr rewrite and column prune rule of group by exprs ( #15097 )
2022-12-16 03:22:36 +08:00
8f914aa864
[feature](Nereids) support 'timestamp' type constructor ( #15095 )
...
sql like: select timestamp '2022-01-01 01:00:00' + interval '2' hours;
2022-12-16 03:20:56 +08:00
6ddbd204e7
[fix](Nereids): Update plan when prune column in DPHyp ( #14880 )
2022-12-15 21:59:55 +08:00
94e0955687
[Bug](thread token) Fix invalid thread token ( #15110 )
2022-12-15 21:54:57 +08:00
c816d9d6e5
[Chore](s2geo) disable ABSL_BTREE_ENABLE_GENERATIONS and use CMAKE_BUILD_TYPE to rep… ( #15104 )
...
disable ABSL_BTREE_ENABLE_GENERATIONS and use CMAKE_BUILD_TYPE to replace o3
2022-12-15 21:36:28 +08:00
5ee5d70f51
[DOCS](Decimalv3) Add document for Decimalv3 ( #15108 )
...
* [DOCS](Decimalv3) Add document for Decimalv3
* update
2022-12-15 21:27:51 +08:00
5ef4c42a80
[Bug](datev2) Fix wrong result when use datev2 as partition key ( #15094 )
2022-12-15 21:27:05 +08:00
bccea1c511
[Enhancement](partition prune): calculate the column ranges of compound predicates ( #14886 )
...
Doris does not support disjunctive predicates very well, which causes some problems in partition prune.
For example, sqls like the followings will trigger a full table scan without partition pruning
select * from test.t1
where (dt between 20211121 and 20211122) or (dt between 20211125 and 20211126)
2022-12-15 20:47:44 +08:00
c4de619110
[fix](merge-on-write) calc delete bitmap need all segments which _do_flush in one memtable ( #15018 )
...
when some case(need modify be.conf), a memtable may flush many segments and then calc delete bitmap with new data. but now, it just only load one segment with max sgement id and this bug will not cala delte bitmap with all data of all segment of one memtable, and will get many rows with same key from merge-on-write table.
2022-12-15 20:44:49 +08:00
401d5776b0
[fix](compile) compile error while with DORIS_WITH_MYSQL #15105
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-12-15 20:40:33 +08:00
71121deed9
[typo](docs)fix fe config en doc err ( #15111 )
2022-12-15 20:27:12 +08:00
2fcdd766bd
[fix](remote) fix be crash while write data to s3 in debug mode ( #15047 )
2022-12-15 19:56:35 +08:00
9fb62a23f4
[Bug](function) fix overflow on concat_ws ( #15043 )
...
fix overflow on concat_ws
2022-12-15 19:44:27 +08:00
6625e650c4
[fix](resource) HdfsStorage can get default.Fs from path or configuration ( #15079 )
2022-12-15 16:56:32 +08:00
c6d93f739c
[feature-wip](file reader) Merge stream_load_pipe to the new file reader ( #15035 )
...
Currently, there are two sets of file readers in Doris, this pr rewrites the old stream_load_pipe with the new file reader.
2022-12-15 16:31:22 +08:00
face82e56a
[fix](meta) fix bug that backend tag may change to default after upgrading to 1.2 ( #15085 )
2022-12-15 12:07:11 +08:00
67e4292533
[fix](iceberg-v2) icebergv2 filter data path ( #14470 )
...
1. a icebergv2 delete file may cross many data paths, so the path of a file split is required as a predicate to filter rows of delete file
- create delete file structure to save predicate parameters
- create predicate for file path
2. add some log to print row range
3. fix bug when create file metadata
2022-12-15 10:18:12 +08:00
7e90fc5784
[regresion-test](config) open fe debug log ( #15044 )
2022-12-15 10:06:25 +08:00
21c2e485ae
[improvment](function) add new function substring_index ( #15024 )
2022-12-15 09:54:34 +08:00
46030d786a
[Bug](datetimev2) Fix wrong result after insertion ( #15052 )
2022-12-15 09:54:18 +08:00
03847b6a3a
[Feature](Api) Support operate node(fe/be). ( #14904 )
...
Support operate node(fe/be) via http
2022-12-14 23:18:56 +08:00
5cf88a5339
[improvement](config) opt the message when missing JAVA_HOME for BE ( #15045 )
...
Make the error message easy to understand
2022-12-14 23:17:46 +08:00
f1b2668a62
[typo](doc) Indicates that the order by feature in group_concat function is supported from version 1.2 ( #15083 )
2022-12-14 21:24:06 +08:00
05805a1632
[typo](docs)Add fe config enable_new_load_scan_node ( #15075 )
2022-12-14 18:09:53 +08:00
48a70212ac
[bugfix](BE)fix broker file compile error ( #15070 )
2022-12-14 15:46:01 +08:00
41838e6acb
[fix](string-type) rectify string type' len to MAX_STRING_LENGTH ( #14985 )
...
cherry pick from #14587
2022-12-14 15:41:08 +08:00
83e81c60a2
[fix](regression) Nereids' const by constant case is unstable ( #15062 )
2022-12-14 15:03:35 +08:00
9d6a81d1e3
[improvement](query)optimize select stmt with limit 0 ( #14956 )
2022-12-14 13:48:09 +08:00
b8f93681eb
[feature-wip](file reader) Merge broker reader to the new file reader ( #14980 )
...
Currently, there are two sets of file readers in Doris, this pr rewrites the old broker reader with the new file reader.
TODO:
1. rewrite stream load pipe and kafka consumer pipe
2022-12-14 12:48:02 +08:00
f17b138cbd
[BugFix](regression) don't use sf1DataPath when stream load ( #15060 )
...
don't use sf1DataPath when stream load
2022-12-14 12:39:56 +08:00
30406ef580
[Chore](s2geo) add with gflags on s2geo ( #15059 )
...
add with gflags on s2geo
2022-12-14 12:19:01 +08:00
7854e9ae5a
[thirdparty](libgsasl) set include dir to enable to find gssapi.h ( #15037 )
...
If not set, it can't find gssapi.h, which is generated by krb5.
This will cause the libhdfs3 failed to visit hdfs with kerberos authentication
2022-12-14 12:07:13 +08:00
