3146fc8189
[bug](jdbc) fix jdbc external table with char type length error ( #15386 )
...
Now have test pg and oracle with char(100), if data='abc'
but read string data length is 100, so need trim extral spaces
2022-12-29 11:19:03 +08:00
1f98dd2c74
[fix](Nereids) Generate is missing on alias query ( #15416 )
...
support table generating function on query alias, syntax as:
```sql
SELECT * FROM (SELECT * FROM tbl) tmp LATERAL VIEW explode(c1) gtmp AS ce;
```
2022-12-29 11:11:25 +08:00
0e154feeb9
[feature](multi catalog nereids)Add file scan node to nereids. ( #15201 )
...
Add file scan node to nereids, so that the new planner could support external hms table.
2022-12-29 10:31:11 +08:00
1b1083eb52
[fix](metric) fix prometheus metric format error for doris_fe_query_latency_ms ( #15447 )
...
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-12-29 08:51:15 +08:00
4336aaa01a
[bug](datetimev2) fix wrong info when show create table ( #15422 )
...
* [bug](datetimev2) fix wrong info when show create table
* update
2022-12-28 19:55:43 +08:00
95e6553d90
[feature-wip](nereids) Implement using join ( #15311 )
2022-12-28 19:22:20 +08:00
75aa00d3d0
[Feature](NGram BloomFilter Index) add new ngram bloom filter index to speed up like query ( #11579 )
...
This PR implement the new bloom filter index: NGram bloom filter index, which was proposed in #10733 .
The new index can improve the like query performance greatly, from our some test case , can get order of magnitude improve.
For how to use it you can check the docs in this PR, and the index based on the ```enable_function_pushdown```,
you need set it to ```true```, to make the index work for like query.
2022-12-28 18:01:50 +08:00
0f8b15b902
[feature](nereids) support string alias in select list ( #15369 )
...
support such syntax: select '' as 'b', col1 from select_with_const
2022-12-28 17:26:48 +08:00
69d95c857a
[feature](remote)Add alter storage policy ( #15381 )
...
* add alter storage policy
* add alter storage policy
* add alter storage policy
2022-12-28 16:09:06 +08:00
8342691b62
[feature](remote)Add drop storage policy ( #15364 )
...
* add drop storage policy
* add drop storage policy
* add drop storage policy
* add drop storage policy
2022-12-28 16:04:30 +08:00
8ce62600dc
[Bug] #14876 && #15225 have some bugs in rewrite or to in, revert them ( #15420 )
2022-12-28 13:30:09 +08:00
121f00b6e2
[Bug](function) forbid hll_union input not hll type param ( #15397 )
...
forbid hll_union input not hll type param
2022-12-28 12:23:34 +08:00
d05f430ca2
[feature](nereids) support syntax: count(all *) ( #15376 )
2022-12-28 11:09:56 +08:00
2af831de33
[Fix](Nereids)fix group by binding error, resulting in incorrect results ( #15328 )
...
Original: group by is bound to the outputExpression of the current node.
Problem: When the name of the new reference of outputExpression is the same as the child's output column, the child's output column should be used for group by, but at this time, the new reference of the node's outputExpression will be used for group by, resulting in an error
Now: Give priority to the child's output for group by binding. If the child does not have a corresponding column, use the outputExpression of this node for binding
2022-12-28 10:42:21 +08:00
28bb13a026
[feature](light-schema-change) enable light schema change by default ( #15344 )
2022-12-28 09:29:26 +08:00
22b31e516c
[Bug](decimalv3) select view of decimalv3 error ( #15404 )
2022-12-28 08:38:33 +08:00
5ac7b09765
[feature](Nereids) Support SchemaScan ( #15411 )
...
such as: select * from information_schema.backends;
2022-12-28 00:33:48 +08:00
03aef7a8ac
[fix](nereids) sender in union's child fragment has no destination ( #15402 )
...
1. always create an exchange node for set operation node's children
2. fix cast expr's nullability bug.
2022-12-27 22:36:54 +08:00
51b14c06d3
[enhancement](nereids) support approx_count_distinct function ( #15406 )
2022-12-27 22:25:21 +08:00
0550dfaeb2
[enhancement](rewrite) add OrToIn rule and fix ExtractCommonFactorsRule apply problems ( #12872 )
...
Co-authored-by: wuhangze <wuhangze@jd.com >
2022-12-27 18:39:53 +08:00
849adca225
[fix](Nereids) expressions is not be extracted when binding function ( #15361 )
2022-12-27 17:12:07 +08:00
a07ca41f8e
[Fix](Nereids) fix repeat node nullable error bugs ( #15251 )
2022-12-27 17:01:33 +08:00
5a8201320a
[fix](nereids) group by constants produce wrong result ( #15322 )
...
SELECT 2 FROM tbl GROUP BY 1
it should produce 2 would the table is not empty when table is not empty. Before this PR, the execution of nereids generated plan would produce empty result set
2022-12-27 14:35:02 +08:00
b3f77a2e00
[feature](Show) add one show type cast command ( #15137 )
2022-12-27 14:19:04 +08:00
69068f9835
[fix](planner) fix hll_union plan: Invalid Aggregate Operator: hll_union ( #14931 )
...
When using hll_union aggregate function, PREAGGREGATION is always OFF and Rollup cannot be hit.
2022-12-27 11:20:41 +08:00
99868f9929
[fix](planner) set limit to nagtive value when has offset in limit ( #15367 )
2022-12-27 11:16:19 +08:00
0f922a83c7
[fix](nereids) group_bit_xxx signature update ( #15318 )
2022-12-27 00:41:42 +08:00
325d247b92
[Feature](Nereids) Support hll and count for materialized index. ( #15275 )
2022-12-27 00:38:04 +08:00
650136c32e
[Enhancement](fe): replace assertTrue(X.equals(X)) with assertEquals ( #15356 )
2022-12-27 00:37:24 +08:00
8879400419
[feature](nereids) Support query on specific partitions ( #15243 )
2022-12-27 00:32:14 +08:00
a1c6ea876f
[fix](inbitmap) fix core dump caused by bitmap filter with union ( #15333 )
...
The join node need project operation to remove unnecessary columns from the output tuples.
For SetOperationNode output tuple and input tuple is consistent and do not need project,
but the children of SetOperationNode may be join nodes, so the children of the SetOperationNode
need to do the project operation.
2022-12-26 23:14:32 +08:00
301640d3c0
[fix](string) fix offsets over flow for extreme large String column ( #15360 )
...
* [fix](string) fix offsets over flow for extreme large String column
* fix
2022-12-26 21:23:58 +08:00
ae87415174
[Feature](Nereids) add simplify arithmetic rule ( #15242 )
...
support simplify arithmetic rule
for example ：
a + 1 > 1
=> a > 0
2022-12-26 16:57:59 +08:00
1400a89065
[Bug](Compile) fix compile error by using correct method name ( #15355 )
...
fix compile error by using correct method name
2022-12-26 14:58:01 +08:00
8b6e4e74e7
[improvement](jdbc) add default jdbc driver's dir ( #15346 )
...
Add a new config "jdbc_drivers_dir" for both FE and BE.
User can put jdbc drivers' jar file in this dir, and only specify file name in "driver_url" properties
when creating jdbc resource.
And Doris will find jar files in this dir.
Also modify the logic so that when the jdbc resource is modified, the corresponding jdbc table
will get the latest properties.
2022-12-26 11:51:12 +08:00
bf71943605
[feature](load) stream load trim double quotes for csv ( #15241 )
2022-12-26 11:45:54 +08:00
7b5739e9a9
[Fix](Nerids) fix dup key for pull predicate from project children ( #15292 )
...
In InferPredicates, we need pull predicates from project children then use sid replace id1.
In our code, use alias name as key, use expression as value to build map. Obviously, sid has two alias name(id1,id2) so throw Duplicate key exception.
2022-12-26 10:57:14 +08:00
6bec1ffc47
[feature](planner) remove restrict of offset without order by ( #15218 )
...
Support SELECT * FROM tbl LIMIT 5, 3;
2022-12-26 09:37:41 +08:00
ada091b5d2
[fix](array-type) forbid implicit cast of array type while load ( #15325 )
...
* forbit array cast while load
* add regression test
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-12-26 09:24:44 +08:00
a807978882
[refactor](non-vec) Remove rowbatch code from delta writer and some rowbatch related code ( #15349 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-12-26 08:54:51 +08:00
b7768a928d
[Improvement](S3) support access s3 via temporary security credentials ( #15340 )
2022-12-26 00:31:55 +08:00
001153ab38
[Improvement](multi-catalog) support hive external tables which store data on tencent chdfs ( #15297 )
...
* support read hive table whichs store data on tencent chdfs in multi-catalog
2022-12-25 21:57:18 +08:00
a291cb17be
[fix](information-schema) fix bug that query tables in information_schema db will return error #15336
2022-12-25 10:09:40 +08:00
d48abd91df
[deps](fe)upgrade deps version ( #15262 )
...
upgrade hadoop version to 2.10.2
jackson-databind to 2.14.1
2022-12-24 22:18:10 +08:00
82d316b419
[bug](decimalv3) Fix wrong decimal scale for arithmetic expr ( #15316 )
2022-12-24 21:57:46 +08:00
6151a43e9c
[Thirdparty](Protobuf) update protobuf from 3.14.0 to 3.15.0 ( #15055 )
2022-12-24 20:45:11 +08:00
fd764b3ccd
[fix](fe)add session variable group_concat_max_len ( #15254 )
2022-12-24 20:07:14 +08:00
acd16b62e2
[feature](multi-catalog) support use catalog.db when client connect to the doris server ( #15293 )
2022-12-24 15:20:00 +08:00
95b4a4a1ba
[fix](s3 load) fix that FE can not access s3 objected-storage ( #15323 )
2022-12-23 22:15:32 +08:00
e31847e925
support rename hive/jdbc engine external table ( #15308 )
2022-12-23 21:04:37 +08:00
