30a13c8141
[Bug](error code) fix db access error code msg #11962
...
Co-authored-by: wuhangze <wuhangze@jd.com >
2022-08-23 14:15:58 +08:00
bc28b7eb4f
[fix](error-code) prompt error when MySQL client login password is incorrect #11973
2022-08-23 09:11:09 +08:00
def6f5568e
[feature](nereids): enable exploration job ( #11867 )
...
Enable the exploration job, and fix related problem.
correct the join reorder
2022-08-22 23:38:17 +08:00
caec862d91
[feature](Nereids)add type coercion rule for nereids ( #11802 )
...
- add an interface ExpectsInputTypes to Expression
- add an interface ImplicitCastInputTypes to Expression
- add a Expression rewrite rule for type coercion
- add a Check Analysis Rule to check whether Plan is Semantically correct
if Expression implements ImplicitCastInputTypes, type coercion rule will automatic rewrite its children that casting it to the most suitable type.
If Expression implements ExpectsInputTypes, Check Analysis will check its children's type whether accepted by expects input types.
2022-08-22 23:06:02 +08:00
c22d097b59
[improvement](compress) Support compress/decompress block with lz4 ( #11955 )
2022-08-22 17:35:43 +08:00
0c5b4ecc7c
[fix](agg)repeat node shouldn't change slot's nullable property of agg node ( #11859 )
2022-08-22 16:28:45 +08:00
92cef580f3
[enhancement](memory) Reduce virtual memory used by PaddedPODArray ( #11816 )
2022-08-22 11:33:07 +08:00
26deebccb8
[improvement](config)Enable insert strict ( #11866 )
2022-08-22 11:32:17 +08:00
dc8f64b3e3
[improvement](agg) Serialize the fixed-length aggregation results with corresponding columns instead of ColumnString ( #11801 )
2022-08-22 10:12:06 +08:00
19496ef9a0
[improve](nereids): remove FakeJoin.java ( #11946 )
2022-08-22 08:28:20 +08:00
adfef85c0c
[improve](fe): use Pair.of to replace new Pair<>() ( #11945 )
2022-08-22 08:27:40 +08:00
192cdd4d76
[Bug](cast) change binary predicate finally cast to varchar ( #11796 )
2022-08-21 10:13:47 +08:00
25b427d0c6
[Bugfix](inpredicate) fix in predicate in group by clause may cause NPE ( #11886 )
...
* [bug](inpredicate) fix in predicate in group by clause may cause NPE
2022-08-21 10:03:30 +08:00
161d134270
[bugfix](load) fix cancel load stmt cannot recognize key words in upper case ( #11906 )
2022-08-21 10:03:10 +08:00
c2efa9c3b5
[refactor](planner): refactor equals code in Catalog dir. ( #11903 )
2022-08-21 10:01:57 +08:00
5c8ea147b1
[Bugfix](FE) fix npe issue when exec 'show tablets' #11896
2022-08-19 21:31:58 +08:00
d83c11a032
[regression](datev2) add schema change cases for datev2/datetimev2 ( #11924 )
2022-08-19 21:29:24 +08:00
ffe7af49c8
[fix](array-type) run 'show create table' return null ( #11912 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-19 21:28:15 +08:00
6ca90afbfa
[Bugfix](datetime) fix DateLiteral range check is no longer valid ( #11917 )
...
* [Bugfix](datetime) fix DateLiteral range check is no longer valid
2022-08-19 21:27:32 +08:00
be7a38e170
[refactor](planner): refactor and replace use NIO ( #11645 )
...
* [refactor](planner): refactor equals code in Catalog dir.
2022-08-19 21:26:39 +08:00
1a8a889d56
[refactor](planner): improve enfocer job. ( #11922 )
...
- handle enforce distribution when meet sort.
- calculate stats in enforcer job
- refactor calculate stats.
2022-08-19 17:55:43 +08:00
1b0b5b5f09
[Enhancement](load) add hidden_columns in stream load param ( #11625 )
...
Stream load will ignore invisible columns if no http header columns
specified, but in some case user cannot get all columns if columns
changed frequently。
Add a hidden_columns header to support hidden columns import。User can
set hidden_columns such as __DORIS_DELETE_SIGN__ and add this column
in stream load data so we can delete this line.
For example:
curl -u root -v --location-trusted -H "hidden_columns: __DORIS_DELETE_SIGN__" -H
"format: json" -H "strip_outer_array: true" -H "jsonpaths: [\"$.id\",
\"$.name\",\"$.__DORIS_DELETE_SIGN__\"]" -T 1.json
http://{beip}:{be_port}/api/test/test1/_stream_load
Co-authored-by: yixiutt <yixiu@selectdb.com >
2022-08-19 14:57:11 +08:00
1f9eec5462
[Regression](datev2) Add test cases for datev2/datetimev2 ( #11831 )
2022-08-19 10:57:55 +08:00
f1ede2aa9d
[fix](function) Fix semantic analysis error in window function at first_value ( #11855 )
2022-08-19 09:13:29 +08:00
b15e2ddeaa
[fix](Nereids): fix and enable stats derive job ( #11755 )
...
fix and enable statistics derive job
Add mock for statistics in computeScan().
2022-08-18 21:26:35 +08:00
b9dcb60172
[Planner](fix)Fix unexpected index out of bound exception ( #11819 )
2022-08-18 15:52:54 +08:00
066bc7693e
[fix](orderby)disallow hll and bitmap data type in order by list ( #11837 )
2022-08-18 14:50:25 +08:00
b8a33d2629
[Improvement](load) turn enable_vectorized_load on by default ( #11833 )
2022-08-18 14:43:09 +08:00
0637c339b1
[fix](array-type) support to insert the largeint in array ( #11868 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-18 14:41:07 +08:00
4c3f72d019
[improvement](meta) sort result by tablename when show table status like 'show data' ( #11885 )
2022-08-18 14:23:45 +08:00
3eeaa8e65b
[typo](fix) Fix spelling errors in comments ( #11810 )
2022-08-18 13:55:41 +08:00
0903dd61f3
[Enhancement](Planner) Improve error message when columns order and keys orders don't match. ( #11724 )
...
When creating table like this:
```
CREATE TABLE `test`.`test_key_order` (
`k1` tinyint(4) NULL COMMENT "",
`k2` smallint(6) NULL COMMENT "",
`k3` int(11) NULL COMMENT "",
`v1` double MAX NULL COMMENT "",
`v2` float SUM NULL COMMENT ""
) ENGINE=OLAP
AGGREGATE KEY(`k1`, `k3`, `k2`)
COMMENT "OLAP"
DISTRIBUTED BY HASH(`k1`) BUCKETS 5
PROPERTIES (
"replication_num" = "1"
);
```
The error message before is:
```
Key columns should be a ordered prefix of the schema.
```
With this PR, the error message is:
```
Key columns should be a ordered prefix of the schema. KeyColumns[1] (starts from zero) is k3, but corresponding column is k2 in the previous columns declaration.
```
2022-08-18 13:28:54 +08:00
e1a1a04c2f
[Enhancement](Doe) Be query es use fe generate dsl. ( #11840 )
2022-08-18 10:31:17 +08:00
6c66bdbf30
[fix](orderby)remove useless null literal in order by ( #11821 )
2022-08-18 10:10:25 +08:00
582be130dd
[Feature] (ODBC) support read/write emoji of utf16 via odbc table ( #11863 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-08-18 09:09:02 +08:00
4cdf9f2a23
[Enhancement](Nereids) Refine nereids parser. ( #11839 )
...
1. Use ParseException in nereids parser.
2. Add check utils in the parser test.
3. Distinguish matchesFromRoot and matches when checking plans.
2022-08-17 20:17:26 +08:00
4a4d3b273d
fix reorder error ( #11854 )
...
join reorder throw unexpected exception when join type is not cross and inner
2022-08-17 17:26:24 +08:00
790a1d681f
[Bug](external iceberg table)Fix iceberg on ha-hdfs unknown hostname bug. #11844
2022-08-17 16:21:30 +08:00
98243e99ae
[feature-wip](unique-key-merge-on-write) unique key table with MOW supports delete sign column ( #11672 )
2022-08-17 15:12:11 +08:00
ba3e0b3f96
[feature](compaction) allow to set disable_auto_compaction for tables ( #11743 )
2022-08-17 11:05:47 +08:00
12c4d1f4dd
[feature-wip](unique-key-merge-on-write) unique key table with MOW supports sequence column ( #11808 )
2022-08-17 10:56:14 +08:00
3e13b7d2c2
[Bugfix](light-shema-change) fix _finish_clone dead lock ( #11823 )
...
In engine_clone_task.cpp, it use tablet->tablet_schema() to create rowset, but in the method, it need a lock that already locked in engine_clone_task.cpp:514. It use cloned_tablet_meta->tablet_schema() originally, but modified in #11131 . It need to revert to use cloned_tablet_meta->tablet_schema().
2022-08-17 09:10:08 +08:00
a07e153419
[Feature](nereids)support view and nested view ( #11589 )
...
support view in query
and add a rewrite rule: merge consecutive projects.
the rule can merge relative consecutive projects to one project to improve efficiency
2022-08-16 19:24:01 +08:00
f2292a3b1d
[Enhancement](array-type) enable_array_type flag update ( #11785 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-08-16 14:41:57 +08:00
cf45151a66
[Fix](audit) do not use duplicate query id in fe.audit.log ( #11746 )
...
The original logic in ConnectProcessor.java might result in duplicate query id for different query statement in fe.audit.log as follows.
2022-08-16 14:37:16 +08:00
56574b5948
[refactor] rename data source to catalog ( #11243 )
...
In #10702 , the origin Catalog class has been renamed to Env.
Now we can rename the datasource to catalog.
2022-08-16 11:45:49 +08:00
f3f1bbc48c
[fix](agg)disallow group by bitmap or hll data type ( #11782 )
...
* [fix](agg)disallow group by bitmap or hll data type
2022-08-16 09:25:02 +08:00
d2d4423c88
[feature](schema change) Light schema change support rollup ( #11494 )
...
1. Move max colUniqueId from OlapTable to IndexMeta.
2. Add updateSlotUniqueId.
2022-08-15 21:39:27 +08:00
5104982614
[enhancement](tracing) append the profile counter to trace. ( #11458 )
...
1. append the profile counter and infos to span attributes.
2. output traceid to audit log.
2022-08-15 21:36:38 +08:00
8f98357c0b
[fix](array-type) disable cast function to array type on origin exec engine. ( #11602 )
...
This commit disable cast to array type on origin exec engine, except cast varchar to array type.
2022-08-15 21:30:56 +08:00
