0c5b4ecc7c
[fix](agg)repeat node shouldn't change slot's nullable property of agg node ( #11859 )
2022-08-22 16:28:45 +08:00
92cef580f3
[enhancement](memory) Reduce virtual memory used by PaddedPODArray ( #11816 )
2022-08-22 11:33:07 +08:00
26deebccb8
[improvement](config)Enable insert strict ( #11866 )
2022-08-22 11:32:17 +08:00
dc8f64b3e3
[improvement](agg) Serialize the fixed-length aggregation results with corresponding columns instead of ColumnString ( #11801 )
2022-08-22 10:12:06 +08:00
915d8989c5
[feature](spark-load)Spark load supports string type data import ( #11927 )
2022-08-22 08:56:59 +08:00
19496ef9a0
[improve](nereids): remove FakeJoin.java ( #11946 )
2022-08-22 08:28:20 +08:00
adfef85c0c
[improve](fe): use Pair.of to replace new Pair<>() ( #11945 )
2022-08-22 08:27:40 +08:00
192cdd4d76
[Bug](cast) change binary predicate finally cast to varchar ( #11796 )
2022-08-21 10:13:47 +08:00
25b427d0c6
[Bugfix](inpredicate) fix in predicate in group by clause may cause NPE ( #11886 )
...
* [bug](inpredicate) fix in predicate in group by clause may cause NPE
2022-08-21 10:03:30 +08:00
161d134270
[bugfix](load) fix cancel load stmt cannot recognize key words in upper case ( #11906 )
2022-08-21 10:03:10 +08:00
c2efa9c3b5
[refactor](planner): refactor equals code in Catalog dir. ( #11903 )
2022-08-21 10:01:57 +08:00
5c8ea147b1
[Bugfix](FE) fix npe issue when exec 'show tablets' #11896
2022-08-19 21:31:58 +08:00
d83c11a032
[regression](datev2) add schema change cases for datev2/datetimev2 ( #11924 )
2022-08-19 21:29:24 +08:00
ffe7af49c8
[fix](array-type) run 'show create table' return null ( #11912 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-19 21:28:15 +08:00
6ca90afbfa
[Bugfix](datetime) fix DateLiteral range check is no longer valid ( #11917 )
...
* [Bugfix](datetime) fix DateLiteral range check is no longer valid
2022-08-19 21:27:32 +08:00
be7a38e170
[refactor](planner): refactor and replace use NIO ( #11645 )
...
* [refactor](planner): refactor equals code in Catalog dir.
2022-08-19 21:26:39 +08:00
1a8a889d56
[refactor](planner): improve enfocer job. ( #11922 )
...
- handle enforce distribution when meet sort.
- calculate stats in enforcer job
- refactor calculate stats.
2022-08-19 17:55:43 +08:00
1b0b5b5f09
[Enhancement](load) add hidden_columns in stream load param ( #11625 )
...
Stream load will ignore invisible columns if no http header columns
specified, but in some case user cannot get all columns if columns
changed frequently。
Add a hidden_columns header to support hidden columns import。User can
set hidden_columns such as __DORIS_DELETE_SIGN__ and add this column
in stream load data so we can delete this line.
For example:
curl -u root -v --location-trusted -H "hidden_columns: __DORIS_DELETE_SIGN__" -H
"format: json" -H "strip_outer_array: true" -H "jsonpaths: [\"$.id\",
\"$.name\",\"$.__DORIS_DELETE_SIGN__\"]" -T 1.json
http://{beip}:{be_port}/api/test/test1/_stream_load
Co-authored-by: yixiutt <yixiu@selectdb.com >
2022-08-19 14:57:11 +08:00
1f9eec5462
[Regression](datev2) Add test cases for datev2/datetimev2 ( #11831 )
2022-08-19 10:57:55 +08:00
f1ede2aa9d
[fix](function) Fix semantic analysis error in window function at first_value ( #11855 )
2022-08-19 09:13:29 +08:00
b15e2ddeaa
[fix](Nereids): fix and enable stats derive job ( #11755 )
...
fix and enable statistics derive job
Add mock for statistics in computeScan().
2022-08-18 21:26:35 +08:00
b9dcb60172
[Planner](fix)Fix unexpected index out of bound exception ( #11819 )
2022-08-18 15:52:54 +08:00
066bc7693e
[fix](orderby)disallow hll and bitmap data type in order by list ( #11837 )
2022-08-18 14:50:25 +08:00
b8a33d2629
[Improvement](load) turn enable_vectorized_load on by default ( #11833 )
2022-08-18 14:43:09 +08:00
0637c339b1
[fix](array-type) support to insert the largeint in array ( #11868 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-18 14:41:07 +08:00
4c3f72d019
[improvement](meta) sort result by tablename when show table status like 'show data' ( #11885 )
2022-08-18 14:23:45 +08:00
3eeaa8e65b
[typo](fix) Fix spelling errors in comments ( #11810 )
2022-08-18 13:55:41 +08:00
0903dd61f3
[Enhancement](Planner) Improve error message when columns order and keys orders don't match. ( #11724 )
...
When creating table like this:
```
CREATE TABLE `test`.`test_key_order` (
`k1` tinyint(4) NULL COMMENT "",
`k2` smallint(6) NULL COMMENT "",
`k3` int(11) NULL COMMENT "",
`v1` double MAX NULL COMMENT "",
`v2` float SUM NULL COMMENT ""
) ENGINE=OLAP
AGGREGATE KEY(`k1`, `k3`, `k2`)
COMMENT "OLAP"
DISTRIBUTED BY HASH(`k1`) BUCKETS 5
PROPERTIES (
"replication_num" = "1"
);
```
The error message before is:
```
Key columns should be a ordered prefix of the schema.
```
With this PR, the error message is:
```
Key columns should be a ordered prefix of the schema. KeyColumns[1] (starts from zero) is k3, but corresponding column is k2 in the previous columns declaration.
```
2022-08-18 13:28:54 +08:00
e1a1a04c2f
[Enhancement](Doe) Be query es use fe generate dsl. ( #11840 )
2022-08-18 10:31:17 +08:00
6c66bdbf30
[fix](orderby)remove useless null literal in order by ( #11821 )
2022-08-18 10:10:25 +08:00
582be130dd
[Feature] (ODBC) support read/write emoji of utf16 via odbc table ( #11863 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-08-18 09:09:02 +08:00
4cdf9f2a23
[Enhancement](Nereids) Refine nereids parser. ( #11839 )
...
1. Use ParseException in nereids parser.
2. Add check utils in the parser test.
3. Distinguish matchesFromRoot and matches when checking plans.
2022-08-17 20:17:26 +08:00
4a4d3b273d
fix reorder error ( #11854 )
...
join reorder throw unexpected exception when join type is not cross and inner
2022-08-17 17:26:24 +08:00
790a1d681f
[Bug](external iceberg table)Fix iceberg on ha-hdfs unknown hostname bug. #11844
2022-08-17 16:21:30 +08:00
98243e99ae
[feature-wip](unique-key-merge-on-write) unique key table with MOW supports delete sign column ( #11672 )
2022-08-17 15:12:11 +08:00
ba3e0b3f96
[feature](compaction) allow to set disable_auto_compaction for tables ( #11743 )
2022-08-17 11:05:47 +08:00
12c4d1f4dd
[feature-wip](unique-key-merge-on-write) unique key table with MOW supports sequence column ( #11808 )
2022-08-17 10:56:14 +08:00
3e13b7d2c2
[Bugfix](light-shema-change) fix _finish_clone dead lock ( #11823 )
...
In engine_clone_task.cpp, it use tablet->tablet_schema() to create rowset, but in the method, it need a lock that already locked in engine_clone_task.cpp:514. It use cloned_tablet_meta->tablet_schema() originally, but modified in #11131 . It need to revert to use cloned_tablet_meta->tablet_schema().
2022-08-17 09:10:08 +08:00
a07e153419
[Feature](nereids)support view and nested view ( #11589 )
...
support view in query
and add a rewrite rule: merge consecutive projects.
the rule can merge relative consecutive projects to one project to improve efficiency
2022-08-16 19:24:01 +08:00
f2292a3b1d
[Enhancement](array-type) enable_array_type flag update ( #11785 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-08-16 14:41:57 +08:00
cf45151a66
[Fix](audit) do not use duplicate query id in fe.audit.log ( #11746 )
...
The original logic in ConnectProcessor.java might result in duplicate query id for different query statement in fe.audit.log as follows.
2022-08-16 14:37:16 +08:00
56574b5948
[refactor] rename data source to catalog ( #11243 )
...
In #10702 , the origin Catalog class has been renamed to Env.
Now we can rename the datasource to catalog.
2022-08-16 11:45:49 +08:00
f3f1bbc48c
[fix](agg)disallow group by bitmap or hll data type ( #11782 )
...
* [fix](agg)disallow group by bitmap or hll data type
2022-08-16 09:25:02 +08:00
d2d4423c88
[feature](schema change) Light schema change support rollup ( #11494 )
...
1. Move max colUniqueId from OlapTable to IndexMeta.
2. Add updateSlotUniqueId.
2022-08-15 21:39:27 +08:00
5104982614
[enhancement](tracing) append the profile counter to trace. ( #11458 )
...
1. append the profile counter and infos to span attributes.
2. output traceid to audit log.
2022-08-15 21:36:38 +08:00
8f98357c0b
[fix](array-type) disable cast function to array type on origin exec engine. ( #11602 )
...
This commit disable cast to array type on origin exec engine, except cast varchar to array type.
2022-08-15 21:30:56 +08:00
fef37990a3
[fix](array-type) Fix incorrect in function-set for array type ( #11585 )
...
There is some wrong logic in FunctionSet.java and it may causes potential risks for array functions invoke.
2022-08-15 21:29:57 +08:00
910d51c76f
[fix](update) Fix where clause is not reanalyzed after rewrite ( #11723 )
2022-08-15 13:24:57 +08:00
1e6b8cd1a9
[feature](nereids): SimplifyCastRule ( #11630 )
...
Remove redundant cast like
```
cast(1 as int) -> 1
```
2022-08-15 12:41:36 +08:00
66116b78d1
fix multJoin bug ( #11772 )
...
In MultiJoin transform, if there is no condition, we should generate cross join instead of inner join
2022-08-15 11:59:09 +08:00
