Commit Graph

2610 Commits

Author SHA1 Message Date
b619bb2000 [enhancement](ldap) optimize LDAP authentication. (#11948)
* [enhancement](ldap) optimize LDAP authentication.

1. Support caching LDAP user information.
2. HTTP authentication supports LDAP.
3. LDAP temporary users support default user property.
4. LDAP configuration supports the `admin show config` and `admin set config` commands.
2022-08-24 17:08:14 +08:00
d87ab69ead [bug](vectorized) fix bug of tuple is null null side do not set (#12012) 2022-08-24 16:19:43 +08:00
8b4f693ad5 [fix](grouping)fix grouping function bug (#11861) 2022-08-24 15:05:25 +08:00
81b6c8d9f9 [fix](sort)the sort expr nullable info is wrong in some case (#12003) 2022-08-24 14:26:09 +08:00
f737ff742e [enhancement](Nereids)support max function (#11795)
- add aggregate function max to Nereids
- add function P0 regression test for Nereids
2022-08-24 10:54:51 +08:00
568f596330 [fix](agg)grouping_id function in having is not correctly substituted (#11834) 2022-08-24 08:50:28 +08:00
d7ffb4e26e [deps](httpv2)upgrade springboot version to 2.7.3 (#11963) 2022-08-24 08:49:57 +08:00
477899af8e [fix](having) Fix the with as clause containing having caused a null pointer (#12007) 2022-08-24 08:48:49 +08:00
c72a84f7c5 [fix](join)the hash join node would get the wrong nullable if the child node is cross join node (#11971)
* [fix](join)the hash join node would get the wrong nullable if the child node is cross join node
2022-08-24 08:47:52 +08:00
dac0883635 [chore](checkstyle)forbidden import all kind of relocated guava (#12018) 2022-08-24 08:47:13 +08:00
83391dc603 [fix](auth) no need to degrade USAGE_PRIV in userPrivTable (#12016) 2022-08-24 08:46:56 +08:00
5c3367b67d [Bug](ctas/ctl): Ctas and ctl default value error (#12015) 2022-08-24 08:46:43 +08:00
76028265e8 [refactor](Nereids): merge rewrite job (#11950)
merge rewrite job
2022-08-23 20:06:34 +08:00
30a13c8141 [Bug](error code) fix db access error code msg #11962
Co-authored-by: wuhangze <wuhangze@jd.com>
2022-08-23 14:15:58 +08:00
bc28b7eb4f [fix](error-code) prompt error when MySQL client login password is incorrect #11973 2022-08-23 09:11:09 +08:00
def6f5568e [feature](nereids): enable exploration job (#11867)
Enable the exploration job, and fix related problem.

correct the join reorder
2022-08-22 23:38:17 +08:00
caec862d91 [feature](Nereids)add type coercion rule for nereids (#11802)
- add an interface ExpectsInputTypes to Expression
- add an interface ImplicitCastInputTypes to Expression
- add a Expression rewrite rule for type coercion
- add a Check Analysis Rule to check whether Plan is Semantically correct

if Expression implements ImplicitCastInputTypes, type coercion rule will automatic rewrite its children that casting it to the most suitable type.
If Expression implements ExpectsInputTypes, Check Analysis will check its children's type whether accepted by expects input types.
2022-08-22 23:06:02 +08:00
c22d097b59 [improvement](compress) Support compress/decompress block with lz4 (#11955) 2022-08-22 17:35:43 +08:00
0c5b4ecc7c [fix](agg)repeat node shouldn't change slot's nullable property of agg node (#11859) 2022-08-22 16:28:45 +08:00
92cef580f3 [enhancement](memory) Reduce virtual memory used by PaddedPODArray (#11816) 2022-08-22 11:33:07 +08:00
26deebccb8 [improvement](config)Enable insert strict (#11866) 2022-08-22 11:32:17 +08:00
dc8f64b3e3 [improvement](agg) Serialize the fixed-length aggregation results with corresponding columns instead of ColumnString (#11801) 2022-08-22 10:12:06 +08:00
915d8989c5 [feature](spark-load)Spark load supports string type data import (#11927) 2022-08-22 08:56:59 +08:00
19496ef9a0 [improve](nereids): remove FakeJoin.java (#11946) 2022-08-22 08:28:20 +08:00
adfef85c0c [improve](fe): use Pair.of to replace new Pair<>() (#11945) 2022-08-22 08:27:40 +08:00
Pxl
192cdd4d76 [Bug](cast) change binary predicate finally cast to varchar (#11796) 2022-08-21 10:13:47 +08:00
25b427d0c6 [Bugfix](inpredicate) fix in predicate in group by clause may cause NPE (#11886)
* [bug](inpredicate) fix in predicate in group by clause may cause NPE
2022-08-21 10:03:30 +08:00
161d134270 [bugfix](load) fix cancel load stmt cannot recognize key words in upper case (#11906) 2022-08-21 10:03:10 +08:00
c2efa9c3b5 [refactor](planner): refactor equals code in Catalog dir. (#11903) 2022-08-21 10:01:57 +08:00
5c8ea147b1 [Bugfix](FE) fix npe issue when exec 'show tablets' #11896 2022-08-19 21:31:58 +08:00
d83c11a032 [regression](datev2) add schema change cases for datev2/datetimev2 (#11924) 2022-08-19 21:29:24 +08:00
ffe7af49c8 [fix](array-type) run 'show create table' return null (#11912)
Co-authored-by: hucheng01 <hucheng01@baidu.com>
2022-08-19 21:28:15 +08:00
6ca90afbfa [Bugfix](datetime) fix DateLiteral range check is no longer valid (#11917)
* [Bugfix](datetime) fix DateLiteral range check is no longer valid
2022-08-19 21:27:32 +08:00
be7a38e170 [refactor](planner): refactor and replace use NIO (#11645)
* [refactor](planner): refactor equals code in Catalog dir.
2022-08-19 21:26:39 +08:00
1a8a889d56 [refactor](planner): improve enfocer job. (#11922)
- handle enforce distribution when meet sort.
- calculate stats in enforcer job
- refactor calculate stats.
2022-08-19 17:55:43 +08:00
1b0b5b5f09 [Enhancement](load) add hidden_columns in stream load param (#11625)
Stream load will ignore invisible columns if no http header columns
specified, but in some case user cannot get all columns if columns
changed frequently。
Add a hidden_columns header to support hidden columns import。User can
set hidden_columns such as __DORIS_DELETE_SIGN__ and add this column
in stream load data so we can delete this line.
For example:
curl -u root -v --location-trusted -H "hidden_columns: __DORIS_DELETE_SIGN__" -H
"format: json" -H "strip_outer_array: true" -H "jsonpaths: [\"$.id\",
\"$.name\",\"$.__DORIS_DELETE_SIGN__\"]" -T 1.json
http://{beip}:{be_port}/api/test/test1/_stream_load

Co-authored-by: yixiutt <yixiu@selectdb.com>
2022-08-19 14:57:11 +08:00
1f9eec5462 [Regression](datev2) Add test cases for datev2/datetimev2 (#11831) 2022-08-19 10:57:55 +08:00
f1ede2aa9d [fix](function) Fix semantic analysis error in window function at first_value (#11855) 2022-08-19 09:13:29 +08:00
b15e2ddeaa [fix](Nereids): fix and enable stats derive job (#11755)
fix and enable statistics derive job
Add mock for statistics in computeScan().
2022-08-18 21:26:35 +08:00
b9dcb60172 [Planner](fix)Fix unexpected index out of bound exception (#11819) 2022-08-18 15:52:54 +08:00
066bc7693e [fix](orderby)disallow hll and bitmap data type in order by list (#11837) 2022-08-18 14:50:25 +08:00
b8a33d2629 [Improvement](load) turn enable_vectorized_load on by default (#11833) 2022-08-18 14:43:09 +08:00
0637c339b1 [fix](array-type) support to insert the largeint in array (#11868)
Co-authored-by: hucheng01 <hucheng01@baidu.com>
2022-08-18 14:41:07 +08:00
4c3f72d019 [improvement](meta) sort result by tablename when show table status like 'show data' (#11885) 2022-08-18 14:23:45 +08:00
3eeaa8e65b [typo](fix) Fix spelling errors in comments (#11810) 2022-08-18 13:55:41 +08:00
0903dd61f3 [Enhancement](Planner) Improve error message when columns order and keys orders don't match. (#11724)
When creating table like this:
```
CREATE TABLE `test`.`test_key_order` (
  `k1` tinyint(4) NULL COMMENT "",
  `k2` smallint(6) NULL COMMENT "",
  `k3` int(11) NULL COMMENT "",
  `v1` double MAX NULL COMMENT "",
  `v2` float SUM NULL COMMENT ""
) ENGINE=OLAP
AGGREGATE KEY(`k1`, `k3`, `k2`)
COMMENT "OLAP"
DISTRIBUTED BY HASH(`k1`) BUCKETS 5
PROPERTIES (
"replication_num" = "1"
);
```

The error message before is:
```
Key columns should be a ordered prefix of the schema.
```

With this PR, the error message is:
```
Key columns should be a ordered prefix of the schema. KeyColumns[1] (starts from zero) is k3, but corresponding column is k2 in the previous columns declaration.
```
2022-08-18 13:28:54 +08:00
e1a1a04c2f [Enhancement](Doe) Be query es use fe generate dsl. (#11840) 2022-08-18 10:31:17 +08:00
6c66bdbf30 [fix](orderby)remove useless null literal in order by (#11821) 2022-08-18 10:10:25 +08:00
582be130dd [Feature] (ODBC) support read/write emoji of utf16 via odbc table (#11863)
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
2022-08-18 09:09:02 +08:00
4cdf9f2a23 [Enhancement](Nereids) Refine nereids parser. (#11839)
1. Use ParseException in nereids parser.
2. Add check utils in the parser test.
3. Distinguish matchesFromRoot and matches when checking plans.
2022-08-17 20:17:26 +08:00