database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
18,429 Commits 1 Branch 0 Tags
3cb0deae9ceef92c71c35444c495bc5b94de6c7c
Commit Graph

18429 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
dataroaring
77b21fba03 [chore] make options of build.sh and run-be-ut.sh work (#8271) 
The h option of build.sh and j option of run-be-ut.sh do not work
in the docker with image
apache/incubator-doris:build-env-ldb-toolchain-latest.
 2022-03-02 10:17:50 +08:00
qiye
f41316a3ec [fix](fold-constant)(hive) fix constant-folding in order by and optimize logs in hive client (#8268) 
fix: #7509 
1. fix order by clause constant folding
2. optimize Hive exception message
3. change hive file status log type
 2022-03-02 10:17:17 +08:00
Mingyu Chen
315bfe2d0e Revert "[chore](dependency) upgrade-grpc-version (#8218)" (#8250) 
This reverts commit df7e848cbbc8170c7bd83d812d7cac58b5574570.

Reverts apache/incubator-doris#8218

Because when using grpc 1.44.1, the corresponding `protoc-gen-grpc-java` plugin
requried GLIBC_2.14, which is not found in CentOS 6.

So I suggest to revert this commit this time. And considering upgrading this component
after most systems have reached glibc version 2.14.

And for Mac M1, you may have to change this version manually for now
 2022-03-02 10:16:25 +08:00
aopangzi
d5b6428c6d [improvement] Upgrade MySQL version to 5.7.37 to reduce unnecessary CVE issues (#8247) 2022-03-02 10:16:02 +08:00
weizuo93
236105daa0 [feature][show-transaction] Support view transactions info for specified status by SHOW TRANSACTION stmt (#8156) 
SHOW TRANSACTION WHERE STATUS = 'prepare/precommitted/committed/visible/aborted';
 2022-03-02 10:14:42 +08:00
steadyBoy
5cc62fa166 [docs] fix document date-time-functions typo (#8053) 
1. en: add convert_tz.md
2. en: fix curdate.md, the fix is to modify the title
3. en: add curtime.md
4. en: fix str_to_date.md, the fix is to modify the title
5. zh-CN: fix convert_tz.md, the fix is to modify the description
6. zh-CN: fix curdate.md, the fix is to modify the title
 2022-03-02 10:07:44 +08:00
Mr.Hu
940efc6014 [Fix]Remove duplicated destructor function in MinMaxFuncBase (#8287) 2022-03-01 18:38:09 +08:00
zhangstar333
2b9b0fc1ec [Fix] Function percentile input null return null (#8238) 2022-03-01 14:42:48 +08:00
zbtzbtzbt
ada39dd9ad [improvement][vec] better memequal impl to speed up string compare (#8229) 
like #8214

faster string compare operator in vec engine.
 2022-03-01 11:25:12 +08:00
Mingyu Chen
93c638f3a2 [fix][chore](insert)(fe) Fix analysis error of insert stmt and modify grpc-netty dependency (#8265) 
This bug is introduced from #8112.

Also , I change the `grpc-netty` dependency to `grpc-netty-shaded`, to avoid dependency conflict:
```
java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.
```
 2022-03-01 11:12:10 +08:00
Zhengguo Yang
757e35744d [refactor] remove unused new_in_predicate code (#8263) 
remove unused code of new_in_predicate.h/cpp
 2022-03-01 11:11:42 +08:00
Pxl
7d0e36a054 [fix](be-ut) fix bitmap_ut result wrong && fix schema_change compile error (#8261) 2022-03-01 11:11:02 +08:00
ZHAOLIPAN
0fce094080 [typo] fix listdb description error (#8257) 
Co-authored-by: zhaolipan <zhaolipan@shizhuang-inc.com>
 2022-03-01 11:08:34 +08:00
Mingyu Chen
13f007bfd5 [doc] Modify document of compilation on ARM64 (#8254) 2022-03-01 11:05:18 +08:00
Mingyu Chen
e77e2b0bf0 [improvement](lateral-view) Add number rows filtered in profile (#8251) 
Add `RowsFiltered` counter in TableFunctionNode profile.
So that we can know the total number of rows that TableFunctionNode processed
 2022-03-01 11:04:57 +08:00
Mingyu Chen
01365f1a1d [community] add more collaborators in .asf.yaml (#8029) (#8252) 
Add following 2 collaborators:

zuochunwei
thomascai126
 2022-02-28 17:49:11 +08:00
yiguolei
27d2e3e949 [refactor](fe) Remove old fe meta version (#8246) 
Remove old FE meta version < 100.
 2022-02-28 17:47:01 +08:00
caiconghui
c66a9bf64b [fix](be-ut) fix unit test bug for tablet_info_test (#8253) 
introduced from #8041
 2022-02-27 10:44:20 +08:00
Amos Bird
7f3564cca6 [chore] Support aarch64 target with ldb_toolchain (#8249) 2022-02-27 10:38:17 +08:00
zuochunwei
351fbbcba5 [fix](olap) add check statement to protect get_dict_word_info() from crash (#8241) 
check _num_elems firstly at the beginning of get_dict_word_info for safe
 2022-02-26 17:05:58 +08:00
daikon
30fbf1da68 [typo](doc)fix some confusing doc content (#8239) 2022-02-26 17:05:08 +08:00
Henry2SS
385ccf7c8a [fix](routine-load) fix show routine load task error (#8195) 2022-02-26 17:04:39 +08:00
qiye
87b96cfcd6 [feature](iceberg) Step3: Support query iceberg external table (#8179) 
1. Add Iceberg scan node 
2. Add Iceberg/Hive table type in thrift 
3. Support querying Iceberg tables of format types `parquet` and `orc`
 2022-02-26 17:04:11 +08:00
Pxl
668188b91f [improvement][vectorized] support es node predicate peel (#8174) 2022-02-26 17:02:54 +08:00
caiconghui
83521a826a [Feature](create_table) Support create table with random distribution to avoid data skew (#8041) 
In some scenarios, users cannot find a suitable hash key to avoid data skew, so we need to provide an additional data distribution for olap table to avoid data skew

example:
CREATE TABLE random_table
(
siteid INT DEFAULT '10',
citycode SMALLINT,
username VARCHAR(32) DEFAULT '',
pv BIGINT SUM DEFAULT '0'
)
AGGREGATE KEY(siteid, citycode, username)
DISTRIBUTED BY random BUCKETS 10
PROPERTIES("replication_num" = "1");

Co-authored-by: caiconghui1 <caiconghui1@jd.com>
 2022-02-26 10:38:55 +08:00
caiconghui
a630e037b9 [Enhancement](routine_load) Support show routine load statement with like predicate (#8188) 
* [Enhancement](routine_load) Support show routine load with like predicate

Co-authored-by: caiconghui1 <caiconghui1@jd.com>
 2022-02-26 10:35:38 +08:00
Zhengguo Yang
40c1fa2335 [refactor] change mysql server version to avoid some cve issues (#8223) 
5.1.0 -> 5.1.73
 2022-02-25 11:14:57 +08:00
yiguolei
f7c18d300c [Improvement] Add minimum fe meta version check (#8203) 
There are many old codes in FE for old FE meta version such as `if (FeMetaVersion < VERSION_45) xxxxx`,
but the latest FE meta version is 107, these code maybe never reached,
but we do not remove these code because "sometimes" there are old code.

Add minimum required version check to allow us remove these old codes.
 2022-02-25 11:14:00 +08:00
zuochunwei
cce721ad5b [improvement](olap) using placement-new to avoid dynamic mallocing for ParsedPage (#8172) 
use C++ placement-new feature to save consuming, placement-new can separate
mallocing from constructing.
 2022-02-25 11:09:53 +08:00
yiguolei
ddf08cc207 [refactor](fe) Remove version hash on FE side (#8099) 
version hash is not used any more
 2022-02-25 11:08:29 +08:00
HappenLee
6f4cf57b17 [Bug][Vectorized] Fix bug of decimal cast to double loss precision (#8221) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-25 11:04:11 +08:00
HappenLee
8642fa38b9 [Bug] Double/Float % 0 should be NULL (#8230) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-25 11:03:42 +08:00
Pxl
4c5d7c27df [Bug] group_concat(value,null) not return null 2022-02-25 11:03:23 +08:00
wunan1210
df7e848cbb [chore](dependency) upgrade-grpc-version (#8218) 
upgrade grpc.version, so macos with M1 chip can build Fe correctly.
1.30.0 -> 1.44.1
 2022-02-24 23:17:32 +08:00
camby
b93936c6f6 [Feature][array-type]add proto for complex data type ARRAY (#8212) 
1. Add repeated PBlock.PColumnMeta.children field for complex data type, such as ARRAY;
2. change PBlock.PColumnMeta.name to optional, nested columns do not need to a column name;
 2022-02-24 23:16:41 +08:00
Shuo Wang
dccb3cf85e [git] Ignore all the .flattened-pom.xml files (#8197) 2022-02-24 23:16:13 +08:00
Arthur Yang
0dcbfbdde0 [fix](load) Fix InsertStmt prepareExpressions (#8112) 
Use queryStmt.getResultExprs() instead of queryStmt.getBaseTblResultExprs() in InsertStmt prepareExpressions func.
 2022-02-24 23:12:51 +08:00
HappenLee
a6bc9cbe53 [Function] Refactor the function code of log (#8199) 
1. Support return null when input is invalid
2. Del the unless code in vec function

Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-24 11:06:58 +08:00
Pxl
90a8ca808a [Bug][Vectorized] fix bitmap_min(empty) not return null (#8190) 2022-02-24 11:06:27 +08:00
Mingyu Chen
9a7931cfed [fix](mem-pool) fix bug that mem pool failed to allocate in ASAN mode (#8216) 
Also fix BE ut:

1. fix scheme_change_test memory leak
2. fix mem_pool_test
    Do not using DEFAULT_PADDING_SIZE = 0x10 in mem_pool when running ut.
3. remove plugin_test
 2022-02-24 10:52:58 +08:00
Adonis Ling
0726a43a2a [fix](be-ut) Fix unused-but-set-variable errors. (#8211) 2022-02-23 21:43:15 +08:00
wangbo
83543c67fe [improvement](storage)Using Be config to switch storage layer vectorization #8166 
Using Be config to switch storage layer vectorization #8166
 2022-02-23 20:11:28 +08:00
HappenLee
01fb25a498 [UT] Fix the UT of column_nullable_test (#8180) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-23 15:37:40 +08:00
wangbo
e3f1efcbbf [Vec][Storage] Support delete condition;ut (#8091) 
Co-authored-by: Wang Bo <wangbo36@meituan.com>
 2022-02-23 12:48:18 +08:00
wangbo
d17ed5e27a [vectorization](storage)support seq column in storage layer (#8186) 
[vectorization](storage)support seq column in storage layer (#8186)
 2022-02-23 12:23:31 +08:00
zhangstar333
31ab569c1d [Vectorized][Feature] support some bitmap functions (#8138) 2022-02-23 11:42:16 +08:00
Zhang.Jinrui
9120de205e [refactor] fix some typos (#8159) 2022-02-23 11:42:00 +08:00
Xujian Duan
f4c6de554b [docs] update backup and restore docs (#8161) 
Co-authored-by: 段绪建 <duanxujian@jd.com>
 2022-02-23 11:41:14 +08:00
awakeljw
b1e7343532 [Vectorized] [HashJoin] Opt HashJoin Performance (#8119) 
Co-authored-by: lihaopeng <happenlee@hotmail.com>
 2022-02-23 10:28:16 +08:00
zuochunwei
802fcbbb05 (#8162)refactor binary dict 
Co-authored-by: zuochunwei <zuochunwei@meituan.com>
 2022-02-22 11:23:54 +08:00