database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
13,073 Commits 1 Branch 0 Tags
0318da1df3661663cd0affdf6c073e686eb99dfe
Commit Graph

13073 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mr.Hu
940efc6014 [Fix]Remove duplicated destructor function in MinMaxFuncBase (#8287) 2022-03-01 18:38:09 +08:00
zhangstar333
2b9b0fc1ec [Fix] Function percentile input null return null (#8238) 2022-03-01 14:42:48 +08:00
zbtzbtzbt
ada39dd9ad [improvement][vec] better memequal impl to speed up string compare (#8229) 
like #8214

faster string compare operator in vec engine.
 2022-03-01 11:25:12 +08:00
Mingyu Chen
93c638f3a2 [fix][chore](insert)(fe) Fix analysis error of insert stmt and modify grpc-netty dependency (#8265) 
This bug is introduced from #8112.

Also , I change the `grpc-netty` dependency to `grpc-netty-shaded`, to avoid dependency conflict:
```
java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.
```
 2022-03-01 11:12:10 +08:00
Zhengguo Yang
757e35744d [refactor] remove unused new_in_predicate code (#8263) 
remove unused code of new_in_predicate.h/cpp
 2022-03-01 11:11:42 +08:00
Pxl
7d0e36a054 [fix](be-ut) fix bitmap_ut result wrong && fix schema_change compile error (#8261) 2022-03-01 11:11:02 +08:00
ZHAOLIPAN
0fce094080 [typo] fix listdb description error (#8257) 
Co-authored-by: zhaolipan <zhaolipan@shizhuang-inc.com>
 2022-03-01 11:08:34 +08:00
Mingyu Chen
13f007bfd5 [doc] Modify document of compilation on ARM64 (#8254) 2022-03-01 11:05:18 +08:00
Mingyu Chen
e77e2b0bf0 [improvement](lateral-view) Add number rows filtered in profile (#8251) 
Add `RowsFiltered` counter in TableFunctionNode profile.
So that we can know the total number of rows that TableFunctionNode processed
 2022-03-01 11:04:57 +08:00
Mingyu Chen
01365f1a1d [community] add more collaborators in .asf.yaml (#8029) (#8252) 
Add following 2 collaborators:

zuochunwei
thomascai126
 2022-02-28 17:49:11 +08:00
yiguolei
27d2e3e949 [refactor](fe) Remove old fe meta version (#8246) 
Remove old FE meta version < 100.
 2022-02-28 17:47:01 +08:00
caiconghui
c66a9bf64b [fix](be-ut) fix unit test bug for tablet_info_test (#8253) 
introduced from #8041
 2022-02-27 10:44:20 +08:00
Amos Bird
7f3564cca6 [chore] Support aarch64 target with ldb_toolchain (#8249) 2022-02-27 10:38:17 +08:00
zuochunwei
351fbbcba5 [fix](olap) add check statement to protect get_dict_word_info() from crash (#8241) 
check _num_elems firstly at the beginning of get_dict_word_info for safe
 2022-02-26 17:05:58 +08:00
daikon
30fbf1da68 [typo](doc)fix some confusing doc content (#8239) 2022-02-26 17:05:08 +08:00
Henry2SS
385ccf7c8a [fix](routine-load) fix show routine load task error (#8195) 2022-02-26 17:04:39 +08:00
qiye
87b96cfcd6 [feature](iceberg) Step3: Support query iceberg external table (#8179) 
1. Add Iceberg scan node 
2. Add Iceberg/Hive table type in thrift 
3. Support querying Iceberg tables of format types `parquet` and `orc`
 2022-02-26 17:04:11 +08:00
Pxl
668188b91f [improvement][vectorized] support es node predicate peel (#8174) 2022-02-26 17:02:54 +08:00
caiconghui
83521a826a [Feature](create_table) Support create table with random distribution to avoid data skew (#8041) 
In some scenarios, users cannot find a suitable hash key to avoid data skew, so we need to provide an additional data distribution for olap table to avoid data skew

example:
CREATE TABLE random_table
(
siteid INT DEFAULT '10',
citycode SMALLINT,
username VARCHAR(32) DEFAULT '',
pv BIGINT SUM DEFAULT '0'
)
AGGREGATE KEY(siteid, citycode, username)
DISTRIBUTED BY random BUCKETS 10
PROPERTIES("replication_num" = "1");

Co-authored-by: caiconghui1 <caiconghui1@jd.com>
 2022-02-26 10:38:55 +08:00
caiconghui
a630e037b9 [Enhancement](routine_load) Support show routine load statement with like predicate (#8188) 
* [Enhancement](routine_load) Support show routine load with like predicate

Co-authored-by: caiconghui1 <caiconghui1@jd.com>
 2022-02-26 10:35:38 +08:00
Zhengguo Yang
40c1fa2335 [refactor] change mysql server version to avoid some cve issues (#8223) 
5.1.0 -> 5.1.73
 2022-02-25 11:14:57 +08:00
yiguolei
f7c18d300c [Improvement] Add minimum fe meta version check (#8203) 
There are many old codes in FE for old FE meta version such as `if (FeMetaVersion < VERSION_45) xxxxx`,
but the latest FE meta version is 107, these code maybe never reached,
but we do not remove these code because "sometimes" there are old code.

Add minimum required version check to allow us remove these old codes.
 2022-02-25 11:14:00 +08:00
zuochunwei
cce721ad5b [improvement](olap) using placement-new to avoid dynamic mallocing for ParsedPage (#8172) 
use C++ placement-new feature to save consuming, placement-new can separate
mallocing from constructing.
 2022-02-25 11:09:53 +08:00
yiguolei
ddf08cc207 [refactor](fe) Remove version hash on FE side (#8099) 
version hash is not used any more
 2022-02-25 11:08:29 +08:00
HappenLee
6f4cf57b17 [Bug][Vectorized] Fix bug of decimal cast to double loss precision (#8221) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-25 11:04:11 +08:00
HappenLee
8642fa38b9 [Bug] Double/Float % 0 should be NULL (#8230) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-25 11:03:42 +08:00
Pxl
4c5d7c27df [Bug] group_concat(value,null) not return null 2022-02-25 11:03:23 +08:00
wunan1210
df7e848cbb [chore](dependency) upgrade-grpc-version (#8218) 
upgrade grpc.version, so macos with M1 chip can build Fe correctly.
1.30.0 -> 1.44.1
 2022-02-24 23:17:32 +08:00
camby
b93936c6f6 [Feature][array-type]add proto for complex data type ARRAY (#8212) 
1. Add repeated PBlock.PColumnMeta.children field for complex data type, such as ARRAY;
2. change PBlock.PColumnMeta.name to optional, nested columns do not need to a column name;
 2022-02-24 23:16:41 +08:00
Shuo Wang
dccb3cf85e [git] Ignore all the .flattened-pom.xml files (#8197) 2022-02-24 23:16:13 +08:00
Arthur Yang
0dcbfbdde0 [fix](load) Fix InsertStmt prepareExpressions (#8112) 
Use queryStmt.getResultExprs() instead of queryStmt.getBaseTblResultExprs() in InsertStmt prepareExpressions func.
 2022-02-24 23:12:51 +08:00
HappenLee
a6bc9cbe53 [Function] Refactor the function code of log (#8199) 
1. Support return null when input is invalid
2. Del the unless code in vec function

Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-24 11:06:58 +08:00
Pxl
90a8ca808a [Bug][Vectorized] fix bitmap_min(empty) not return null (#8190) 2022-02-24 11:06:27 +08:00
Mingyu Chen
9a7931cfed [fix](mem-pool) fix bug that mem pool failed to allocate in ASAN mode (#8216) 
Also fix BE ut:

1. fix scheme_change_test memory leak
2. fix mem_pool_test
    Do not using DEFAULT_PADDING_SIZE = 0x10 in mem_pool when running ut.
3. remove plugin_test
 2022-02-24 10:52:58 +08:00
Adonis Ling
0726a43a2a [fix](be-ut) Fix unused-but-set-variable errors. (#8211) 2022-02-23 21:43:15 +08:00
wangbo
83543c67fe [improvement](storage)Using Be config to switch storage layer vectorization #8166 
Using Be config to switch storage layer vectorization #8166
 2022-02-23 20:11:28 +08:00
HappenLee
01fb25a498 [UT] Fix the UT of column_nullable_test (#8180) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-02-23 15:37:40 +08:00
wangbo
e3f1efcbbf [Vec][Storage] Support delete condition;ut (#8091) 
Co-authored-by: Wang Bo <wangbo36@meituan.com>
 2022-02-23 12:48:18 +08:00
wangbo
d17ed5e27a [vectorization](storage)support seq column in storage layer (#8186) 
[vectorization](storage)support seq column in storage layer (#8186)
 2022-02-23 12:23:31 +08:00
zhangstar333
31ab569c1d [Vectorized][Feature] support some bitmap functions (#8138) 2022-02-23 11:42:16 +08:00
Zhang.Jinrui
9120de205e [refactor] fix some typos (#8159) 2022-02-23 11:42:00 +08:00
Xujian Duan
f4c6de554b [docs] update backup and restore docs (#8161) 
Co-authored-by: 段绪建 <duanxujian@jd.com>
 2022-02-23 11:41:14 +08:00
awakeljw
b1e7343532 [Vectorized] [HashJoin] Opt HashJoin Performance (#8119) 
Co-authored-by: lihaopeng <happenlee@hotmail.com>
 2022-02-23 10:28:16 +08:00
zuochunwei
802fcbbb05 (#8162)refactor binary dict 
Co-authored-by: zuochunwei <zuochunwei@meituan.com>
 2022-02-22 11:23:54 +08:00
caiconghui
273ced0219 [Build] Fix build fe error caused by Inaccessible pentaho-aggdesigner-algorithm jar (#8175) 
Co-authored-by: caiconghui1 <caiconghui1@jd.com>
 2022-02-22 09:30:39 +08:00
Pxl
87e555c27d [Feature][Vectorized] support function json_array/json_object/json_quote (#8158) 2022-02-22 09:29:56 +08:00
dataroaring
d6aebc0c2c [improvement] make asan work as much as possible (#8148) 
* make ASAN poisoning work as much as possible

Before this patch a use after poison is reported like below
==19305==ERROR: AddressSanitizer: unknown-crash on address
0x625000137013 at pc 0x561c44bcf6b8 bp 0x7ffb75a00910 sp 0x7ffb75a000b8

After this patch the use after poison is reported like below
==17782==ERROR: AddressSanitizer: use-after-poison on address
0x625000137033 at pc 0x55633c8f56b8 bp 0x7ff3dc437930 sp 0x7ff3dc43

Before this patch, a false memory usage is reported like below
==33080==AddressSanitizer CHECK failed: ../../../../src/libsanitizer/
asan/asan_allocator.cpp:189 "((old)) == ((kAllocBegMagic))"
 2022-02-22 09:29:22 +08:00
Mingyu Chen
6e8d52f3fc [fix](stream-load) fix bug that stream load may be blocked with unqualified data (#8176) 
Co-authored-by: morningman <chenmingyu@baidu.com>
 2022-02-22 09:26:23 +08:00
zuochunwei
47067e40a6 [refactor](common) optimize Status implemention: no dynamic new (#8117) 2022-02-22 09:23:29 +08:00
jacktengg
f13fd13e1b [fix] (schema change) Fix BE crash after schema change int column to varchar column(#8073) (#8142) 
Co-authored-by: jianping.teng <tengjp@outlook.com>
 2022-02-22 09:22:00 +08:00