database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
4,754 Commits 1 Branch 0 Tags
ec5027a00a2ba66f04876947ccbc17dfc09dd56a
Commit Graph

4754 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zy-kkk
ec5027a00a [regressiontest]add bitmap index test case (#9880) 2022-05-31 19:18:43 +08:00
zy-kkk
3025a23f83 [test]Add MATERIALIZED VIEW test for regression test (#9855) 
* add MATERIALIZED VIEW test

* Fix DESC message does not match out file

* fix
 2022-05-31 19:17:56 +08:00
Xinyi Zou
c8d303a82c [bugfix] Fix BE core about vectorized join build thread memtracker switch, and FileStat duplicate 2022-05-31 19:12:42 +08:00
Pxl
fa50b63cee fix core dump on vcase_expr::close (#9875) 2022-05-31 15:45:39 +08:00
HappenLee
0cba6b7d95 [Bug][Fix] One Rowset have same key output in unique table (#9858) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-05-31 12:29:16 +08:00
HappenLee
7199102d7c [Opt][VecLoad] Opt the vec stream load performance (#9772) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-05-31 11:53:32 +08:00
Mingyu Chen
e2b93a4165 [feature-wip](multi-catalog) Add basic class and interface for multi catalog support 2022-05-31 11:32:44 +08:00
wudi
f9d969cd10 [doc] fix alter resource doc style (#9866) 2022-05-31 09:53:46 +08:00
jiafeng.zhang
abdf83dc06 [fix][doc]Doc fix (#9851) 
doc fix
 2022-05-31 09:09:53 +08:00
Gabriel
7b55d4cb88 [BUG] return NULL for invalid date value (#9862) 2022-05-30 21:35:41 +08:00
Amos Bird
85f525e991 [Bugfix(Vec)] Close result_sink properly (#9849) 
Close result_sink properly so that error code is reported and
expr_context is always closed.
 2022-05-30 19:03:33 +08:00
Adonis Ling
f377c26bf7 [refactor][be] Optimize headers (#9708) 2022-05-30 16:12:10 +08:00
jakevin
46e84d39df [enhancement](style): polish the checkstyle (#9767) 
* [enhancement](style): cancel auto tab for Javadoc.

* *: fix review
 2022-05-30 16:10:04 +08:00
zy-kkk
dc39a9acc9 [test]add update test (#9829) 2022-05-30 16:07:54 +08:00
wudi
654940ce00 [doc]add alter resource doc (#9837) 
Co-authored-by: wudi <>
 2022-05-30 16:06:56 +08:00
zy-kkk
63786df253 [test]Add schema change for regression test (#9836) 
* add alter table column test

* add test date

* add cancelled state judge
 2022-05-30 16:06:17 +08:00
smallhibiscus
88325392d0 [doc]Modify export example in en and zh-cn doc. (#9840) 
Co-authored-by: smallhibiscus <844981280>
 2022-05-30 16:05:17 +08:00
yiguolei
4af2493c42 [Improvement] optimize scannode concurrency query performance in vectorized engine. (#9792) 2022-05-30 16:04:40 +08:00
Mingyu Chen
453af2795a [community] add more collaborators (#9830) 
Add new collaborators:
    - dataalive
 2022-05-30 09:46:06 +08:00
smallhibiscus
4df1106e1e [improvement](script) Add jvm parameters and the process will automatically stop when oom occurs in fe. (#9765) 2022-05-30 09:44:12 +08:00
dujl
8092439634 [feature](hudi) Step2: Support query hudi external table(include cow and mor table) (#9752) 
support query cow and mor hudi table.
 2022-05-30 09:43:36 +08:00
Jing Shen
7b98dd438d [feature](function) Add nvl function (#9726) 2022-05-30 09:43:00 +08:00
EmmyMiao87
0683181fef [API changed](parser) Remove merge join syntax (#9795) 
Remove merge join sql and merge join node
 2022-05-30 09:04:21 +08:00
smallhibiscus
080c70f32d [regression test]Add regression test case for multiple column delete. (#9817) 
Co-authored-by: smallhibiscus <844981280>
 2022-05-30 09:01:25 +08:00
smallhibiscus
88db94c220 [doc]Fix typo in create-table documentation. (#9834) 
Co-authored-by: smallhibiscus <844981280>
 2022-05-30 08:28:15 +08:00
Gabriel
a96b41db7a [Improvement] Simplify expressions for _vconjunct_ctx_ptr (#9816) 2022-05-29 23:05:21 +08:00
Amos Bird
63aab5ee5d [Bugfix(Vec)] Fix some memory leak issues (#9824) 2022-05-29 23:04:11 +08:00
xueweizhang
c5369d3220 [bugfix] Fix create table like when having hidden columns (#9694) 2022-05-29 18:02:16 +08:00
morrySnow
9f4291dcc9 [enhancement] (community) update intellij style file (#9783) 2022-05-29 17:34:25 +08:00
compiletheworld
635b5630e3 [fix](third-party) Fix build issues of third-party in ubuntu docker (#9805) 
Fixes:
1. Fully static linkage of protoc may lead to core dump when using it.
2. Building libmyclient may fail due to miss-used option `-v` of `make`
3. Building lzma implicitly requires autopoint
4. Building xml2 implicitly requires pkg-config
 2022-05-29 17:33:59 +08:00
Stalary
e231273ddf [fix](sql-block-rule) sql block rule NPE (#9778) 2022-05-29 16:21:00 +08:00
yixiutt
1aeb16d153 [improvement](load) reduce useless err_msg format in VOlapTableSink send (#9531) 2022-05-29 16:02:57 +08:00
Mingyu Chen
9fe3827239 [fix](ut) fix BE ut (#9831) 
introduced from #8923, the github checks has some problem that failed to check BE ut in #8923
 2022-05-29 12:25:41 +08:00
htyoung
3ee804f7b3 [doc]join优化文档笔误更改 (#9825) 2022-05-28 21:36:25 +08:00
Pxl
f33ef32d92 [Bug] [Bitmap] change to_bitmap to always_not_nullable (#9716) 2022-05-28 17:33:55 +08:00
Dongyang Li
92c1c82422 [tools]add ssb flat test scripts (#9796) 
Co-authored-by: stephen <hello-stephen@qq.com>
 2022-05-28 17:28:03 +08:00
Dayue Gao
4d1e926b6c [feature][config] introduce a new BE config storage_page_cache_shard_size (#9821) 
Co-authored-by: gaodayue <gaodayue@bytedance.com>
 2022-05-28 10:17:09 +08:00
Adonis Ling
cfe640c37b [doc] Add a note about the version of checkstyle (#9785) 2022-05-27 21:58:49 +08:00
pengxiangyu
ee1bed46be [config] Add backend_rpc_timeout_second in FE config (#9779) 2022-05-27 21:58:09 +08:00
LOVEGISER
77de4869ed [doc] website document update (#9776) 2022-05-27 21:57:06 +08:00
Kang
efdb3b79a5 [feature] add zstd compression codec (#9747) 
ZSTD compression is fast with high compression ratio. It can be used to archive higher compression ratio
than default Lz4f codec for storing cost sensitive data such as logs.

Compared to Lz4f codec, we see zstd codec get 35% compressed size off, 30% faster at first time read without OS page 
cache, 40% slower at second time read with OS page cache in the following comparison test.

test data: 25GB text log, 110 million rows
test table: test_table(ts varchar(30), log string)
test SQL: set enable_vectorized_engine=1; select sum(length(log)) from test_table
be.conf: disable_storage_page_cache = true
set this config to disable doris page cache to avoid all data cached in memory for test real decompression speed.
test result

master branch with lz4f codec result: 
- compressed size 4.3G
- SQL first exec time(read data from disk + decompress + little computation) : 18.3s
- SQL second exec time(read data from OS pagecache + decompress + little computation) : 2.4s

this branch with zstd codec (hardcode enable it) result:
- compressed size: 2.8G
- SQL first exec time: 12.8s
- SQL second exec time: 3.4s
 2022-05-27 21:56:18 +08:00
Lightman
b2c2cdb122 [feature] Support compression prop (#8923) 2022-05-27 21:52:05 +08:00
shaqf
ea4eaf1411 [doc] fix typos in bloomfilter.md (#9806) 
修改错别字
 2022-05-27 20:47:18 +08:00
Luwei
af2cfa2db4 [fix] Fix bug of bloom filter hash value calculation error (#9802) 
* Fix bug of bloom filter hash value calculation error

* fix code style
 2022-05-27 20:44:26 +08:00
Jerry Hu
a52e91a140 [chore] Update .gitignore to ignore generated files in tools (#9782) 2022-05-27 20:43:06 +08:00
hanfengcan
b2b9463537 [doc] Updated the compilation and deployment chapter in the documentation (#9702) 
Updated the compilation and deployment chapter in the documentation
 2022-05-27 17:11:31 +08:00
smallhibiscus
8019da4504 fix the format error of en doc. (#9756) 
fix the format error of en doc
 2022-05-27 17:10:47 +08:00
lit
dbc2feb31a modify bloomfilter.md (#9798) 
modify bloomfilter
 2022-05-27 17:10:08 +08:00
jiafeng.zhang
b07004e2f7 [fix]Documentation fixes (#9787) 
[fix]Documentation fixes （rollup)
 2022-05-27 12:57:00 +08:00
jiafeng.zhang
e7e551ffa7 [doc][fix]Sync job doc (#9790) 
binlog load documentation fix
 2022-05-27 12:56:19 +08:00