database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
88a3d08fee9d9239ad8b5969dae22262185fdeba
doris/docs/en
History
Mingyu Chen 5f8d91257b [improvement](routine-load) Reduce the probability that the routine load task rpc timeout (#7754) 
If an load task has a relatively short timeout, then we need to ensure that
each RPC of this task does not get blocked for a long time.
And an RPC is usually blocked for two reasons.

1. handling "memory exceeds limit" in the RPC
    
    If the system finds that the memory occupied by the load exceeds the threshold,
    it will select the load channel that occupies the most memory and flush the memtable in it.
    this operation is done in the RPC, which may be more time consuming.

2. close the load channel

    When the load channel receives the last batch, it will end the task.
    It will wait for all memtables flushes to finish synchronously. This process is also time consuming.

Therefore, this PR solves this problem by.

1. Use timeout to determine whether it is a high-priority load task

    If the timeout of an load task is relatively short, then we mark it as a high-priority task.

2. not processing "memory exceeds limit" for high priority tasks
3. use a separate flush thread to flush memtable for high priority tasks.
2022-01-16 10:41:31 +08:00
..
administrator-guide
[improvement](routine-load) Reduce the probability that the routine load task rpc timeout (#7754)
2022-01-16 10:41:31 +08:00
article
[docs][community] Remove articles (#7449)
2021-12-21 18:50:09 +08:00
benchmark
[Doc] Reorganize documents (#7093)
2021-11-12 12:05:10 +08:00
case-user
[docs](website) develop the caseList component (#7402)
2021-12-16 10:41:11 +08:00
community
[docs] add doc for community feedback and fix CI (#7759)
2022-01-14 22:19:28 +08:00
developer-guide
[docs] add more faq and FE debugging method (#7422)
2021-12-31 09:55:04 +08:00
downloads
[docs] fix 0.14 release date in download page (#7253)
2021-11-30 15:00:36 +08:00
extending-doris
[docs](website) Add Database ODBC version correspondence (#7675)
2022-01-13 15:28:02 +08:00
faq
[docs](faq) add multiple FE WEB UI login issues (#7654)
2022-01-14 09:26:39 +08:00
getting-started
[docs] update data-model-rollup.md (#7321)
2021-12-07 10:05:00 +08:00
installing
[docs] Improve instructions for the configuration of BE. (#7620)
2022-01-11 15:06:05 +08:00
internal
Add flink doris connector design document (#5709)
2021-05-17 11:53:43 +08:00
sql-reference
[improvement] create/drop index support if [not] exist (#7748)
2022-01-16 10:40:44 +08:00
sql-reference-v2/sql-statements
[feature](storage-format) Z-Order Implement (#7149)
2021-12-02 11:39:51 +08:00
README.md
[Website][Doc] Add the sharing blog function to the document site (#7047)
2021-11-09 10:01:23 +08:00

README.md

home, heroImage, heroBgImage, heroText, tagline, structure, features, cases, actionText, actionLink, articleText, articleLink
home heroImage heroBgImage heroText tagline structure features cases actionText actionLink articleText articleLink
true /images/home/banner-stats.png /images/home/hero-bg.png
Welcome to
Apache Doris
A fast MPP database for all modern analytics on big data.
title subTitle descriptions image actionText actionLink
Apache Doris
Apache Doris is a modern MPP analytical database product. It can provide sub-second queries and efficient real-time data analysis. With it's distributed architecture, up to 10PB level datasets will be well supported and easy to operate.
Apache Doris can meet various data analysis demands, including history data reports, real-time data analysis, interactive data analysis, and exploratory data analysis. Make your data analysis easier!
/images/home/structure-fresh.png Learn More /en/getting-started/basic-usage
title subTitle list
Apache Doris Core Features
title icon
Modern MPP architecture /images/home/struct.png
title icon
Getting result of a query within one second /images/home/clock.png
title icon
Support standard SQL language, compatible with MySQL protocol /images/home/sql.png
title icon
Vectorized SQL executor /images/home/program.png
title icon
Effective data model for aggregation /images/home/aggr.png
title icon
Rollup, novel pre-computation mechanism /images/home/rollup.png
title icon
High performance, high availability, high reliability /images/home/cpu.png
title icon
easy for operation, Elastic data warehouse for big data /images/home/dev.png
title subTitle list
Apache Doris Users
logo alt
/images/home/logo-meituan.png 美团
logo alt
/images/home/logo-xiaomi.png 小米
logo alt
/images/home/logo-jd.png 京东
logo alt
/images/home/logo-huawei.png 华为
logo alt
/images/home/logo-baidu.png 百度
logo alt
/images/home/logo-weibo.png 新浪微博
logo alt
/images/home/logo-zuoyebang.png 作业帮
logo alt
/images/home/logo-vipkid.png Vipkid
logo alt
/images/home/logo-360.png 360
logo alt
/images/home/logo-shopee.png Shopee
logo alt
/images/home/logo-tantan.png 探探
logo alt
/images/home/logo-kuaishou.png 快手
logo alt
/images/home/logo-sohu.png 搜狐
logo alt
/images/home/logo-yidian.png 一点资讯
logo alt
/images/home/logo-dingdong.png 叮咚买菜
logo alt
/images/home/logo-youdao.png 有道
Quick Start → /en/installing/compilation Latest News /en/article/article-list