Go to file

Mingyu Chen c996334ad1 [improvement] Optimize send fragment logic to reduce send fragment timeout error (#9720 )

This CL mainly changes:
1. Reducing the rpc timeout problem caused by rpc waiting for the worker thread of brpc.
    1. Merge multiple fragment instances on the same BE to send requests to reduce the number of send fragment rpcs
    2. If fragments size >= 3, use 2 phase RPC: one is to send all fragments, two is to start these fragments. So that there
         will be at most 2 RPC for each query on one BE.

3. Set the timeout of send fragment rpc to the query timeout to ensure the consistency of users' expectation of query timeout period.

4. Do not close the connection anymore when rpc timeout occurs.
5. Change some log level from info to debug to simplify the fe.log content.

NOTICE:
1. Change the definition of execPlanFragment rpc, must first upgrade BE.
3. Remove FE config `remote_fragment_exec_timeout_ms`

2022-06-03 15:47:40 +08:00

.github

[fix] fix Code Quality Analysis failed (#9685 )

2022-05-19 23:13:47 +08:00

[improvement] Optimize send fragment logic to reduce send fragment timeout error (#9720 )

2022-06-03 15:47:40 +08:00

bin

[improvement](script) Add jvm parameters and the process will automatically stop when oom occurs in fe. (#9765 )

2022-05-30 09:44:12 +08:00

build-support

[enhancement](style): polish the checkstyle (#9767 )

2022-05-30 16:10:04 +08:00

conf

Fix some typos for docs. (#9680 )

2022-05-19 20:55:21 +08:00

contrib/udf

[UDF] support RPC udaf part 1: support create RPC udaf in fe (#8510 )

2022-04-21 17:38:58 +08:00

dist

[doc] Update dev image (#9721 )

2022-05-23 11:59:15 +08:00

docker

[chore][fix](librdkafka) disable librdkafka assert and update some thirdparty (#8425 )

2022-03-12 22:09:06 +08:00

docs

[doc][fix]English document title case (#9935 )

2022-06-02 20:52:58 +08:00

extension

Fix some typos for docs. (#9680 )

2022-05-19 20:55:21 +08:00

[improvement] Optimize send fragment logic to reduce send fragment timeout error (#9720 )

2022-06-03 15:47:40 +08:00

fe_plugins

[feature] (sql-digest) support sql digest (#8919 )

2022-05-08 17:25:41 +08:00

fs_brokers/apache_hdfs_broker

[Bug] (load) Broker load kerberos auth fail (#9494 )

2022-05-12 15:43:29 +08:00

gensrc

[improvement] Optimize send fragment logic to reduce send fragment timeout error (#9720 )

2022-06-03 15:47:40 +08:00

regression-test

[fix] fix invalid SQL rewrite for field in materialized view (#9877 )

2022-06-02 23:43:13 +08:00

samples

[UDF] support RPC udaf part 1: support create RPC udaf in fe (#8510 )

2022-04-21 17:38:58 +08:00

thirdparty

[Enhancement][Chore] remove breakpad and unused variable (#9937 )

2022-06-02 20:52:17 +08:00

tools

[tools][doc]add ssb flat tools, and update performance doc (#9827 )

2022-06-01 08:09:55 +08:00

[fix](fe-ui) fix home page spin bug #7170 (#7912 )

2022-01-30 16:47:58 +08:00

webroot

[License] Organize and modify the license of the code (#4371 )

2020-08-24 21:51:55 +08:00

.asf.yaml

[community] add more collaborators (#9830 )

2022-05-30 09:46:06 +08:00

.clang-format

[refactor][style] Use clang-format to sort includes (#9483 )

2022-05-10 21:25:35 +08:00

.clang-format-ignore

[chore](clang-format)(license-eye) Add Clang Format/Skywalking eyes github action (#7132 )

2021-11-24 10:41:02 +08:00

.clang-tidy

[refactor] add some clang-tidy checks && some code style fix (#8752 )

2022-03-31 13:53:41 +08:00

.editorconfig

[community](*) polish config about project (#8987 )

2022-04-20 14:48:32 +08:00

.gitattributes

Enable auto convert when check in (#1926 )

2019-10-09 22:31:27 +08:00

.gitignore

[chore] Update .gitignore to ignore generated files in tools (#9782 )

2022-05-27 20:43:06 +08:00

.gitmodules

[FE Code Style][step 0]add github action to check incremental code in pr (#9328 )

2022-05-01 17:30:29 +08:00

.licenserc.yaml

[Features]Add dbt doris adapter (#9299 )

2022-04-29 11:40:29 +08:00

.rat-excludes

[improvement] Improve sig handler (#8545 )

2022-03-22 10:40:31 +08:00

build_plugin.sh

[Fix Bug] Fix ehco command not found (#9021 )

2022-04-15 13:43:47 +08:00

build.sh

[fix](memory tracker) Fix lru cache, compaction tracker, add USE_MEM_TRACKER compile (#9661 )

2022-05-25 08:56:17 +08:00

CODE_OF_CONDUCT.md

[Doc] Create CODE_OF_CONDUCT.md (#4070 )

2020-07-14 22:28:38 +08:00

CONTRIBUTING_CN.md

[typo](doc) Fix the broken link in the CONTRIBUTING.md (#8876 )

2022-04-14 10:04:32 +08:00

CONTRIBUTING.md

[typo](doc) Fix the broken link in the CONTRIBUTING.md (#8876 )

2022-04-14 10:04:32 +08:00

DISCLAIMER

[Apache] Add DISCLAIMER back (#5531 )

2021-03-18 11:24:19 +08:00

env.sh

[refactor] fix warings when compile with clang (#8069 )

2022-02-19 11:29:02 +08:00

LICENSE.txt

[improvement] Improve sig handler (#8545 )

2022-03-22 10:40:31 +08:00

NOTICE.txt

[license] Organize third-party dependent licenses for bianry releases (#8350 )

2022-03-07 23:18:58 +08:00

README.md

[fix][doc]Modify readme link (#9334 )

2022-04-30 16:55:43 +08:00

run-be-ut.sh

[fix](memory tracker) Fix lru cache, compaction tracker, add USE_MEM_TRACKER compile (#9661 )

2022-05-25 08:56:17 +08:00

run-fe-ut.sh

[Fix Bug] Fix ehco command not found (#9021 )

2022-04-15 13:43:47 +08:00

run-regression-test.sh

[improvement](regression-test) support exclude suite/group/directory (#9096 )

2022-05-05 09:50:07 +08:00

tsan_suppressions

[TSAN] Fix tsan bugs (part 1) (#5162 )

2021-01-15 09:45:11 +08:00

README.md

Apache Doris (incubating)

Doris is an MPP-based interactive SQL data warehousing for reporting and analysis. Its original name was Palo, developed in Baidu. After donated to Apache Software Foundation, it was renamed Doris.

Doris provides high concurrent low latency point query performance, as well as high throughput queries of ad-hoc analysis.
Doris provides batch data loading and real-time mini-batch data loading.
Doris provides high availability, reliability, fault tolerance, and scalability.

The main advantages of Doris are the simplicity (of developing, deploying and using) and meeting many data serving requirements in a single system. For details, refer to Overview.

Official website: https://doris.apache.org/

License

Apache License, Version 2.0

Note

Some licenses of the third-party dependencies are not compatible with Apache 2.0 License. So you need to disable some Doris features to be complied with Apache 2.0 License. For details, refer to the thirdparty/LICENSE.txt

Technology

Doris mainly integrates the technology of Google Mesa and Apache Impala, and it is based on a column-oriented storage engine and can communicate by MySQL client.