Go to file

morrySnow 4ab7694a7f [Enhancement](Nereids)rewrite framework used in Memo (#9807 )

Issue Number: close #9627 , #9628

This PR introduce two essentials for Nereids

1. pattern match iterator used in memo

pattern match iterator is implemented by two iterators nested within each other: GroupExpressionIterator and GroupIterator.
GroupExpressionIterator use GroupIterator to get all children Plan which matching pattern and use them as children to generate pattern matched plan.
GroupIterator use GroupExpressionIterator to get all pattern matched Plan related to GroupExpressions in itself.

2. plan rewrite framework for memo

Rewrite framework is implemented by two jobs: RewriteTopDownJob and RewriteBottomUpJob
Both of them takes a group, a set of rules that need to be applied, and a context as construction parameters.
RewriteTopDownJob apply these jobs from top to down one by one.
RewriteBottomUpJob apply these jobs from bottom to up one by one.
When one rule rewrites plan tree at a plan node. This plan node will be applied all rules again until no rules can rewrite it.

2022-06-01 15:12:58 +08:00

.github

[fix] fix Code Quality Analysis failed (#9685 )

2022-05-19 23:13:47 +08:00

[Feature] add weekday function on vectorized engine (#9901 )

2022-06-01 14:47:37 +08:00

bin

[improvement](script) Add jvm parameters and the process will automatically stop when oom occurs in fe. (#9765 )

2022-05-30 09:44:12 +08:00

build-support

[enhancement](style): polish the checkstyle (#9767 )

2022-05-30 16:10:04 +08:00

conf

Fix some typos for docs. (#9680 )

2022-05-19 20:55:21 +08:00

contrib/udf

[UDF] support RPC udaf part 1: support create RPC udaf in fe (#8510 )

2022-04-21 17:38:58 +08:00

dist

[doc] Update dev image (#9721 )

2022-05-23 11:59:15 +08:00

docker

[chore][fix](librdkafka) disable librdkafka assert and update some thirdparty (#8425 )

2022-03-12 22:09:06 +08:00

docs

[doc][fix]Update the description of the doris In_memory attribute to avoid users from interpreting it as an in-memory table (#9892 )

2022-06-01 08:47:56 +08:00

extension

Fix some typos for docs. (#9680 )

2022-05-19 20:55:21 +08:00

[Enhancement](Nereids)rewrite framework used in Memo (#9807 )

2022-06-01 15:12:58 +08:00

fe_plugins

[feature] (sql-digest) support sql digest (#8919 )

2022-05-08 17:25:41 +08:00

fs_brokers/apache_hdfs_broker

[Bug] (load) Broker load kerberos auth fail (#9494 )

2022-05-12 15:43:29 +08:00

gensrc

[feature-wip](multi-catalog) Add basic class and interface for multi catalog support

2022-05-31 11:32:44 +08:00

regression-test

[test] Add datetime function test for regression test. (#9897 )

2022-06-01 12:31:22 +08:00

samples

[UDF] support RPC udaf part 1: support create RPC udaf in fe (#8510 )

2022-04-21 17:38:58 +08:00

thirdparty

[fix](third-party) Fix build issues of third-party in ubuntu docker (#9805 )

2022-05-29 17:33:59 +08:00

tools

[tools][doc]add ssb flat tools, and update performance doc (#9827 )

2022-06-01 08:09:55 +08:00

[fix](fe-ui) fix home page spin bug #7170 (#7912 )

2022-01-30 16:47:58 +08:00

webroot

[License] Organize and modify the license of the code (#4371 )

2020-08-24 21:51:55 +08:00

.asf.yaml

[community] add more collaborators (#9830 )

2022-05-30 09:46:06 +08:00

.clang-format

[refactor][style] Use clang-format to sort includes (#9483 )

2022-05-10 21:25:35 +08:00

.clang-format-ignore

[chore](clang-format)(license-eye) Add Clang Format/Skywalking eyes github action (#7132 )

2021-11-24 10:41:02 +08:00

.clang-tidy

[refactor] add some clang-tidy checks && some code style fix (#8752 )

2022-03-31 13:53:41 +08:00

.editorconfig

[community](*) polish config about project (#8987 )

2022-04-20 14:48:32 +08:00

.gitattributes

Enable auto convert when check in (#1926 )

2019-10-09 22:31:27 +08:00

.gitignore

[chore] Update .gitignore to ignore generated files in tools (#9782 )

2022-05-27 20:43:06 +08:00

.gitmodules

[FE Code Style][step 0]add github action to check incremental code in pr (#9328 )

2022-05-01 17:30:29 +08:00

.licenserc.yaml

[Features]Add dbt doris adapter (#9299 )

2022-04-29 11:40:29 +08:00

.rat-excludes

[improvement] Improve sig handler (#8545 )

2022-03-22 10:40:31 +08:00

build_plugin.sh

[Fix Bug] Fix ehco command not found (#9021 )

2022-04-15 13:43:47 +08:00

build.sh

[fix](memory tracker) Fix lru cache, compaction tracker, add USE_MEM_TRACKER compile (#9661 )

2022-05-25 08:56:17 +08:00

CODE_OF_CONDUCT.md

[Doc] Create CODE_OF_CONDUCT.md (#4070 )

2020-07-14 22:28:38 +08:00

CONTRIBUTING_CN.md

[typo](doc) Fix the broken link in the CONTRIBUTING.md (#8876 )

2022-04-14 10:04:32 +08:00

CONTRIBUTING.md

[typo](doc) Fix the broken link in the CONTRIBUTING.md (#8876 )

2022-04-14 10:04:32 +08:00

DISCLAIMER

[Apache] Add DISCLAIMER back (#5531 )

2021-03-18 11:24:19 +08:00

env.sh

[refactor] fix warings when compile with clang (#8069 )

2022-02-19 11:29:02 +08:00

LICENSE.txt

[improvement] Improve sig handler (#8545 )

2022-03-22 10:40:31 +08:00

NOTICE.txt

[license] Organize third-party dependent licenses for bianry releases (#8350 )

2022-03-07 23:18:58 +08:00

README.md

[fix][doc]Modify readme link (#9334 )

2022-04-30 16:55:43 +08:00

run-be-ut.sh

[fix](memory tracker) Fix lru cache, compaction tracker, add USE_MEM_TRACKER compile (#9661 )

2022-05-25 08:56:17 +08:00

run-fe-ut.sh

[Fix Bug] Fix ehco command not found (#9021 )

2022-04-15 13:43:47 +08:00

run-regression-test.sh

[improvement](regression-test) support exclude suite/group/directory (#9096 )

2022-05-05 09:50:07 +08:00

tsan_suppressions

[TSAN] Fix tsan bugs (part 1) (#5162 )

2021-01-15 09:45:11 +08:00

README.md

Apache Doris (incubating)

Doris is an MPP-based interactive SQL data warehousing for reporting and analysis. Its original name was Palo, developed in Baidu. After donated to Apache Software Foundation, it was renamed Doris.

Doris provides high concurrent low latency point query performance, as well as high throughput queries of ad-hoc analysis.
Doris provides batch data loading and real-time mini-batch data loading.
Doris provides high availability, reliability, fault tolerance, and scalability.

The main advantages of Doris are the simplicity (of developing, deploying and using) and meeting many data serving requirements in a single system. For details, refer to Overview.

Official website: https://doris.apache.org/

License

Apache License, Version 2.0

Note

Some licenses of the third-party dependencies are not compatible with Apache 2.0 License. So you need to disable some Doris features to be complied with Apache 2.0 License. For details, refer to the thirdparty/LICENSE.txt

Technology

Doris mainly integrates the technology of Google Mesa and Apache Impala, and it is based on a column-oriented storage engine and can communicate by MySQL client.