3b0ddd7ae0
Column pruning for filter/agg/join/sort.
#### For agg
Pattern : agg()
Transformed:
```
agg
|
project
|
child
```
#### For filter()/sort():
Pattern: project(filter()/join()/sort())
Transformed:
```
project
|
filter/sort
|
project
|
child
```
#### For join
Pattern: project(join())
Transformed:
```
project
|
join
/ \
project project
| |
child child
```
for example:
```sql
table a: k1,v1
table b: k1,k2,k3,v1
select a.k1,b.k2 from a,b on a.k1 = b.k1 where a.k1 > 1
```
origin plan tree:
```
project(a.k1,b.k2 )
|
join(a:k1,v1 b:k1,k2,k3,v1)
/ \
scan(a:k1,v1) scan(b:k1,k2,k3,v1)
```
transformed plan tree:
```
project(a.k1,b.k2 )
|
join(a:k1 b:k1,k2)
/ \
project(k1) project(k1,k2)
| |
scan(a:k1,v1) scan(b:k1,k2,k3,v1)
```
Apache Doris
Doris is an MPP-based interactive SQL data warehousing for reporting and analysis. Its original name was Palo, developed in Baidu. After donated to Apache Software Foundation, it was renamed Doris.
-
Doris provides high concurrent low latency point query performance, as well as high throughput queries of ad-hoc analysis.
-
Doris provides batch data loading and real-time mini-batch data loading.
-
Doris provides high availability, reliability, fault tolerance, and scalability.
The main advantages of Doris are the simplicity (of developing, deploying and using) and meeting many data serving requirements in a single system. For details, refer to Overview.
Official website: https://doris.apache.org/
License
Note
Some licenses of the third-party dependencies are not compatible with Apache 2.0 License. So you need to disable some Doris features to be complied with Apache 2.0 License. For details, refer to the
thirdparty/LICENSE.txt
Technology
Doris mainly integrates the technology of Google Mesa and Apache Impala, and it is based on a column-oriented storage engine and can communicate by MySQL client.
Compile and install
See Compilation
Getting start
See Basic Usage
Doris Connector
Doris provides support for Spark/Flink to read data stored in Doris through Connector, and also supports to write data to Doris through Connector.
Doris Manager
Doris provides one-click visual automatic installation and deployment, cluster management and monitoring tools for clusters.
Report issues or submit pull request
If you find any bugs, feel free to file a GitHub issue or fix it by submitting a pull request.
Contact Us
Contact us through the following mailing list.
| Name | Scope | |||
|---|---|---|---|---|
| dev@doris.apache.org | Development-related discussions | Subscribe | Unsubscribe | Archives |
Links
- Doris official site - https://doris.apache.org
- Developer Mailing list - dev@doris.apache.org. Mail to dev-subscribe@doris.apache.org, follow the reply to subscribe the mail list.
- Slack channel - Join the Slack