database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
9c24334956cfb80ff18886563dc2c18fe1a68072
doris/docs/en
History
wei zhao f39a5bc1d0 [Feature] Spark connector supports to specify fields to write (#6973) 
1. By default , Spark connector must write all fields value to `Doris` table .
In this feature , user can specify part of fields to write ,  even specify the order of the fields to write.

eg:
I have a table named `student` which has three columns (name,gender,age) ,
creating table sql as following:
```sql
create table student (name varchar(255), gender varchar(10), age int) duplicate key (name) distributed by hash(name) buckets 2;
```
Now , I just want  to write values to two columns : name , gender.
The code as following:
```scala
    val df = spark.createDataFrame(Seq(
      ("m", "zhangsan"),
      ("f", "lisi"),
      ("m", "wangwu")
    ))
    df.write
      .format("doris")
      .option("doris.fenodes", dorisFeNodes)
      .option("doris.table.identifier", dorisTable)
      .option("user", dorisUser)
      .option("password", dorisPwd)
      //specify your fields or the order
      .option("doris.write.field", "gender,name")
      .save()
```
2021-11-02 16:35:29 +08:00
..
administrator-guide
[S3] Support path style endpoint (#6962)
2021-11-01 10:48:10 +08:00
best-practices
[Enhance][Load] Reduce the number of segments when loading a large volume data in one batch (#6947)
2021-11-01 10:51:50 +08:00
community
[Document] update docker env version to 1.3.1 (#6517)
2021-08-30 11:01:39 +08:00
developer-guide
[Doc] Update fe-idea developer guide for latest version (#6963)
2021-11-01 11:42:13 +08:00
downloads
[Docs] Fix error KEY url (#6955)
2021-10-29 12:07:44 +08:00
extending-doris
[Feature] Spark connector supports to specify fields to write (#6973)
2021-11-02 16:35:29 +08:00
getting-started
[Doc]Update hit-the-rollup.md (#6430)
2021-08-25 22:35:05 +08:00
installing
Docker 1.4.1 Compile Environment, First Compile Description (#6943)
2021-11-01 10:49:45 +08:00
internal
Add flink doris connector design document (#5709)
2021-05-17 11:53:43 +08:00
sql-reference
[Function] add functions of bitmap_and/or_count (#6912)
2021-11-01 14:00:07 +08:00
sql-reference-v2/sql-statements
Replace replica_allocation to replication_allocation (#6870)
2021-10-20 15:32:35 +08:00
README.md
[Doc] correct format errors in English doc (#5321)
2021-02-26 11:32:14 +08:00

README.md

home, heroImage, heroBgImage, heroText, tagline, structure, features, cases, actionText, actionLink
home heroImage heroBgImage heroText tagline structure features cases actionText actionLink
true /images/home/banner-stats.png /images/home/hero-bg.png
Welcome to
Apache Doris
A fast MPP database for all modern analytics on big data.
title subTitle descriptions image actionText actionLink
Apache Doris
Apache Doris is a modern MPP analytical database product. It can provide sub-second queries and efficient real-time data analysis. With it's distributed architecture, up to 10PB level datasets will be well supported and easy to operate.
Apache Doris can meet various data analysis demands, including history data reports, real-time data analysis, interactive data analysis, and exploratory data analysis. Make your data analysis easier!
/images/home/structure-fresh.png Learn More /en/getting-started/basic-usage
title subTitle list
Apache Doris Core Features
title icon
Modern MPP architecture /images/home/struct.png
title icon
Getting result of a query within one second /images/home/clock.png
title icon
Support standard SQL language, compatible with MySQL protocol /images/home/sql.png
title icon
Vectorized SQL executor /images/home/program.png
title icon
Effective data model for aggregation /images/home/aggr.png
title icon
Rollup, novel pre-computation mechanism /images/home/rollup.png
title icon
High performance, high availability, high reliability /images/home/cpu.png
title icon
easy for operation, Elastic data warehouse for big data /images/home/dev.png
title subTitle list
Apache Doris Users
logo alt
/images/home/logo-meituan.png 美团
logo alt
/images/home/logo-xiaomi.png 小米
logo alt
/images/home/logo-jd.png 京东
logo alt
/images/home/logo-huawei.png 华为
logo alt
/images/home/logo-baidu.png 百度
logo alt
/images/home/logo-weibo.png 新浪微博
logo alt
/images/home/logo-zuoyebang.png 作业帮
logo alt
/images/home/logo-vipkid.png Vipkid
logo alt
/images/home/logo-360.png 360
logo alt
/images/home/logo-shopee.png Shopee
logo alt
/images/home/logo-tantan.png 探探
logo alt
/images/home/logo-kuaishou.png 快手
logo alt
/images/home/logo-sohu.png 搜狐
logo alt
/images/home/logo-yidian.png 一点资讯
logo alt
/images/home/logo-dingdong.png 叮咚买菜
logo alt
/images/home/logo-youdao.png 有道
Quick Start → /en/installing/compilation