From 875e72b5ea06cb1441f5b04ace690a5c074684f2 Mon Sep 17 00:00:00 2001 From: caoliang-web <71004656+caoliang-web@users.noreply.github.com> Date: Sat, 27 May 2023 22:44:20 +0800 Subject: [PATCH] [typo](doc)spark load add task timeout parameter #20115 --- docs/en/docs/data-operate/import/import-way/spark-load-manual.md | 1 + .../docs/data-operate/import/import-way/spark-load-manual.md | 1 + 2 files changed, 2 insertions(+) diff --git a/docs/en/docs/data-operate/import/import-way/spark-load-manual.md b/docs/en/docs/data-operate/import/import-way/spark-load-manual.md index 5e0b7690fc..76e3f7ed90 100644 --- a/docs/en/docs/data-operate/import/import-way/spark-load-manual.md +++ b/docs/en/docs/data-operate/import/import-way/spark-load-manual.md @@ -186,6 +186,7 @@ REVOKE USAGE_PRIV ON RESOURCE resource_name FROM ROLE role_name - `spark.master`: required, yarn is supported at present, `spark://host:port`. - `spark.submit.deployMode`: the deployment mode of Spark Program. It is required and supports cluster and client. - `spark.hadoop.fs.defaultfs`: required when master is yarn. + - `spark.submit.timeout`：spark task timeout, default 5 minutes - Other parameters are optional, refer to `http://spark.apache.org/docs/latest/configuration.html` - YARN RM related parameters are as follows： - If Spark is a single-point RM, you need to configure `spark.hadoop.yarn.resourcemanager.address`，address of the single point resource manager. diff --git a/docs/zh-CN/docs/data-operate/import/import-way/spark-load-manual.md b/docs/zh-CN/docs/data-operate/import/import-way/spark-load-manual.md index b4ab87f4a7..557488eb76 100644 --- a/docs/zh-CN/docs/data-operate/import/import-way/spark-load-manual.md +++ b/docs/zh-CN/docs/data-operate/import/import-way/spark-load-manual.md @@ -159,6 +159,7 @@ REVOKE USAGE_PRIV ON RESOURCE resource_name FROM ROLE role_name - `spark.master`: 必填，目前支持 Yarn，Spark://host:port。 - `spark.submit.deployMode`: Spark 程序的部署模式，必填，支持 Cluster、Client 两种。 - `spark.hadoop.fs.defaultFS`: Master 为 Yarn 时必填。 + - `spark.submit.timeout`：spark任务超时时间，默认5分钟 - YARN RM 相关参数如下： - 如果 Spark 为单点 RM，则需要配置`spark.hadoop.yarn.resourcemanager.address`，表示单点 ResourceManager 地址。 - 如果 Spark 为 RM-HA，则需要配置（其中 hostname 和 address 任选一个配置）：