[typo](doc)update jfs docs (#16090)

This commit is contained in:
Liqf
2023-01-19 15:10:49 +08:00
committed by GitHub
parent 6e090e4daf
commit b9f1e4a17f
3 changed files with 16 additions and 3 deletions

View File

@ -33,7 +33,7 @@ Broker is an optional process in the Doris cluster. It is mainly used to support
- Tencent Cloud CHDFS
- Huawei Cloud OBS (since 1.2.0)
- Amazon S3
- JuiceFS (since master)
- JuiceFS (since 2.0.0)
Broker provides services through an RPC service port. It is a stateless JVM process that is responsible for encapsulating some POSIX-like file operations for read and write operations on remote storage, such as open, pred, pwrite, and so on.
In addition, the Broker does not record any other information, so the connection information, file information, permission information, and so on stored remotely need to be passed to the Broker process in the RPC call through parameters in order for the Broker to read and write files correctly .

View File

@ -33,7 +33,7 @@ Broker 是 Doris 集群中一种可选进程,主要用于支持 Doris 读写
- 腾讯云 CHDFS
- 华为云 OBS (1.2.0 版本后支持)
- 亚马逊 S3
- JuiceFS (master 版本支持)
- JuiceFS (2.0.0 版本支持)
Broker 通过提供一个 RPC 服务端口来提供服务,是一个无状态的 Java 进程,负责为远端存储的读写操作封装一些类 POSIX 的文件操作,如 open,pread,pwrite 等等。除此之外,Broker 不记录任何其他信息,所以包括远端存储的连接信息、文件信息、权限信息等等,都需要通过参数在 RPC 调用中传递给 Broker 进程,才能使得 Broker 能够正确读写文件。

View File

@ -35,7 +35,7 @@ under the License.
1. hive 支持 1/2/3 版本。
2. 支持 Managed Table 和 External Table。
3. 可以识别 Hive Metastore 中存储的 hive、iceberg、hudi 元数据。
4. 支持数据存储在 Juicefs 上的 hive 表,用法和普通 hive 一样(需要把juicefs-hadoop-x.x.x.jar放在 fe/lib/ 和 apache_hdfs_broker/lib/ 下)。
4. 支持数据存储在 Juicefs 上的 hive 表,用法如下(需要把juicefs-hadoop-x.x.x.jar放在 fe/lib/ 和 apache_hdfs_broker/lib/ 下)。
## 创建 Catalog
@ -97,6 +97,19 @@ CREATE CATALOG hive PROPERTIES (
'dfs.encryption.key.provider.uri' = 'kms://http@kms_host:kms_port/kms'
);
```
hive数据存储在JuiceFS,示例如下:
```sql
CREATE CATALOG hive PROPERTIES (
'type'='hms',
'hive.metastore.uris' = 'thrift://172.21.0.1:7004',
'hadoop.username' = 'root',
'fs.jfs.impl' = 'io.juicefs.JuiceFileSystem',
'fs.AbstractFileSystem.jfs.impl' = 'io.juicefs.JuiceFS',
'juicefs.meta' = 'xxx'
);
```
在 1.2.1 版本之后,我们也可以将这些信息通过创建一个 Resource 统一存储,然后在创建 Catalog 时使用这个 Resource。示例如下: