database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

[doc] Add Flink Connector Sink Bitmap Type Doc (#9316)

Browse Source
This commit is contained in:
wudi
2022-05-01 17:53:10 +08:00
committed by GitHub
parent 239b6374ca
commit bdf66731fa
2 changed files with 36 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

19
docs/en/ecosystem/flink-doris-connector.md
View File

@ -443,6 +443,23 @@ Then suppose a row of data is 500B, and the user wants every 100MB or 10 seconds
### common problem
1.Could not execute SQL statement. Reason：java.lang.IllegalAraumenException: Row parity: 32，but serializer rarity：31
1. Could not execute SQL statement. Reason：java.lang.IllegalAraumenException: Row parity: 32，but serializer rarity：31
Because Doris has a hidden column, you need to manually add a column `__DORIS_DELETE_SIGN__` in Flink Schema Type: TINYINT
2. Bitmap type write
```sql
CREATE TABLE bitmap_sink (
dt int,
page string,
user_id int
)
WITH (
'connector' = 'doris',
'fenodes' = '127.0.0.1:8030',
'table.identifier' = 'test.bitmap_test',
'username' = 'root',
'password' = '',
'sink.properties.columns' = 'dt,page,user_id,user_id=to_bitmap(user_id)'
)
````

19
docs/zh-CN/ecosystem/flink-doris-connector.md
View File

@ -522,6 +522,23 @@ Flink Doris Connector写入频率主要是通过sink.batch.size，sink.batch.int
### 常见问题
1.Could not execute SQL statement. Reason：java.lang.IllegalAraumenException: Row parity: 32，but serializer rarity：31
1. Could not execute SQL statement. Reason：java.lang.IllegalAraumenException: Row parity: 32，but serializer rarity：31
因为Doris有个隐藏列，需要在Flink Schema中手动添加一列`__DORIS_DELETE_SIGN__` 类型：TINYINT
2. Bitmap类型写入
```sql
CREATE TABLE bitmap_sink (
dt int,
page string,
user_id int
)
WITH (
'connector' = 'doris',
'fenodes' = '127.0.0.1:8030',
'table.identifier' = 'test.bitmap_test',
'username' = 'root',
'password' = '',
'sink.properties.columns' = 'dt,page,user_id,user_id=to_bitmap(user_id)'
)
```