database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
4,720 Commits 1 Branch 0 Tags
f33ef32d92b2fa348abe9566fb569657e94c8b13
Commit Graph

1146 Commits

Author SHA1 Message Date
Dongyang Li
92c1c82422 [tools]add ssb flat test scripts (#9796) 
Co-authored-by: stephen <hello-stephen@qq.com>
 2022-05-28 17:28:03 +08:00
Dayue Gao
4d1e926b6c [feature][config] introduce a new BE config storage_page_cache_shard_size (#9821) 
Co-authored-by: gaodayue <gaodayue@bytedance.com>
 2022-05-28 10:17:09 +08:00
Adonis Ling
cfe640c37b [doc] Add a note about the version of checkstyle (#9785) 2022-05-27 21:58:49 +08:00
pengxiangyu
ee1bed46be [config] Add backend_rpc_timeout_second in FE config (#9779) 2022-05-27 21:58:09 +08:00
LOVEGISER
77de4869ed [doc] website document update (#9776) 2022-05-27 21:57:06 +08:00
hanfengcan
b2b9463537 [doc] Updated the compilation and deployment chapter in the documentation (#9702) 
Updated the compilation and deployment chapter in the documentation
 2022-05-27 17:11:31 +08:00
smallhibiscus
8019da4504 fix the format error of en doc. (#9756) 
fix the format error of en doc
 2022-05-27 17:10:47 +08:00
lit
dbc2feb31a modify bloomfilter.md (#9798) 
modify bloomfilter
 2022-05-27 17:10:08 +08:00
jiafeng.zhang
b07004e2f7 [fix]Documentation fixes (#9787) 
[fix]Documentation fixes （rollup)
 2022-05-27 12:57:00 +08:00
jiafeng.zhang
e7e551ffa7 [doc][fix]Sync job doc (#9790) 
binlog load documentation fix
 2022-05-27 12:56:19 +08:00
jiafeng.zhang
80e9c3395a [doc]Add export sql help documentation (#9797) 
Add export sql help documentation
 2022-05-27 12:55:45 +08:00
jiafeng.zhang
add3f5da85 [doc]Remove tcp-h (#9794) 
remove tcp-h
 2022-05-27 12:55:19 +08:00
jiafeng.zhang
dbc5af44ef [doc]Add Doris join optimization documentation (#9753) 
* [doc]Add Doris join optimization documentation
 2022-05-26 18:11:43 +08:00
wudi
8898b11bb0 [docs]add sql mode markdown (#9742) 
Co-authored-by: wudi <>
 2022-05-26 15:06:23 +08:00
Mingyu Chen
0c70359404 [fix](resource-tag) Consider resource tags when assigning tasks for broker & routine load (#9492) 
This CL mainly changes:
1. Broker Load
    When assigning backends, use user level resource tag to find available backends.
    If user level resource tag is not set, broker load task can be assigned to any BE node,
    otherwise, task can only be assigned to BE node which match the user level tags.

2. Routine Load
    The current routine load job does not have user info, so it can not get user level tag when assigning tasks.
    So there are 2 ways:
    1. For old routine load job, use tags of replica allocation info to select BE nodes.
    2. For new routine load job, the user info will be added and persisted in routine load job.
 2022-05-26 08:42:09 +08:00
camby
2ad691edf7 [doc] Add manual for Array data type and functions (#9700) 
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
 2022-05-25 16:44:20 +08:00
jiafeng.zhang
fdd5bc07a9 [doc]Add SQL Select usage help documentation (#9729) 
Add SQL Select usage help documentation
 2022-05-23 13:33:07 +08:00
Mingyu Chen
ddda91c89d [doc] Update dev image (#9721) 2022-05-23 11:59:15 +08:00
Gabriel
d97e2b1eb2 [doc] update docs for FE UT (#9718) 2022-05-22 21:36:45 +08:00
Jibing-Li
3768fdd3f8 [doc] Add trim_tailing_spaces_for_external_table_query variable to the docs. (#9701) 2022-05-22 21:32:23 +08:00
Mingyu Chen
d270f4f2d4 [config](checksum) Disable consistency checker by default (#9699) 
Disable by default because current checksum logic has some bugs.
And it will also bring some overhead.
 2022-05-22 21:31:43 +08:00
zxealous
ad4da4aa8f [doc] Fix typos in documentation (#9692) 2022-05-22 21:30:22 +08:00
jiafeng.zhang
97fad7a2ff [doc]Add insert best practices (#9723) 
Add insert best practices
 2022-05-22 16:24:20 +08:00
jakevin
0c4b47756a [enhancement](community): enhance java style (#9693) 
Enhance java style.

Now: checkstyle about code order is in this page--Class and Interface Declarations

This pr can make idea auto rearrange code
 2022-05-20 15:24:30 +08:00
zhangstar333
6f61af7682 [Vectorized][java-udf] add datetime&&largeint&&decimal type to java-udf (#9440) 2022-05-20 10:26:09 +08:00
HappenLee
1e940f28b0 [docs] Fix error command of meta tool docs (#9590) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-05-20 09:36:26 +08:00
Shuangchi He
87e3904cc6 Fix some typos for docs. (#9680) 2022-05-19 20:55:21 +08:00
wudi
cbf1e20fbc [doc]update streamload 2pc doc (#9651) 
Co-authored-by: wudi <>
 2022-05-19 14:30:17 +08:00
zy-kkk
dd5e9fa9a4 [doc] Fixed a error in the Bitmap Index section of the document (#9679) 2022-05-19 13:55:52 +08:00
Zhengguo Yang
3efe97e73c [website] fix doris website with no link to the Privacy Policy. (#9665) 
All websites must link to the Privacy Policy
 2022-05-18 22:49:49 +08:00
Mingyu Chen
7d9c25e718 [config] Remove some old config and session variable (#9495) 
1. Remove session variable "enable_lateral_view"
2. Remove Fe config: enable_materialized_view
3. Remove Fe config: enable_create_sync_job
4. Fe config dynamic_partition_enable is only used for disable dynamic partition scheduler.
 2022-05-17 22:37:11 +08:00
Stalary
d95fe08458 [feature] group_concat support distinct (#9576) 2022-05-17 19:29:47 +08:00
Adonis Ling
ec2cd0083a [code format]Upgrade clang-format in BE Code Formatter from 8 to 13 (#9602) 2022-05-17 19:28:15 +08:00
zy-kkk
7417f9dfa3 [doc]modified the spark-load doc (#9605) 2022-05-17 19:27:02 +08:00
jiafeng.zhang
0aac9489ae [doc]add largeint doc (#9609) 
add largeint doc
 2022-05-17 19:26:45 +08:00
dujl
72e0042efb [feature-wip](hudi) Step1: Support create hudi external table (#9559) 
support create hudi table
support show create table for hudi table

### Design
1. create hudi table without schema(recommanded)
```sql
    CREATE [EXTERNAL] TABLE table_name
    ENGINE = HUDI
    [COMMENT "comment"]
    PROPERTIES (
    "hudi.database" = "hudi_db_in_hive_metastore",
    "hudi.table" = "hudi_table_in_hive_metastore",
    "hudi.hive.metastore.uris" = "thrift://127.0.0.1:9083"
    );
```

2. create hudi table with schema
```sql
    CREATE [EXTERNAL] TABLE table_name
    [(column_definition1[, column_definition2, ...])]
    ENGINE = HUDI
    [COMMENT "comment"]
    PROPERTIES (
    "hudi.database" = "hudi_db_in_hive_metastore",
    "hudi.table" = "hudi_table_in_hive_metastore",
    "hudi.hive.metastore.uris" = "thrift://127.0.0.1:9083"
    );
```
When create hudi table with schema, the columns must exist in corresponding table in hive metastore.
 2022-05-17 11:30:23 +08:00
zy-kkk
7e8e14b3c6 [docs]Modifide flink-doris-connector.md (#9595) 2022-05-17 09:01:14 +08:00
jiafeng.zhang
cfe22f8691 [Doc]Add show tables help documentation (#9568) 2022-05-15 10:18:33 +08:00
dataalive
1075648093 [doc]fix doc typo in data-model and date data type (#9571) 2022-05-15 10:17:46 +08:00
Stalary
9151cf717a ADD: 补充idea开发文档，添加help-resource.zip的生成步骤 (#9561) 2022-05-14 19:04:11 +08:00
LOVEGISER
f144041a3c [doc] [Improved] The flink connector documentation is perfect (#9528) 
Co-authored-by: 王磊 <lei.wang@unidt.com>
 2022-05-13 16:22:54 +08:00
FreeOnePlus
34e64fbea9 [doc]Add ARM architecture compilation tutorial content (#9535) 
Co-authored-by: manyi <fop@freeoneplus.com>
 2022-05-13 10:24:19 +08:00
smallhibiscus
da1a0c96db Incorrect sequence numbers in revision documents. (#9496) 
Co-authored-by: smallhibiscus <844981280>
 2022-05-12 15:44:41 +08:00
Stalary
f11d320213 [feature] support row policy filter (#9206) 2022-05-11 22:11:10 +08:00
morrySnow
3ba5ff4705 [doc] update fe checkstyle doc (#9373) 2022-05-11 15:44:29 +08:00
xueweizhang
375c1bf5c0 [feature](mysql-table) support utf8mb4 for mysql external table (#9402) 
This patch supports utf8mb4 for mysql external table.

if someone needs a mysql external table with utf8mb4 charset, but only support charset utf8 right now.

When create mysql external table, it can add an optional propertiy "charset" which can set character fom mysql connection, 
default value is "utf8". You can set "utf8mb4" instead of "utf8" when you need.
 2022-05-11 09:39:23 +08:00
Stalary
092a12e983 [feature] show create materialized view (#9391) 2022-05-11 09:29:55 +08:00
liuzhuang2017
76154f11b7 [docs][typo] Fix some typoes in "update.md" content. (#9455) 
Fix some typoes in "update.md" content
 2022-05-10 09:02:04 +08:00
Stalary
70642e3bff [Doc] 添加CTAS文档 (#9454) 
* ADD: 添加CTAS文档
 2022-05-10 09:01:42 +08:00
BePPPower
5df5d39161 [doc] update data-model.md and data-partition.md (#9448) 
update data-model.md and data-partition.md
 2022-05-09 09:19:09 +08:00