database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
4,662 Commits 1 Branch 0 Tags
31e40191a8ba7e5295258e9be61e91c8ffb2fa33
Commit Graph

1123 Commits

Author SHA1 Message Date
jakevin
0c4b47756a [enhancement](community): enhance java style (#9693) 
Enhance java style.

Now: checkstyle about code order is in this page--Class and Interface Declarations

This pr can make idea auto rearrange code
 2022-05-20 15:24:30 +08:00
zhangstar333
6f61af7682 [Vectorized][java-udf] add datetime&&largeint&&decimal type to java-udf (#9440) 2022-05-20 10:26:09 +08:00
HappenLee
1e940f28b0 [docs] Fix error command of meta tool docs (#9590) 
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
 2022-05-20 09:36:26 +08:00
Shuangchi He
87e3904cc6 Fix some typos for docs. (#9680) 2022-05-19 20:55:21 +08:00
wudi
cbf1e20fbc [doc]update streamload 2pc doc (#9651) 
Co-authored-by: wudi <>
 2022-05-19 14:30:17 +08:00
zy-kkk
dd5e9fa9a4 [doc] Fixed a error in the Bitmap Index section of the document (#9679) 2022-05-19 13:55:52 +08:00
Zhengguo Yang
3efe97e73c [website] fix doris website with no link to the Privacy Policy. (#9665) 
All websites must link to the Privacy Policy
 2022-05-18 22:49:49 +08:00
Mingyu Chen
7d9c25e718 [config] Remove some old config and session variable (#9495) 
1. Remove session variable "enable_lateral_view"
2. Remove Fe config: enable_materialized_view
3. Remove Fe config: enable_create_sync_job
4. Fe config dynamic_partition_enable is only used for disable dynamic partition scheduler.
 2022-05-17 22:37:11 +08:00
Stalary
d95fe08458 [feature] group_concat support distinct (#9576) 2022-05-17 19:29:47 +08:00
Adonis Ling
ec2cd0083a [code format]Upgrade clang-format in BE Code Formatter from 8 to 13 (#9602) 2022-05-17 19:28:15 +08:00
zy-kkk
7417f9dfa3 [doc]modified the spark-load doc (#9605) 2022-05-17 19:27:02 +08:00
jiafeng.zhang
0aac9489ae [doc]add largeint doc (#9609) 
add largeint doc
 2022-05-17 19:26:45 +08:00
dujl
72e0042efb [feature-wip](hudi) Step1: Support create hudi external table (#9559) 
support create hudi table
support show create table for hudi table

### Design
1. create hudi table without schema(recommanded)
```sql
    CREATE [EXTERNAL] TABLE table_name
    ENGINE = HUDI
    [COMMENT "comment"]
    PROPERTIES (
    "hudi.database" = "hudi_db_in_hive_metastore",
    "hudi.table" = "hudi_table_in_hive_metastore",
    "hudi.hive.metastore.uris" = "thrift://127.0.0.1:9083"
    );
```

2. create hudi table with schema
```sql
    CREATE [EXTERNAL] TABLE table_name
    [(column_definition1[, column_definition2, ...])]
    ENGINE = HUDI
    [COMMENT "comment"]
    PROPERTIES (
    "hudi.database" = "hudi_db_in_hive_metastore",
    "hudi.table" = "hudi_table_in_hive_metastore",
    "hudi.hive.metastore.uris" = "thrift://127.0.0.1:9083"
    );
```
When create hudi table with schema, the columns must exist in corresponding table in hive metastore.
 2022-05-17 11:30:23 +08:00
zy-kkk
7e8e14b3c6 [docs]Modifide flink-doris-connector.md (#9595) 2022-05-17 09:01:14 +08:00
jiafeng.zhang
cfe22f8691 [Doc]Add show tables help documentation (#9568) 2022-05-15 10:18:33 +08:00
dataalive
1075648093 [doc]fix doc typo in data-model and date data type (#9571) 2022-05-15 10:17:46 +08:00
Stalary
9151cf717a ADD: 补充idea开发文档，添加help-resource.zip的生成步骤 (#9561) 2022-05-14 19:04:11 +08:00
LOVEGISER
f144041a3c [doc] [Improved] The flink connector documentation is perfect (#9528) 
Co-authored-by: 王磊 <lei.wang@unidt.com>
 2022-05-13 16:22:54 +08:00
FreeOnePlus
34e64fbea9 [doc]Add ARM architecture compilation tutorial content (#9535) 
Co-authored-by: manyi <fop@freeoneplus.com>
 2022-05-13 10:24:19 +08:00
smallhibiscus
da1a0c96db Incorrect sequence numbers in revision documents. (#9496) 
Co-authored-by: smallhibiscus <844981280>
 2022-05-12 15:44:41 +08:00
Stalary
f11d320213 [feature] support row policy filter (#9206) 2022-05-11 22:11:10 +08:00
morrySnow
3ba5ff4705 [doc] update fe checkstyle doc (#9373) 2022-05-11 15:44:29 +08:00
xueweizhang
375c1bf5c0 [feature](mysql-table) support utf8mb4 for mysql external table (#9402) 
This patch supports utf8mb4 for mysql external table.

if someone needs a mysql external table with utf8mb4 charset, but only support charset utf8 right now.

When create mysql external table, it can add an optional propertiy "charset" which can set character fom mysql connection, 
default value is "utf8". You can set "utf8mb4" instead of "utf8" when you need.
 2022-05-11 09:39:23 +08:00
Stalary
092a12e983 [feature] show create materialized view (#9391) 2022-05-11 09:29:55 +08:00
liuzhuang2017
76154f11b7 [docs][typo] Fix some typoes in "update.md" content. (#9455) 
Fix some typoes in "update.md" content
 2022-05-10 09:02:04 +08:00
Stalary
70642e3bff [Doc] 添加CTAS文档 (#9454) 
* ADD: 添加CTAS文档
 2022-05-10 09:01:42 +08:00
BePPPower
5df5d39161 [doc] update data-model.md and data-partition.md (#9448) 
update data-model.md and data-partition.md
 2022-05-09 09:19:09 +08:00
emerkfu
35f0725387 [doc] Update DECIMAL.md (#9451) 
* Update DECIMAL.md
 2022-05-09 09:17:24 +08:00
sparklezzz
327f61b796 Update data-partition.md (#9450) 
Update data-partition.md
 2022-05-09 09:17:00 +08:00
wudi
8932fcaf59 [Doc] fix doc link suffix .html to .md (#9442) 
* fix doc link suffix html to md
 2022-05-09 09:16:06 +08:00
Henry2SS
c633402ce3 [feature] (sql-digest) support sql digest (#8919) 2022-05-08 17:25:41 +08:00
morrySnow
181aa1b4a9 [style]add IntelliJ code style xml (#9438) 2022-05-08 06:41:46 +08:00
cxzl25
68fae88b36 improve doc spark3.2.0 (#9445) 2022-05-08 06:39:58 +08:00
caoliang-web
816aaa7fd1 [doc]Add create java udf document (#9430) 
* Add create java udf document

* Add create java udf document
 2022-05-07 19:20:56 +08:00
dataalive
ba2cc98cc0 [doc]fix typo in en faq and format pattern (#9423) 2022-05-07 19:16:59 +08:00
hongdd
a5a7d1276b [DOC]Improve fe idea dev (#9431) 2022-05-07 19:15:35 +08:00
jiafeng.zhang
882987c0e7 [doc]Add hll usage documentation (#9398) 
Add hll usage documentation
 2022-05-07 18:56:48 +08:00
dataalive
659417c5c9 [doc]add error reason for storage medium (#9390) 2022-05-07 08:46:50 +08:00
Gabriel
22439cb6a6 [Improvement] [compaction]Enable vectorized compaction by default (#9383) 2022-05-07 08:46:35 +08:00
Mingyu Chen
0d909b73a1 [doc] add github checks doc (#9387) 2022-05-07 08:44:23 +08:00
jiafeng.zhang
48966c9e7c [fix][doc]style issues (#9386) 2022-05-07 08:44:08 +08:00
Mingyu Chen
dce18cb325 [doc] Add window functions sql help doc (#9393) 2022-05-07 08:43:51 +08:00
jiafeng.zhang
f5ef179f22 [fix][doc]Chinese and English homepage link error (#9397) 
Chinese and English homepage link error
 2022-05-07 08:43:34 +08:00
huangzhaowei
b0afa850ca [doc]Fix some path error in regression-testing doc (#9413) 2022-05-07 08:40:23 +08:00
nvguiyachuang
17b95b4366 [docs]docs ddl modify (#9415) 2022-05-07 08:39:47 +08:00
caoliang-web
86b7717fe2 [doc]Add binlog to load and import the doris table and the original table … (#9317) 2022-05-06 15:22:55 +08:00
Jibing-Li
a5f9031c89 [improvement](hive) Support hive with HA HDFS. Pass ha configuration through hive create table properties. (#9151) 
Doris couldn't resolve the defaultFS of HDFS with HA configuration, so it could query hive table on HA HDFS.
This is because there's no way to send the HA configs to hive external table.

Describe the overview of changes.
Pass the ha configs to hive external table through create table properties.

Usage:
Example of creating hive table with ha configuration properties:

CREATE TABLE region (
r_regionkey integer NOT NULL,
r_name char(25) NOT NULL,
r_comment varchar(152)
) engine=hive properties
("database"="default",
"table"="region",
"hive.metastore.uris"="thrift://172.21.16.11:7004",
"dfs.nameservices"="hacluster",
"dfs.ha.namenodes.hacluster"="3,4",
"dfs.namenode.rpc-address.hacluster.3"="192.168.0.93:8020",
"dfs.namenode.rpc-address.hacluster.4"="172.21.16.11:8020", "dfs.client.failover.proxy.provider.hacluster"="org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider");
 2022-05-05 23:43:11 +08:00
qimumu9406
2970f9842e [doc] The description of the metadata design document is not clear (#9367) 2022-05-05 20:48:32 +08:00
dataalive
ae0f6b17d8 [doc]fix geo funtion st_distance_sphere (#9341) 
add ST_Distance_Sphere function parameter values range restrictions
 2022-05-05 20:46:22 +08:00
Mingyu Chen
cec09c18f9 [doc][community] add more collaborator and modify documents (#9320) 
1. Add collaborator morrySnow
2. Add document: How To Be A Committer
3. Add guidance to install clang-format 11
 2022-05-05 20:46:03 +08:00