Commit Graph

1853 Commits

Author SHA1 Message Date
f5668ac1a0 [fix](doc) Fix table typo in star schema benchmark documentation and join optimization (#19181) 2023-06-29 11:50:04 +08:00
3a12b67517 [Improvement](statistics, multi catalog)Implement hive table statistic connector (#21053)
This pr is to add the collecting hive statistic function. While the CBO fetching hive table statistics, statistic cache will 
first load from internal stats olap table. If not found, then using this pr's function to fetch from remote Hive metastore.
2023-06-29 10:50:54 +08:00
54e2e2f7ee [typo](doc)FlinkCDC access to multi-table or whole database example document mod… (#21295) 2023-06-29 09:42:13 +08:00
73bce9e750 [typo](doc) add params description and example for accessing hdfs in ha mode by tvf #21277 2023-06-29 09:05:35 +08:00
449c8d4568 [fix](jdbc) Handling Zero DateTime Values in Non-nullable Columns for JDBC Catalog Reading MySQL (#21296) 2023-06-28 22:51:17 +08:00
274203a59c [typo](storage)Fixed wrong description about Storage_root_path parameter (#20641) 2023-06-28 21:28:50 +08:00
a6b51ec19a [Feature](avro) Support Apache Avro file format (#19990)
support read avro file by hdfs() or s3() .
```sql
select * from s3(
         "uri" = "http://127.0.0.1:9312/test2/person.avro",
         "ACCESS_KEY" = "ak",
         "SECRET_KEY" = "sk",
         "FORMAT" = "avro");
+--------+--------------+-------------+-----------------+
| name   | boolean_type | double_type | long_type       |
+--------+--------------+-------------+-----------------+
| Alyssa |            1 |     10.0012 | 100000000221133 |
| Ben    |            0 |    5555.999 |      4009990000 |
| lisi   |            0 | 5992225.999 |      9099933330 |
+--------+--------------+-------------+-----------------+

select * from hdfs(
                "uri" = "hdfs://127.0.0.1:9000/input/person2.avro",
                "fs.defaultFS" = "hdfs://127.0.0.1:9000",
                "hadoop.username" = "doris",
                "format" = "avro");
+--------+--------------+-------------+-----------+
| name   | boolean_type | double_type | long_type |
+--------+--------------+-------------+-----------+
| Alyssa |            1 |  8888.99999 |  89898989 |
+--------+--------------+-------------+-----------+
```

current avro reader only support common data type, the complex data types will be supported later.
2023-06-28 21:15:35 +08:00
4e082a803f [typo](docs) improvement lakehouse doc sidebar (#21270) 2023-06-28 20:19:17 +08:00
283fd2903f [typo](doc)json document optimization (#20753) 2023-06-28 18:01:41 +08:00
824c1fe165 [typo](docs)delete the native udf doc (#21146) 2023-06-28 11:29:49 +08:00
1d406d486c [typo](docs) modify invalid URLs in release-1.2.0 (#21175) 2023-06-28 11:29:33 +08:00
18878df1c0 [typo](doc)outfile export document optimization (#21211) 2023-06-28 10:30:30 +08:00
ac62ca0320 [typo](doc) add model limitation description for inverted index (#21245) 2023-06-28 10:13:42 +08:00
bed2a5efa7 [typo](doc) Fix errors in the example (#21151) 2023-06-27 18:23:48 +08:00
3ab06bf381 [typo](docs) fix monitor alert doc start grafana err (#21244) 2023-06-27 18:20:32 +08:00
5f4167d816 [fix](doc)description of stream-load (#20979) 2023-06-27 15:22:34 +08:00
f7fd891cd3 [typo](docs) delete no-used ENABLE-FEATURE doc (#21227) 2023-06-27 14:24:29 +08:00
Pxl
70ddf64126 [Chore](agg-state) add documentation about agg_state, add group_concat agg_state test case (#21147)
add documentation about agg_state, add group_concat agg_state test case
2023-06-27 11:28:19 +08:00
e0b20f0437 [feature](function) add ip function ipv4numtostring (alias inet_ntoa) (#20936) 2023-06-27 10:17:40 +08:00
efcc65a0d3 [feature-wip](workload-group) Support for workload group Authentication (#20242) 2023-06-27 09:57:18 +08:00
c9306e9c48 [improvement](ms jdbc)Support for automatically obtaining the precision of the sqlserver datetime type (#21145) 2023-06-26 23:10:46 +08:00
05d94e5a4c [typo](docs) add a create table as select sample (#21078) 2023-06-26 19:27:05 +08:00
eb2a08bdf2 [typo](docs) Update the audit document (#21185) 2023-06-26 19:25:10 +08:00
65d81c04e6 [Docs](inverted index) update docs for build index (#21184) 2023-06-26 19:24:44 +08:00
1138ed1d70 [doc](catalog) update and improve doc of multi catalog (#21105)
Update the document of multi catalog feature.
2023-06-26 11:36:44 +08:00
880252984b [typo](docs) fix jdbc catalog doc example err (#21152) 2023-06-26 10:14:17 +08:00
69d5adaee3 [Improvement](doc) improve ngram and inverted index documents #21091 2023-06-25 19:13:41 +08:00
ee2492dd78 [typo](doc)fix delete table associate to other table only support unique model (#21129)
Co-authored-by: smallhibiscus <844981280>
2023-06-25 19:04:27 +08:00
76bdcf1d26 [improvement](pipeline) task group scan entity (#19924) 2023-06-25 14:43:35 +08:00
bc6692a1b8 [typo](doc) add automatic service start (#20974)
* add automatic service start

* add automatic service start

* add docs sidebars

* Update automatic-service-start.md
2023-06-22 08:45:09 +08:00
18a0824eb3 [fix](compaction)Modify time series compaction policy default config (#21079) 2023-06-21 20:29:58 +08:00
442a734ef5 [improvement](config) update be config max_runnings_transactions_per_txn_map default value (#21060) 2023-06-21 20:29:13 +08:00
6ac0bfeceb [Feature](inverted index) add unicode parser for inverted index (#21035) 2023-06-21 20:14:06 +08:00
62fb0e642e [chore](dynamic schema) deprecated create dynamic schema table (#21058) 2023-06-21 14:44:57 +08:00
d7cc05502a [typo](doc) To access a Kafka cluster with PLAIN authentication enabled (#21019) 2023-06-20 23:19:59 +08:00
19dd35f908 [doc](fix) cold hot separation cache doc (#20994) 2023-06-20 18:18:22 +08:00
824bc02603 [Function] Support date function: microsecond() (#20044) 2023-06-20 10:32:54 +08:00
63b9684696 [Feature](broker-load) Support priority for Broker Load job. (#20628)
Support priority for Broker Load job.
2023-06-19 14:16:48 +08:00
26cca5e00a [Enhancement](tvf) Add frontends table-valued-function (#20857) 2023-06-19 13:57:40 +08:00
124db9addc [docs](releasenote)add 1.2.5 release note (#20965) 2023-06-19 12:12:49 +08:00
e3454494b4 [improvement](extension) add new features to Mysql to doris tools (#14243) 2023-06-19 11:08:48 +08:00
06806dc737 [typo](doc) fix bucket description and style (#20922) 2023-06-17 21:56:00 +08:00
15a4eca467 [typo](docs) Delete invalid streaming hint. (#20929) 2023-06-17 01:03:48 +08:00
483d96368c [doc](insert-overwrite) add related doc (#20657) 2023-06-16 21:11:04 +08:00
97135a1cbb [Feature] (json)add json_contains function (#20824) 2023-06-16 15:10:12 +08:00
05e5ebfdeb [typo][docs] Fix a parameter error (#20841) 2023-06-16 11:37:41 +08:00
c3e6db827c [typo][docs] remove unuse config mysql_service_nio_enabled (#20862) 2023-06-16 09:58:33 +08:00
9daa277b0d [typo](doc) Fix the description of the alter-table-partition document (#20800) 2023-06-15 21:27:59 +08:00
71aba93e19 [typo](doc) spark connector add new param and a way to write bitmap and hll col (#20850) 2023-06-15 21:27:37 +08:00
6d4c16b497 [typo](doc) Fix formatting errors in CREATE-TABLE documents due to line indentation (#20839) 2023-06-15 21:22:01 +08:00