Commit Graph

2425 Commits

Author SHA1 Message Date
8c2963961f [docs](releasenote) 2.0 beta release note (#21457) 2023-07-04 19:02:18 +08:00
be406a1696 [typo](docs) fix presto jdbc catalog docs (#21445) 2023-07-04 18:24:58 +08:00
890e55b604 [typo](docs)Delete unsupported sql statements in GROUP_CONCAT() (#21455)
Delete unsupported sql statements in GROUP_CONCAT()
2023-07-04 14:46:49 +08:00
e4c0a0ac24 [improve](dependency)Upgrade dependency version (#21431)
exclude old netty version
upgrade spring-boot version to 2.7.13
used ojdbc8 replace ojdbc6
upgrade jackson version to 2.15.2
upgrade fabric8 version to 6.7.2
2023-07-04 11:29:21 +08:00
5e6242e235 [typo](docs) Refactor upgrade documentation (#21449)
Co-authored-by: Yijia Su <suyijia@selectdb.com>
2023-07-03 20:14:19 +08:00
bb33ad0bde [opt](docs) update nereids doc to reflect the latest changes (#21444) 2023-07-03 18:50:01 +08:00
124516c1ea [Fix](orc-reader) Fix Wrong data type for column error when column order in hive table is not same in orc file schema. (#21306)
`Wrong data type for column` error when column order in hive table is not same in orc file schema.

The root cause is in order to handle the following case:

The table in orc format of Hive 1.x may encounter system column names such as `_col0`, `_col1`, `_col2`... in the underlying orc file schema, which need to use the column names in the hive table for mapping.

### Solution
Currently fix this issue by handling the following case by specifying hive version to 1.x.x in the hive catalog configuration.

```sql
CREATE CATALOG hive PROPERTIES (
    'hive.version' = '1.x.x'
);
```
2023-07-03 09:32:55 +08:00
1fe04b7242 [Chore](metrics) remove trace metrics code using runtime profile instead (#21394)
* commit

* fix

* format
2023-07-01 12:18:23 +08:00
e8ffca6487 [doc](stream load json) modify enable_simdjson_reader since it's default open (#21379) 2023-07-01 08:42:50 +08:00
df23ab3f29 [Enhancement](tvf) Add authentication for workload group tvf (#21323) 2023-06-30 12:56:23 +08:00
6d63261b71 [docs]<docs>Add file system benchmark tools docs (#21262) 2023-06-30 09:27:18 +08:00
3fb75c1844 [docs](workload-group) Modify workload group docs (#21349) 2023-06-29 23:25:06 +08:00
f07e0d7686 [typo](docs) Some typo in nereids.md has been fixed (#20475) 2023-06-29 22:04:13 +08:00
f5668ac1a0 [fix](doc) Fix table typo in star schema benchmark documentation and join optimization (#19181) 2023-06-29 11:50:04 +08:00
3a12b67517 [Improvement](statistics, multi catalog)Implement hive table statistic connector (#21053)
This pr is to add the collecting hive statistic function. While the CBO fetching hive table statistics, statistic cache will 
first load from internal stats olap table. If not found, then using this pr's function to fetch from remote Hive metastore.
2023-06-29 10:50:54 +08:00
54e2e2f7ee [typo](doc)FlinkCDC access to multi-table or whole database example document mod… (#21295) 2023-06-29 09:42:13 +08:00
73bce9e750 [typo](doc) add params description and example for accessing hdfs in ha mode by tvf #21277 2023-06-29 09:05:35 +08:00
449c8d4568 [fix](jdbc) Handling Zero DateTime Values in Non-nullable Columns for JDBC Catalog Reading MySQL (#21296) 2023-06-28 22:51:17 +08:00
274203a59c [typo](storage)Fixed wrong description about Storage_root_path parameter (#20641) 2023-06-28 21:28:50 +08:00
a6b51ec19a [Feature](avro) Support Apache Avro file format (#19990)
support read avro file by hdfs() or s3() .
```sql
select * from s3(
         "uri" = "http://127.0.0.1:9312/test2/person.avro",
         "ACCESS_KEY" = "ak",
         "SECRET_KEY" = "sk",
         "FORMAT" = "avro");
+--------+--------------+-------------+-----------------+
| name   | boolean_type | double_type | long_type       |
+--------+--------------+-------------+-----------------+
| Alyssa |            1 |     10.0012 | 100000000221133 |
| Ben    |            0 |    5555.999 |      4009990000 |
| lisi   |            0 | 5992225.999 |      9099933330 |
+--------+--------------+-------------+-----------------+

select * from hdfs(
                "uri" = "hdfs://127.0.0.1:9000/input/person2.avro",
                "fs.defaultFS" = "hdfs://127.0.0.1:9000",
                "hadoop.username" = "doris",
                "format" = "avro");
+--------+--------------+-------------+-----------+
| name   | boolean_type | double_type | long_type |
+--------+--------------+-------------+-----------+
| Alyssa |            1 |  8888.99999 |  89898989 |
+--------+--------------+-------------+-----------+
```

current avro reader only support common data type, the complex data types will be supported later.
2023-06-28 21:15:35 +08:00
4e082a803f [typo](docs) improvement lakehouse doc sidebar (#21270) 2023-06-28 20:19:17 +08:00
283fd2903f [typo](doc)json document optimization (#20753) 2023-06-28 18:01:41 +08:00
824c1fe165 [typo](docs)delete the native udf doc (#21146) 2023-06-28 11:29:49 +08:00
1d406d486c [typo](docs) modify invalid URLs in release-1.2.0 (#21175) 2023-06-28 11:29:33 +08:00
e9bbac71dc [typo](docs) poor phrasing (#21224) 2023-06-28 11:05:09 +08:00
a6ff87f32c [docker](trino) add Trino docker compose and hive catalog (#21086) 2023-06-28 11:04:41 +08:00
33ace22471 [typo](docs) improvement SQL manual doc sidebar (#21267) 2023-06-28 11:03:53 +08:00
18878df1c0 [typo](doc)outfile export document optimization (#21211) 2023-06-28 10:30:30 +08:00
ac62ca0320 [typo](doc) add model limitation description for inverted index (#21245) 2023-06-28 10:13:42 +08:00
bed2a5efa7 [typo](doc) Fix errors in the example (#21151) 2023-06-27 18:23:48 +08:00
3ab06bf381 [typo](docs) fix monitor alert doc start grafana err (#21244) 2023-06-27 18:20:32 +08:00
5f4167d816 [fix](doc)description of stream-load (#20979) 2023-06-27 15:22:34 +08:00
f7fd891cd3 [typo](docs) delete no-used ENABLE-FEATURE doc (#21227) 2023-06-27 14:24:29 +08:00
Pxl
70ddf64126 [Chore](agg-state) add documentation about agg_state, add group_concat agg_state test case (#21147)
add documentation about agg_state, add group_concat agg_state test case
2023-06-27 11:28:19 +08:00
e0b20f0437 [feature](function) add ip function ipv4numtostring (alias inet_ntoa) (#20936) 2023-06-27 10:17:40 +08:00
efcc65a0d3 [feature-wip](workload-group) Support for workload group Authentication (#20242) 2023-06-27 09:57:18 +08:00
c9306e9c48 [improvement](ms jdbc)Support for automatically obtaining the precision of the sqlserver datetime type (#21145) 2023-06-26 23:10:46 +08:00
70207e0986 [typo](docs) improvement SQL manual database administration doc (#21204) 2023-06-26 22:59:41 +08:00
2fea770e32 [typo](docs) improvement SQL manual account management doc (#21203) 2023-06-26 22:52:15 +08:00
b89b17492f [typo](docs) improvement SQL manual cluster management doc (#21202) 2023-06-26 22:51:57 +08:00
254aaf589d [typo](docs) improvement SQL manual ddl backup and restore doc (#21200) 2023-06-26 22:33:29 +08:00
0fd77fdfa9 [typo](docs) improvement SQL manual dml load doc (#21199) 2023-06-26 22:33:13 +08:00
05d94e5a4c [typo](docs) add a create table as select sample (#21078) 2023-06-26 19:27:05 +08:00
eb2a08bdf2 [typo](docs) Update the audit document (#21185) 2023-06-26 19:25:10 +08:00
65d81c04e6 [Docs](inverted index) update docs for build index (#21184) 2023-06-26 19:24:44 +08:00
839ad8786a [typo](docs) improvement SQL manual ddl drop doc (#21188) 2023-06-26 18:51:28 +08:00
986f3b2176 [typo](docs) improvement SQL manual ddl alter doc (#21179) 2023-06-26 18:17:01 +08:00
5ebac73a93 [typo](docs) improvement SQL manual ddl create doc (#21181) 2023-06-26 18:16:50 +08:00
1138ed1d70 [doc](catalog) update and improve doc of multi catalog (#21105)
Update the document of multi catalog feature.
2023-06-26 11:36:44 +08:00
880252984b [typo](docs) fix jdbc catalog doc example err (#21152) 2023-06-26 10:14:17 +08:00