Commit Graph

1835 Commits

Author SHA1 Message Date
bb334de00f [enhancement](load) Change transaction limit from global level to db level (#15830)
Add transaction size quota for database

Co-authored-by: wuhangze <wuhangze@jd.com>
2023-02-08 18:04:26 +08:00
2883f67042 [fix](iceberg) update iceberg docs and add credential properties (#16429)
Update iceberg docs
Add new s3 credential and properties
2023-02-08 13:53:01 +08:00
2fd7833a12 [fix](doc): fix typo of tpch.md (#16229) 2023-02-08 12:01:21 +08:00
713c11b42b [typo](docs) Fix some errors in the description (#16452) 2023-02-08 11:47:39 +08:00
2350ef1a64 Modify thrift_rpc_timeout_ms default value documentation (#16464) 2023-02-08 11:35:38 +08:00
afdaf2d70e [Doc](Jdbc Catlog) JDBC Catalog support Insert operation (#16454) 2023-02-08 10:59:20 +08:00
0744aeb201 [fix](docs) fix the 404 bad link of website doc (#16284) 2023-02-06 18:56:07 +08:00
d10d6ec906 Add a version label to the jdbc multi-catalog (#16423) 2023-02-06 09:49:12 +08:00
d2044c2dc5 [typo](docs) fix docs,chinese characters error (#16387) 2023-02-05 15:47:09 +08:00
b1b2697cc7 [fix](iceberg) fix iceberg catalog (#16372)
1. Fix iceberg catalog access s3
2. Fix iceberg catalog partition table query
3. Fix persistence
2023-02-05 13:15:28 +08:00
09870098af [fix](func) fix core dump when the pattern of the regexp_extract_all function does not contain subpatterns (#16408) 2023-02-05 01:16:54 +08:00
1deefd7f72 [typo](docs)Remove doris manager doc (#16278)
* [typo](docs)remove doris manager docs

* fix
2023-02-04 22:54:53 +08:00
60386a46a6 fix ADMIN-CHECK-TABLET typo (#16389) 2023-02-04 18:44:08 +08:00
712fa8c538 [typo](docs) Fixed some display errors caused by MD syntax errors (#16395) 2023-02-04 18:12:05 +08:00
f443ebfd9a [Improvement](statistics) optimise histogram keyword (#16369) 2023-02-03 23:02:41 +08:00
b621d1d68a [docs](docs) update en docs (#16257) 2023-02-03 22:01:43 +08:00
Pxl
5e4bb98900 [Chore](build) enable -Wpedantic and update lowest gcc version to 11.1 (#16290)
enable -Wpedantic and update lowest gcc version to 11.1
2023-02-03 11:28:48 +08:00
cb6875b5a4 [improvement](multi-catalog) use date/datetimev2 as default col type for catalog table (#16304)
1. When mapping column from external datasource, use date/datetimev2 as default type
2. check `is_cancelled` when read data, to avoid endless loop after query is cancelled
2023-02-02 17:35:48 +08:00
a69c0f28ca [typo](doc) revise zh-CN document markdown format in ALTER-SYSTEM-DECOMMISSION-BACKEND (#16221) 2023-02-02 15:42:27 +08:00
42960ffd08 [typo](docs)fix docs format (#16279) 2023-02-02 14:13:17 +08:00
c4e1c5c15a [Docs](pipeline) Add doc of pipeline execution engine and remove vectorized-execution-engine (#16310)
Add doc of pipeline execution engine and remove vectorized-execution-engine
2023-02-01 23:57:18 +08:00
b878a7e61e [feature](Load)Suppot skip specific lines number for csv stream load (#16055)
Support set skip line number for stream load to load csv file.

Usage `-H skip_lines:number`:
```
curl --location-trusted -u root: -T test.csv -H skip_lines:5  -XPUT http://127.0.0.1:8030/api/testDb/testTbl/_stream_load
```

Skip line number also can be used in mysql load as below:
```sql
LOAD DATA
LOCAL
INFILE '${mysql_load_skip_lines}'
INTO TABLE ${tableName}
COLUMNS TERMINATED BY ','
IGNORE 2 LINES
PROPERTIES ("auth" = "root:");
```
2023-02-01 20:42:43 +08:00
d224624bbe [improvement](session variable)Add enable_file_cache session variable (#16268)
Add enable_file_cache session variable, so that we can close file cache without restart BE.
2023-02-01 18:15:03 +08:00
cd457312e4 [Enhancement](grouping) Add a switch for users to force using alias name in group by and having clause (#15748) 2023-01-31 23:46:31 +08:00
6470ae58ea [enhancement](config) remove config load_process_max_memory_limit_bytes (#15686) 2023-01-31 21:36:34 +08:00
cb43010d60 [docs](kms) Add faq doc for accessing kms hdfs jce invalid key size issue. (#16264) 2023-01-31 11:30:58 +08:00
8b2aa9f3a2 fix date_sub function doc (#16250) 2023-01-30 21:53:45 +08:00
53e50d2b05 [typo](doc): fix SELECT.md (#16245) 2023-01-30 19:39:30 +08:00
7c3c5576b9 [Fix](doc) fix hive catalog docs with kerberos enabled. (#16236)
* [Fix](doc) fix hive catalog docs with kerberos enabled.

* [Fix](doc) fix hive catalog docs with kerberos enabled.

---------

Co-authored-by: wangxiangyu@360shuke.com <wangxiangyu@360shuke.com>
2023-01-30 16:44:27 +08:00
f87f80a9ef [typo](doc) fix spelling mistaks word uninstall (#16219) 2023-01-30 12:32:53 +08:00
ec4a56922f [enhancement](memory) reduce memory usage for failed broker loads (#15895)
* [enhancement](memory) reduce memory usage for failed  broker loads
2023-01-30 10:22:31 +08:00
9894d239b7 [typo](doc)Add an example of how to assign a value to a field of Date type (#16199)
* 添加Date类型字段赋值示例,Date类型字段需要使用Epoch Day

* Update flink-doris-connector.md
2023-01-30 08:22:52 +08:00
c9f66250a8 [docker](iceberg) add iceberg docker compose and modify scripts (#16175)
Add iceberg docker compose
Rename start-thirdparties-docker.sh to run-thirdparties-docker.sh and support start to stop specified components.
2023-01-29 14:31:27 +08:00
46ce66cbd8 [docs](multi-catalog)update en docs (#16160) 2023-01-29 00:36:31 +08:00
aa87e31b6f [doc](cold hot separation)cold hot separation document adjustment (#15811) 2023-01-24 23:24:28 +08:00
253445ca46 [vectorzied](jdbc) fix jdbc executor for get result by batch and memo… (#15843)
result set should be get by batch size2.
fix memory leak3.
2023-01-21 08:22:22 +08:00
d318d644ff [docs](en) update en docs (#16124) 2023-01-20 23:05:39 +08:00
956070e17f fix english number of tpch (#16116) 2023-01-20 17:27:10 +08:00
13d93cb2b4 [typo](doc)nvl add 1.2 label (#15856) 2023-01-20 15:11:58 +08:00
1638936e3f [fix](oracle catalog) oracle catalog support TIMESTAMP dateType of oracle (#16113)
`TIMESTAMP` dateType of Oracle will map to `DateTime` dateType of Doris
2023-01-20 14:47:58 +08:00
116e17428b [Enhancement](point query optimize) improve performace of point query on primary keys (#15491)
1. support row format using codec of jsonb
2. short path optimize for point query
3. support prepared statement for point query
4. support mysql binary format
2023-01-20 13:33:01 +08:00
ba71516eba [feature](jdbc catalog) support SQLServer jdbc catalog (#16093) 2023-01-20 12:37:38 +08:00
6c5470b163 [typo](docs) fix error path in ssb/tpch docs (#16108)
* fix docs error path

* commit suggestionns
2023-01-20 11:07:12 +08:00
5b2191a496 [fix](multi-catalog)Make ES catalog and resource compatible (#16096)
close #16099 

1. Make ES resource compatible with `username` property. Keep the same behavior with ES catalog.
2. Change ES catalog `username` to `user` to avoid confusion.
3. Add log in ESRestClient and make debug easier.
2023-01-20 09:31:57 +08:00
43dade0f68 [fix](doc): fix some spelling mistaks (#16097) 2023-01-19 23:31:45 +08:00
6cff651f71 [enhancement](statistics) add some methods to use histogram statistics (#15755)
1. Fix the histogram document
2. Add some methods for histogram statistics

TODO:
1. use histogram statistics for the optimizer
2023-01-19 19:20:18 +08:00
f9406234c6 [ComputeNode](Doc)Add document for compute node (#15743)
Issue Number: close #13144
2023-01-19 15:16:14 +08:00
b9f1e4a17f [typo](doc)update jfs docs (#16090) 2023-01-19 15:10:49 +08:00
c7a72436e6 [Feature](multi-catalog)Add support for JuiceFS (#15969)
The broker implements the interface to juicefs,It supports loading data from juicefs to doris through broker.
At the same time, it also implements the multi catalog to read the hive data stored in juicefs
2023-01-19 08:54:16 +08:00
a7d572ec7f typo(docs):correct the default value of the be parameter brpc_num_threads in the document (#16041)
Co-authored-by: tongyang.hty <hantongyang@douyu.tv>
2023-01-18 13:50:58 +08:00