Commit Graph

2556 Commits

Author SHA1 Message Date
445bebb4cb [docs](docs)Rename Titles & URL and Add Histogram Files of Aggregate Functions (#22720) 2023-08-09 13:13:07 +08:00
512af9b2ff [docs](docs)Rename Title and URL of Struct Functions (#22712) 2023-08-09 13:12:48 +08:00
7164dd09e6 [docs](docs) Rename Title and URL of String Functions (#22711) 2023-08-09 13:12:26 +08:00
d7ea27a5c7 [docs](docs) Rename Title and URL of GIS Functions (#22704) 2023-08-09 13:12:10 +08:00
a778027569 [typo](docs)Modified description of JSON /String size (#21694) 2023-08-09 10:00:25 +08:00
8ef38637ae [docs](docs) Rename Title and URL of Date Functions (#22686) 2023-08-08 14:44:05 +08:00
0c972288ef [docs](docs)Rename Title and URL of Array Functions for SEO (#22669) 2023-08-08 14:32:05 +08:00
1d2046de64 [docs](docs)Rename Title of zh-CN Docs (#22662) 2023-08-08 14:31:28 +08:00
66784cef71 [Enhancement](Load) Stream Load using SQL (#22509)
This PR was originally #16940 , but it has not been updated for a long time due to the original author @Cai-Yao . At present, we will merge some of the code into the master first.

thanks @Cai-Yao @yiguolei
2023-08-08 13:49:04 +08:00
d1a2473944 [Feature](broker)Support GCS (#20904) 2023-08-07 19:37:18 +08:00
77e772e103 [enhancement](config) add some pre-process and pre-check for BE storage config attentions in docs (#22486) 2023-08-07 18:16:57 +08:00
1a8a1e5b16 [Feature](count_by_enum) support count_by_enum function (#22071)
count_by_enum(expr1, expr2, ... , exprN);

Treats the data in a column as an enumeration and counts the number of values in each enumeration. Returns the number of enumerated values for each column, and the number of non-null values versus the number of null values.
2023-08-06 16:05:14 +08:00
d628baba0a [improvement](hdfs) support hedged read (#22634)
In some cases, the high load of HDFS may lead to a long time to read the data on HDFS,
thereby slowing down the overall query efficiency. HDFS Client provides Hedged Read.
This function can start another read thread to read the same data when a read request
exceeds a certain threshold and is not returned, and whichever is returned first will use the result.

eg:

create catalog regression properties (
    'type'='hms',
    'hive.metastore.uris' = 'thrift://172.21.16.47:7004',
    'dfs.client.hedged.read.threadpool.size' = '128',
    'dfs.client.hedged.read.threshold.millis' = "500"
);
2023-08-06 14:51:48 +08:00
96f42ca20a [fix](memory) Independent count exec node memory profile (#22598)
Independent count exec node memory profile, after #22582
2023-08-06 10:56:31 +08:00
1073a924c1 [fix](doc) Update upgrade.md file add mysql_ssl_default_certificate folder info #22623 2023-08-06 10:55:46 +08:00
20fbc6dcf4 [typo](doc) Modify auto pull up document #21662 2023-08-06 10:47:40 +08:00
60b802eafa [typo](docs) update document syntax and add links to referenced articles (#21817) 2023-08-06 10:41:08 +08:00
fe6bae2924 [fix](invert index) supports utf8 and non-utf8 strings (#22570)
supports utf8 and non-utf8 strings: [fix] compatible with utf8 and invalid utf8 doris-thirdparty#110
2023-08-05 12:52:53 +08:00
fcdd1b96d2 [docs](delete-recover) merge docs: recover catalog and recover tablet trash #22525
Doris trash include FE catalog recycle bin and BE tablet trash. Users sometimes may be confused abount them. Put them together to let them better understand.
2023-08-05 10:31:48 +08:00
ea674aa540 [docs](community) Delete Gitter Mannual of EN & CN Verison (#22348) 2023-08-04 19:45:31 +08:00
846d6edab8 [docs](docs) Rename Advanced Usage Files for SEO (#22511) 2023-08-04 19:33:57 +08:00
d040a858f2 [docs](docs) Capitalize Query Acceleration Files Name and Title (#22512) 2023-08-04 19:33:31 +08:00
30b8c7b9e6 [docs](docs) Rename Lakehouse Files for SEO (#22513) 2023-08-04 19:33:02 +08:00
577cd51fde [docs](docs) Capitalize Ecosystem Files Name and Titles (#22515) 2023-08-04 19:32:39 +08:00
89fff98ced [docs](docs)Update spark_load.md (#22428) 2023-08-04 19:22:52 +08:00
872280135d [exec](pipeline) revert FE pipeline instance num pr (#22617)
* Revert "[fix](executor) only mysql connect to set GlobalPipelineTask (#22205)"
* Revert "[feature](executor) using fe version to set instance_num (#22047)"
2023-08-04 19:07:14 +08:00
d974af5feb [Fix](Load)Multi table plan not include task info (#22613) 2023-08-04 18:52:22 +08:00
95aa4d8631 [Feature](Export) Supports concurrently export of table data (#21911) 2023-08-04 18:50:17 +08:00
93593a013d [feature](load) add segment bytes limit in segcompaction (#22526) 2023-08-04 18:00:52 +08:00
9cf6b1b4cf [docs](typo) fix some typo of docs (#22591) 2023-08-04 16:29:04 +08:00
b9e344617a [typo](kerberos)support read jdk auth creds and add some krb tips in FAQ (#22535)
support read jdk auth creds and add some krb tips in FAQ
1. about the 'javax.security.auth.useSubjectCredsOnly': https://stackoverflow.com/questions/43660265/java-automatically-uses-kerberos-ticketcache-when-it-shouldnt
2. add tips for `No common protection layer between client and server` and yum jdk version.
2023-08-04 14:51:31 +08:00
4f9969ce1e [feature](show-frontends-disk) Add Show frontend disks (#22040)
Co-authored-by: yuxianbing <yuxianbing@yy.com>
Co-authored-by: yuxianbing <iloveqaz123>
2023-08-03 14:04:48 +08:00
e670d84b72 [feature](executor) using max_instance_num to limit automatically instance (#22521) 2023-08-03 13:12:32 +08:00
17f4776b0f [typo](docs) fix get start zh doc (#22524) 2023-08-02 23:32:07 +08:00
5aeea985e6 [typo](docs) Replace invalid mysql-connector-java download package. (#21954) 2023-08-02 22:58:08 +08:00
876bd1c747 [typo](Docs) Capitalize the Title of Files in Data Operation - Import Category (#22456) 2023-08-02 22:17:15 +08:00
bbbefc4b6f [typo](docs) Capitalize and Rename Title of Files in Data Operation-Export (#22457) 2023-08-02 21:56:38 +08:00
d5bf00583f [typo](docs) Capitalize and Rename Table Design Files (#22453) 2023-08-02 21:51:58 +08:00
76108bac2f [typo](docs) Capitalize and Rename Title of Install and Deployment Files (#22451) 2023-08-02 21:51:36 +08:00
a7a5e14d52 [typo](docs) Merge Doris Introductions File into Getting Started Category (#22449) 2023-08-02 21:50:55 +08:00
ec4fc1f9ef [typo](doc) fix be java env faq (#22462) 2023-08-02 21:50:33 +08:00
57e0fa448c [typo](docs) Change the jdk version on the macOS to 11 (#22522) 2023-08-02 21:47:14 +08:00
6f575cf4b3 [typo](doc)Add a description of whether one of the dynamic partitioning parameters must be required. (#22422) 2023-08-02 21:28:18 +08:00
2ff4e9d79d [typo](doc)modify some sql syntax description errors (#22420) 2023-08-02 21:28:02 +08:00
498c0124e8 [typo](doc)modify some sql syntax and example description errors (#22460) 2023-08-02 21:27:34 +08:00
4d9f4c7a68 [typo(docs) Capitalize Title of Files in Data Operation - Update and Delete(#22459) 2023-08-02 19:16:11 +08:00
19d1f49fbe [improvement](compaction) compaction policy and options in the properties of a table (#22461) 2023-08-01 22:02:23 +08:00
94dee833cd [fix](multi-catalog)fix compatible with hdfs HA empty prefix (#22424) 2023-08-01 21:48:16 +08:00
ff0fda460c [be](parameter) change default fragment_pool_thread_num_max from 512 to 2048 (#22448)
change some parameter's default value:
brpc_num_threads from -1 to 256
compaction_task_num_per_disk from 2 to 4
compaction_task_num_per_fast_disk from 4 to 8
fragment_pool_thread_num_max from 512 to 2048
fragment_pool_queue_size from 2048 to 4096

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2023-08-01 20:33:41 +08:00
58c62431d1 [typo](doc) illustrate storage policy is not supported on merge-on-write table (#22194) 2023-08-01 15:57:51 +08:00