Commit Graph

1432 Commits

Author SHA1 Message Date
b0b876f640 [typo](docs) vectorization needs to be turned off to use native udf #12739 2022-09-21 09:13:48 +08:00
43d6be8c4d [docs](function) add a series of date function documents (#12713)
* [docs](function) add a series of date function documents
add docs for `hours_add`, `hours_sub`, `minutes_add`, `minutes_sub`,
`seconds_add`, `seconds_sub`, `years_sub`, `years_add`, `months_add`,
`months_sub`, `days_add`, `days_add`, `weeks_add`, `weeks_sub` functions.
2022-09-19 21:42:35 +08:00
a5d11dce3b [typo](docs) Add docs of math function (#12532)
* docs of math function
2022-09-19 21:41:59 +08:00
3bb042e45c [fix](memtracker) Process physical mem check does not include tc/jemalloc allocator cache (#12688)
tcmalloc/jemalloc allocator cache does not participate in the mem check as part of the process physical memory.

because new/malloc will trigger mem hook when using tcmalloc/jemalloc allocator cache, but it may not actually alloc physical memory, which is not expected in mem hook fail.

in addition:

The value of tcmalloc/jemalloc allocator cache is used as a mem tracker, the parent is the process mem tracker, which is updated every 1s.
Modify the process default mem_limit to 90%. expect mem tracker to effectively limit the memory usage of the process.
2022-09-17 11:31:01 +08:00
42b6532131 remove gc and fix print (#12682) 2022-09-17 00:16:15 +08:00
a3fee5afbb [doc](variables) fix forward_to_master doc bug #12659
Co-authored-by: wudi <>
2022-09-16 20:56:55 +08:00
97ff14482f [enhancement](doc) When we use flink doris connector with bounded source, we should using the BATCH mode. (#12576) 2022-09-16 10:31:17 +08:00
22a8d35999 [Feature](vectorized) support jdbc sink for insert into data to table (#12534) 2022-09-15 11:08:41 +08:00
353bb6fdfb [doc] update docs (#12615) 2022-09-15 11:07:34 +08:00
08ee84ef67 [typo](docs)fix tablet-local-debug doc err #12572 2022-09-14 14:26:56 +08:00
6bf5fc6db5 [improvement](storage) For debugging problems: add session variable skip_storage_engine_merge to treat agg and unique data model as dup model (#11952)
For debug purpose:
Add session variable skip_storage_engine_merge, when set to true, tables of aggregate key model and unique key model will be read as duplicate key model.
Add session variable skip_delete_predicate, when set to true, rows deleted with delete statement will be selected.
2022-09-13 19:18:56 +08:00
550b1e531b [fix](doc) add the key columes description of the table model document (#12500)
add the key columes description of the table model document
2022-09-13 11:27:05 +08:00
e33f4f90ae [fix](exec) Avoid query thread block on wait_for_start (#12411)
When FE send cancel rpc to BE, it does not notify the wait_for_start() thread, so that the fragment will be blocked and occupy the execution thread.
Add a max wait time for wait_for_start() thread. So that it will not block forever.
2022-09-13 08:57:37 +08:00
c8e9a32bb2 [Function](cbrt)Add cbrt function for doris (#12523)
Add cbrt function for doris
2022-09-12 19:58:45 +08:00
ecfefae715 [enhancement](load) make default load mem limit configurable (#12348)
* make LoadMemLimit valid for broker load, stream load and routine load

Co-authored-by: wuhangze <wuhangze@jd.com>
2022-09-12 10:25:01 +08:00
9b73b45d05 [Doc](Streamload) update streamload default timeout #12499
Co-authored-by: wudi <>
2022-09-12 10:23:18 +08:00
3cc06820c4 [doc](performance) performance doc and script update (#12493) 2022-09-09 09:09:49 +08:00
2aad293d8a delete_doc_upd (#12473)
delete_doc_update
2022-09-09 09:08:12 +08:00
0ea7c4b37b [docs](quick-compaction) update quick-compaction docs (#12417) 2022-09-08 15:00:59 +08:00
6cd06f7586 [typo](docs) INSERT documentation fix (#12455)
INSERT documentation fix
2022-09-08 13:09:08 +08:00
c2808de867 [Doc](balance)add replica balance speed param (#12406)
* update balance param
2022-09-07 19:41:45 +08:00
09b45f2b71 [Function](ELT)Add elt function (#12321) 2022-09-07 15:21:08 +08:00
42bdde8750 [Feature](Vectorized) support jdbc scan node (#12010) 2022-09-07 10:29:41 +08:00
c975d71fd4 [typo](docs)Sql blacklist documentation fix (#12376)
Sql blacklist documentationfix
2022-09-06 19:34:05 +08:00
b398fd60fc [DOCS](function) Add docs for new time functions (#12382)
Add docs for new time functions
2022-09-06 19:33:41 +08:00
7c2da89518 [docs](spark-load) set hadoop env (#12342)
(spark-load) set hadoop env
2022-09-06 16:41:38 +08:00
53b79d5a8c [Enhancement](restore) new add the property of reserve_replica to restore statement (#11942)
Add a new property called 'reserve_replica', which means you can
get a table with same partitions with the same replication num
as before the backup.

Co-authored-by: Stalary <stalary@163.com>
Co-authored-by: camby <104178625@qq.com>
2022-09-06 10:32:21 +08:00
f2aa87d797 Add ctas support config key type ut and doc. (#12327) 2022-09-06 09:16:02 +08:00
0deee72a63 About the modification of broker load specifying hdfs user name parameter (#12330)
About the modification of broker load specifying hdfs user name parameter
2022-09-05 19:34:26 +08:00
e5f3f0e730 [typo](docs) mix of SSD and HDD disks should specify the storage directory only (#12309)
add notice of storage
2022-09-05 09:23:34 +08:00
74b6eaf44b [typo](docs)Replace table link fix (#12317) 2022-09-05 08:29:41 +08:00
3a30e12ffb update data-model, add error_code into DUPLICATE KEY (#12131) 2022-09-03 14:23:29 +08:00
b154a1b45e [doc] fix some docs issue (#11101)
* fix some docs issue

* add -y for apt-get

Co-authored-by: chaow <941210239@qq.com>
2022-09-02 21:06:12 +08:00
1fd3490c56 remove duplicate "comments" (#12264) 2022-09-02 18:57:10 +08:00
64302ff4c9 [typo](docs)Sidebar fix (#12297)
* sidebar fix
2022-09-02 15:09:26 +08:00
7a4173b497 [typo](docs)Fix admin copy table format (#12288)
Fix admin copy table format
2022-09-02 14:08:56 +08:00
3ce6bb548d doc_stream_load_format (#12144)
doc_stream_load_format
2022-09-02 09:22:10 +08:00
10c3e683dd [docs]update users numbers (#12248)
update users numbers
2022-09-02 09:21:36 +08:00
1c91257c01 📝 fix create table doc typo (#12269)
fix create table doc typo
2022-09-02 09:20:46 +08:00
061b49b7bf [doc](website) update SHOW-PROC doc (#12229) 2022-09-01 19:50:25 +08:00
58c1d6ce9d [typo](docs)Modify the maximum handle parameter reference #12244 2022-09-01 19:50:07 +08:00
1a198b3777 [typo](docs) Fix Bitmap index and Type QUANTILE_STATE: fix description (#12217)
Fix Bitmap index and Type QUANTILE_STATE: fix description
2022-08-31 18:10:17 +08:00
c2f7e95c7f [typo](docs)Add somm json format load doc (#12213)
* Specify JSON root document when adding JSON import, and add JSON file size limit parameter prompt
2022-08-31 14:34:55 +08:00
254cb321b9 [optimize](remote) Optimize cache reader use a pre-created buffer when downloading the cache (#12165)
* optimize cache reader

* add description for config

* optimize cache reader

* optimize cache reader
2022-08-31 10:15:40 +08:00
22430cd7bb [feature](stmt) add ADMIN COPY TABLET stmt for local debug (#12176)
Add a new stmt ADMIN COPY TABLET for easy copy a tablet to local env to reproduce problem.
See document for more details.
2022-08-31 09:06:49 +08:00
dda446f490 fix typos in get-starting.md (both en and zh-CN) (#12189) 2022-08-30 20:52:24 +08:00
fc400a15db [fix] (docs) Fix Data type: string length and parameter description (#11565) 2022-08-30 19:16:00 +08:00
9c7016f6e7 [docs](query plan) Add a description explain graph and desc graph and explain verbose (#11697)
* docs: 增加explain graph与desc graph描述,避免文档前后描述不一致

* docs: add the usage docs of `explain verbose`
2022-08-30 19:12:23 +08:00
eea756fd5b [docs](hive)add hadoop.username config item (#12109)
add hadoop.username config item
2022-08-30 12:34:27 +08:00
7f295fc2fb [typo](doc)Modify data operation documentation (#12137)
fix data operate doc
2022-08-30 12:34:01 +08:00