Commit Graph

2664 Commits

Author SHA1 Message Date
1d1a9e2bfc [improvement](graceful shutdown) waiting for all query finished when graceful shutdown (#23865)
In some cloud native deployment scenario, BE(especially the Compute Node BE) will be add to cluster and remove from cluster very frequently. User's query will fail if there is a fragment is running on the shutting down BE. Users could use stop_be.sh --grace, then BE will wait all running queries to stop to avoiding running query failure, but if the waiting time exceed the limit, then be will exit directly. During this period, FE will not send any queries to BE and waiting for all running queries to stop
2023-09-05 09:52:28 +08:00
c9b4749276 [fix](RemoteUDF) fix string type do not set PGenericType #23832 2023-09-05 09:23:20 +08:00
d694f4a946 [doc](bitmap) add docs from bitmap_to_base64 and bitmap_from_base64 (#23805) 2023-09-04 17:57:24 +08:00
a1915d13c0 [docs] Correct spelling of words (#23652)
Co-authored-by: 苗宏凯 <9499318+miaohongkai@user.noreply.gitee.com>
2023-09-04 11:55:48 +08:00
0f2bbf5b81 [doc](datetime) description of datetime in DATETIME.md (#23683) 2023-09-04 11:54:16 +08:00
3e00d62780 [docs](releasenote) 2.0.1&1.2.7 release note (#23807) 2023-09-04 11:29:03 +08:00
8c213f8498 [typo][doc]modify some error decriptions. (#22491) 2023-09-03 15:20:04 +08:00
89eacd4751 [enhancement](load) support dry_run_query for load (#23680)
If dry_run_query is set, a sink just discards blocks and do
not send them to destination.
2023-09-03 15:08:10 +08:00
24a5cca145 [typo](docs) add comment of audit plugin (#22834)
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
2023-09-03 14:48:26 +08:00
2457fbd3e0 [typo][doc]modify error description in OUTFILE. (#22715)
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
2023-09-03 14:46:04 +08:00
e4ee931281 [fix](doc)description of unique (#21664) 2023-09-03 10:57:17 +08:00
b31acee856 [typo](docs) Changes to expressions in workload group (#23609) 2023-09-03 09:13:12 +08:00
ed93b8ac77 [typo][doc]modify tablet_repair_and_balance incorrect parameter descriptions. (#22532) 2023-09-03 09:08:06 +08:00
2b194864a4 [typo](docs)Resolved compilation errors caused by using a higher version of Node.js. (#22797)
Fixed errors caused by using a higher version of Node.js.

Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
2023-09-03 09:07:45 +08:00
c7348105e3 [typo](docs)Correct the odbc markdown comments (#22477) 2023-09-03 09:07:04 +08:00
ef1ff19e70 [docs] Add BE debug build instruction to docs (#21964) 2023-09-02 23:22:37 +08:00
81b51e1440 [typo][doc]Modify the error description in the broker-load-manual. (#22772) 2023-09-02 23:20:20 +08:00
xyf
0318da1df3 [fix](doc) Modify README.md
Change ‘kafka_default_offset’ to ‘kafka_default_offsets’. (#23791) 2023-09-02 23:17:56 +08:00
3619cd9d68 [faq](doc) add some FAQ for flink-doris-connector (#21829) 2023-09-02 21:56:59 +08:00
91c69f10da [typo](docs) fix docs characters error (#22294) 2023-09-02 21:47:00 +08:00
a1400677b6 [typo](docs) modify standard-deployment doc (#23473) 2023-09-02 21:24:55 +08:00
e9104765ea [fix](doc) modify the document error,about outfile (#22475) 2023-09-02 21:14:59 +08:00
bf1b281388 [typo][doc] delete redundant '/' in flink-doris-connector. (#23185) 2023-09-02 21:01:37 +08:00
a86aa7161f [enhancement](doc) Lack of detailed parameter documentation (#23247) 2023-09-02 20:54:23 +08:00
45414db1ba [enhancement](table-meta) flush column unique ids for tables before 1.2 automatically (#23616) 2023-09-02 14:56:48 +08:00
a6dff2faf0 [Feature](config) allow update multiple be configs in one request (#23702) 2023-09-02 14:26:54 +08:00
228f0ac5bb [Feature](Multi-Catalog) support query doris bitmap column in external jdbc catalog (#23021) 2023-09-02 12:46:33 +08:00
18d470ecf7 [improvement](config) add a specific be config for segment_cache_capacity (#23701)
* add segment_cache_capacity config istead of fd limit * 2/5
* default -1 for backward compatibility
2023-09-02 01:14:14 +08:00
ba863a992e [doc](alter table) add notes for modify column (#23720) 2023-09-01 19:32:44 +08:00
0d50c11d5c [Doc](AuditLoader) improvement auditLoader doc (#23758) 2023-09-01 18:48:39 +08:00
e88c218390 [Improve](Job)Job internal interface provides immediate scheduling (#23735)
Delete meaningless job status
System scheduling is executed in the time wheel
Optimize window calculation code
2023-09-01 12:50:08 +08:00
d96bc2de1a [enhance](policy) Support to change table's storage policy if the two policy has same resource (#23665) 2023-09-01 11:25:27 +08:00
b16ab0bff7 [Docs] (maint-monitor) when config automatic-service-start, we need config JAVA_HOME in the fe.conf and be.conf firstly (#23610) 2023-09-01 08:01:12 +08:00
d0e906f329 [Docs](alter partition) Fix the docs of adding default partition (#23705)
according to https://github.com/apache/doris/pull/15509, add a default list partition don't need the keyword `DEFAULT`
2023-09-01 00:20:12 +08:00
6b4d1c2d86 [Doc](flink connector) Add new configuration be nodes (#23698) 2023-09-01 00:16:08 +08:00
b763bfa17d [Doc](tvf)Added tvf support for reading documents from avro files (#23436) 2023-08-31 21:49:27 +08:00
72fef48f87 [Doc](flink-connector)Flink connector adds schema change related parameter documents (#23439) 2023-08-31 21:48:27 +08:00
3a34ec95af [FE](fucntion) add date_floor/ceil in FE function (#23539) 2023-08-31 19:26:47 +08:00
96c4471b4a [feature](udf) udf array/map support decimal and update doc (#23560)
* update

* decimal

* update table name

* remove log

* add log
2023-08-31 07:44:18 +08:00
05771e8a14 [Enhancement](Load) stream Load using SQL (#23362)
Using stream load in SQL mode

for example:
example.csv

10000,北京
10001,天津
curl -v --location-trusted -u root: -H "sql: insert into test.t1(c1, c2) select c1,c2 from stream(\"format\" = \"CSV\", \"column_separator\" = \",\")" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
curl -v --location-trusted -u root: -H "sql: insert into test.t2(c1, c2, c3) select c1,c2, 'aaa' from stream(\"format\" = \"CSV\", \"column_separator\" = \",\")" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
curl -v --location-trusted -u root: -H "sql: insert into test.t3(c1, c2) select c1, count(1) from stream(\"format\" = \"CSV\", \"column_separator\" = \",\") group by c1" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
2023-08-30 19:02:48 +08:00
ca55bd88ad [Fix](Job)Fix the window time is not updated when no job is registered (#23628)
Fix resume job grammar definition is inconsistent
Show Job task Add execution results
JOB allows to define update operations
2023-08-30 09:48:21 +08:00
4c00b1760b [feature](partial update) Support partial update for broker load (#22970) 2023-08-29 14:41:01 +08:00
1fd637eab7 [Docs](Job)Add Job and Job tasks docs (#23576) 2023-08-29 10:06:49 +08:00
b2cb0d99d4 [opt](docs) opt doc to avoid users using port 8030 everywhere (#23379) 2023-08-29 09:47:24 +08:00
bea5701cce [minor](docs) update docs for variable sql_select_limit (#23262) 2023-08-28 14:38:32 +08:00
4c8fc06e40 [Feature](fe) Add admin set partition version statement (#23086)
This commit add a statement to modify partition visible version.
2023-08-28 14:31:54 +08:00
83467e5d9e [docs](website) fix a typo in docs tittle (#23431) 2023-08-28 14:27:45 +08:00
eadffedb33 [Feature](fe) Add admin set table status statement (#23139)
For some certain bugs, jobs is stuck in FE by the table state. For example, There is a bug which causes table remains ROLLUP state after adding rollup job, then other alter jobs later will not succeed because the table state is always ROLLUP but not NORMAL.

This commit adds a statement which is used to set the state of the specified table.
2023-08-28 10:22:09 +08:00
4dbec854e4 [Docs](inverted index) add tokenize function doc (#23518) 2023-08-28 10:19:03 +08:00
2b6d876280 [feature](move-memtable)[6/7] add options to enable memtable on sink node (#23470)
Co-authored-by: Siyang Tang <82279870+TangSiyang2001@users.noreply.github.com>
2023-08-25 22:32:22 +08:00