aa850fc9c3
[doc](hive) add faq for multi delimiter config ( #24179 )
...
when a user sets `serde` as `org.apache.hadoop.hive.contrib.serde2.MultiDelimitserDe`, we should add a configuration in hive-site.xml
2023-09-12 10:34:23 +08:00
0c30fff811
add add navigator for vector distance functions ( #24081 )
2023-09-11 19:55:36 +08:00
6e28d878b5
[fix](hudi) compatible with hudi spark configuration and support skip merge ( #24067 )
...
Fix three bugs:
1. Hudi slice maybe has log files only, so `new Path(filePath)` will throw errors.
2. Hive column names are lowercase only, so match column names in ignore-case-mode.
3. Compatible with [Spark Datasource Configs](https://hudi.apache.org/docs/configurations/#Read-Options ), so users can add `hoodie.datasource.merge.type=skip_merge` in catalog properties to skip merge logs files.
2023-09-11 19:54:59 +08:00
229ee50c93
[Docs](StreamLoad)Add partial columns docs ( #24184 )
2023-09-11 17:16:29 +08:00
8ae7e67623
[Docs](Ldap)Add Jdbc connect docs ( #24181 )
2023-09-11 15:53:37 +08:00
7abd88f1b4
remove editlogport in frontrnds disks ( #24047 )
2023-09-11 12:38:56 +08:00
cd13f9e8c6
[BUG](view) fix can't create view with lambda function ( #23942 )
...
before the lambda function Expr not implement toSqlImpl() function.
so it's call parent function, which is not suit for lambda function.
and will be have error when create view.
2023-09-11 10:04:00 +08:00
a27349c83a
[fix](Export) Concatenation the outfile sql for Export ( #23635 )
...
In the original logic, the `Export` statement generates `Selectstmt` for execution. But there is no way to make the `SelectStmt` use the new optimizer.
Now, we change the `Export` statement to generate the `outfile SQL`, and then use the new optimizer to parse the SQL so that outfile can use the new optimizer.
2023-09-08 10:20:18 +08:00
20b3e5eafe
[feature](Datetime) add from_microsecond / from_millisecond function ( #23902 )
2023-09-07 19:03:49 +08:00
7adab1138c
[improvement](index) support CANCEL BUILD INDEX ( #23760 )
...
Currently, BUILD INDEX can not be canceled.
This pr add CANCEL BUILD INDEX as follows:
`CANCEL BUILD INDEX index_name ON table_name [(jobid1,jobid2)]`
2023-09-07 14:48:13 +08:00
45dfbeb8b3
[feature](agg) add the aggregation function 'array_agg' #23474
...
This function requires one arguments just as ARRAY_AGG(col) and col means the column whose values you want to aggregate.
This function Aggregates the values including NULL in a column into an array and returns a value of the ARRAY data type.
2023-09-07 10:21:55 +08:00
a96adc01aa
[Chore](function) refactor of quantile_state ( #23862 )
...
refactor of quantile_state
2023-09-06 15:39:19 +08:00
728ee90462
[improvement](deploy) Forbid LocalDeployManager drop node ( #23875 )
...
Forbid LocalDeployManager drop nodes to prevent errors in the cluster.info file from causing nodes to be dropped.
2023-09-06 08:58:25 +08:00
44bb94d5e7
[fe](default parameters) change remote_fragment_exec_timeout_ms from 5s to 30s ( #23909 )
2023-09-06 00:16:23 +08:00
672a6ad3dd
[typo](docs) Add some explanations about AUTO_INCREMENT columns ( #23899 )
2023-09-05 14:31:50 +08:00
e090b83e33
[improvemnt](script) support custom lib dir to save custom libs ( #23887 )
...
Sometimes, user need to add some custom libs to the cluster, such lzo.jar, orai18n.jar, etc.
In previous, these lib files are places in fe/lib or be/lib.
But when upgrading cluster, the lib dir will be replaced by new lib dir, so that all custom libs are lost.
In this PR, I add new dir custom_lib for FE and BE, and user can place custom lib files in it.
2023-09-05 11:54:19 +08:00
3f2f2a7218
[typo](docs) remove redundant column data from the insert statement ( #23880 )
2023-09-05 11:52:18 +08:00
1d1a9e2bfc
[improvement](graceful shutdown) waiting for all query finished when graceful shutdown ( #23865 )
...
In some cloud native deployment scenario, BE(especially the Compute Node BE) will be add to cluster and remove from cluster very frequently. User's query will fail if there is a fragment is running on the shutting down BE. Users could use stop_be.sh --grace, then BE will wait all running queries to stop to avoiding running query failure, but if the waiting time exceed the limit, then be will exit directly. During this period, FE will not send any queries to BE and waiting for all running queries to stop
2023-09-05 09:52:28 +08:00
c9b4749276
[fix](RemoteUDF) fix string type do not set PGenericType #23832
2023-09-05 09:23:20 +08:00
d694f4a946
[doc](bitmap) add docs from bitmap_to_base64 and bitmap_from_base64 ( #23805 )
2023-09-04 17:57:24 +08:00
a1915d13c0
[docs] Correct spelling of words ( #23652 )
...
Co-authored-by: 苗宏凯 <9499318+miaohongkai@user.noreply.gitee.com >
2023-09-04 11:55:48 +08:00
0f2bbf5b81
[doc](datetime) description of datetime in DATETIME.md ( #23683 )
2023-09-04 11:54:16 +08:00
3e00d62780
[docs](releasenote) 2.0.1&1.2.7 release note ( #23807 )
2023-09-04 11:29:03 +08:00
8c213f8498
[typo][doc]modify some error decriptions. ( #22491 )
2023-09-03 15:20:04 +08:00
89eacd4751
[enhancement](load) support dry_run_query for load ( #23680 )
...
If dry_run_query is set, a sink just discards blocks and do
not send them to destination.
2023-09-03 15:08:10 +08:00
24a5cca145
[typo](docs) add comment of audit plugin ( #22834 )
...
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com >
2023-09-03 14:48:26 +08:00
2457fbd3e0
[typo][doc]modify error description in OUTFILE. ( #22715 )
...
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com >
2023-09-03 14:46:04 +08:00
e4ee931281
[fix](doc)description of unique ( #21664 )
2023-09-03 10:57:17 +08:00
b31acee856
[typo](docs) Changes to expressions in workload group ( #23609 )
2023-09-03 09:13:12 +08:00
ed93b8ac77
[typo][doc]modify tablet_repair_and_balance incorrect parameter descriptions. ( #22532 )
2023-09-03 09:08:06 +08:00
2b194864a4
[typo](docs)Resolved compilation errors caused by using a higher version of Node.js. ( #22797 )
...
Fixed errors caused by using a higher version of Node.js.
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com >
2023-09-03 09:07:45 +08:00
c7348105e3
[typo](docs)Correct the odbc markdown comments ( #22477 )
2023-09-03 09:07:04 +08:00
ef1ff19e70
[docs] Add BE debug build instruction to docs ( #21964 )
2023-09-02 23:22:37 +08:00
81b51e1440
[typo][doc]Modify the error description in the broker-load-manual. ( #22772 )
2023-09-02 23:20:20 +08:00
0318da1df3
[fix](doc) Modify README.md
Change ‘kafka_default_offset’ to ‘kafka_default_offsets’. ( #23791 )
2023-09-02 23:17:56 +08:00
3619cd9d68
[faq](doc) add some FAQ for flink-doris-connector ( #21829 )
2023-09-02 21:56:59 +08:00
91c69f10da
[typo](docs) fix docs characters error ( #22294 )
2023-09-02 21:47:00 +08:00
a1400677b6
[typo](docs) modify standard-deployment doc ( #23473 )
2023-09-02 21:24:55 +08:00
e9104765ea
[fix](doc) modify the document error,about outfile ( #22475 )
2023-09-02 21:14:59 +08:00
bf1b281388
[typo][doc] delete redundant '/' in flink-doris-connector. ( #23185 )
2023-09-02 21:01:37 +08:00
a86aa7161f
[enhancement](doc) Lack of detailed parameter documentation ( #23247 )
2023-09-02 20:54:23 +08:00
45414db1ba
[enhancement](table-meta) flush column unique ids for tables before 1.2 automatically ( #23616 )
2023-09-02 14:56:48 +08:00
a6dff2faf0
[Feature](config) allow update multiple be configs in one request ( #23702 )
2023-09-02 14:26:54 +08:00
228f0ac5bb
[Feature](Multi-Catalog) support query doris bitmap column in external jdbc catalog ( #23021 )
2023-09-02 12:46:33 +08:00
18d470ecf7
[improvement](config) add a specific be config for segment_cache_capacity ( #23701 )
...
* add segment_cache_capacity config istead of fd limit * 2/5
* default -1 for backward compatibility
2023-09-02 01:14:14 +08:00
ba863a992e
[doc](alter table) add notes for modify column ( #23720 )
2023-09-01 19:32:44 +08:00
0d50c11d5c
[Doc](AuditLoader) improvement auditLoader doc ( #23758 )
2023-09-01 18:48:39 +08:00
e88c218390
[Improve](Job)Job internal interface provides immediate scheduling ( #23735 )
...
Delete meaningless job status
System scheduling is executed in the time wheel
Optimize window calculation code
2023-09-01 12:50:08 +08:00
d96bc2de1a
[enhance](policy) Support to change table's storage policy if the two policy has same resource ( #23665 )
2023-09-01 11:25:27 +08:00
b16ab0bff7
[Docs] (maint-monitor) when config automatic-service-start, we need config JAVA_HOME in the fe.conf and be.conf firstly ( #23610 )
2023-09-01 08:01:12 +08:00
