Commit Graph

2635 Commits

Author SHA1 Message Date
0d50c11d5c [Doc](AuditLoader) improvement auditLoader doc (#23758) 2023-09-01 18:48:39 +08:00
e88c218390 [Improve](Job)Job internal interface provides immediate scheduling (#23735)
Delete meaningless job status
System scheduling is executed in the time wheel
Optimize window calculation code
2023-09-01 12:50:08 +08:00
d96bc2de1a [enhance](policy) Support to change table's storage policy if the two policy has same resource (#23665) 2023-09-01 11:25:27 +08:00
b16ab0bff7 [Docs] (maint-monitor) when config automatic-service-start, we need config JAVA_HOME in the fe.conf and be.conf firstly (#23610) 2023-09-01 08:01:12 +08:00
d0e906f329 [Docs](alter partition) Fix the docs of adding default partition (#23705)
according to https://github.com/apache/doris/pull/15509, add a default list partition don't need the keyword `DEFAULT`
2023-09-01 00:20:12 +08:00
6b4d1c2d86 [Doc](flink connector) Add new configuration be nodes (#23698) 2023-09-01 00:16:08 +08:00
b763bfa17d [Doc](tvf)Added tvf support for reading documents from avro files (#23436) 2023-08-31 21:49:27 +08:00
72fef48f87 [Doc](flink-connector)Flink connector adds schema change related parameter documents (#23439) 2023-08-31 21:48:27 +08:00
3a34ec95af [FE](fucntion) add date_floor/ceil in FE function (#23539) 2023-08-31 19:26:47 +08:00
96c4471b4a [feature](udf) udf array/map support decimal and update doc (#23560)
* update

* decimal

* update table name

* remove log

* add log
2023-08-31 07:44:18 +08:00
05771e8a14 [Enhancement](Load) stream Load using SQL (#23362)
Using stream load in SQL mode

for example:
example.csv

10000,北京
10001,天津
curl -v --location-trusted -u root: -H "sql: insert into test.t1(c1, c2) select c1,c2 from stream(\"format\" = \"CSV\", \"column_separator\" = \",\")" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
curl -v --location-trusted -u root: -H "sql: insert into test.t2(c1, c2, c3) select c1,c2, 'aaa' from stream(\"format\" = \"CSV\", \"column_separator\" = \",\")" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
curl -v --location-trusted -u root: -H "sql: insert into test.t3(c1, c2) select c1, count(1) from stream(\"format\" = \"CSV\", \"column_separator\" = \",\") group by c1" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
2023-08-30 19:02:48 +08:00
ca55bd88ad [Fix](Job)Fix the window time is not updated when no job is registered (#23628)
Fix resume job grammar definition is inconsistent
Show Job task Add execution results
JOB allows to define update operations
2023-08-30 09:48:21 +08:00
4c00b1760b [feature](partial update) Support partial update for broker load (#22970) 2023-08-29 14:41:01 +08:00
1fd637eab7 [Docs](Job)Add Job and Job tasks docs (#23576) 2023-08-29 10:06:49 +08:00
b2cb0d99d4 [opt](docs) opt doc to avoid users using port 8030 everywhere (#23379) 2023-08-29 09:47:24 +08:00
bea5701cce [minor](docs) update docs for variable sql_select_limit (#23262) 2023-08-28 14:38:32 +08:00
4c8fc06e40 [Feature](fe) Add admin set partition version statement (#23086)
This commit add a statement to modify partition visible version.
2023-08-28 14:31:54 +08:00
83467e5d9e [docs](website) fix a typo in docs tittle (#23431) 2023-08-28 14:27:45 +08:00
eadffedb33 [Feature](fe) Add admin set table status statement (#23139)
For some certain bugs, jobs is stuck in FE by the table state. For example, There is a bug which causes table remains ROLLUP state after adding rollup job, then other alter jobs later will not succeed because the table state is always ROLLUP but not NORMAL.

This commit adds a statement which is used to set the state of the specified table.
2023-08-28 10:22:09 +08:00
4dbec854e4 [Docs](inverted index) add tokenize function doc (#23518) 2023-08-28 10:19:03 +08:00
2b6d876280 [feature](move-memtable)[6/7] add options to enable memtable on sink node (#23470)
Co-authored-by: Siyang Tang <82279870+TangSiyang2001@users.noreply.github.com>
2023-08-25 22:32:22 +08:00
2b7d60eb4d [fix](docs) fix stream load docs (#23472) 2023-08-25 19:28:40 +08:00
3692c10654 [doc](flink-connector) add pg and sqlserver database sync (#23427) 2023-08-25 15:30:59 +08:00
8ef6b4d996 [fix](json) fix json int128 overflow (#22917)
* support int128 in jsonb

* fix jsonb int128 write

* fix jsonb to json int128

* fix json functions for int128

* add nereids function jsonb_extract_largeint

* add testcase for json int128

* change docs for json int128

* add nereids function jsonb_extract_largeint

* clang format

* fix check style

* using int128_t = __int128_t for all int128

* use fmt::format_to instead of snprintf digit by digit for int128

* clang format

* delete useless check

* add warn log

* clang format
2023-08-25 11:40:30 +08:00
ffadf09eec [fix](catalog)add custom jar (#23406)
- allow put custom jar in `${DORIS_HOME}/lib/java_extensions/custom_extension` such as `paimon-s3-0.4.0-incubating.jar`
- add some note for paimon and fqdn
2023-08-25 11:10:53 +08:00
71071ba057 [feature](move-memtable)[4/7] add stream sink file writer (#23416)
Co-authored-by: laihui <1353307710@qq.com>
2023-08-25 00:08:27 +08:00
adafcc1f7a [typo](docs) Fix Sidebar Category Name of CN Version and Capitalize Files Name (#23050) 2023-08-24 22:56:23 +08:00
e262c8b4be [chore](fe)correct some doc errors (#23398) 2023-08-24 17:05:13 +08:00
448b7755c6 [feature](jdbc catalog) support doris jdbc catalog array type (#23056) 2023-08-23 21:17:16 +08:00
22e373a799 [feature](vector-search) add 4 distance functions to support vector search (#23129) 2023-08-23 15:51:15 +08:00
c7b9eb5f9c [enhancement](bitmap)support bitmap type for non-key column in unique table (#23228) 2023-08-23 14:21:22 +08:00
d9993a7790 [doc](multi-catalog)add gcs broker load faq (#23229)
add gcs broker load faq

When the '_' is used  at buckt name, will report an error:  Missing required property: uri

the gcs bucket not match the s3 bucket name format: https://docs.aws.amazon.com/zh_cn/AmazonS3/latest/userguide/bucketnamingrules.html

we'd better not use  '_' in bucket.

<!--Describe your changes.-->
2023-08-22 22:48:31 +08:00
a7675243d9 [fix](jdbc catalog) fix adaptation to Oracle special character / table names (#23080)
The changes of this PR for JdbcOracleClient are as follows:

#### bug fixes:
  1. Fix the problem that if there is an approximate table name for Schema synchronization with a table name with `/` characters, the synchronization Column will be confused
  2. Fix the NPE problem of metadata synchronization after enabling lower_case_table_names configuration

#### improvement:
  1. Modify the method of synchronizing Oracle User to Doris Database mapping, use `metadata.getSchemas` instead of `SELECT DISTINCT OWNER FROM all_tables`
  2. When synchronizing metadata, change `null` at the catalog level to `conn.getcatalog`
2023-08-22 15:25:42 +08:00
51db11ed0b [improve](jdbc catalog) Add a variable to accommodate the final keyword in ClickHouse Jdbc Catalog queries (#23282) 2023-08-22 12:13:36 +08:00
2a5aed46f7 add CloudCanal en doc (#22731) 2023-08-22 10:49:54 +08:00
81dd00f6e4 [Feature](Compaction) Support do full compaction by table id (#22010) 2023-08-21 11:54:51 +08:00
Pxl
a11e0e3bc4 [Bug](agg) fix QUANTILE_UNION many problems (#23181)
fix QUANTILE_UNION many problems
2023-08-21 10:04:27 +08:00
97fa840324 [feature](multi-catalog)support iceberg hadoop catalog external table query (#22949)
support iceberg hadoop catalog external table query
2023-08-20 19:29:25 +08:00
ac855e75f1 [fix](doc) fix from_unixtime error range #23176 2023-08-19 12:17:13 +08:00
0838ff4bf4 [fix](Outfile) fix bug that the fileSize is not correct when outfile is completed (#22951) 2023-08-18 22:31:44 +08:00
5b8a76a22e [doc](catalog)faq for lzo.jar not found (#23070) 2023-08-18 10:16:32 +08:00
6e51632ca9 [docs](kerberos)add FAQ cases and enable krb5 debug (#22821) 2023-08-17 14:25:09 +08:00
41bce29ae3 [docs](docs)Rename Title and URL of Bitwise Functions (#22722) 2023-08-17 11:18:02 +08:00
4512569a3a [docs](releasenote)Update en release note 2.0.0 (#23041) 2023-08-16 15:13:09 +08:00
a2095b7d9e [fix](docs) add enable_single_replica_load on be config doc (#22948) 2023-08-16 10:31:01 +08:00
fe08db191f [typo](docs) Optimize the release note 2.0.0 (#22926) 2023-08-15 20:09:56 +08:00
27f5b623e6 [Chore](docs)Add SSL Faq (#22956) 2023-08-15 09:49:39 +08:00
c67d1cc805 [docs](releasenote)2.0.0 release note (#22904) 2023-08-14 10:11:03 +08:00
e2b06cd0cf [opt](docs) Optimize docs to avoid user set wrong replication_allocation (#22767) 2023-08-14 09:38:22 +08:00
79a61ced42 [docs](load) fix indentation in stream load manual (#22807) 2023-08-13 10:16:11 +08:00