6502da8917
[bugfix](restore) add partition id into convert_rowset_ids() ( #24834 )
2023-09-25 20:07:24 +08:00
9dff620471
[feature](binlog) add truncate table binlog ( #24868 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-09-25 19:53:42 +08:00
1b95ce1d93
[feature](json-function) add json_insert, json_replace, json_set functions ( #24384 )
...
[feature](json-function) add three json funcitons
2023-09-25 12:52:29 +08:00
22616d125d
[function](bitmap) add function alias bitmap_andnot and bitmap_andnot_count ( #24771 )
2023-09-22 12:18:31 +08:00
58ab25ccaa
Revert "[Feature](merge-on-write)Support ignore mode for merge-on-write unique table ( #21773 )" ( #24731 )
...
This reverts commit 3ee89aea35726197cb7e94bb4f2c36bc9d50da84.
2023-09-21 21:01:28 +08:00
61578f92e6
[chore](function name order) reorder math functions in doris_builtins_functions #24716
2023-09-21 15:07:50 +08:00
d62b59b620
[pipelineX](profile) Complete load profile ( #24690 )
2023-09-21 09:57:34 +08:00
ca5bdc0482
[feature](restore) Add thrift RestoreSnapshotRequest support table alias ( #24547 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-09-20 17:33:35 +08:00
81e65f4a12
[feature](function) Support SHA family functions ( #24342 )
2023-09-20 17:21:45 +08:00
fc12362a6d
[feature-wip](arrow-flight)(step2) FE support Arrow Flight server ( #24314 )
...
This is a POC, the design documentation will be updated soon
2023-09-20 14:42:54 +08:00
e9435c14f8
[Improve](array-func)improve array union support multi params ( #24327 )
2023-09-20 14:29:48 +08:00
14bd290aec
[feature](jsonb)support json_length and json_contains function ( #24332 )
2023-09-20 10:40:44 +08:00
e59aa49f28
[feature](datetime-func)support milliseconds_add/sub/diff and microseconds_diff ( #24114 )
2023-09-20 10:38:56 +08:00
b092bdaabf
[feature](load) collect loaded rows on table level after txn published ( #24346 )
...
As title.
Stream load 20 lines
```
2023-09-14 11:40:04,186 DEBUG (PUBLISH_VERSION|23) [DatabaseTransactionMgr.updateCatalogAfterVisible():1769] table id to loaded rows:{51016=20}
```
```
mysql> select count(*) from dup_tbl_basic;
+----------+
| count(*) |
+----------+
| 20 |
+----------+
1 row in set (0.05 sec)
```
2023-09-19 12:00:08 +08:00
f3e350e8ec
[Improvement](statistics)Improve statistics user experience ( #24414 )
...
Two improvements:
1. Move the `Job_id` column for the return info of `Analyze table` command to the first column. To keep consistent with `show analyze`.
```
mysql> analyze table hive.tpch100.region;
+--------+--------------+-------------------------+------------+--------------------------------+
| Job_Id | Catalog_Name | DB_Name | Table_Name | Columns |
+--------+--------------+-------------------------+------------+--------------------------------+
| 14403 | hive | default_cluster:tpch100 | region | [r_regionkey,r_comment,r_name] |
+--------+--------------+-------------------------+------------+--------------------------------+
1 row in set (0.03 sec)
```
2. Add `analyze_timeout` session variable, to control `analyze table/database with sync` timeout.
2023-09-18 13:36:41 +08:00
990d6c02ec
[Feature](new function) Add a uuid-numeric function, returns uuid in largerint type, 20x faster than uuid ( #24395 )
2023-09-16 18:26:13 +08:00
b9ddcbf729
[feature](merge-cloud) Rewrite code related to IOContext ( #24269 )
2023-09-15 19:57:58 +08:00
4ad5845dcc
[fix](planner) add if function signature for jsonb data type ( #24436 )
2023-09-15 17:50:51 +08:00
d24f3efd4a
[pipelineX](profile) Phase 1: refactor pipelineX detailed profile ( #24322 )
2023-09-15 16:14:05 +08:00
29fe87982f
[improve](outfile) add file_suffix options for outfile ( #24334 )
2023-09-15 12:58:41 +08:00
9c681692bd
Revert "[fix] fix http_stream retry mechanism ( #23969 )" ( #24407 )
...
This reverts commit 05e365ea137eb8c92b8e7eedc7d1435e83f065ae.
2023-09-15 10:07:53 +08:00
05e365ea13
[fix] fix http_stream retry mechanism ( #23969 )
...
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-14 21:41:11 +08:00
d20365cdcf
[fix](transaction) fix publish txn fake succ ( #24273 )
2023-09-14 21:04:59 +08:00
3ee89aea35
[Feature](merge-on-write)Support ignore mode for merge-on-write unique table ( #21773 )
2023-09-14 18:03:51 +08:00
4fbb25bc55
[Enhancement](function) Support date_trunc(date) and use it in auto partition ( #24341 )
...
Support date_trunc(date) and use it in auto partition
2023-09-14 16:53:09 +08:00
d8feca2530
[Enhancement]The page cache can be parameterized by the session variable of fe. ( #23981 )
2023-09-14 14:28:19 +08:00
1ef22d7f7c
[Feature](variant) add variant type ( #24170 )
...
Add variant type for metadata Add persistent information for variant, including the path of variant sub-columns, persisting them to the segment footer and tablet schema of the rowset.
2023-09-14 14:21:53 +08:00
ed108d48fa
[fix](invert index) fix query use char filter ( #24268 )
2023-09-14 11:42:47 +08:00
4bb9a12038
[function](bitmap) support bitmap_remove ( #24190 )
2023-09-12 14:52:04 +08:00
b5227af6a1
[Feature](partitions) Support auto partition FE part ( #24079 )
2023-09-11 17:48:19 +08:00
134b210c03
[improvement](shutdown) not print thread pool error stack trace when shutdown ( #24155 )
...
* [improvement](shutdown) not print thread pool error stack trace when shutdown
when thread pool shutdown, should not print error stack trace, it is very confuse.
arrow flight server should not call shutdown, if it is not enabled, because it will print error stack.
remove service unavailable from thrift because it is useless.
Part of this PR need to pick to 2.0 branch.
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-09-11 12:20:07 +08:00
f9a75b5c4f
[feature](csv_serde)1.append csv serde for serialize to csv and deserialize from csv. 2.let csvReader use csv serde not text_converter. ( #23352 )
...
1. append csv serde for serialize to csv and deserialize from csv.
2. let csvReader use csv serde not text_converter.
2023-09-10 00:16:21 +08:00
6b9698a248
[bugfix](insert into) should not send profile during report process ( #24127 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-09-09 17:12:35 +08:00
153c7982f3
[Optimize](invert index) Optimize multiple terms conjunction query ( #23871 )
2023-09-09 01:52:58 +08:00
5c2f9eb92e
[Improvement] (pipeline) Cancel related query if backend restarts or dead ( #23863 )
2023-09-08 20:30:52 +08:00
82dc970916
[feature](insert) Support group commit insert ( #22829 )
2023-09-08 15:51:03 +08:00
20b3e5eafe
[feature](Datetime) add from_microsecond / from_millisecond function ( #23902 )
2023-09-07 19:03:49 +08:00
fdb7a44f57
Revert "[Feature](partitions) Support auto partition" ( #24024 )
...
* Revert "[Feature](partitions) Support auto partition (#23236 )"
This reverts commit 6c544dd2011d731b8c9c51384c77bcf19c017981.
* Update config.h
2023-09-07 17:08:26 +08:00
6c544dd201
[Feature](partitions) Support auto partition ( #23236 )
...
Co-authored-by: zhangstar333 <2561612514@qq.com >
2023-09-06 16:26:45 +08:00
a96adc01aa
[Chore](function) refactor of quantile_state ( #23862 )
...
refactor of quantile_state
2023-09-06 15:39:19 +08:00
b885ac5df3
[fix](statistics)Set default database while forwarding stmt to master. #23938
...
Set default database while forwarding request to master. Avoid No database selected error.
2023-09-06 08:53:30 +08:00
1d1a9e2bfc
[improvement](graceful shutdown) waiting for all query finished when graceful shutdown ( #23865 )
...
In some cloud native deployment scenario, BE(especially the Compute Node BE) will be add to cluster and remove from cluster very frequently. User's query will fail if there is a fragment is running on the shutting down BE. Users could use stop_be.sh --grace, then BE will wait all running queries to stop to avoiding running query failure, but if the waiting time exceed the limit, then be will exit directly. During this period, FE will not send any queries to BE and waiting for all running queries to stop
2023-09-05 09:52:28 +08:00
039c76cbc0
[feature-wip] (arrow-flight) (step1) BE support Arrow Flight server, read data only ( #23765 )
2023-09-04 19:19:55 +08:00
bb3fadc5d3
[Bug](materialized-view) fix mv not match because cast and alias name ( #23580 )
...
fix mv not match because cast and alias name
2023-09-04 12:46:33 +08:00
acbd8ca185
[improvement](show backends) show backends print trash used ( #23792 )
2023-09-03 20:30:58 +08:00
347cceb530
[Feature](inverted index) push count on index down to scan node ( #22687 )
...
Co-authored-by: airborne12 <airborne12@gmail.com >
2023-09-02 22:24:43 +08:00
de8fa2cff5
[Fix](thrift) Add fe master check in some thrift calls ( #23757 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-09-02 14:05:31 +08:00
bbc893c953
[Enhancement](binlog) Add ModifyPartition, BatchModifyPartitions && ReplacePartitionOperationLog support ( #23773 )
2023-09-02 13:19:07 +08:00
75e2bc8a25
[function](bitmap) support bitmap_to_base64 and bitmap_from_base64 ( #23759 )
2023-09-02 00:58:48 +08:00
16d6357266
[fix] (mac compile) Fix mac compile error & fe start time related ( #23727 )
...
Fix of PR #23582
Some Fe codes are deleted by [Improvement](pipeline) Cancel outdated query if original fe restarts #23582 , need to be added back;
Fix mac build failed caused by wrong thrift declaration order.
2023-09-01 08:02:30 +08:00
