57340a4187
[feature](nereids) add function array_agg ( #25630 )
2023-10-23 02:05:54 -05:00
75000a5f6e
[enhancement](stmt-exec) make CTAS use insert timeout fix forward timeout ( #25731 )
2023-10-23 14:57:02 +08:00
09b2593035
[enhancement](Nereids): when rule return original plan, skip copyIn() ( #25730 )
2023-10-23 12:38:43 +08:00
cbc5c91aec
[fix](datetime) fix unstable str_to_date function result ( #25707 )
...
fix unstable str_to_date function result
2023-10-23 11:52:08 +08:00
144e12ae78
[fix](rpc) Rebuild failed channel to avoid connection refused ( #25688 )
2023-10-23 11:32:24 +08:00
e69b8abb86
[Feature](materialized-view) support delete stmt on materialized-view ( #25710 )
...
support delete stmt on materialized-view
2023-10-23 10:44:55 +08:00
fbc448520a
[feature](ColdHeatSeperation) Support to upload cold data to HDFS ( #22048 )
2023-10-22 21:04:43 +08:00
13780e4827
[fix](nereids)(create-table) fix bug that replication num is not set when create table with no property ( #25651 )
...
When executing create partitioned table with Nereids, and replication_num property is not set,
the replication number will be 0, so the tablet will has no replica.
2023-10-21 23:15:08 +08:00
3ffc6f0835
[fix](Nereids) should do read lock on table being insert when analyze ( #25619 )
2023-10-20 08:09:19 -05:00
ea6309059b
[improvement](outfile)support underscore prefix when select outfile ( #25395 )
2023-10-20 19:56:55 +08:00
fe52988ef8
[improvement](tablet clone) tablet balance ignore deleted partitions ( #25499 )
2023-10-20 19:40:44 +08:00
f1b81fafd4
[improvement](tablet clone) partition balance should invalidate tablet move in cache when sched failed ( #25602 )
2023-10-20 19:35:16 +08:00
fded8ba824
[improvement](insert) Modify insert into table_id(xxx) to doris_inter… ( #25662 )
2023-10-20 19:31:37 +08:00
ef6bf067ca
[refactor](delete) refactor FE DeleteHandler related logic ( #25497 )
2023-10-20 18:19:56 +08:00
a11cde7bee
[fix](nereids)fix bug of duplicate name of inline view ( #25627 )
2023-10-20 15:37:44 +08:00
2cd22e5187
[fix](nereids)fix bug of lost rollup property in create table statement ( #25580 )
2023-10-20 14:55:21 +08:00
26f8c7e352
[fix](Nereids) collect_list and collect_set should always not null ( #25592 )
2023-10-20 01:54:00 -05:00
9f31914018
[enhancement](backup) Add build version in backup snapshot info ( #25513 )
...
The snapshot info uploaded to S3 obj system by backup job is a json file, which is useful for us to get information about this snapshot.
If we add version info to the JSON file, we can know what version of the cluster used to manufacture this snapshot was, in order to prevent restoring the newer version of the snapshot to the older version of the cluster.
The following info has been added:
```
"major_version": 1,
"minor_version": 2,
"patch_version": 6
```
2023-10-20 14:36:43 +08:00
d0cd535cb9
[improvement](insert) refactor group commit stream load ( #25560 )
2023-10-20 13:27:30 +08:00
dc47087560
[fix](function) fix str_to_date default return type scale for nereids ( #24932 )
...
fix str_to_date default return type scale for nereids
2023-10-20 12:55:49 +08:00
0510d548c6
[FeMeta](function) write function nullable mode info ( #25535 )
...
notice: this PR have change the fe meta version.
the nullable mode of udf-function is important,
if not write to info, it's will be loss after restart.
2023-10-20 11:37:11 +08:00
54780c62e0
[improvement](executor)Using cgroup to implement cpu hard limit ( #25489 )
...
* Using cgroup to implement cpu hard limit
* code style
2023-10-19 18:56:26 +08:00
4d2e7d7c86
[improvement](statistics)Set min max to NULL when collect stats with sample ( #25593 )
...
1. To avoid misleading of inaccurate min max stats, set the stats value to NULL while using sample to collect stats.
2. Fix NDV_SAMPLE_TEMPLATE typo, it shouldn't contain row count related contents.
2023-10-19 18:00:55 +08:00
2353582493
[enhancement](load) support for broker load, routine load, mysql load and add docs ( #25528 )
...
cases will be added later.
2023-10-19 15:43:22 +08:00
159be51ea6
[bugfix](schema_change) Fix the coredump when doubly write during schema change ( #22557 )
2023-10-19 14:43:18 +08:00
3d1206d325
[date](fix) modify push-down predicate for datev1 type ( #25571 )
...
For comparison predicate, two arguments must be cast to datetime and push down to storage if either one is date type. This PR disables predicate push-down for this case.
2023-10-19 14:18:27 +08:00
ed713c2e2d
[FIX](func) fix count distinct do not support arr/map/struct ( #25483 )
2023-10-19 01:04:50 -05:00
b45f501e51
[improvement](nereids) Support aggregate functions without from clause ( #25500 )
...
Support aggregate functions in select without from clause, here are some examples as following:
SELECT 1,
'a',
COUNT(),
SUM(1) + 1,
AVG(2) / COUNT(),
MAX(3),
MIN(4),
RANK() OVER() AS w_rank,
DENSE_RANK() OVER() AS w_dense_rank,
ROW_NUMBER() OVER() AS w_row_number,
SUM(5) OVER() AS w_sum,
AVG(6) OVER() AS w_avg,
COUNT() OVER() AS w_count,
MAX(7) OVER() AS w_max,
MIN(8) OVER() AS w_min;
2023-10-18 23:07:37 -05:00
45178f5664
[improvement](disk balance) impr disk rebalancer sched with partition rebalancer ( #25549 )
2023-10-19 09:33:42 +08:00
2a442972a8
[Fix](merge-on-write) Fix some bugs about sequence column ( #24915 )
...
1. add checks and handling of sequence column in #21896 to insert statement in origin planner and Nereids planner.
2. disable drop sequence mapping column in schema change.
2023-10-18 20:40:12 +08:00
2ddd2e5079
[feature](Nereids) add map_agg function ( #25246 )
2023-10-18 06:44:36 -05:00
9e07291e65
[fix](stats) internal stats table tablet replica num not update as expected ( #25563 )
...
Before this PR, scale would not happen, since in the previous implementation relica count of all tablets was considered
2023-10-18 06:42:41 -05:00
ea97f2d6e5
[refactor](nereids)make enable_stats session var ( #25550 )
...
this pr is used to test plan shape without column stats
2023-10-18 18:13:15 +08:00
85e83b9c6c
[fix](auth)fix not check udf auth in nereids ( #25541 )
2023-10-18 16:22:36 +08:00
62d06584f1
[feature](fe) add function 'BitmapAgg' in nereids ( #25508 )
2023-10-18 14:24:27 +08:00
8a8e6edba9
[enhancement](stats) Unify sample algorithm between olap table and external table ( #25472 )
...
To reduce error of ndv estimation of olap table's column
2023-10-18 01:18:40 -05:00
0ec537edef
[fix](column-id) fix null conn ctx in column id flusher and parser for database field in corresponding show stmt ( #25393 )
2023-10-18 14:11:31 +08:00
db16a14970
[fix](backup) fix backup fail on s3 ( #25496 )
...
The s3 client properties are not passed to BE correctly.
The test cases will be added later
2023-10-18 13:52:12 +08:00
d2400d1d7b
[feature](profile) profilev2 distinguish Sink and Operator in pipelineX ( #25491 )
...
* update
* update
2023-10-18 13:12:29 +08:00
ef9cbc4c64
[enhancement](priv) Clarify ccr releated FrontendServiceImpl call privs ( #25530 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-10-18 10:51:55 +08:00
6f6264693f
[fix](Nereids) can't choosing best plan for join that could only broadcast ( #25511 )
...
we need ensure there is one request properties at least
2023-10-17 21:40:05 -05:00
b0e0a0569a
[Fix](row store) Real default value should be used instead of default… ( #25230 )
...
Before this PR the default value is not correct, we should use default value in Frontend schema.
2023-10-18 10:13:44 +08:00
26e332c608
[fix](multi-catalog)add exception for unsupported hive input format ( #25490 )
...
add exception for unsupported hive input format
2023-10-17 22:53:53 +08:00
b76e23fb34
[improvement](meta) allow to ignore unknown image module ( #25450 )
...
Add new FE config `ignore_unknown_metadata_module`. Default is false.
If set to true, when reading metadata image file, and there are unknown modules, these modules
will be ignored and skipped.
This is mainly used in downgrade operation, old version can be compatible with new version Image file.
2023-10-17 22:53:31 +08:00
18c2a13e09
[fix](multi-catalog)fix maxcompute partition filter and session creation ( #24911 )
...
add maxcompute partition support
fix maxcompute partition filter
modify maxcompute session create method
2023-10-17 22:36:10 +08:00
d287f53d77
[fix](nereids)in physical plan, print join class simple name not full name #25515
2023-10-17 20:25:14 +08:00
9b1cdd3230
[fix](planner) mark join slot should always be nullable ( #25433 )
2023-10-17 06:14:13 -05:00
8eff1486bd
[feature](nereids)print query id with memo and physical tree ( #25501 )
...
print query id with memo and physical tree when dump_nereids_memo switched on. This is used for regression test.
2023-10-17 05:06:11 -05:00
9d6b2dceb2
[fix](Nereids) non-slot filter should not be push through aggregate ( #25525 )
2023-10-17 05:02:26 -05:00
af8832389f
[feature](Nereids) add 4 array functions ( #25488 )
...
- array_concat
- array_pushback
- array_pushfront
- array_zip
2023-10-17 04:45:15 -05:00
