0eea19403e
[fix](stats) analyze specific column only if indicate column in analyze stmt ( #25660 )
2023-10-25 04:08:10 -05:00
8a03a07339
[feature](Nereids): pull up Project under Limit/TopN ( #25866 )
...
If project contains expression-eval, we need pull up through limit, it can improve performance.
2023-10-25 16:44:32 +08:00
693982fd1a
[feature](decimal) support decimal256 ( #25386 )
2023-10-25 15:47:51 +08:00
4f17c2a8b1
[feature](alter backends)backend modify & drop & decommission by ids ( #25444 )
2023-10-25 14:32:30 +08:00
ae66464d6b
[refactor](Nereids) refactor infer predicate rule to avoid lost cast ( #25637 )
...
extract slot and literal in comparison predicate. infer new one by equals predicates.
use TypeCoercion to add cast on new comparison predicate to ensure it is correct.
This reverts "[Fix](Nereids) Add cast comparison with slot reference when inferring predicate (#21171 )"
commit 58f2593ba1b65713e7b3c1ed39fc84be8cc3ff2c.
2023-10-25 01:12:22 -05:00
3b9ae91910
[Fix](Nereids) fix test leading suite and add tpch shape checking base on leading ( #25842 )
...
- fix test leading suite caused by sessionvariable setting error
- add tpch shape checking base on leading
2023-10-25 01:10:14 -05:00
ba75f3457c
[opt](Nereids) update first_value and last_value signature ( #25790 )
2023-10-25 00:49:27 -05:00
4ac82fd367
[opt](Nereids) add group_array as collect_list alias ( #25836 )
2023-10-25 00:46:40 -05:00
d94ae20d4a
[improvement](nereids) support insert into doris_internal_table_id(xxx) ( #25722 )
2023-10-25 11:12:00 +08:00
440345169a
[Fix](Nereids) fix column statistic derive in outer join estimation ( #25586 )
...
Problem:
When join estimation, upper join output slot statistic ndv would go wrong
Example:
we have two table:
tableA (a1[ndv = 10.0]) tableB(b1[ndv = 0.0], b2[ndv = 10.0])
tableA left join tableB on A.a1 = B.b1. which B.b1 with ndv zero.
the problem is after join estimation, B.b2 changed to 1.0.
Reason:
When estimating outer join, we can assume it behave like inner join. But we estimation then like inner join do
Solved:
When estimation outer join, output slot would update seperatly.
2023-10-24 22:25:20 +08:00
b82136bdb9
[fix](report handler) fix report handler lock leak ( #25853 )
2023-10-24 21:43:55 +08:00
2f600cdd89
[fix](Nereids) order by with cte cannot bind ( #25794 )
2023-10-24 05:40:56 -05:00
ac79cbaf66
[enhancement](log) remove some temp debug log ( #25809 )
...
* [enhancement](log) remove some temp debug log
* update
2023-10-24 18:17:04 +08:00
b7c4cc0667
[opt](Nereids) let DecimalV2Literal overflow check same with V3 ( #25699 )
2023-10-24 04:40:32 -05:00
4cd0dae4b3
[improvement](auth) support show all properties ( #25645 )
...
support `show all properties`
2023-10-24 17:27:59 +08:00
091cb0ce37
[Bug](materialized-view) add limit for group by with float/double on create mv ( #25823 )
...
doris do not support float/double key type on storage engine.
2023-10-24 17:06:45 +08:00
2972daaed9
[Bug](status) process error status on es_scroll_parser and compaction_action ( #25745 )
...
process error status on es_scroll_parser and compaction_action
2023-10-24 15:51:01 +08:00
57b2c2abc5
[opt](metric) add jvm jsonMetric ( #25774 )
...
The "http://fe_host:http_port/metrics?type=json " interface is missing the JVM metric.
2023-10-24 15:25:13 +08:00
a2d82220e2
[fix](tablet clone) clone add replica prefer choose the same medium ( #25640 )
2023-10-24 15:18:32 +08:00
c0f8c0af39
[FIX](collectiontype) fix collection type with char which without length ( #25703 )
...
fix create complex type like array/map/struct with char which without length
2023-10-24 02:16:37 -05:00
3c0fd5029d
[fix](Nereids): support complex project in PushdownTopNThroughJoin ( #25748 )
2023-10-24 14:52:30 +08:00
5c9f3ab6ee
[fix](nereids)do not generate min-max runtime filter for A<=>B and A!=B #25676
2023-10-24 10:23:22 +08:00
267c11207b
[feature](paimon)paimon catalog supports complex types ( #25364 )
2023-10-23 17:32:13 +08:00
2c3bc65fae
[feature](Nereids): generate left deep tree when stats is unknown ( #25620 )
...
generate left deep tree when stats is unknown
2023-10-23 15:41:55 +08:00
57340a4187
[feature](nereids) add function array_agg ( #25630 )
2023-10-23 02:05:54 -05:00
75000a5f6e
[enhancement](stmt-exec) make CTAS use insert timeout fix forward timeout ( #25731 )
2023-10-23 14:57:02 +08:00
09b2593035
[enhancement](Nereids): when rule return original plan, skip copyIn() ( #25730 )
2023-10-23 12:38:43 +08:00
cbc5c91aec
[fix](datetime) fix unstable str_to_date function result ( #25707 )
...
fix unstable str_to_date function result
2023-10-23 11:52:08 +08:00
144e12ae78
[fix](rpc) Rebuild failed channel to avoid connection refused ( #25688 )
2023-10-23 11:32:24 +08:00
e69b8abb86
[Feature](materialized-view) support delete stmt on materialized-view ( #25710 )
...
support delete stmt on materialized-view
2023-10-23 10:44:55 +08:00
fbc448520a
[feature](ColdHeatSeperation) Support to upload cold data to HDFS ( #22048 )
2023-10-22 21:04:43 +08:00
13780e4827
[fix](nereids)(create-table) fix bug that replication num is not set when create table with no property ( #25651 )
...
When executing create partitioned table with Nereids, and replication_num property is not set,
the replication number will be 0, so the tablet will has no replica.
2023-10-21 23:15:08 +08:00
3ffc6f0835
[fix](Nereids) should do read lock on table being insert when analyze ( #25619 )
2023-10-20 08:09:19 -05:00
ea6309059b
[improvement](outfile)support underscore prefix when select outfile ( #25395 )
2023-10-20 19:56:55 +08:00
fe52988ef8
[improvement](tablet clone) tablet balance ignore deleted partitions ( #25499 )
2023-10-20 19:40:44 +08:00
f1b81fafd4
[improvement](tablet clone) partition balance should invalidate tablet move in cache when sched failed ( #25602 )
2023-10-20 19:35:16 +08:00
fded8ba824
[improvement](insert) Modify insert into table_id(xxx) to doris_inter… ( #25662 )
2023-10-20 19:31:37 +08:00
ef6bf067ca
[refactor](delete) refactor FE DeleteHandler related logic ( #25497 )
2023-10-20 18:19:56 +08:00
a2ceea5951
[refactor](jni) unified jni framework for java udaf ( #25591 )
...
Follow https://github.com/apache/doris/pull/25302 , and use the unified jni framework to refactor java udaf.
This PR has removed the old interfaces to run java udf/udaf. Thanks to the ease of use of the new framework, the core code for modifying UDAF does not exceed 100 lines, and the logic is similar to that of UDF.
2023-10-20 16:13:40 +08:00
a11cde7bee
[fix](nereids)fix bug of duplicate name of inline view ( #25627 )
2023-10-20 15:37:44 +08:00
2cd22e5187
[fix](nereids)fix bug of lost rollup property in create table statement ( #25580 )
2023-10-20 14:55:21 +08:00
26f8c7e352
[fix](Nereids) collect_list and collect_set should always not null ( #25592 )
2023-10-20 01:54:00 -05:00
9f31914018
[enhancement](backup) Add build version in backup snapshot info ( #25513 )
...
The snapshot info uploaded to S3 obj system by backup job is a json file, which is useful for us to get information about this snapshot.
If we add version info to the JSON file, we can know what version of the cluster used to manufacture this snapshot was, in order to prevent restoring the newer version of the snapshot to the older version of the cluster.
The following info has been added:
```
"major_version": 1,
"minor_version": 2,
"patch_version": 6
```
2023-10-20 14:36:43 +08:00
d0cd535cb9
[improvement](insert) refactor group commit stream load ( #25560 )
2023-10-20 13:27:30 +08:00
dc47087560
[fix](function) fix str_to_date default return type scale for nereids ( #24932 )
...
fix str_to_date default return type scale for nereids
2023-10-20 12:55:49 +08:00
0510d548c6
[FeMeta](function) write function nullable mode info ( #25535 )
...
notice: this PR have change the fe meta version.
the nullable mode of udf-function is important,
if not write to info, it's will be loss after restart.
2023-10-20 11:37:11 +08:00
54780c62e0
[improvement](executor)Using cgroup to implement cpu hard limit ( #25489 )
...
* Using cgroup to implement cpu hard limit
* code style
2023-10-19 18:56:26 +08:00
4d2e7d7c86
[improvement](statistics)Set min max to NULL when collect stats with sample ( #25593 )
...
1. To avoid misleading of inaccurate min max stats, set the stats value to NULL while using sample to collect stats.
2. Fix NDV_SAMPLE_TEMPLATE typo, it shouldn't contain row count related contents.
2023-10-19 18:00:55 +08:00
2353582493
[enhancement](load) support for broker load, routine load, mysql load and add docs ( #25528 )
...
cases will be added later.
2023-10-19 15:43:22 +08:00
159be51ea6
[bugfix](schema_change) Fix the coredump when doubly write during schema change ( #22557 )
2023-10-19 14:43:18 +08:00
