8a8ae44eee
[Fix](regression)Fix statistics related regression test ( #25888 )
2023-10-25 05:59:13 -05:00
01d5901356
[fix](Nereids) cte should support nested name reuse ( #25858 )
...
for example:
```sql
with a as (with a as (select * from t) select * from a) select * from a;
with a as (select * from t1), b as (with a as (select * from a) select * from a) select * from b;
```
2023-10-25 18:52:14 +08:00
e8f479882d
[pipelineX](local exchange) Add local exchange operator ( #25846 )
2023-10-25 18:45:02 +08:00
a919ef618d
[fix](planner) Fix select table tablet not effective ( #25378 )
...
Fix select table tablet not effective, table distributed by random.
If tabletID specified in query does not exist in this partition, skip scan partition.
2023-10-25 18:02:27 +08:00
4bda1650e1
[docs & fix](stats) Fix tablesample init failed and some outdated contents in docs ( #25603 )
2023-10-25 04:38:00 -05:00
20fa1eff65
[enhancement](Nereids) Filter no data partition after partition prune ( #25456 )
2023-10-25 04:37:10 -05:00
8a436d8ecc
[FIX](collectiontype) fix shrink char column in map/struct ( #25725 )
...
fix shrink char column in map/struct
before we has char with specific length defined in map or struct field
we select map or struct , the char column in which one has been padding if we just insert less than specific length chars
but in mysql here just show inserted chars not padding specific length chars
---------
Co-authored-by: yiguolei <676222867@qq.com >
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-10-25 17:16:13 +08:00
0eea19403e
[fix](stats) analyze specific column only if indicate column in analyze stmt ( #25660 )
2023-10-25 04:08:10 -05:00
8a03a07339
[feature](Nereids): pull up Project under Limit/TopN ( #25866 )
...
If project contains expression-eval, we need pull up through limit, it can improve performance.
2023-10-25 16:44:32 +08:00
693982fd1a
[feature](decimal) support decimal256 ( #25386 )
2023-10-25 15:47:51 +08:00
97c2fe75d1
[feature](pipelineX) use expected<T, Status> in local_state ( #25878 )
2023-10-25 15:23:17 +08:00
4f17c2a8b1
[feature](alter backends)backend modify & drop & decommission by ids ( #25444 )
2023-10-25 14:32:30 +08:00
49b73483fd
[fix](field) fix coredump of field function when the first argument is const ( #25859 )
2023-10-25 14:14:32 +08:00
ae66464d6b
[refactor](Nereids) refactor infer predicate rule to avoid lost cast ( #25637 )
...
extract slot and literal in comparison predicate. infer new one by equals predicates.
use TypeCoercion to add cast on new comparison predicate to ensure it is correct.
This reverts "[Fix](Nereids) Add cast comparison with slot reference when inferring predicate (#21171 )"
commit 58f2593ba1b65713e7b3c1ed39fc84be8cc3ff2c.
2023-10-25 01:12:22 -05:00
3b9ae91910
[Fix](Nereids) fix test leading suite and add tpch shape checking base on leading ( #25842 )
...
- fix test leading suite caused by sessionvariable setting error
- add tpch shape checking base on leading
2023-10-25 01:10:14 -05:00
235ae9ded4
[improvement](fragment) optimize to get query context logic ( #25621 )
2023-10-25 14:03:47 +08:00
a979d5a1f0
[improve](regression test) Add case for if function ( #25780 )
2023-10-25 14:03:28 +08:00
ba75f3457c
[opt](Nereids) update first_value and last_value signature ( #25790 )
2023-10-25 00:49:27 -05:00
4ac82fd367
[opt](Nereids) add group_array as collect_list alias ( #25836 )
2023-10-25 00:46:40 -05:00
e3317ac1b9
[fix](compile) fix BE compile failure on Mac ( #25876 )
2023-10-25 12:55:00 +08:00
7ca3f7100f
[testcases](datetime) temporarily remove str_to_date related case ( #25877 )
2023-10-25 12:54:38 +08:00
f5db5703c9
[regression-test](remove case) remove test_bitmap_filter_p1.groovy ( #25812 )
2023-10-25 11:39:25 +08:00
0068783e88
[fix](merge-on-write) change some static_cast<void> to RETURN_IF_ERROR ( #25863 )
2023-10-25 11:23:06 +08:00
d94ae20d4a
[improvement](nereids) support insert into doris_internal_table_id(xxx) ( #25722 )
2023-10-25 11:12:00 +08:00
411fae951b
[fix](trash core) fix get trash directory core when stop be ( #25428 ) ( #25829 )
2023-10-25 11:05:25 +08:00
5e3277e8fb
[improvement](routine-load) add routine load rows check ( #25818 )
2023-10-25 11:04:28 +08:00
552091f21f
[performance](pipelineX) optimize pipelineX ( #25713 )
2023-10-25 10:13:17 +08:00
6b2eed779c
[feature](AuditLog) add scanRows scanBytes in auditlog ( #25435 )
2023-10-25 10:00:35 +08:00
440345169a
[Fix](Nereids) fix column statistic derive in outer join estimation ( #25586 )
...
Problem:
When join estimation, upper join output slot statistic ndv would go wrong
Example:
we have two table:
tableA (a1[ndv = 10.0]) tableB(b1[ndv = 0.0], b2[ndv = 10.0])
tableA left join tableB on A.a1 = B.b1. which B.b1 with ndv zero.
the problem is after join estimation, B.b2 changed to 1.0.
Reason:
When estimating outer join, we can assume it behave like inner join. But we estimation then like inner join do
Solved:
When estimation outer join, output slot would update seperatly.
2023-10-24 22:25:20 +08:00
88dd480c2e
[enhancement](CSV-reader) enhance err log for csv reading containing enclose or escape ( #25816 )
2023-10-24 22:10:08 +08:00
69c3e08699
[improve](load) set load id in signal handler ( #25813 )
2023-10-24 21:58:39 +08:00
bab7581054
[fix](delete) fix potential delete fail after adding columns ( #25817 )
2023-10-24 21:45:21 +08:00
b82136bdb9
[fix](report handler) fix report handler lock leak ( #25853 )
2023-10-24 21:43:55 +08:00
40e430ca55
[regression](multi-catalog) add aliyun dlf hive on oss and huawei obs test case ( #25650 )
...
add aliyun dlf hive on oss and huawei obs test case
now obs cases have some problem, will not fix this at this PR, just add comment.
2023-10-24 20:52:50 +08:00
d4fca3c67e
[fix](load) fix load rpc timeout ( #25701 )
2023-10-24 19:50:44 +08:00
10f1957379
[feature](docker)add docker-iceberg init tables ( #25424 )
...
Add some init tables for docker-iceberg.
2023-10-24 19:29:57 +08:00
b16af25f7b
[pipelineX](fix) fix union operator which return only const values ( #25837 )
2023-10-24 18:51:41 +08:00
2f600cdd89
[fix](Nereids) order by with cte cannot bind ( #25794 )
2023-10-24 05:40:56 -05:00
0147561c88
[Update](clucene) sync clucene version to latest ( #25821 )
2023-10-24 18:22:42 +08:00
ac79cbaf66
[enhancement](log) remove some temp debug log ( #25809 )
...
* [enhancement](log) remove some temp debug log
* update
2023-10-24 18:17:04 +08:00
3837e7b779
[opt](filecache) do not sync segment data into storage system ( #25691 )
...
File cache will return the reading data only when its writer has finished the write operation and close the segment file. However there's no need to call fdatasync when closing segment file. fdatasync takes a lot of time, and severely impact on cache performance.
2023-10-24 18:08:56 +08:00
ade475a52b
[regression](outfile)add regression for select outfile with underscore prefix #25797
2023-10-24 17:58:38 +08:00
b7c4cc0667
[opt](Nereids) let DecimalV2Literal overflow check same with V3 ( #25699 )
2023-10-24 04:40:32 -05:00
4cd0dae4b3
[improvement](auth) support show all properties ( #25645 )
...
support `show all properties`
2023-10-24 17:27:59 +08:00
091cb0ce37
[Bug](materialized-view) add limit for group by with float/double on create mv ( #25823 )
...
doris do not support float/double key type on storage engine.
2023-10-24 17:06:45 +08:00
5e5a331de4
[fix](trigger) fix pipeline bug that does not trigger Doris_Performance_Clickbench_ClickbenchNew ( #25827 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2023-10-24 16:28:01 +08:00
2972daaed9
[Bug](status) process error status on es_scroll_parser and compaction_action ( #25745 )
...
process error status on es_scroll_parser and compaction_action
2023-10-24 15:51:01 +08:00
9160834606
[FIX](resize) fix array and map offsets resize with default value ( #25669 )
2023-10-24 02:50:01 -05:00
57b2c2abc5
[opt](metric) add jvm jsonMetric ( #25774 )
...
The "http://fe_host:http_port/metrics?type=json " interface is missing the JVM metric.
2023-10-24 15:25:13 +08:00
a2d82220e2
[fix](tablet clone) clone add replica prefer choose the same medium ( #25640 )
2023-10-24 15:18:32 +08:00
