xzj7019 8a562aeb77 [opt](nereids) recover adoptive bucket shuffle (#39598) ...

## Proposed changes

pick from https://github.com/apache/doris/pull/36784

Co-authored-by: xiongzhongjian <xiongzhongjian@selectdb.com>

2024-08-21 09:26:53 +08:00

..

account_p0

…

auth_p0

[fix](auth)fix missing authentication (#33347) (#33956)

2024-04-22 13:52:36 +08:00

backup_restore

[case](regression) Backup & restore with view (#29573)

2024-01-07 00:03:22 +08:00

bitmap_functions

…

bloom_filter_p0

[improve](ip)update ip for bloom_filter (#39414)

2024-08-16 08:20:19 +08:00

brown_p2/sql

…

cast_decimal_to_boolean

…

cast_double_to_decimal

…

catalog_recycle_bin_p0

[fix](catalog recycle bin) Forbid recover partition if table schame is changed #31146

2024-02-21 13:53:18 +08:00

clone_p0

[fix](decommission) fix cann't decommission mtmv (#33823)

2024-04-25 12:01:44 +08:00

compaction

[branch-2.1] Picks "[fix](delete) Fix delete stmt on MOW table doesn't use partial update in Nereids planner #38751" (#39214)

2024-08-12 17:02:48 +08:00

compression_p0

…

compression_p1

…

connector_p0/spark_connector

[feature](serde) support presto compatible output format (#37039) (#37253)

2024-07-04 13:56:05 +08:00

correctness

[fix](function)timediff with now function causes a error signature (… (#39349)

2024-08-14 18:36:14 +08:00

correctness_p0

[fix](nereids)check functionBuilders is not null before using it (#38535)

2024-07-31 11:00:39 +08:00

csv_header_p0

…

data_model_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

database_p0

…

datatype_p0

[fix](nestedtype) support nested type for schema change reorder (#39392)

2024-08-15 14:03:03 +08:00

datatype_p2

…

ddl_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

decimalv3/tpch_sf0.1_p1/sql

…

delete_p0

[Fix](Planner) fix delete from using does not attach partition information (#39020) (#39418)

2024-08-16 17:16:08 +08:00

demo_p0

…

empty_relation

[opt](Nereids) add where Null rule to create empty relation as where false (#38135) (#38361)

2024-07-26 14:50:06 +08:00

export

[feature](serde) support presto compatible output format (#37039) (#37253)

2024-07-04 13:56:05 +08:00

export_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

export_p2

[Fix](outfile) FE check the hdfs URI of outfile (#38602)

2024-07-31 22:46:37 +08:00

external_table_p0

[improvement](iceberg)]support doris's char/varchar to iceberg's string for 2.1 #38807 (#39645)

2024-08-21 09:19:10 +08:00

external_table_p2

[bugfix](hudi)add timetravel for nereids for 2.1 (#38324) (#38582)

2024-08-01 11:37:57 +08:00

fault_injection_p0

[opt](inverted index) unified optimization judgment to prevent omissions (#39473)

2024-08-17 16:57:19 +08:00

flink_connector_p0

[test](regression) add flink sync db case (#19328)

2023-12-14 17:06:17 +08:00

function_p0

[fix](nereids)fix nullable property of ForEachCombinator (#37980)

2024-07-17 13:48:21 +08:00

github_events_p2

…

index_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

insert_overwrite_p0

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_overwrite_p1

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_p0

[fix](group commit) fix repaly wal check label status (#38883) (#38997)

2024-08-07 22:06:59 +08:00

insert_p2

[fix](group commit) Fix p2 regression-test (#32270)

2024-03-21 14:07:24 +08:00

inverted_index_p0

[fix] (nereids) fix Match Expreesion in filter estimation (#39050) (#39215)

2024-08-13 10:57:53 +08:00

inverted_index_p1

[test](inverted index) add test for need read data opt (#38261) (#39534)

2024-08-21 09:01:12 +08:00

inverted_index_p2

[FIX] Pick array inverted index bugfix (#35837)

2024-06-06 09:54:14 +08:00

javaudf_p0

[cherry-pick](branch-21)fix operator do_projections should use local_state intermediate_projections (#38612) (#38765)

2024-08-05 09:07:16 +08:00

json_p0

[Fix](Json) fix some cast issue (#38683) (#39025)

2024-08-07 22:05:43 +08:00

jsonb_p0

[Fix](Json) fix some cast issue (#38683) (#39025)

2024-08-07 22:05:43 +08:00

load/insert

…

load_p0

[Pick](Branch-2.1) pick json reader fix and support specify $. as column (#39271)

2024-08-13 17:44:45 +08:00

load_p1

[case](regression) using load_parallelism when load csv and json from s3 (#27525)

2023-12-03 09:56:47 +08:00

load_p2/broker_load

[fix](test) fix case conflict between test_tvf_based_broker_load and test_broker_load #37622 (#37631)

2024-07-11 17:52:21 +08:00

manager

[Test](manager_interface)append manager interface test. (#35889) (#36912)

2024-06-28 18:38:33 +08:00

map_p0

…

migrate_p0

[fix](migrate disk) fix migrate disk lost data during publish version (#29887)

2024-01-16 18:37:06 +08:00

mtmv_p0

[opt](mtmv) partition rollup support week and quarter (#39286) (#39477)

2024-08-16 20:01:06 +08:00

mv_p0

revert [improvement](mv) Support to use cast when create sync materialized view #38008 (#39378)

2024-08-15 14:16:57 +08:00

mysql_fulltext

…

mysql_fulltext_array_contains

[fix](cases) array contains with index cases (#39087)

2024-08-09 04:06:47 +08:00

mysqldump_p0

…

nereids_arith_p0

[fix](Nereids) decimalv2 and int/date bit arithmetic need cast to bigint (#32311)

2024-03-21 14:07:49 +08:00

nereids_broadcast_shuffle_join

[fix](nereids) make runtime filter targets in fixed order (#33191)

2024-04-10 16:22:39 +08:00

nereids_clickbench_shape_p0

[feat](Nereids): rewrite sum literal to sum and count (#32244)

2024-03-22 16:35:47 +08:00

nereids_function_p0

[opt](Nereids) polish aggregate function signature matching (#39352) (#39460)

2024-08-16 13:57:11 +08:00

nereids_hint_tpcds_p0/shape

[test](Nereids) Add all hint tpcds tests (#38081) (#38368)

2024-07-31 10:24:10 +08:00

nereids_hint_tpch_p0/shape

[Fix](Nereids) fix leading with brace can not generate correct plan (#36328)

2024-06-19 14:47:55 +08:00

nereids_p0

[fix](window_funnel) fix wrong result of window_funnel #38954 (#39270)

2024-08-16 09:59:31 +08:00

nereids_rules_p0

[fix](mtmv) Fix rewrite by materialized view fail when query hive table (#38909) (#39163)

2024-08-10 18:15:11 +08:00

nereids_ssb_shape_sf100_p0/shape

[Nereids](Nereids): fix shape change in nereids regression test (#35488)

2024-05-31 10:53:12 +08:00

nereids_syntax_p0

[fix](ub) undefined behavior in FixedContainer (#39191) (#39201)

2024-08-12 10:02:07 +08:00

nereids_tpcds_shape_sf100_p0

[opt](nereids) recover adoptive bucket shuffle (#39598)

2024-08-21 09:26:53 +08:00

nereids_tpcds_shape_sf1000_p0

[opt](nereids) recover adoptive bucket shuffle (#39598)

2024-08-21 09:26:53 +08:00

nereids_tpch_p0/tpch

Revert "[fix](nereids) push filter through window, using slot equal-set (#35361)" (#35541)

2024-05-28 17:54:13 +08:00

nereids_tpch_shape_sf1000_p0

[mv](nereids) mv cost related PRs (#35652 #35701 #35864 #36368 #36789 #34970) (#37097)

2024-07-04 09:42:11 +08:00

opensky_p2/sql

…

partition_p0

[testcases](auto-partition) Add and fix testcases in P0 #33588

2024-04-17 23:42:11 +08:00

partition_p1/auto_partition/sql

[branch-2.1](auto-partition) Fix auto partition load failure in multi replica (#36586)

2024-06-20 17:51:18 +08:00

performance_p0

[Feat](nereids)when dealing insert into stmt with empty table source, fe returns directly (#35333)

2024-05-24 16:25:00 +08:00

pipeline_p0/local_shuffle

[Fix](Nereids) fix pipelineX distribute expr list with child output expr ids (#29621)

2024-01-08 10:46:27 +08:00

plsql_p0

[fix](plsql) Fix regression test for routine select (#33860)

2024-04-19 23:41:46 +08:00

point_query_p0

[Fix](Short Circuit) fix no project list in OlapScanNode (#37121) (#37504)

2024-07-11 10:04:28 +08:00

postgres/sql

…

prepared_stmt_p0

[Fix](Prepared Statment) use fixed charset to init StringLiteral (#37084)

2024-07-01 23:11:13 +08:00

query/regexp

…

query_p0

[cherry-pick](branch-2.1) add function regexp_extract_or_null (#39561)

2024-08-21 09:14:58 +08:00

query_p1

[improve](function) add limit check for lpad/rpad function input big value of length (#34810)

2024-05-21 12:54:25 +08:00

query_p2

[Bug](join) avoid overflow on bucket_size+1 (#37807)

2024-07-15 18:47:36 +08:00

rollup

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

rollup_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

schema_change

[branch-2.1] Picks "[Fix](schema change) Fix can't do reorder column schema change for MOW table and duplicate key table #37067" (#37226)

2024-07-03 22:42:51 +08:00

schema_change_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

schema_change_p2

…

segcompaction_p2

[fix](inverted index) Fix inverted index for MOR unique table #31051 (#31354)

2024-02-23 23:10:36 +08:00

show_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

spill_p0

[fix] fix wrong result of spill agg with limit (#35403)

2024-05-28 13:12:03 +08:00

sql_block_rule_p0

…

ssb_sf0.1_p1/sql

…

ssb_sf1_p2/sql

…

ssb_sf100_p2/sql

[Chore](case) add case of join with big hashtable (#27825)

2023-12-01 15:32:23 +08:00

ssb_unique_sql_zstd_p0

…

statistics

[test](statistics)Add analyze mtmv test case (#30847)

2024-02-16 10:12:23 +08:00

statistics_p1

…

topn_optimize

(topN)runtime_predicate is only triggered when the column name is obtained (#28419)

2023-12-21 18:08:23 +08:00

tpcds_sf1_p1

[opt](spill) add session variable of 'enable_force_spill' (#34664) (#35561)

2024-05-29 09:57:31 +08:00

tpcds_sf1_unique_p1

check stats and log memo for ds46 (#28396)

2023-12-22 14:50:11 +08:00

tpcds_sf100_dup_without_key_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf1000_p2/sql

…

tpch_sf0.1_p1/sql

[fix](nereids)when clause cannot be regarded as common sub expression (#33358)

2024-04-12 15:09:25 +08:00

tpch_sf0.1_unique_p1/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf1_p1

…

tpch_sf1_p2

…

tpch_sf1_unique_p1/sql

…

tpch_sf1_unique_p2/sql

…

tpch_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf100_unique_sql_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_unique_sql_zstd_bucket1_p0/sql

[pipelineX](scan) ignore storage data distribution by default (#29192)

2023-12-28 14:54:09 +08:00

tpch_unique_sql_zstd_p0/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

trino_p0

…

types

…

types_p0/unsigned

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

unique_with_mow_p0

[branch-2.1] Picks "[fix](delete) Fix delete stmt on MOW table doesn't use partial update in Nereids planner #38751" (#39214)

2024-08-12 17:02:48 +08:00

unique_with_mow_p2

[feature-wip](merge-on-write) MOW table support different primary keys and sort keys (#24788)

2023-11-24 16:37:30 +08:00

update

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

variable_p0

[feature](variable) add read_only and super_read_only (#33795)

2024-04-19 15:02:21 +08:00

variant_github_events_new_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_github_events_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_log_data_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_p0

[pick](Row store) fix row store with invalid json string in variant ty… (#39456)

2024-08-16 14:43:11 +08:00

variant_p2

[regression-test](variant) fix unstable query result m… (#28390)

2023-12-15 10:52:50 +08:00

view_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

with_clause_p0/sql

…

workload_manager_p0

[Fix](executor)Fix workload reg test #35082

2024-05-20 20:36:29 +08:00

yandex_metrica_p2

…