Qi Chen 84e9a14063 [Fix](hive-writer) Fix partition column orders issue when the partition fields inserted into the target table are inconsistent with the field order of the query source table and the schema field order of the query source table. (#35543) ...

## Proposed changes

backport #35347

## Further comments

If this is a relatively large or complex change, kick off the discussion
at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why
you chose the solution you did and what alternatives you considered,
etc...

2024-05-28 18:11:55 +08:00

..

account_p0

…

auth_p0

[fix](auth)fix missing authentication (#33347) (#33956)

2024-04-22 13:52:36 +08:00

backup_restore

[case](regression) Backup & restore with view (#29573)

2024-01-07 00:03:22 +08:00

bitmap_functions

…

bloom_filter_p0

[WIP](test) remove enable_nereids_planner in regression cases (part 2) (#34490)

2024-05-10 22:02:32 +08:00

brown_p2/sql

…

cast_decimal_to_boolean

…

cast_double_to_decimal

…

catalog_recycle_bin_p0

[fix](catalog recycle bin) Forbid recover partition if table schame is changed #31146

2024-02-21 13:53:18 +08:00

clone_p0

[fix](decommission) fix cann't decommission mtmv (#33823)

2024-04-25 12:01:44 +08:00

compaction

[fix](prepare) fix datetimev2 return err when binary_row_format (#34662)

2024-05-18 18:37:41 +08:00

compression_p0

…

compression_p1

…

connector_p0/spark_connector

[behavior change](output) change float output format (#32049)

2024-03-21 14:07:22 +08:00

correctness

[WIP](test) remove enable_nereids_planner in regression cases (part 2) (#34490)

2024-05-10 22:02:32 +08:00

correctness_p0

[Fix](function) fix days/weeks_diff result wrong on BE #35104

2024-05-22 10:00:26 +08:00

csv_header_p0

…

data_model_p0

[Cherry-Pick](branch-2.1) Pick "Fix multiple replica partial update auto inc data inconsistency problem #34788" (#35056)

2024-05-20 15:43:46 +08:00

database_p0

[regression](fe) Add more regression test for FE (#25976)

2023-10-27 10:27:22 +08:00

datatype_p0

[fix](decimalv2) fix scale of decimalv2 to string (#35222) (#35359)

2024-05-24 17:20:43 +08:00

datatype_p2

…

ddl_p0

fix case: test_create_table_without_distribution

2024-05-23 19:03:30 +08:00

decimalv3/tpch_sf0.1_p1/sql

…

delete_p0

[fix](planner) Fix delete statement on MOR unique table (#28968)

2023-12-27 12:59:15 +08:00

demo_p0

[enhancement](regression test) stream load support direct load to be (#26829)

2023-11-13 10:07:10 +08:00

empty_relation

[fix](Nereids) mark join should not eliminate join when child is empty (#29409)

2024-01-05 11:55:37 +08:00

export

[Fix](Serde) Fix content displayed by complex types in MySQL Client (#25946)

2023-11-01 23:48:55 +08:00

export_p0

[opt](Nereids) normalize column name of output file (#34650)

2024-05-13 22:12:46 +08:00

export_p2

…

external_table_p0

[Fix](hive-writer) Fix partition column orders issue when the partition fields inserted into the target table are inconsistent with the field order of the query source table and the schema field order of the query source table. (#35543)

2024-05-28 18:11:55 +08:00

external_table_p2

[Fix](tvf) Fix that tvf reading empty files in compressed formats. (#34926)

2024-05-21 12:59:31 +08:00

fault_injection_p0

[fix](inverted index) normal process query for null condition when index is missing (#33663)

2024-04-17 23:42:14 +08:00

flink_connector_p0

[test](regression) add flink sync db case (#19328)

2023-12-14 17:06:17 +08:00

function_p0

[feature](function) Support for aggregate function foreach combiner for some error function (#31913)

2024-03-21 14:07:49 +08:00

github_events_p2

…

index_p0

[fix](inverted index) Fix inverted index for MOR unique table #31051 (#31354)

2024-02-23 23:10:36 +08:00

insert_overwrite_p0

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_overwrite_p1

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_p0

[test](shuffle) test insert row count when rows filtered by ExchangeNode (#34657)

2024-05-11 11:47:49 +08:00

insert_p2

[fix](group commit) Fix p2 regression-test (#32270)

2024-03-21 14:07:24 +08:00

inverted_index_p0

[Fix](test) fix test case output for inverted_index_p0.test_tokenize (#35464)

2024-05-27 19:19:24 +08:00

inverted_index_p1/tpcds_sf1_index/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

javaudf_p0

[WIP](test) remove enable_nereids_planner in regression cases (part 4) (#34642)

2024-05-18 18:07:39 +08:00

json_p0

[Fix](Json type) correct cast result for json type (#34764)

2024-05-18 18:40:17 +08:00

jsonb_p0

[Fix](Json type) correct cast result for json type (#34764)

2024-05-18 18:40:17 +08:00

load/insert

[fix](transaction) Fix publish txn wait too long when not meet quorum (#26659)

2023-11-10 14:55:26 +08:00

load_p0

[Feat](nereids)when dealing insert into stmt with empty table source, fe returns directly (#35333)

2024-05-24 16:25:00 +08:00

load_p1

[case](regression) using load_parallelism when load csv and json from s3 (#27525)

2023-12-03 09:56:47 +08:00

load_p2/broker_load

…

map_p0

…

migrate_p0

[fix](migrate disk) fix migrate disk lost data during publish version (#29887)

2024-01-16 18:37:06 +08:00

mtmv_p0

[feature](mtmv) create mtmv support partitions rollup (#31812)

2024-05-18 18:14:48 +08:00

mv_p0

[Bug](materialized-view) fix unmatch mv coz table name (#35444)

2024-05-28 13:17:33 +08:00

mysql_fulltext

…

mysqldump_p0

…

nereids_arith_p0

[fix](Nereids) decimalv2 and int/date bit arithmetic need cast to bigint (#32311)

2024-03-21 14:07:49 +08:00

nereids_broadcast_shuffle_join

[fix](nereids) make runtime filter targets in fixed order (#33191)

2024-04-10 16:22:39 +08:00

nereids_clickbench_shape_p0

[feat](Nereids): rewrite sum literal to sum and count (#32244)

2024-03-22 16:35:47 +08:00

nereids_function_p0

[Fix](Json type) correct cast result for json type (#34764)

2024-05-18 18:40:17 +08:00

nereids_hint_tpcds_p0/shape

[Fix](Nereids) fix leading with multi level of brace pairs (#34169) (#35043)

2024-05-20 10:28:22 +08:00

nereids_hint_tpch_p0/shape

[Fix](Nereids) fix leading hint with update of alias name (#34434) (#35046)

2024-05-20 10:40:10 +08:00

nereids_p0

[opt](Nereids) remove restrict for count(*) in window (#35220)

2024-05-24 16:23:58 +08:00

nereids_rules_p0

[Fix](nereids) fix merge aggregate setting top projection bug (#35348)

2024-05-28 13:13:31 +08:00

nereids_ssb_shape_sf100_p0/shape

[opt](nereids) optimize str-like-col range filter estimation (#34542)

2024-05-10 22:14:00 +08:00

nereids_syntax_p0

[fix](nereids) do not push RF into nested cte (#33769)

2024-04-20 20:08:00 +08:00

nereids_tpcds_shape_sf100_p0

[feat](Nereids): Put the Child with Least Row Count in the First Position of Intersect (#34290) (#35339)

2024-05-27 11:52:35 +08:00

nereids_tpcds_shape_sf1000_p0

[feat](Nereids): Put the Child with Least Row Count in the First Position of Intersect (#34290) (#35339)

2024-05-27 11:52:35 +08:00

nereids_tpch_p0/tpch

Revert "[fix](nereids) push filter through window, using slot equal-set (#35361)" (#35541)

2024-05-28 17:54:13 +08:00

nereids_tpch_shape_sf1000_p0

[pick](nereids)Runtime filter pushdown refactor for branch-2.1 (#34682)

2024-05-11 09:44:24 +08:00

opensky_p2/sql

…

partition_p0

[testcases](auto-partition) Add and fix testcases in P0 #33588

2024-04-17 23:42:11 +08:00

performance_p0

[Feat](nereids)when dealing insert into stmt with empty table source, fe returns directly (#35333)

2024-05-24 16:25:00 +08:00

pipeline_p0/local_shuffle

[Fix](Nereids) fix pipelineX distribute expr list with child output expr ids (#29621)

2024-01-08 10:46:27 +08:00

plsql_p0

[fix](plsql) Fix regression test for routine select (#33860)

2024-04-19 23:41:46 +08:00

point_query_p0

[Fix](Row store) support decimal256 type (#34887)

2024-05-15 19:01:18 +08:00

postgres/sql

[decimal](test case) porting postgres regression test cases (#26836)

2023-11-13 10:06:43 +08:00

prepared_stmt_p0

[Feature](PreparedStatement) implement general server side prepared (#33807)

2024-05-10 22:10:11 +08:00

query/regexp

…

query_p0

[fix](nereids) set mark join reference for bitmap-in-apply (#35435)

2024-05-28 13:13:41 +08:00

query_p1

[improve](function) add limit check for lpad/rpad function input big value of length (#34810)

2024-05-21 12:54:25 +08:00

query_p2

…

rollup

[Fix](Planner) fix varchar does not show real length (#25171)

2023-11-14 10:49:21 +08:00

rollup_p0

[Bug](stream-load) fix stream load failed on table with rollup (#29665)

2024-01-12 11:46:29 +08:00

schema_change

[fix](transaction) Fix concurrent schema change and txn cause dead lock (#26428)

2023-11-13 21:39:28 +08:00

schema_change_p0

[bugfix] Fix the case is unstable because Table[tbl_scalar_types_dup]'s state(ROLLUP) is not NORMAL (#35460)

2024-05-28 13:12:27 +08:00

schema_change_p2

[feature](regression) Add p2 level test for schema change (#20243)

2023-09-15 10:39:07 +08:00

segcompaction_p2

[fix](inverted index) Fix inverted index for MOR unique table #31051 (#31354)

2024-02-23 23:10:36 +08:00

show_p0

[feat](nereids) support create view in nereids (#32743)

2024-04-17 23:42:00 +08:00

spill_p0

[fix] fix wrong result of spill agg with limit (#35403)

2024-05-28 13:12:03 +08:00

sql_block_rule_p0

…

ssb_sf0.1_p1/sql

…

ssb_sf1_p2/sql

…

ssb_sf100_p2/sql

[Chore](case) add case of join with big hashtable (#27825)

2023-12-01 15:32:23 +08:00

ssb_unique_sql_zstd_p0

[bug](partition_sort)partition sort need sort all data in two phase global (#24960)

2023-10-08 10:46:43 +08:00

statistics

[test](statistics)Add analyze mtmv test case (#30847)

2024-02-16 10:12:23 +08:00

statistics_p1

…

topn_optimize

(topN)runtime_predicate is only triggered when the column name is obtained (#28419)

2023-12-21 18:08:23 +08:00

tpcds_sf1_p1

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf1_unique_p1

check stats and log memo for ds46 (#28396)

2023-12-22 14:50:11 +08:00

tpcds_sf100_dup_without_key_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf1000_p2/sql

…

tpch_sf0.1_p1/sql

[fix](nereids)when clause cannot be regarded as common sub expression (#33358)

2024-04-12 15:09:25 +08:00

tpch_sf0.1_unique_p1/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf1_p1

…

tpch_sf1_p2

…

tpch_sf1_unique_p1/sql

…

tpch_sf1_unique_p2/sql

…

tpch_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf100_unique_sql_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_unique_sql_zstd_bucket1_p0/sql

[pipelineX](scan) ignore storage data distribution by default (#29192)

2023-12-28 14:54:09 +08:00

tpch_unique_sql_zstd_p0/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

trino_p0

…

types

[Feature](datatype) Add IPv4/v6 data type for doris (#24965)

2023-10-26 17:33:28 +08:00

types_p0/unsigned

[feature](merge-on-write) enable merge-on-write by default again (#28105)

2023-12-14 19:35:52 +08:00

unique_with_mow_p0

[fix](partial update) only unique table with MOW insert with target columns can consider be a partial update (#33656)

2024-05-07 07:53:25 +08:00

unique_with_mow_p2

[feature-wip](merge-on-write) MOW table support different primary keys and sort keys (#24788)

2023-11-24 16:37:30 +08:00

update

[Fix](partial-update) Fix wrong column number passing to BE when partial and enable nereids (#31461)

2024-03-09 19:45:42 +08:00

variable_p0

[feature](variable) add read_only and super_read_only (#33795)

2024-04-19 15:02:21 +08:00

variant_github_events_p0

[regression-test](Variant) add order by to make test stable (#33014) (#33039)

2024-03-29 17:25:26 +08:00

variant_github_events_p0_new

[bug](distinct agg) fix distinct streaming agg not output all data (#32760)

2024-03-26 20:19:36 +08:00

variant_p0

[Fix](Json type) correct cast result for json type (#34764)

2024-05-18 18:40:17 +08:00

variant_p2

[regression-test](variant) fix unstable query result m… (#28390)

2023-12-15 10:52:50 +08:00

view_p0

[Fix](planner) fix create view star except and modify cast to sql (#33726)

2024-04-19 15:02:49 +08:00

with_clause_p0/sql

…

workload_manager_p0

[Fix](executor)Fix workload reg test #35082

2024-05-20 20:36:29 +08:00

yandex_metrica_p2

…