Calvin Kirs f9b79c613a [Fix](Job)Replaying logs should not modify the original information of the job (#40474) (#40808) ...

…

## Proposed changes
```
        JobExecutionConfiguration jobConfig = new JobExecutionConfiguration();
        jobConfig.setExecuteType(JobExecuteType.INSTANT);
        setJobConfig(jobConfig);
```
- Replaying logs should not modify the original information of the job
- Use the new optimizer to check whether the executed statement is legal

(cherry picked from commit de90051162de7004cf171bbf4d21bd95ff9f3540)

## Proposed changes

Issue Number: #40474

2024-09-13 20:47:57 +08:00

..

account_p0

…

alter_p1

[fix](fe) LIST partition table support modify default bucket num (#39688)

2024-08-23 11:52:16 +08:00

auth_p0

[fix](auth)fix missing authentication (#33347) (#33956)

2024-04-22 13:52:36 +08:00

backup_restore

[chore](backup) Fix the db name of the restored view (#38072)

2024-08-26 14:12:47 +08:00

bitmap_functions

…

bloom_filter_p0

[improve](ip)update ip for bloom_filter (#39414)

2024-08-16 08:20:19 +08:00

brown_p2/sql

…

cast_decimal_to_boolean

…

cast_double_to_decimal

…

catalog_recycle_bin_p0

[fix](catalog recycle bin) Forbid recover partition if table schame is changed #31146

2024-02-21 13:53:18 +08:00

clone_p0

[fix](decommission) fix cann't decommission mtmv (#33823)

2024-04-25 12:01:44 +08:00

compaction

[fix](cluster key) forbid cluster key and remove case (#39679)

2024-08-21 14:31:54 +08:00

compression_p0

…

compression_p1

…

connector_p0/spark_connector

[feature](serde) support presto compatible output format (#37039) (#37253)

2024-07-04 13:56:05 +08:00

correctness

[fix](scan) fix predicate contains cast that results in null, the pr… (#39809)

2024-08-23 01:46:22 +08:00

correctness_p0

[Cherry-pick](branch-2.1) Pick "[Featrue](default value) Support bitmap_empty default value (#40364)" (#40487)

2024-09-09 16:57:38 +08:00

csv_header_p0

…

data_model_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

database_p0

…

datatype_p0

[fix](funcs) fix map struct construct funcs (#39973)

2024-08-27 18:31:51 +08:00

datatype_p2

…

ddl_p0

[chore](nereids) Added compatibility with mysql alias filter (#39738)

2024-08-22 14:36:14 +08:00

decimalv3/tpch_sf0.1_p1/sql

…

delete_p0

[cherry-pick](branch-2.1) fix delete random distributed tbl (#39830)

2024-08-23 17:17:05 +08:00

demo_p0

…

empty_relation

[opt](Nereids) add where Null rule to create empty relation as where false (#38135) (#38361)

2024-07-26 14:50:06 +08:00

export

[feature](serde) support presto compatible output format (#37039) (#37253)

2024-07-04 13:56:05 +08:00

export_p0

[fix](parquet)Fix the be core issue when reading parquet unsigned types. (#39926) (#40123)

2024-08-29 21:52:52 +08:00

export_p2

[Fix](outfile) FE check the hdfs URI of outfile (#38602)

2024-07-31 22:46:37 +08:00

external_table_p0

[bugfix](hive/iceberg)align with Hive insert overwrite table functionality (#39840) (#40724)

2024-09-12 19:20:15 +08:00

external_table_p2

[bugfix](hudi)add timetravel for nereids for 2.1 (#38324) (#38582)

2024-08-01 11:37:57 +08:00

fault_injection_p0

[opt](inverted index) Controls whether the in_list can execute fast_execute. (#40141)

2024-08-30 10:32:43 +08:00

flink_connector_p0

[test](regression) add flink sync db case (#19328)

2023-12-14 17:06:17 +08:00

function_p0

[fix](nereids)fix nullable property of ForEachCombinator (#37980)

2024-07-17 13:48:21 +08:00

github_events_p2

…

index_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

insert_overwrite_p0

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_overwrite_p1

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_p0

[cherry-pick](branch-2.1) Pick "[Enhancement](txn) Block new insert into if schema change happens during transaction (#39483)" (#40115)

2024-08-30 10:01:10 +08:00

insert_p2

[fix](group commit) Fix p2 regression-test (#32270)

2024-03-21 14:07:24 +08:00

inverted_index_p0

[fix](inverted index) Fix match_regexp to correctly handle empty string patterns (#40659)

2024-09-11 18:10:33 +08:00

inverted_index_p1

[test](inverted index) add test for need read data opt (#38261) (#39534)

2024-08-21 09:01:12 +08:00

inverted_index_p2

[regression-test](cases) optimize some cases (#40240)

2024-09-02 14:50:48 +08:00

javaudf_p0

[Bug](expr) execute expr should use local states instead of operators (#40189) (#40219)

2024-09-01 00:41:10 +08:00

job_p0/job_meta

[Fix](Job)Replaying logs should not modify the original information of the job (#40474) (#40808)

2024-09-13 20:47:57 +08:00

json_p0

[Fix](Json) fix some cast issue (#38683) (#39025)

2024-08-07 22:05:43 +08:00

jsonb_p0

[Fix](Json) fix some cast issue (#38683) (#39025)

2024-08-07 22:05:43 +08:00

load/insert

…

load_p0

[opt](routine load) support routine load perceived schema change (#39412) (#40508)

2024-09-10 11:05:58 +08:00

load_p1

…

load_p2/broker_load

[fix](test) fix case conflict between test_tvf_based_broker_load and test_broker_load #37622 (#37631)

2024-07-11 17:52:21 +08:00

manager

[Test](manager_interface)append manager interface test. (#35889) (#36912)

2024-06-28 18:38:33 +08:00

map_p0

…

migrate_p0

[fix](migrate disk) fix migrate disk lost data during publish version (#29887)

2024-01-16 18:37:06 +08:00

mtmv_p0

[fix](mtmv)fix nested mtmv not refresh (#40433) (#40560)

2024-09-10 11:51:41 +08:00

mtmv_up_down_olap_p0

[fix](mtmv)fix nested mtmv not refresh (#40433) (#40560)

2024-09-10 11:51:41 +08:00

mv_p0

revert [improvement](mv) Support to use cast when create sync materialized view #38008 (#39378)

2024-08-15 14:16:57 +08:00

mysql_fulltext

…

mysql_fulltext_array_contains

[fix](cases) array contains with index cases (#39087)

2024-08-09 04:06:47 +08:00

mysqldump_p0

…

nereids_arith_p0

[Bug](predicate) fix wrong result of AcceptNullPredicate (#39497) (#39672)

2024-08-22 00:24:57 +08:00

nereids_broadcast_shuffle_join

[fix](nereids) make runtime filter targets in fixed order (#33191)

2024-04-10 16:22:39 +08:00

nereids_clickbench_shape_p0

[feat](Nereids): rewrite sum literal to sum and count (#32244)

2024-03-22 16:35:47 +08:00

nereids_function_p0

[branch-2.1](function) fix random_bytes return same data for multi rows (#39891) (#40137)

2024-08-30 10:43:42 +08:00

nereids_hint_tpcds_p0/shape

[opt](nereids) refine left semi/anti cost under short-cut opt (#39636)

2024-08-23 17:26:56 +08:00

nereids_hint_tpch_p0/shape

[Fix](Nereids) fix leading with brace can not generate correct plan (#36328)

2024-06-19 14:47:55 +08:00

nereids_p0

[opt](Nereids) fix several insert into related issues (#40467) (#40755)

2024-09-13 10:19:56 +08:00

nereids_rules_p0

[test](mtmv) SSB mv rewrite test use little data set for test performance (#40188) (#40437)

2024-09-09 11:23:47 +08:00

nereids_ssb_shape_sf100_p0/shape

[Nereids](Nereids): fix shape change in nereids regression test (#35488)

2024-05-31 10:53:12 +08:00

nereids_syntax_p0

[chore](nereids) Added compatibility with mysql alias conflict (#38104) (#38440)

2024-08-22 14:37:49 +08:00

nereids_tpcds_shape_sf100_p0

[fix](nereids) fix bug for A>n, where A.max is infinity #39936 (#40368)

2024-09-05 08:33:04 +08:00

nereids_tpcds_shape_sf1000_p0

[fix](nereids) fix bug for A>n, where A.max is infinity #39936 (#40368)

2024-09-05 08:33:04 +08:00

nereids_tpch_p0/tpch

Revert "[fix](nereids) push filter through window, using slot equal-set (#35361)" (#35541)

2024-05-28 17:54:13 +08:00

nereids_tpch_shape_sf1000_p0

[opt](nereids) refine left semi/anti cost under short-cut opt (#39636)

2024-08-23 17:26:56 +08:00

opensky_p2/sql

…

partition_p0

[branch-2.1](partition) Support use Auto and Dynamic partition at the same time (#39580) (#40649)

2024-09-11 15:35:20 +08:00

partition_p1/auto_partition/sql

[branch-2.1](auto-partition) Fix auto partition load failure in multi replica (#36586)

2024-06-20 17:51:18 +08:00

performance_p0

[Feat](nereids)when dealing insert into stmt with empty table source, fe returns directly (#35333)

2024-05-24 16:25:00 +08:00

pipeline_p0/local_shuffle

[Fix](Nereids) fix pipelineX distribute expr list with child output expr ids (#29621)

2024-01-08 10:46:27 +08:00

plsql_p0

[fix](plsql) Fix regression test for routine select (#33860)

2024-04-19 23:41:46 +08:00

point_query_p0

[Fix](ShortCircuit) consider delete sign flag when hits row (#40300) (#40408)

2024-09-09 10:04:05 +08:00

postgres/sql

…

prepared_stmt_p0

[Fix](Prepared Statment) use fixed charset to init StringLiteral (#37084)

2024-07-01 23:11:13 +08:00

query/regexp

…

query_p0

[fix](nereids) build agg for random distributed agg table in bindRelation phase (#40181) (#40702)

2024-09-12 14:08:50 +08:00

query_p1

[improve](function) add limit check for lpad/rpad function input big value of length (#34810)

2024-05-21 12:54:25 +08:00

query_p2

[Bug](join) avoid overflow on bucket_size+1 (#37807)

2024-07-15 18:47:36 +08:00

rollup

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

rollup_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

schema_change

[branch-2.1] Picks "[Fix](schema change) Fix can't do reorder column schema change for MOW table and duplicate key table #37067" (#37226)

2024-07-03 22:42:51 +08:00

schema_change_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

schema_change_p2

…

segcompaction_p2

[fix](inverted index) Fix inverted index for MOR unique table #31051 (#31354)

2024-02-23 23:10:36 +08:00

show_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

spill_p0

[fix] fix wrong result of spill agg with limit (#35403)

2024-05-28 13:12:03 +08:00

sql_block_rule_p0

…

ssb_sf0.1_p1/sql

…

ssb_sf1_p2/sql

…

ssb_sf100_p2/sql

…

ssb_unique_sql_zstd_p0

…

statistics

[test](statistics)Add analyze mtmv test case (#30847)

2024-02-16 10:12:23 +08:00

statistics_p1

…

topn_optimize

(topN)runtime_predicate is only triggered when the column name is obtained (#28419)

2023-12-21 18:08:23 +08:00

tpcds_sf1_p1

[opt](spill) add session variable of 'enable_force_spill' (#34664) (#35561)

2024-05-29 09:57:31 +08:00

tpcds_sf1_unique_p1

check stats and log memo for ds46 (#28396)

2023-12-22 14:50:11 +08:00

tpcds_sf100_dup_without_key_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf1000_p2/sql

…

tpch_sf0.1_p1/sql

[fix](nereids)when clause cannot be regarded as common sub expression (#33358)

2024-04-12 15:09:25 +08:00

tpch_sf0.1_unique_p1/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf1_p1

…

tpch_sf1_p2

…

tpch_sf1_unique_p1/sql

…

tpch_sf1_unique_p2/sql

…

tpch_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf100_unique_sql_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_unique_sql_zstd_bucket1_p0/sql

[pipelineX](scan) ignore storage data distribution by default (#29192)

2023-12-28 14:54:09 +08:00

tpch_unique_sql_zstd_p0/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

trino_p0

…

types

…

types_p0/unsigned

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

unique_with_mow_p0

[branch-2.1] Picks "[Opt](delete) Skip newly inserted rows check in non-strict mode partial update if the row's delete sign is marked #40322" (#40383)

2024-09-09 16:32:24 +08:00

unique_with_mow_p2/ssb_unique_sql_zstd/sql

[fix](cluster key) forbid cluster key and remove case (#39679)

2024-08-21 14:31:54 +08:00

update

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

variable_p0

[feature](variable) add read_only and super_read_only (#33795)

2024-04-19 15:02:21 +08:00

variant_github_events_new_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_github_events_p2

[pick](Variant) variant fallthrough with inverted index (#40070)

2024-08-29 00:30:37 +08:00

variant_log_data_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_p0

[Fix](Variant) use uinque id to access column reader (#39841) (#40269)

2024-09-09 18:01:12 +08:00

variant_p1/compaction

[regression-test](cases) optimize some cases (#40240)

2024-09-02 14:50:48 +08:00

variant_p2

[regression-test](variant) fix unstable query result m… (#28390)

2023-12-15 10:52:50 +08:00

view_p0

[fix](compatibility) type toSql should return lowercase string (#38012) (#38517)

2024-08-09 11:35:42 +08:00

with_clause_p0/sql

…

workload_manager_p0

[branch-2.1]Pick IO limit/workload group usage table (#39839)

2024-08-23 18:51:47 +08:00

yandex_metrica_p2

…