amory 9b07cd2069 [pick](json-serde)pick jsonb string deserialize with spec char (#38711) ...

## Proposed changes
backport: https://github.com/apache/doris/pull/37176
Issue Number: close #xxx

<!--Describe your changes.-->

2024-08-02 13:37:41 +08:00

..

account_p0

…

auth_p0

[fix](auth)fix missing authentication (#33347) (#33956)

2024-04-22 13:52:36 +08:00

backup_restore

[case](regression) Backup & restore with view (#29573)

2024-01-07 00:03:22 +08:00

bitmap_functions

…

bloom_filter_p0

[WIP](test) remove enable_nereids_planner in regression cases (part 2) (#34490)

2024-05-10 22:02:32 +08:00

brown_p2/sql

…

cast_decimal_to_boolean

…

cast_double_to_decimal

…

catalog_recycle_bin_p0

[fix](catalog recycle bin) Forbid recover partition if table schame is changed #31146

2024-02-21 13:53:18 +08:00

clone_p0

[fix](decommission) fix cann't decommission mtmv (#33823)

2024-04-25 12:01:44 +08:00

compaction

[cherry-pick](branch-2.1) Pick "[Fix](delete command) Mark delete sign when do delete command in MoW table (#35917)" (#37594)

2024-07-15 18:54:01 +08:00

compression_p0

…

compression_p1

…

connector_p0/spark_connector

[feature](serde) support presto compatible output format (#37039) (#37253)

2024-07-04 13:56:05 +08:00

correctness

[branch-2.1](function) fix FE impl of some time functions (#37746) (#38316)

2024-07-25 11:38:27 +08:00

correctness_p0

[fix](nereids)check functionBuilders is not null before using it (#38535)

2024-07-31 11:00:39 +08:00

csv_header_p0

…

data_model_p0

[cherry-pick](branch-2.1) Pick "[Enhancement](partial update) Add some partial update case (#36385)" (#37382)

2024-07-09 10:52:04 +08:00

database_p0

[regression](fe) Add more regression test for FE (#25976)

2023-10-27 10:27:22 +08:00

datatype_p0

[pick](case) fix one_nested_types cases (#38723)

2024-08-02 12:07:14 +08:00

datatype_p2

…

ddl_p0

[Fix](nereids) add backquote and qualifier to udf, column, column alias and table alias when create view (#37237) (#37984)

2024-07-19 00:56:26 +08:00

decimalv3/tpch_sf0.1_p1/sql

…

delete_p0

[fix](delete) Incorrect precision detection for the decimal type in condition.​ (#37801) (#37904)

2024-07-16 19:02:02 +08:00

demo_p0

[enhancement](regression test) stream load support direct load to be (#26829)

2023-11-13 10:07:10 +08:00

empty_relation

[opt](Nereids) add where Null rule to create empty relation as where false (#38135) (#38361)

2024-07-26 14:50:06 +08:00

export

[feature](serde) support presto compatible output format (#37039) (#37253)

2024-07-04 13:56:05 +08:00

export_p0

[Fix](outfile) FE check the hdfs URI of outfile (#38602)

2024-07-31 22:46:37 +08:00

export_p2

[Fix](outfile) FE check the hdfs URI of outfile (#38602)

2024-07-31 22:46:37 +08:00

external_table_p0

[bugfix](paimon)Fixed the reading of timestamp with time zone type data for 2.1 (#37716) (#38592)

2024-08-01 10:23:06 +08:00

external_table_p2

[bugfix](hudi)add timetravel for nereids for 2.1 (#38324) (#38582)

2024-08-01 11:37:57 +08:00

fault_injection_p0

[Update](inverted index) Add column name to debug point for "no need to read data" optimization #37649 (#38579)

2024-07-31 19:17:46 +08:00

flink_connector_p0

[test](regression) add flink sync db case (#19328)

2023-12-14 17:06:17 +08:00

function_p0

[fix](nereids)fix nullable property of ForEachCombinator (#37980)

2024-07-17 13:48:21 +08:00

github_events_p2

…

index_p0

[fix](nereids)change the decimal's precision and scale for cast(xx as decimal) (#36540)

2024-06-20 17:46:11 +08:00

insert_overwrite_p0

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_overwrite_p1

[branch-2.1](auto-partition) pick auto partition and some more prs (#33523)

2024-04-11 17:12:17 +08:00

insert_p0

[fix](group commit) Fix prepare stmt setNull return too many filtered rows error (#38262) (#38276)

2024-07-24 19:02:59 +08:00

insert_p2

[fix](group commit) Fix p2 regression-test (#32270)

2024-03-21 14:07:24 +08:00

inverted_index_p0

[test](inverted index)Add cases for inverted index format v2 (#38132)(#38443) (#38222)

2024-08-02 12:04:26 +08:00

inverted_index_p1

[cherry-pick](branch-2.1) fix inverted index file size (#37836)

2024-07-16 11:28:47 +08:00

inverted_index_p2

[FIX] Pick array inverted index bugfix (#35837)

2024-06-06 09:54:14 +08:00

javaudf_p0

[case](restart_fe) add demo case for restart_fe test (#37091) (#37313)

2024-07-15 19:42:20 +08:00

json_p0

[improve](json)improve json support empty keys #36762 (#37351)

2024-07-08 19:04:51 +08:00

jsonb_p0

[pick](json-serde)pick jsonb string deserialize with spec char (#38711)

2024-08-02 13:37:41 +08:00

load/insert

[fix](transaction) Fix publish txn wait too long when not meet quorum (#26659)

2023-11-10 14:55:26 +08:00

load_p0

[pick](simdjson) fix simdjson with object array when jsonroot is not empty (#38633)

2024-08-01 11:04:54 +08:00

load_p1

[case](regression) using load_parallelism when load csv and json from s3 (#27525)

2023-12-03 09:56:47 +08:00

load_p2/broker_load

[fix](test) fix case conflict between test_tvf_based_broker_load and test_broker_load #37622 (#37631)

2024-07-11 17:52:21 +08:00

manager

[Test](manager_interface)append manager interface test. (#35889) (#36912)

2024-06-28 18:38:33 +08:00

map_p0

…

migrate_p0

[fix](migrate disk) fix migrate disk lost data during publish version (#29887)

2024-01-16 18:37:06 +08:00

mtmv_p0

[feature](mtmv) pick some mtmv pr from master (#37651)

2024-07-12 10:35:54 +08:00

mv_p0

[Bug](query) fix meet invalid column when direct scan on mow mv (#37806)

2024-07-15 18:29:30 +08:00

mysql_fulltext

…

mysqldump_p0

…

nereids_arith_p0

[fix](Nereids) decimalv2 and int/date bit arithmetic need cast to bigint (#32311)

2024-03-21 14:07:49 +08:00

nereids_broadcast_shuffle_join

[fix](nereids) make runtime filter targets in fixed order (#33191)

2024-04-10 16:22:39 +08:00

nereids_clickbench_shape_p0

[feat](Nereids): rewrite sum literal to sum and count (#32244)

2024-03-22 16:35:47 +08:00

nereids_function_p0

[cherry-pick](branch-21) fix collect_set function core dump without arena pool (#38234) (#38307)

2024-07-25 12:05:52 +08:00

nereids_hint_tpcds_p0/shape

[test](Nereids) Add all hint tpcds tests (#38081) (#38368)

2024-07-31 10:24:10 +08:00

nereids_hint_tpch_p0/shape

[Fix](Nereids) fix leading with brace can not generate correct plan (#36328)

2024-06-19 14:47:55 +08:00

nereids_p0

[cherry-pick](branch-21) fix conv function get wrong result as parse overflow (#38001) (#38309)

2024-07-25 12:06:46 +08:00

nereids_rules_p0

[Fix](test) fix pull up literal predicate regression (#38564)

2024-07-31 22:59:08 +08:00

nereids_ssb_shape_sf100_p0/shape

[Nereids](Nereids): fix shape change in nereids regression test (#35488)

2024-05-31 10:53:12 +08:00

nereids_syntax_p0

[fix](nereids)subquery unnesting get wrong result if correlated conjuncts is not slot_a = slot_b (#37683)

2024-07-16 15:06:40 +08:00

nereids_tpcds_shape_sf100_p0

[fix](nereids) refine row count estimation for mark join (#38270) (#38297)

2024-07-25 10:19:13 +08:00

nereids_tpcds_shape_sf1000_p0

[fix](nereids) refine row count estimation for mark join (#38270) (#38297)

2024-07-25 10:19:13 +08:00

nereids_tpch_p0/tpch

Revert "[fix](nereids) push filter through window, using slot equal-set (#35361)" (#35541)

2024-05-28 17:54:13 +08:00

nereids_tpch_shape_sf1000_p0

[mv](nereids) mv cost related PRs (#35652 #35701 #35864 #36368 #36789 #34970) (#37097)

2024-07-04 09:42:11 +08:00

opensky_p2/sql

…

partition_p0

[testcases](auto-partition) Add and fix testcases in P0 #33588

2024-04-17 23:42:11 +08:00

partition_p1/auto_partition/sql

[branch-2.1](auto-partition) Fix auto partition load failure in multi replica (#36586)

2024-06-20 17:51:18 +08:00

performance_p0

[Feat](nereids)when dealing insert into stmt with empty table source, fe returns directly (#35333)

2024-05-24 16:25:00 +08:00

pipeline_p0/local_shuffle

[Fix](Nereids) fix pipelineX distribute expr list with child output expr ids (#29621)

2024-01-08 10:46:27 +08:00

plsql_p0

[fix](plsql) Fix regression test for routine select (#33860)

2024-04-19 23:41:46 +08:00

point_query_p0

[Fix](Short Circuit) fix no project list in OlapScanNode (#37121) (#37504)

2024-07-11 10:04:28 +08:00

postgres/sql

[decimal](test case) porting postgres regression test cases (#26836)

2023-11-13 10:06:43 +08:00

prepared_stmt_p0

[Fix](Prepared Statment) use fixed charset to init StringLiteral (#37084)

2024-07-01 23:11:13 +08:00

query/regexp

…

query_p0

[Bug](fix) fix ubsan use int32_t pointer access bool value (#38621)

2024-08-01 13:52:12 +08:00

query_p1

[improve](function) add limit check for lpad/rpad function input big value of length (#34810)

2024-05-21 12:54:25 +08:00

query_p2

[Bug](join) avoid overflow on bucket_size+1 (#37807)

2024-07-15 18:47:36 +08:00

rollup

[Fix](Planner) fix varchar does not show real length (#25171)

2023-11-14 10:49:21 +08:00

rollup_p0

[branch-2.1](mtmv) Support read sync materialized view in async materialized view (#38462)

2024-07-31 22:32:28 +08:00

schema_change

[branch-2.1] Picks "[Fix](schema change) Fix can't do reorder column schema change for MOW table and duplicate key table #37067" (#37226)

2024-07-03 22:42:51 +08:00

schema_change_p0

[enhancement](regression-test) sync unique case to 2.1 (#37272)

2024-07-16 16:59:33 +08:00

schema_change_p2

…

segcompaction_p2

[fix](inverted index) Fix inverted index for MOR unique table #31051 (#31354)

2024-02-23 23:10:36 +08:00

show_p0

[Fix](nereids) add backquote and qualifier to udf, column, column alias and table alias when create view (#37237) (#37984)

2024-07-19 00:56:26 +08:00

spill_p0

[fix] fix wrong result of spill agg with limit (#35403)

2024-05-28 13:12:03 +08:00

sql_block_rule_p0

…

ssb_sf0.1_p1/sql

…

ssb_sf1_p2/sql

…

ssb_sf100_p2/sql

[Chore](case) add case of join with big hashtable (#27825)

2023-12-01 15:32:23 +08:00

ssb_unique_sql_zstd_p0

…

statistics

[test](statistics)Add analyze mtmv test case (#30847)

2024-02-16 10:12:23 +08:00

statistics_p1

…

topn_optimize

(topN)runtime_predicate is only triggered when the column name is obtained (#28419)

2023-12-21 18:08:23 +08:00

tpcds_sf1_p1

[opt](spill) add session variable of 'enable_force_spill' (#34664) (#35561)

2024-05-29 09:57:31 +08:00

tpcds_sf1_unique_p1

check stats and log memo for ds46 (#28396)

2023-12-22 14:50:11 +08:00

tpcds_sf100_dup_without_key_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpcds_sf1000_p2/sql

…

tpch_sf0.1_p1/sql

[fix](nereids)when clause cannot be regarded as common sub expression (#33358)

2024-04-12 15:09:25 +08:00

tpch_sf0.1_unique_p1/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf1_p1

…

tpch_sf1_p2

…

tpch_sf1_unique_p1/sql

…

tpch_sf1_unique_p2/sql

…

tpch_sf100_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_sf100_unique_sql_p2/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

tpch_unique_sql_zstd_bucket1_p0/sql

[pipelineX](scan) ignore storage data distribution by default (#29192)

2023-12-28 14:54:09 +08:00

tpch_unique_sql_zstd_p0/sql

[improvement](decimal) use new way for decimal arithmetic precision promotion (#27787)

2023-12-05 12:54:40 +08:00

trino_p0

…

types

[Feature](datatype) Add IPv4/v6 data type for doris (#24965)

2023-10-26 17:33:28 +08:00

types_p0/unsigned

[feature](merge-on-write) enable merge-on-write by default again (#28105)

2023-12-14 19:35:52 +08:00

unique_with_mow_p0

[fix](partial-update) insert only without auto_inc column should not use partial update (#38229) (#38504)

2024-07-31 11:01:08 +08:00

unique_with_mow_p2

[feature-wip](merge-on-write) MOW table support different primary keys and sort keys (#24788)

2023-11-24 16:37:30 +08:00

update

[cherry-pick](branch-2.1) Pick "[Enhancement](partial update) Add some partial update case (#36385)" (#37382)

2024-07-09 10:52:04 +08:00

variable_p0

[feature](variable) add read_only and super_read_only (#33795)

2024-04-19 15:02:21 +08:00

variant_github_events_new_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_github_events_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_log_data_p2

[Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037)

2024-07-18 16:53:09 +08:00

variant_p0

[Pick](Variant) pick some fix #38413 #38364 (#38512)

2024-07-31 11:03:31 +08:00

variant_p2

[regression-test](variant) fix unstable query result m… (#28390)

2023-12-15 10:52:50 +08:00

view_p0

[fix](planner) fix bug of select stmt toSql(#37274) (#37344)

2024-07-09 20:34:57 +08:00

with_clause_p0/sql

…

workload_manager_p0

[Fix](executor)Fix workload reg test #35082

2024-05-20 20:36:29 +08:00

yandex_metrica_p2

…