ElvinWei fae2e5fd22 [enchancement](statistics) implement automatically analyzing statistics and support table level statistics #19420 ...

Add table level statistics, support SHOW TABLE STATS statement to show table level statistics.
Implement automatically analyze statistics, support ANALYZE... WITH AUTO ... statement to automatically analyze statistics.
TODO:

collate relevant p0 tests
Supplement the design description to README.md
Issue Number: close #xxx

2023-05-10 11:47:34 +08:00

..

account_p0

[Enhance](auth)Users support multiple roles (#17236)

2023-03-07 10:28:56 +08:00

bitmap_functions

[fix](planner) Keep type of null literal expr when register conjuncts (#15878)

2023-01-17 16:48:02 +08:00

bloom_filter_p0

[Enchancement](compatible) show dateV2/datetimeV2 to date/datetime (#18358)

2023-04-09 10:34:14 +08:00

brown_p2/sql

Revert "[test](pipeline) Run nereids cases in p1/p2 (#16130)" (#16792)

2023-02-17 18:48:27 +08:00

cast_double_to_decimal

[fix](type) Data precision is lost when converting DOUBLE type data to DECIMAL (#17191) (#17562)

2023-03-28 09:46:43 +08:00

compaction

[test](compaction) add delete test (#18335)

2023-04-04 12:28:19 +08:00

connector_p0/spark_connector

[regression-test](spark-connector) Add the regression case of the spark doris connector (#14877)

2023-01-18 16:41:41 +08:00

correctness

[fix](function) Support more behaviors of cast time in MySQL

2023-04-26 07:49:54 +08:00

correctness_p0

[fix](sequence-column) Fix sequence_col column used default expr insert failed (#18933)

2023-05-08 17:18:25 +08:00

csv_header_p0

[Regression](datev2) Add test cases for datev2/datetimev2 (#11831)

2022-08-19 10:57:55 +08:00

data_model_p0

[Enchancement](compatible) show dateV2/datetimeV2 to date/datetime (#18358)

2023-04-09 10:34:14 +08:00

datatype_p0

Revert "[refactor](function) ignore DST for function from_unixtime (#19151)" (#19333)

2023-05-06 16:33:58 +08:00

datatype_p2

[FIX](Map)fix calculate map offset in olap convertor (#18295)

2023-04-07 17:04:08 +08:00

datev2

[fix-core](block) clear block row_same_bit when block reuse (#16172)

2023-02-10 12:21:27 +08:00

ddl_p0

(fix)[olap] not support in_memory=true now (#18731)

2023-04-21 21:55:37 +08:00

decimalv3

[regression](decimalv3)Add decimal type as filter condition in regression test (#17160)

2023-04-03 14:20:09 +08:00

delete_p0

[Bug](delete) Fix bug of delete partition prune error (#18057)

2023-03-24 20:22:12 +08:00

demo_p0

[Bug](sort)fix merge sorter might div zero when block bytes less than block rows (#15859)

2023-01-13 18:33:40 +08:00

dynamic_table_p0

[refactor](config) Delete the environment variable enable_vectorized_engine (#18166)

2023-04-07 14:23:16 +08:00

es_p0

[BugFix](DOE) Add http prefix when it's not set in hosts properties. (#17745)

2023-03-21 10:08:20 +08:00

export

[vectorized](bug) fix some case in enable fold constant (#17997)

2023-03-31 11:41:31 +08:00

export_p0

[Regression-test](Export) add regression test for export #18897

2023-04-23 19:43:22 +08:00

export_p2

[Enhencement](Export) add property for outfile/export and add test (#18997)

2023-05-08 14:02:20 +08:00

external_catalog_p0

[Test](multi-catalog) Fix test_hive_parquet regression test order issue. (#18879)

2023-04-21 22:59:34 +08:00

external_table_emr_p2

[Fix](multi catalog)Fix Hive partition path doesn't contain partition value case bug (#19053)

2023-04-26 17:18:51 +08:00

flink_connector_p0

[regression](flink)add flink doris connector case (#15676)

2023-01-10 17:25:06 +08:00

github_events_p2/sql

Revert "[test](pipeline) Run nereids cases in p1/p2 (#16130)" (#16792)

2023-02-17 18:48:27 +08:00

index_p0

[Enchancement](compatible) show dateV2/datetimeV2 to date/datetime (#18358)

2023-04-09 10:34:14 +08:00

insert_p0

[Bug](DECIMALV3) report failure if a decimal value is overflow (#18336)

2023-04-17 13:18:14 +08:00

inverted_index_p0

[bugfix](inverted index) fix inverted index to support NULL value filter (#18302)

2023-04-15 13:20:26 +08:00

inverted_index_p1/tpcds_sf1_index/sql

[fix](regression) fix inverted_index_p1 q72.sql timeout error (#19241)

2023-05-04 11:05:15 +08:00

javaudf_p0

[vectorized](udaf) fix java-udaf case is unstable with fuzzy mode #18146

2023-03-28 09:30:49 +08:00

jdbc_catalog_p0

[feature](multi-catalog) Rename multi-catalog config 'specified_database_list' to 'include_database_list', and introduce new multi-catalog config 'exclude_database_list' (#18834)

2023-05-04 09:30:02 +08:00

jdbc_p0

[vectorzied](jdbc) refactor jdbc table read array type (#18187)

2023-04-04 11:57:04 +08:00

jsonb_p0

[feature](json) add json_extract function (#17808)

2023-03-27 21:19:47 +08:00

load/insert

[Improve](complex-type) Support Count(complexType) (#17868)

2023-03-30 15:43:32 +08:00

load_p0

[bug](map-type)fix some bugs in map and map element function (#18935)

2023-04-26 22:10:15 +08:00

load_p1/stream_load

[fix](stream-load) find line delimiter in csv should start with no offset (#18161)

2023-03-30 14:42:34 +08:00

load_p2/broker_load

[fix](test)Move broker test to p2. Move test data to cos in Beijing region (#18893)

2023-04-21 22:15:52 +08:00

map_p0

[Feature](map-type) Support stream load and fix some bugs for map type (#16776)

2023-02-19 15:11:54 +08:00

mtmv_p0

[fix](MTMV) Tasks leak when dropping job (#17984)

2023-03-21 23:22:17 +08:00

mv_p0

[feature-wip](mv lifecycle) separate life cycle of base table and its materialized views (#19210)

2023-04-30 17:42:02 +08:00

mysql_fulltext

[refactor](config) Delete the environment variable enable_vectorized_engine (#18166)

2023-04-07 14:23:16 +08:00

mysqldump_p0

[Enchancement](mysql-compatable) add regression-test for MySQLdump #18208

2023-04-03 09:49:07 +08:00

nereids_arith_p0

[Bug](DECIMALV3) report failure if a decimal value is overflow (#18336)

2023-04-17 13:18:14 +08:00

nereids_datev2_p1/tpch

[fix](nereids) fix bug in multiply return data type (#15949)

2023-01-20 11:44:24 +08:00

nereids_function_p0

[Improve](GEO)wkb input and output are represented as hexadecimal strings And delete EWKB (#18721)

2023-04-21 15:11:18 +08:00

nereids_p0

Revert "[refactor](function) ignore DST for function from_unixtime (#19151)" (#19333)

2023-05-06 16:33:58 +08:00

nereids_syntax_p0

[fix](nereids) LogicalProject should always has non-empty project list (#18863)

2023-04-21 14:28:07 +08:00

nereids_tpch_p0/tpch

[fix](Nereids) fix some bugs in Subquery to window rule (#18233)

2023-03-30 16:09:16 +08:00

nereids_tpch_shape_sf1_p0/shape

[opt](Nereids) forbid some bad pattern aggregate in AggregateStrategy (#18877)

2023-04-26 20:01:35 +08:00

nereids_tpch_shape_sf500_p0/shape

[opt](Nereids) forbid some bad pattern aggregate in AggregateStrategy (#18877)

2023-04-26 20:01:35 +08:00

nereids_tpch_shape_sf1000_p0/shape

[fix](nereids) plan shape on tpch_sf1T q21 case #19291

2023-05-05 14:24:28 +08:00

opensky_p2/sql

[enhancement](test) add opensky cases to p2 (#12693)

2022-09-19 08:38:17 +08:00

partition_p0

[fix](value-range) fix the value range of non-nullable column contains null causes query short key index error. (#16943)

2023-02-28 11:15:32 +08:00

performance_p0

[enhance](planner)convert 'or' into 'in-predicate' (#15737)

2023-01-18 12:33:20 +08:00

point_query_p0

[Bug](mysql proto) fix binary proto with dynamic mode (#19055)

2023-04-27 11:18:01 +08:00

query/regexp

[fix](test) move cases in query to query_p0 (#14452)

2022-11-22 21:35:18 +08:00

query_p0

[Bug](scan) forbiden push down in predicate when in_state->use_set is false (#19471)

2023-05-10 11:12:20 +08:00

query_p2

[Chore](case) remove load big lateral view from p1 to p2 (#17851)

2023-03-20 13:10:12 +08:00

rollup

[Enchancement](compatible) show dateV2/datetimeV2 to date/datetime (#18358)

2023-04-09 10:34:14 +08:00

rollup_p0

[Enchancement](compatible) show dateV2/datetimeV2 to date/datetime (#18358)

2023-04-09 10:34:14 +08:00

schema_change

[feature](table-metadata) support altering the property "light_schema_change" for the tables which created before 1.2 (#17704)

2023-04-11 11:09:43 +08:00

schema_change_p0

[feature](table-metadata) support altering the property "light_schema_change" for the tables which created before 1.2 (#17704)

2023-04-11 11:09:43 +08:00

segcompaction_p2

[fix](regression) mv segcompaction_p1 to segcompaction_p2 (#18806)

2023-04-26 15:34:46 +08:00

sql_block_rule_p0

[fix](test) try to let cases run in parallel (#13114)

2022-10-04 20:56:22 +08:00

ssb_sf0.1_p1/sql

[refactor](config) Delete the environment variable enable_vectorized_engine (#18166)

2023-04-07 14:23:16 +08:00

ssb_sf1_p2/sql

[enhancement](regression) split ssb sf1 to sf0.1 to get smaller test data size (#14437)

2022-11-22 10:36:12 +08:00

ssb_sf100_p2/sql

Revert "[test](pipeline) Run nereids cases in p1/p2 (#16130)" (#16792)

2023-02-17 18:48:27 +08:00

ssb_unique_sql_zstd_p0/sql

[improvement](test) group some cases and group a case to p0 if it is not grouped (#11548)

2022-08-06 15:12:08 +08:00

statistics

[enchancement](statistics) implement automatically analyzing statistics and support table level statistics #19420

2023-05-10 11:47:34 +08:00

tpcds_sf1_p1

[fix](join) fix wrong result of right join (#18365)

2023-04-06 10:55:58 +08:00

tpcds_sf1_unique_p1/sql

[test](decimal) Update output data for P1 regression (#18199)

2023-03-29 15:13:12 +08:00

tpcds_sf100_p2/sql

[Chore](regression) Fix wrong result for decimal (#13644)

2022-10-26 09:24:46 +08:00

tpcds_sf1000_p2/sql

[enhancement](test) add tpcds_sf1000 to p2 (#12695)

2022-09-27 17:12:52 +08:00

tpch_sf0.1_p1/sql

[refactor](regression) make nereids case in a separate dir (#14990)

2022-12-13 16:28:41 +08:00

tpch_sf0.1_unique_p1/sql

Revert "[test](pipeline) Run nereids cases in p1/p2 (#16130)" (#16792)

2023-02-17 18:48:27 +08:00

tpch_sf1_p0/multi_catalog_query

[Fix](mutli-catalog) Use decimal v3 type to fix decimal loss issue in multi-catalog module. (#18835)

2023-04-20 11:02:53 +08:00

tpch_sf1_p1

[fix](test) tpch_sf1_p1 and tpch_sf1_p1/tpch_sf1 are confusing (#14206)

2022-11-28 19:30:32 +08:00

tpch_sf1_p2

rename tpch dir (#14668)

2022-11-30 17:59:13 +08:00

tpch_sf1_unique_p1/sql

[fix](test) tpch_sf1_p1 and tpch_sf1_p1/tpch_sf1 are confusing (#14206)

2022-11-28 19:30:32 +08:00

tpch_sf1_unique_p2/sql

rename tpch dir (#14668)

2022-11-30 17:59:13 +08:00

tpch_sf100_p2/sql

[fix](test) add tpch_sf100 and fix results of tpcds_sf100 (#13098)

2022-10-01 20:53:04 +08:00

tpch_sf100_unique_sql_p2/sql

Revert "[test](pipeline) Run nereids cases in p1/p2 (#16130)" (#16792)

2023-02-17 18:48:27 +08:00

tpch_unique_sql_zstd_p0/sql

[regression-test](unique) Add tpch sf0.1 test under unique table with zstd (#12122)

2022-08-27 21:39:09 +08:00

trino_p0

[fix](planner) fix bug in agg on constant column (#16442)

2023-02-13 11:26:08 +08:00

types

[Improvement](data types) enhance show data types stmt (#18831)

2023-05-09 09:42:44 +08:00

types_p0/unsigned

[fix](type compatibility) fix unsigned int type compatibility problem (#17427)

2023-03-07 08:55:38 +08:00

unique_with_mow_p0

[feature-wip](partial update) PART1: support basic partial write (#17542)

2023-04-28 17:17:57 +08:00

unique_with_mow_p2/ssb_unique_sql_zstd/sql

[regression-test](merge-on-write) Optimize merge-on-write case (#18038)

2023-03-23 17:59:49 +08:00

update

[enhencement](planner) update and delete support use alias for target table (#17914)

2023-03-22 11:07:39 +08:00

view_p0

[Bug](view) fix AES_ENCRYPT have wrong result on view (#18034)

2023-03-29 10:49:39 +08:00

with_clause_p0/sql

[enhancement](test) add more p0 cases (#12285)

2022-09-29 10:45:17 +08:00

yandex_metrica_p2

[refactor](config) Delete the environment variable enable_vectorized_engine (#18166)

2023-04-07 14:23:16 +08:00