Commit Graph

18429 Commits

Author SHA1 Message Date
Pxl
19e6ebd09c [Feature](materialized-view) support mv with bitmap_union(bitmap_from_array()) case (#31962)
support mv with bitmap_union(bitmap_from_array()) case
2024-03-09 19:45:03 +08:00
679cd0ab45 [opt](mtmv) ensure rewritten plan output order correct even project been eliminated (#31870) 2024-03-09 19:45:03 +08:00
1721bfb87a [fix](nereids)forbid some join reorder rules for mark join (#31966) 2024-03-09 19:45:03 +08:00
f968d96545 [profile](pipelineX) Add lost metrics (#31964) 2024-03-09 19:45:03 +08:00
4bfecac08a [enhancement](plsql) Support show procedure and show create procedure (#31297) (#31763) 2024-03-09 19:45:03 +08:00
1b783aaa7f [fix](p2)Fix analyze hive partition column p2 case after row count change. #31958 2024-03-09 19:45:03 +08:00
eb280d374b [case](Nereids) add leading tpc-h (#30405)
add tpc-h shape cases using leading hint
except:

single table without join q1 q6
not support feature include tables after subquery unnested q2 q16 q18 q20 q21 q22
2024-03-09 19:45:03 +08:00
861461403f add missing RuleType LOGICAL_REPEAT_TO_PHYSICAL_REPEAT_RULE (#31877) 2024-03-09 19:45:03 +08:00
93d298d34a [fix](agg) wrong result of two or more map_agg functions in query (#31928) 2024-03-09 19:45:03 +08:00
b2de83f250 [agg](conf) Add a knob to control distinct agg (#31930)
Add a knob to control distinct agg
2024-03-09 19:44:54 +08:00
e9c1638507 Add waiting timeout while creating mv and row count report. (#31944) 2024-03-09 19:44:54 +08:00
908dff551a [fix](statistics)Add synchronize for modify analysisTaskInfoMap and analysisJobInfoMap. #31940 2024-03-09 19:44:54 +08:00
0da010603e [Improve](TabletSchemaCache) reduce duplicated memory consumption for column name and column path (#31141)
Both could be reference to related field in TabletColumn.And use shared_ptr for TabletColumn in TabletSchema for later memory reuse
2024-03-09 19:44:42 +08:00
779ca464a5 [Fix](Status) Handle returned overall Status correctly (#31692)
Handle returned overall Status correctly
2024-03-09 19:44:39 +08:00
aff09fc9bc [feature](Nereids) support make miss slot as null alias when converting anti join (#31854)
transform

project(A.*, B.slot)
  - filter(B.slot is null)
    - LeftOuterJoin(A, B)

to

project(A.*, null as B.slot)
  - LeftAntiJoin(A, B)
2024-03-09 19:43:21 +08:00
Pxl
981ea73466 [Bug](top-n) init query_ctx runtime predicate before _build_pipelines (#31896)
init query_ctx runtime predicate before _build_pipelines
2024-03-09 19:43:21 +08:00
c6a8146db5 [typo](doc)Doriswriter document modification (#31322) 2024-03-09 19:43:21 +08:00
8801916675 [regression](spark)Add spark to read doris multiple data types cases (#31861) 2024-03-09 19:43:21 +08:00
5b52812af2 Problem: When the old optimizer processes an INSERT INTO statement that contains two quotation marks, it results in only one quotation mark being written into the database. (#31890)
Reason: During syntax parsing, the old optimizer interprets two quotation marks as a single quotation mark.
Solution: Remove the logic that consolidates two quotation marks into one.
2024-03-09 19:43:21 +08:00
xy
92320bbd2d [Fix](doc) Adjust default values (#31882)
Co-authored-by: xingying01 <xingying01@corp.netease.com>
2024-03-09 19:43:21 +08:00
9fa470caca [doc](external) delete external table docs in 1.2 (#28353) 2024-03-09 19:43:21 +08:00
3b56c4bcfa [enhancement](nereids)send is_nereids flag to be (#31752) 2024-03-09 19:43:12 +08:00
197b204e02 [type](docs) delete duplicated sidebar items (#31991) 2024-03-08 16:26:06 +08:00
1898517b2f [type](doc) update 2.1 doc label (#31942) 2024-03-07 17:12:03 +08:00
009ca9b90b [fix] (doc)Fix invalid link on benchmark tool page #31920 2024-03-07 16:53:49 +08:00
db389d7d4e [feat](nereids) support null safe eq runtime filter (FE part) (#31655)
be part has been merged in #31754
2024-03-07 16:53:49 +08:00
fa411f88df [Fix](Nereids) fix hint cases with random result (#31865) 2024-03-07 16:53:49 +08:00
29b858d8c9 [chore](build) Using multithread to accelerate FE compilation (#31855) 2024-03-07 16:53:49 +08:00
667b1fba04 [enhance](mtmv) MTMV Use partial partition of base table (#31632)
MTMV add 3 properties:
partition_sync_limit: digit
partition_sync_time_unit: DAY/MONTH/YEAR
partition_sync_date_format: like "%Y-%m-%d"/"%Y%m%d"

For example, the current time is 2020-02-03 20:10:10
- If partition_sync_limit is set to 1 and partition_sync_time_unit is set to DAY, only partitions with a time greater than or equal to 2020-02-03 00:00:00 will be synchronized to the MTMV
- If partition_sync_limit is set to 1 and partition_sync_time_unit is set to MONTH, only partitions with a time greater than or equal to 2020-02-01 00:00:00 will be synchronized to the MTMV
- If partition_sync_limit is set to 1 and partition_sync_time_unit is set to YEAR, only partitions with a time greater than or equal to 2020-01-01 00:00:00 will be synchronized to the MTMV
- If partition_sync_limit is set to 3 and partition_sync_time_unit is set to MONTH, only partitions with a time greater than or equal to 2019-12-01 00:00:00 will be synchronized to the MTMV
- If partition_sync_limit is set to 4 and partition_sync_time_unit is set to DAY, only partitions with a time greater than or equal to 2020-01-31 00:00:00 will be synchronized to the MTMV
2024-03-07 16:53:49 +08:00
0c7e9257a8 [cloud](point query) enable short circuit query in cloud (#31897) 2024-03-07 16:53:40 +08:00
56342278f1 [bug](meta) exit when get RollbackException in observer (#31687) 2024-03-07 16:53:20 +08:00
370b050cae [doc](apache-superset)add doc for apache superset compatible (#31314) 2024-03-07 16:53:19 +08:00
e91d16854b [fix](function) fix date_format function execution error on fe (#31645) 2024-03-07 16:53:19 +08:00
21ce85dc14 [fix](money_format) fix money_format #31883 2024-03-07 16:53:19 +08:00
a3c24b84e3 [fix](mtmv) support null value in partition for updating (#31843) 2024-03-07 16:53:19 +08:00
da5a40077f [fix](http stream) http stream support memtable_on_sink_node header (#31866) 2024-03-07 16:53:19 +08:00
9d5c51f5c3 [enhancement](nereids) show nullaware semi join in plan (#31738) 2024-03-07 16:53:19 +08:00
5905ffa1da [enhancement](nereids) allow reorder mark join (#30644) 2024-03-07 16:53:19 +08:00
474cacd572 [type](doc) Standardize the name in the sql-dialect document and modify the format (#31636) 2024-03-07 16:53:19 +08:00
9bf22a872a [Bug](fix) fix or and "<=>" cause coredump in query (#31884) 2024-03-07 16:53:19 +08:00
42776eefdf [typo](doc) Add a full backup case and modify sidebars (#31801) 2024-03-07 16:53:19 +08:00
5b00f4fbeb [improvement](jdbc catalog) opt get db2 schema list & xml type mapping (#31856)
1. Trim Schema Names: Adapted the system to remove trailing spaces from DB2 schema names, ensuring compatibility without affecting query operations.
2. XML Mapping: Implemented a feature to directly map XML types to String.
2024-03-07 16:53:19 +08:00
80c80b6719 [enhancement](Nereids): support more condition Date/DateTime Literal (#31858) 2024-03-07 16:16:05 +08:00
561709451c [fix](Nereids) fix group_concat(distinct) failed (#31873) 2024-03-07 16:16:05 +08:00
ad2f7fc316 [bugfix](coordinator) should use fragment id not profile fragment id to cancel fragment (#31852) 2024-03-07 16:16:05 +08:00
d276610694 [deps](docker) update docker build env to add jdk17 (#31644) 2024-03-07 16:16:05 +08:00
1d9e9fc884 [regression test] Test the unique model by modify a value type from TINYINT to other type (#31682) 2024-03-07 16:16:05 +08:00
Pxl
3716f8a171 [Bug](partition) fix npe when prune partition with not exist partition column in mv #31860 2024-03-07 16:16:05 +08:00
5c1c73e5bb [Fix](Nereids) fix missing comment when creating table (#31869) 2024-03-07 16:16:05 +08:00
686cbffd8a [fix](multi-catalog) fix iceberg defalut credentials proviers (#31704) 2024-03-07 16:16:05 +08:00