dbbab63623
[fix](nereids)keep cast operator if cast a varchar to another longer varchar in LogicalSetOperator ( #27393 )
2023-11-24 14:07:04 +08:00
dfe3a2dd01
[feature](mtmv)(3)Implementing multi table materialized views ( #26146 )
...
Introduction to Main Classes：
- MTMVService：MTMV services for other modules to call
- MTMVHookService：All operations that affect the MTMV
- MTMVJobManager：All operations that affect the MTMV job
- MTMVCacheManager：All operations that affect the MTMV Cache
- MTMVTask&MTMVJob：Inherit from job framework
2023-11-24 12:34:38 +08:00
da71fde066
[fix](build index) Fix inverted index hardlink leak and missing problem ( #26903 )
2023-11-24 10:30:21 +08:00
d5908b0c8b
[regression](compaction) Add case to test base_compaction with dup_key_max_file_size_limit ( #27088 )
2023-11-24 10:27:51 +08:00
160adbaa69
[regression test](routine test) add case for num_as_string ( #27436 )
2023-11-24 10:15:47 +08:00
75c9f00137
[Bug](bitmap) Fix heap-use-after-free in the bitmap functions ( #27411 )
2023-11-24 10:09:31 +08:00
39a5229027
[fix](regression)Fix hive p2 case ( #27466 )
2023-11-23 23:32:21 +08:00
5adbe47d3a
[test](regression) add stream load tvf properties regression test ( #27467 )
2023-11-23 23:04:10 +08:00
5d31bc99b8
[Fix](Group_commit) Fix group commit regression test failure ( #27475 )
2023-11-23 23:03:38 +08:00
2ea33518b0
[Opt](load) use batching to optimize auto partition ( #26915 )
...
use batching to optimize auto partition
2023-11-23 19:12:28 +08:00
d9f6e51884
[fix](planner)output slot should be materialized as intermediate slot in agg node ( #27282 )
2023-11-23 18:41:08 +08:00
1555b11035
[fix](nereids)remove literal partition by and order by expression in window function ( #26899 )
2023-11-23 18:40:51 +08:00
2ec3395087
[fix](planner)the data type should be the same between input slot and sort slot ( #27137 )
2023-11-23 18:40:02 +08:00
6fdaf2da6f
[fix](ci) 1. if skip compile then skip p0 p1 external pipelinex_p0 also, ( #27469 )
...
1. if skip compile then skip p0 p1 external pipelinex_p0 also
2. if change files too many, export all_files may cause problem of 'Argument list too long', change to use file
Co-authored-by: stephen <hello-stephen@qq.com >
2023-11-23 18:11:29 +08:00
4b22fc14d5
[Feature](update) Support update on current_timestamp ( #25884 )
2023-11-23 16:23:31 +08:00
c884e46e6c
[regression test](routine test) add case for desired_concurrent_number ( #27372 )
2023-11-23 15:11:01 +08:00
6253f7d6c7
[test](regression) add routine load condition test ( #27430 )
2023-11-23 14:37:35 +08:00
97932d0381
[fix](export) the label of export should be unique with database scope ( #27401 )
...
### How to reproduce
1. create a database db1 and a table tbl1;
2. insert some data and export with label L1;
3. drop the db1 and tbl1, and recreate them with same name.
4. insert some data and export with same label L1;
Expect: export success
Actual: error: Label L1 have already been used.
This PR fix it.
2023-11-23 14:30:57 +08:00
f6a02fd401
[regression test](routine load) add case for invaild format ( #27245 )
2023-11-23 14:30:36 +08:00
699798eaa7
[fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT ( #27343 )
...
* fix
* fix nullable
* remove null
* add case
2023-11-23 14:26:19 +08:00
93cfdffb75
[regression test](routine test) add case for exec_mem_limit ( #27308 )
2023-11-23 14:25:54 +08:00
33de92cc61
[improve](nereids) support agg function of count(const value) pushdown #26677
...
support sql: select count(1)-count(not null) from table, the agg of count could push down.
2023-11-23 11:26:06 +08:00
301bfe4d5d
[Bug](mark-join) fix mark join report error when probe block have column do not output ( #27360 )
...
fix mark join report error when probe block have column do not output
2023-11-23 11:16:02 +08:00
42c32c584b
[case](regression) test invalid jsonpaths ( #27359 )
...
Co-authored-by: qinhao <qinhao@newland.com.cn >
2023-11-23 10:16:34 +08:00
5b8aaf96d2
[fix](planner)scan node should project all required expr from parent node ( #26886 )
2023-11-23 09:44:21 +08:00
0302a9d026
[fix](fe) slots in having clause should be set to need materialized ( #27412 )
2023-11-22 19:47:09 +08:00
a2a6a722eb
[test](regression) add routine load command test ( #27384 )
2023-11-22 18:55:35 +08:00
96e3636905
[Fix](Group_commit) Fix group commit regression test failure ( #27380 )
2023-11-22 18:55:20 +08:00
6a48abeb80
[feature](Nereids) support queries tvf ( #27138 )
2023-11-22 02:47:16 -06:00
fd3c42d8cf
[fix](test) order by clause in test_map ( #27390 )
2023-11-22 16:43:31 +08:00
732a3fa9c8
[fix](stats) fix auto collector always create sample job no matter the table size ( #26968 )
2023-11-22 02:42:40 -06:00
e06e976a8b
[test](case) delete duplicate pipelineX cases ( #27381 )
2023-11-22 12:58:30 +08:00
b541de7a03
do not push down agg on aggregate column ( #27356 )
...
do not push down agg on aggregate column
2023-11-22 10:53:29 +08:00
b821672f8b
[test](regression) add 'sync' for som stream load ( #27357 )
2023-11-22 10:52:34 +08:00
c332811721
[fix](ci) fix bug of new trigger ( #27379 )
...
* [fix](ci) fix bug of new trigger
Co-authored-by: stephen <hello-stephen@qq.com >
2023-11-22 10:35:39 +08:00
4fbcad9c7c
[minor](show_export) make result of file url usable ( #27209 )
...
* [minor](show_export) make result of file url usable
* update regression-test
* update regression-test
2023-11-22 10:14:45 +08:00
34f500ac2a
[github](action) optimize trigger teamcity pipeline ( #27257 )
...
optimize triiger teamcity pipeline
2023-11-22 09:34:47 +08:00
9b59bc14b5
[test](Export) add show export regression testes ( #27140 )
2023-11-22 00:13:30 +08:00
6e86bf5b1b
[test](decimalv2) add some regression cases about decimalv2 ( #27352 )
...
All cases' results are tested and passed with decimalv3
Cases about:
Calculation ( +, - , *, /)
Kinds of predicates(<, >, =, <>, in, not in, is null, is not null)
Load test(from csv and select into)
Runtime filter
Delete conditions
Key columns(agg/duplicate/uniq model, distributed/partition, bitmap index...)
2023-11-21 21:36:20 +08:00
c9b959d2d8
[opt](Nereids) AssertNumRows node should triger runtime filter pruning #27279
...
1. optimize rf prune when col stats are not avaliable
2. add regression case to check plan and rf for tpcds_sf100 with stats
3. add regression case to check plan and rf for tpcds_sf100 without stats
2023-11-21 21:00:41 +08:00
1cd1c58eee
[Feature](group commit) move group_commit_interval_ms from be.conf to table property ( #27116 )
2023-11-21 20:50:02 +08:00
c1435c0589
[regression test](routine test) add case for send_batch_parallelism ( #27333 )
2023-11-21 20:43:20 +08:00
a0fab03289
[case](regression-test) Add backup & restore regression test with auto Bucket and dynamic partition ( #27033 )
...
* (Case)Add backup & restore regression test
1. (case)Table with auto Bucket
2. Table with dynamic partition
(case)set "reserve_dynamic_partition_enable = true" on restore properties
(case)set "reserve_dynamic_partition_enable = false" on restore properties
Co-authored-by: Bears0haunt <bearshaunt0@gamil.com >
2023-11-21 20:32:45 +08:00
d541424936
do not check invisible column stats ( #27201 )
...
1. forbid_unknown_col_stats check ignore invisible columns
2. a better error message when meet unknown col stats
2023-11-21 19:46:16 +08:00
dea40e7095
[fix](Nereids): NullSafeEqual should be in HashJoinCondition ( #27127 )
...
Originally, we just put `EqualTo` in `HashJoinCondition`, we also need to allow `NullSafeEqual`
2023-11-21 19:08:14 +08:00
445484270b
[fix](Nereids): fill miss slot in having subquery ( #27177 )
...
fill miss slot in having subquery.
such as
```
select * from t group by k having max(k) in (select k from t2)
```
the max(k) should be push down aggregate
2023-11-21 18:54:58 +08:00
1ebb54afdc
[fix](null equal) fix coredump of pushing eq_for_null ( #27341 )
2023-11-21 18:36:33 +08:00
f7a1c3edac
[FIX](jsonb)fix jsonb is not in predict column #27325
2023-11-21 18:35:12 +08:00
016dccb4b7
[fix](null_equal) fix wrong result and coredump of operator <=> ( #27312 )
...
* [fix](null_equal) fix wrong result and coredump of operator <=>
* fix
2023-11-21 14:32:03 +08:00
b63f00987f
[regression](invered index) add test null index case and fix fault injection index case ( #27265 )
2023-11-21 14:04:57 +08:00
