dfe3a2dd01
[feature](mtmv)(3)Implementing multi table materialized views ( #26146 )
...
Introduction to Main Classes：
- MTMVService：MTMV services for other modules to call
- MTMVHookService：All operations that affect the MTMV
- MTMVJobManager：All operations that affect the MTMV job
- MTMVCacheManager：All operations that affect the MTMV Cache
- MTMVTask&MTMVJob：Inherit from job framework
2023-11-24 12:34:38 +08:00
da71fde066
[fix](build index) Fix inverted index hardlink leak and missing problem ( #26903 )
2023-11-24 10:30:21 +08:00
160adbaa69
[regression test](routine test) add case for num_as_string ( #27436 )
2023-11-24 10:15:47 +08:00
5adbe47d3a
[test](regression) add stream load tvf properties regression test ( #27467 )
2023-11-23 23:04:10 +08:00
5d31bc99b8
[Fix](Group_commit) Fix group commit regression test failure ( #27475 )
2023-11-23 23:03:38 +08:00
2ea33518b0
[Opt](load) use batching to optimize auto partition ( #26915 )
...
use batching to optimize auto partition
2023-11-23 19:12:28 +08:00
d9f6e51884
[fix](planner)output slot should be materialized as intermediate slot in agg node ( #27282 )
2023-11-23 18:41:08 +08:00
1555b11035
[fix](nereids)remove literal partition by and order by expression in window function ( #26899 )
2023-11-23 18:40:51 +08:00
2ec3395087
[fix](planner)the data type should be the same between input slot and sort slot ( #27137 )
2023-11-23 18:40:02 +08:00
4b22fc14d5
[Feature](update) Support update on current_timestamp ( #25884 )
2023-11-23 16:23:31 +08:00
c884e46e6c
[regression test](routine test) add case for desired_concurrent_number ( #27372 )
2023-11-23 15:11:01 +08:00
6253f7d6c7
[test](regression) add routine load condition test ( #27430 )
2023-11-23 14:37:35 +08:00
699798eaa7
[fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT ( #27343 )
...
* fix
* fix nullable
* remove null
* add case
2023-11-23 14:26:19 +08:00
301bfe4d5d
[Bug](mark-join) fix mark join report error when probe block have column do not output ( #27360 )
...
fix mark join report error when probe block have column do not output
2023-11-23 11:16:02 +08:00
42c32c584b
[case](regression) test invalid jsonpaths ( #27359 )
...
Co-authored-by: qinhao <qinhao@newland.com.cn >
2023-11-23 10:16:34 +08:00
5b8aaf96d2
[fix](planner)scan node should project all required expr from parent node ( #26886 )
2023-11-23 09:44:21 +08:00
0302a9d026
[fix](fe) slots in having clause should be set to need materialized ( #27412 )
2023-11-22 19:47:09 +08:00
a2a6a722eb
[test](regression) add routine load command test ( #27384 )
2023-11-22 18:55:35 +08:00
fd3c42d8cf
[fix](test) order by clause in test_map ( #27390 )
2023-11-22 16:43:31 +08:00
e06e976a8b
[test](case) delete duplicate pipelineX cases ( #27381 )
2023-11-22 12:58:30 +08:00
b541de7a03
do not push down agg on aggregate column ( #27356 )
...
do not push down agg on aggregate column
2023-11-22 10:53:29 +08:00
9b59bc14b5
[test](Export) add show export regression testes ( #27140 )
2023-11-22 00:13:30 +08:00
6e86bf5b1b
[test](decimalv2) add some regression cases about decimalv2 ( #27352 )
...
All cases' results are tested and passed with decimalv3
Cases about:
Calculation ( +, - , *, /)
Kinds of predicates(<, >, =, <>, in, not in, is null, is not null)
Load test(from csv and select into)
Runtime filter
Delete conditions
Key columns(agg/duplicate/uniq model, distributed/partition, bitmap index...)
2023-11-21 21:36:20 +08:00
c9b959d2d8
[opt](Nereids) AssertNumRows node should triger runtime filter pruning #27279
...
1. optimize rf prune when col stats are not avaliable
2. add regression case to check plan and rf for tpcds_sf100 with stats
3. add regression case to check plan and rf for tpcds_sf100 without stats
2023-11-21 21:00:41 +08:00
1cd1c58eee
[Feature](group commit) move group_commit_interval_ms from be.conf to table property ( #27116 )
2023-11-21 20:50:02 +08:00
c1435c0589
[regression test](routine test) add case for send_batch_parallelism ( #27333 )
2023-11-21 20:43:20 +08:00
dea40e7095
[fix](Nereids): NullSafeEqual should be in HashJoinCondition ( #27127 )
...
Originally, we just put `EqualTo` in `HashJoinCondition`, we also need to allow `NullSafeEqual`
2023-11-21 19:08:14 +08:00
1ebb54afdc
[fix](null equal) fix coredump of pushing eq_for_null ( #27341 )
2023-11-21 18:36:33 +08:00
f7a1c3edac
[FIX](jsonb)fix jsonb is not in predict column #27325
2023-11-21 18:35:12 +08:00
016dccb4b7
[fix](null_equal) fix wrong result and coredump of operator <=> ( #27312 )
...
* [fix](null_equal) fix wrong result and coredump of operator <=>
* fix
2023-11-21 14:32:03 +08:00
b63f00987f
[regression](invered index) add test null index case and fix fault injection index case ( #27265 )
2023-11-21 14:04:57 +08:00
cee8cc44e2
[Bug](insert)fix insert wrong data on mv when stmt have multiple values ( #27297 )
...
fix insert wrong data on mv when stmt have multiple values
2023-11-21 12:55:30 +08:00
c0f22e8feb
[FIX](complextype)fix struct nested complex collection type and and regresstest ( #26973 )
2023-11-20 22:29:12 +08:00
0b459e50fb
[fix](partial update) keep case insensitivity and use the columns' origin names in partialUpdateCols in origin planner ( #27223 )
...
close : #27161
2023-11-20 21:16:28 +08:00
273cbfc36c
[fix](inverted index) reset fs_writer to nullptr before throw exception ( #27202 )
2023-11-20 17:40:56 +08:00
7164b7cebb
[case](regression) add read json by line test case ( #26670 )
...
Co-authored-by: qinhao <qinhao@newland.com.cn >
2023-11-20 17:33:40 +08:00
add6bdb240
[fix](multi-catalog)add the max compute fe ut and fix download expired ( #27007 )
...
1. add the max compute fe ut and fix download expired
2. solve memery leak when allocator close
3. add correct partition rows
2023-11-20 10:42:07 +08:00
febd60c75f
[fix](join) incorrect result of left join with other conjuncts ( #27238 )
2023-11-19 15:36:39 +08:00
b560d863c2
[fix](dynamic) Fix error reporting when dynamic partition properties contain incorrect attributes ( #25373 )
2023-11-19 09:51:57 +08:00
329abc3452
[feature](nereids) runtime filter prune when column stats are not available ( #27099 )
...
1. prune rf when column stats are not available
2. print rf in "explain shape plan", both join side and apply side
3. add regression case to check plan shape/rf/rf prune for tpch_sf1000 (stats are not available)
2023-11-18 19:32:33 +08:00
b42828cf69
[fix](window_function) min/max/sum/avg should be always nullable ( #27104 )
...
Co-authored-by: starocean999 <40539150+starocean999@users.noreply.github.com >
2023-11-18 18:41:42 +08:00
2f41e0c823
[FIX](complextype)fix information schema for complex type ( #27203 )
...
when we select in information schema , here do not show complex type information
2023-11-18 11:32:32 +08:00
4b6330cb93
[regression test](http stream) add case for strict_mode ( #27098 )
2023-11-18 00:10:02 +08:00
fc47eb51f7
[regression test](schema change) add some schema change regression cases ( #27112 )
2023-11-18 00:08:53 +08:00
b477839bce
[enhancement](jdbc catalog) Add lowercase column name mapping to Jdbc data source & optimize database and table mapping ( #27124 )
...
This PR adds the processing of lowercase Column names in Oracle Jdbc Catalog. In the previous behavior, we changed all Oracle columns to uppercase queries by default, but could not handle the lowercase case. This PR can solve this situation and improve All Jdbc Catalog works
2023-11-17 23:51:47 +08:00
52995c528e
[fix](iceberg) iceberg use customer method to encode special characters of field name ( #27108 )
...
Fix two bugs:
1. Missing column is case sensitive, change the column name to lower case in FE for hive/iceberg/hudi
2. Iceberg use custom method to encode special characters in column name. Decode the column name to match the right column in parquet reader.
2023-11-17 18:38:55 +08:00
0ece18d6cd
[FIX](regresstest) fix test_map_nested_array csv file for id( #27105 )
2023-11-17 04:20:02 -06:00
a0661ed9d2
[Fix](multi-catalog) Fix complex type crash when using dict filter facility in the parquet-reader. ( #27151 )
...
- Fix complex type crash when using the dict filter facility in the parquet-reader by turning off the dict filter facility in this case.
- Add orc complex types regression test.
2023-11-17 13:43:58 +08:00
c7d961cb11
[regression test](stream load) add case for strict_mode=true and max_filter_ratio=0.5 ( #27125 )
2023-11-17 13:39:01 +08:00
ee08958526
[regression test](http_stream) case for timezone ( #27149 )
...
It does not work now, anyway we need a case.
2023-11-17 13:36:41 +08:00
