dbff9d7a89
[chore](fuzzy) topn_opt_limit_threshold ( #27496 )
2023-11-24 14:08:27 +08:00
dbbab63623
[fix](nereids)keep cast operator if cast a varchar to another longer varchar in LogicalSetOperator ( #27393 )
2023-11-24 14:07:04 +08:00
dfe3a2dd01
[feature](mtmv)(3)Implementing multi table materialized views ( #26146 )
...
Introduction to Main Classes：
- MTMVService：MTMV services for other modules to call
- MTMVHookService：All operations that affect the MTMV
- MTMVJobManager：All operations that affect the MTMV job
- MTMVCacheManager：All operations that affect the MTMV Cache
- MTMVTask&MTMVJob：Inherit from job framework
2023-11-24 12:34:38 +08:00
da71fde066
[fix](build index) Fix inverted index hardlink leak and missing problem ( #26903 )
2023-11-24 10:30:21 +08:00
d5908b0c8b
[regression](compaction) Add case to test base_compaction with dup_key_max_file_size_limit ( #27088 )
2023-11-24 10:27:51 +08:00
c24a33c857
[enhancement](audit) hide password and other sensitive information in log and audit log ( #27115 )
...
Signed-off-by: nextdreamblue <zxw520blue1@163.com >
2023-11-24 10:27:30 +08:00
0a8e3d2199
[enhance](PrefetchReader) Make the prefetch timeout one config ( #27371 )
2023-11-24 10:24:15 +08:00
9a92323221
[fix](fs) prefetch buffer check status before verifing buf size ( #27388 )
2023-11-24 10:19:37 +08:00
160adbaa69
[regression test](routine test) add case for num_as_string ( #27436 )
2023-11-24 10:15:47 +08:00
75c9f00137
[Bug](bitmap) Fix heap-use-after-free in the bitmap functions ( #27411 )
2023-11-24 10:09:31 +08:00
17ca75f834
[chore](Nereids): add eager aggregate into rules ( #27505 )
...
Add `Eager Aggregate` rules into Rewrite rules.
2023-11-24 10:06:04 +08:00
5a82a5746e
[pipelineX](bug) Fix core dump if cancelled ( #27449 )
2023-11-24 09:21:17 +08:00
df628e1538
[chore](merge-on-write) disable rowid conversion check for mow table by default ( #27482 )
2023-11-23 23:39:01 +08:00
39a5229027
[fix](regression)Fix hive p2 case ( #27466 )
2023-11-23 23:32:21 +08:00
b580ee91ce
[fix](compile) fix macOS compile and format code ( #27494 )
2023-11-23 23:24:10 +08:00
8e74470db9
[fix](statistics)Fix auto analyze remove finished job bug ( #27486 )
...
Finished job must be removed from the job list, otherwise the next batch of jobs will not be scheduled.
2023-11-23 23:22:02 +08:00
eb878ad0d2
[fix](Export) add feut for Cancel Export ( #27178 )
2023-11-23 23:18:30 +08:00
5adbe47d3a
[test](regression) add stream load tvf properties regression test ( #27467 )
2023-11-23 23:04:10 +08:00
5d31bc99b8
[Fix](Group_commit) Fix group commit regression test failure ( #27475 )
2023-11-23 23:03:38 +08:00
540bce4d1b
[typo](log) Let env lock msg more distinct ( #27493 )
2023-11-23 23:03:06 +08:00
aa766a7b4a
[bugfix](pipeline core) lock fragment context during task close to avoid concurrent delete ( #27484 )
2023-11-23 21:43:39 +08:00
d73b945535
[chore](Nereids): rename pushdown to push_down ( #27473 )
2023-11-23 21:04:40 +08:00
d04a2de3cc
[fix](hms) fix compatibility issue of hive metastore client ( #27327 )
...
For hive version lower than 2.3.7, there is no enum ClientCapability.INSERT_ONLY_TABLES.
So if we send this enum to the server side, the server side will get a null,
and this will cause some undefined behavior, eg, failed to get tables infos from hms.
2023-11-23 19:42:46 +08:00
78203c8b7a
[chore](docker cases): support for specifying output from the command line ( #27340 )
2023-11-23 19:36:43 +08:00
dd65cc1d14
[opt](MergedIO) no need to merge large columns ( #27315 )
...
1. Fix a profile bug of `MergeRangeFileReader`, and add a profile `ApplyBytes` to show the total bytes of ranges.
2. There's no need to merge large columns, because `MergeRangeFileReader` will increase the copy time.
2023-11-23 19:15:47 +08:00
2ea33518b0
[Opt](load) use batching to optimize auto partition ( #26915 )
...
use batching to optimize auto partition
2023-11-23 19:12:28 +08:00
511eedb4ff
[fix](nereids)select base index if mv's data type is different from base table ( #27387 )
...
normally, mv column's data type should be same as base table. This pr plays as a fail-safe, if mv column's data type is different from base table accidentally, fall back to select base table to make the query works.
2023-11-23 18:41:59 +08:00
d9f6e51884
[fix](planner)output slot should be materialized as intermediate slot in agg node ( #27282 )
2023-11-23 18:41:08 +08:00
1555b11035
[fix](nereids)remove literal partition by and order by expression in window function ( #26899 )
2023-11-23 18:40:51 +08:00
2ec3395087
[fix](planner)the data type should be the same between input slot and sort slot ( #27137 )
2023-11-23 18:40:02 +08:00
ab739a6cdc
[Chore](workflow)Fix Pr comment not worker ( #27400 )
2023-11-23 18:17:31 +08:00
6fdaf2da6f
[fix](ci) 1. if skip compile then skip p0 p1 external pipelinex_p0 also, ( #27469 )
...
1. if skip compile then skip p0 p1 external pipelinex_p0 also
2. if change files too many, export all_files may cause problem of 'Argument list too long', change to use file
Co-authored-by: stephen <hello-stephen@qq.com >
2023-11-23 18:11:29 +08:00
772f181e94
[fix](stats) Fix thread leaks when doing checkpoint ( #27334 )
2023-11-23 03:18:19 -06:00
ca7dbc3636
[refactor](pipelineX) refine union dependency ( #27348 )
2023-11-23 16:28:32 +08:00
4b22fc14d5
[Feature](update) Support update on current_timestamp ( #25884 )
2023-11-23 16:23:31 +08:00
5d9c555dcf
[minor](stats) Fix potential npe when loading stats ( #27200 )
...
Besides, lower down the log level of loading stats from warning to debug, since it doesn't such matter for workflow.
2023-11-23 01:37:58 -06:00
b457856bd2
[chore](be) remove bthread scanner related codes ( #27417 )
2023-11-23 15:18:49 +08:00
8e3b4e99d9
[improve](move-memtable) add switch for stream load in fe.conf ( #27440 )
2023-11-23 15:11:17 +08:00
c884e46e6c
[regression test](routine test) add case for desired_concurrent_number ( #27372 )
2023-11-23 15:11:01 +08:00
afe5af433a
[log](tablet) add create / gc tablet log ( #27452 )
2023-11-23 14:42:47 +08:00
6253f7d6c7
[test](regression) add routine load condition test ( #27430 )
2023-11-23 14:37:35 +08:00
97932d0381
[fix](export) the label of export should be unique with database scope ( #27401 )
...
### How to reproduce
1. create a database db1 and a table tbl1;
2. insert some data and export with label L1;
3. drop the db1 and tbl1, and recreate them with same name.
4. insert some data and export with same label L1;
Expect: export success
Actual: error: Label L1 have already been used.
This PR fix it.
2023-11-23 14:30:57 +08:00
f6a02fd401
[regression test](routine load) add case for invaild format ( #27245 )
2023-11-23 14:30:36 +08:00
699798eaa7
[fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT ( #27343 )
...
* fix
* fix nullable
* remove null
* add case
2023-11-23 14:26:19 +08:00
93cfdffb75
[regression test](routine test) add case for exec_mem_limit ( #27308 )
2023-11-23 14:25:54 +08:00
7a75f8c380
[improve](move-memtable) set brpc streaming params in config ( #27442 )
2023-11-23 14:14:43 +08:00
dbbed113cf
[feature](mtmv)(4)MTMV extends Olap ( #26645 )
2023-11-23 14:10:36 +08:00
4fc638c98c
[fix](memory) Fix make_top_consumption_snapshots heap-use-after-free #27434
2023-11-23 13:59:53 +08:00
75d1594d11
[pipelineX](minor) remove unused code ( #27446 )
2023-11-23 11:53:06 +08:00
b79f5d77f1
[improve](move-memtable) improve logging messages ( #27443 )
2023-11-23 11:46:29 +08:00
