5adbe47d3a
[test](regression) add stream load tvf properties regression test ( #27467 )
2023-11-23 23:04:10 +08:00
5d31bc99b8
[Fix](Group_commit) Fix group commit regression test failure ( #27475 )
2023-11-23 23:03:38 +08:00
540bce4d1b
[typo](log) Let env lock msg more distinct ( #27493 )
2023-11-23 23:03:06 +08:00
aa766a7b4a
[bugfix](pipeline core) lock fragment context during task close to avoid concurrent delete ( #27484 )
2023-11-23 21:43:39 +08:00
d73b945535
[chore](Nereids): rename pushdown to push_down ( #27473 )
2023-11-23 21:04:40 +08:00
d04a2de3cc
[fix](hms) fix compatibility issue of hive metastore client ( #27327 )
...
For hive version lower than 2.3.7, there is no enum ClientCapability.INSERT_ONLY_TABLES.
So if we send this enum to the server side, the server side will get a null,
and this will cause some undefined behavior, eg, failed to get tables infos from hms.
2023-11-23 19:42:46 +08:00
78203c8b7a
[chore](docker cases): support for specifying output from the command line ( #27340 )
2023-11-23 19:36:43 +08:00
dd65cc1d14
[opt](MergedIO) no need to merge large columns ( #27315 )
...
1. Fix a profile bug of `MergeRangeFileReader`, and add a profile `ApplyBytes` to show the total bytes of ranges.
2. There's no need to merge large columns, because `MergeRangeFileReader` will increase the copy time.
2023-11-23 19:15:47 +08:00
2ea33518b0
[Opt](load) use batching to optimize auto partition ( #26915 )
...
use batching to optimize auto partition
2023-11-23 19:12:28 +08:00
511eedb4ff
[fix](nereids)select base index if mv's data type is different from base table ( #27387 )
...
normally, mv column's data type should be same as base table. This pr plays as a fail-safe, if mv column's data type is different from base table accidentally, fall back to select base table to make the query works.
2023-11-23 18:41:59 +08:00
d9f6e51884
[fix](planner)output slot should be materialized as intermediate slot in agg node ( #27282 )
2023-11-23 18:41:08 +08:00
1555b11035
[fix](nereids)remove literal partition by and order by expression in window function ( #26899 )
2023-11-23 18:40:51 +08:00
2ec3395087
[fix](planner)the data type should be the same between input slot and sort slot ( #27137 )
2023-11-23 18:40:02 +08:00
ab739a6cdc
[Chore](workflow)Fix Pr comment not worker ( #27400 )
2023-11-23 18:17:31 +08:00
6fdaf2da6f
[fix](ci) 1. if skip compile then skip p0 p1 external pipelinex_p0 also, ( #27469 )
...
1. if skip compile then skip p0 p1 external pipelinex_p0 also
2. if change files too many, export all_files may cause problem of 'Argument list too long', change to use file
Co-authored-by: stephen <hello-stephen@qq.com >
2023-11-23 18:11:29 +08:00
772f181e94
[fix](stats) Fix thread leaks when doing checkpoint ( #27334 )
2023-11-23 03:18:19 -06:00
ca7dbc3636
[refactor](pipelineX) refine union dependency ( #27348 )
2023-11-23 16:28:32 +08:00
4b22fc14d5
[Feature](update) Support update on current_timestamp ( #25884 )
2023-11-23 16:23:31 +08:00
5d9c555dcf
[minor](stats) Fix potential npe when loading stats ( #27200 )
...
Besides, lower down the log level of loading stats from warning to debug, since it doesn't such matter for workflow.
2023-11-23 01:37:58 -06:00
b457856bd2
[chore](be) remove bthread scanner related codes ( #27417 )
2023-11-23 15:18:49 +08:00
8e3b4e99d9
[improve](move-memtable) add switch for stream load in fe.conf ( #27440 )
2023-11-23 15:11:17 +08:00
c884e46e6c
[regression test](routine test) add case for desired_concurrent_number ( #27372 )
2023-11-23 15:11:01 +08:00
afe5af433a
[log](tablet) add create / gc tablet log ( #27452 )
2023-11-23 14:42:47 +08:00
6253f7d6c7
[test](regression) add routine load condition test ( #27430 )
2023-11-23 14:37:35 +08:00
97932d0381
[fix](export) the label of export should be unique with database scope ( #27401 )
...
### How to reproduce
1. create a database db1 and a table tbl1;
2. insert some data and export with label L1;
3. drop the db1 and tbl1, and recreate them with same name.
4. insert some data and export with same label L1;
Expect: export success
Actual: error: Label L1 have already been used.
This PR fix it.
2023-11-23 14:30:57 +08:00
f6a02fd401
[regression test](routine load) add case for invaild format ( #27245 )
2023-11-23 14:30:36 +08:00
699798eaa7
[fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT ( #27343 )
...
* fix
* fix nullable
* remove null
* add case
2023-11-23 14:26:19 +08:00
93cfdffb75
[regression test](routine test) add case for exec_mem_limit ( #27308 )
2023-11-23 14:25:54 +08:00
7a75f8c380
[improve](move-memtable) set brpc streaming params in config ( #27442 )
2023-11-23 14:14:43 +08:00
dbbed113cf
[feature](mtmv)(4)MTMV extends Olap ( #26645 )
2023-11-23 14:10:36 +08:00
4fc638c98c
[fix](memory) Fix make_top_consumption_snapshots heap-use-after-free #27434
2023-11-23 13:59:53 +08:00
75d1594d11
[pipelineX](minor) remove unused code ( #27446 )
2023-11-23 11:53:06 +08:00
b79f5d77f1
[improve](move-memtable) improve logging messages ( #27443 )
2023-11-23 11:46:29 +08:00
33de92cc61
[improve](nereids) support agg function of count(const value) pushdown #26677
...
support sql: select count(1)-count(not null) from table, the agg of count could push down.
2023-11-23 11:26:06 +08:00
301bfe4d5d
[Bug](mark-join) fix mark join report error when probe block have column do not output ( #27360 )
...
fix mark join report error when probe block have column do not output
2023-11-23 11:16:02 +08:00
42c32c584b
[case](regression) test invalid jsonpaths ( #27359 )
...
Co-authored-by: qinhao <qinhao@newland.com.cn >
2023-11-23 10:16:34 +08:00
5b8aaf96d2
[fix](planner)scan node should project all required expr from parent node ( #26886 )
2023-11-23 09:44:21 +08:00
179d4ab754
[bugfix](potential bug) add lock when modify total tasks number ( #27428 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-11-23 09:28:09 +08:00
fe5c4e3b46
[pipelineX](api) Fix core dump for pipelineX API ( #27437 )
2023-11-23 00:24:32 +08:00
044a295541
[performance](Planner): optimize getStringValue() in DateLiteral ( #27363 )
...
- reduce cost of `getStringValue()`
- original code don't consider `microsecond` part in `getStringValue()`
2023-11-22 22:42:44 +08:00
1b3512d942
[pipelineX](bug) Fix cancel timeout ( #27396 )
2023-11-22 22:31:34 +08:00
a68b62b421
[refactor](datatype) Introduce a toolkits for clarify datelike types usage ( #26810 )
2023-11-22 22:08:13 +08:00
19c36dcc86
[Fix](statistics)Fix auto job start time incorrect bug ( #27402 )
...
Before, the auto analyze job start time was the job creation time, not the start to execute time, which is inaccurate. This pr is to change the start time to the first task start to execute time.
2023-11-22 21:38:08 +08:00
3e1a5b6e29
[profile](rf) make runtime filter profile readable ( #27323 )
2023-11-22 21:13:35 +08:00
0302a9d026
[fix](fe) slots in having clause should be set to need materialized ( #27412 )
2023-11-22 19:47:09 +08:00
7cdad51133
[feature](invert index) add the reader buffer as a parameter ( #27339 )
...
The inverted index read buffer is configurable
2023-11-22 19:29:20 +08:00
f49722163e
[pipelineX](bug) Fix query timeout due to broadcast ( #27398 )
2023-11-22 19:25:04 +08:00
a2a6a722eb
[test](regression) add routine load command test ( #27384 )
2023-11-22 18:55:35 +08:00
96e3636905
[Fix](Group_commit) Fix group commit regression test failure ( #27380 )
2023-11-22 18:55:20 +08:00
c7e3d74ffc
[minor](stats) Report error with more friendly meesage when timeout ( #27197 )
2023-11-22 04:50:09 -06:00
