2ec3395087
[fix](planner)the data type should be the same between input slot and sort slot ( #27137 )
2023-11-23 18:40:02 +08:00
ab739a6cdc
[Chore](workflow)Fix Pr comment not worker ( #27400 )
2023-11-23 18:17:31 +08:00
6fdaf2da6f
[fix](ci) 1. if skip compile then skip p0 p1 external pipelinex_p0 also, ( #27469 )
...
1. if skip compile then skip p0 p1 external pipelinex_p0 also
2. if change files too many, export all_files may cause problem of 'Argument list too long', change to use file
Co-authored-by: stephen <hello-stephen@qq.com >
2023-11-23 18:11:29 +08:00
772f181e94
[fix](stats) Fix thread leaks when doing checkpoint ( #27334 )
2023-11-23 03:18:19 -06:00
ca7dbc3636
[refactor](pipelineX) refine union dependency ( #27348 )
2023-11-23 16:28:32 +08:00
4b22fc14d5
[Feature](update) Support update on current_timestamp ( #25884 )
2023-11-23 16:23:31 +08:00
5d9c555dcf
[minor](stats) Fix potential npe when loading stats ( #27200 )
...
Besides, lower down the log level of loading stats from warning to debug, since it doesn't such matter for workflow.
2023-11-23 01:37:58 -06:00
b457856bd2
[chore](be) remove bthread scanner related codes ( #27417 )
2023-11-23 15:18:49 +08:00
8e3b4e99d9
[improve](move-memtable) add switch for stream load in fe.conf ( #27440 )
2023-11-23 15:11:17 +08:00
c884e46e6c
[regression test](routine test) add case for desired_concurrent_number ( #27372 )
2023-11-23 15:11:01 +08:00
afe5af433a
[log](tablet) add create / gc tablet log ( #27452 )
2023-11-23 14:42:47 +08:00
6253f7d6c7
[test](regression) add routine load condition test ( #27430 )
2023-11-23 14:37:35 +08:00
97932d0381
[fix](export) the label of export should be unique with database scope ( #27401 )
...
### How to reproduce
1. create a database db1 and a table tbl1;
2. insert some data and export with label L1;
3. drop the db1 and tbl1, and recreate them with same name.
4. insert some data and export with same label L1;
Expect: export success
Actual: error: Label L1 have already been used.
This PR fix it.
2023-11-23 14:30:57 +08:00
f6a02fd401
[regression test](routine load) add case for invaild format ( #27245 )
2023-11-23 14:30:36 +08:00
699798eaa7
[fix](function) make TIMESTAMP function DEPEND_ON_ARGUMENT ( #27343 )
...
* fix
* fix nullable
* remove null
* add case
2023-11-23 14:26:19 +08:00
93cfdffb75
[regression test](routine test) add case for exec_mem_limit ( #27308 )
2023-11-23 14:25:54 +08:00
7a75f8c380
[improve](move-memtable) set brpc streaming params in config ( #27442 )
2023-11-23 14:14:43 +08:00
dbbed113cf
[feature](mtmv)(4)MTMV extends Olap ( #26645 )
2023-11-23 14:10:36 +08:00
4fc638c98c
[fix](memory) Fix make_top_consumption_snapshots heap-use-after-free #27434
2023-11-23 13:59:53 +08:00
75d1594d11
[pipelineX](minor) remove unused code ( #27446 )
2023-11-23 11:53:06 +08:00
b79f5d77f1
[improve](move-memtable) improve logging messages ( #27443 )
2023-11-23 11:46:29 +08:00
33de92cc61
[improve](nereids) support agg function of count(const value) pushdown #26677
...
support sql: select count(1)-count(not null) from table, the agg of count could push down.
2023-11-23 11:26:06 +08:00
301bfe4d5d
[Bug](mark-join) fix mark join report error when probe block have column do not output ( #27360 )
...
fix mark join report error when probe block have column do not output
2023-11-23 11:16:02 +08:00
42c32c584b
[case](regression) test invalid jsonpaths ( #27359 )
...
Co-authored-by: qinhao <qinhao@newland.com.cn >
2023-11-23 10:16:34 +08:00
5b8aaf96d2
[fix](planner)scan node should project all required expr from parent node ( #26886 )
2023-11-23 09:44:21 +08:00
179d4ab754
[bugfix](potential bug) add lock when modify total tasks number ( #27428 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-11-23 09:28:09 +08:00
fe5c4e3b46
[pipelineX](api) Fix core dump for pipelineX API ( #27437 )
2023-11-23 00:24:32 +08:00
044a295541
[performance](Planner): optimize getStringValue() in DateLiteral ( #27363 )
...
- reduce cost of `getStringValue()`
- original code don't consider `microsecond` part in `getStringValue()`
2023-11-22 22:42:44 +08:00
1b3512d942
[pipelineX](bug) Fix cancel timeout ( #27396 )
2023-11-22 22:31:34 +08:00
a68b62b421
[refactor](datatype) Introduce a toolkits for clarify datelike types usage ( #26810 )
2023-11-22 22:08:13 +08:00
19c36dcc86
[Fix](statistics)Fix auto job start time incorrect bug ( #27402 )
...
Before, the auto analyze job start time was the job creation time, not the start to execute time, which is inaccurate. This pr is to change the start time to the first task start to execute time.
2023-11-22 21:38:08 +08:00
3e1a5b6e29
[profile](rf) make runtime filter profile readable ( #27323 )
2023-11-22 21:13:35 +08:00
0302a9d026
[fix](fe) slots in having clause should be set to need materialized ( #27412 )
2023-11-22 19:47:09 +08:00
7cdad51133
[feature](invert index) add the reader buffer as a parameter ( #27339 )
...
The inverted index read buffer is configurable
2023-11-22 19:29:20 +08:00
f49722163e
[pipelineX](bug) Fix query timeout due to broadcast ( #27398 )
2023-11-22 19:25:04 +08:00
a2a6a722eb
[test](regression) add routine load command test ( #27384 )
2023-11-22 18:55:35 +08:00
96e3636905
[Fix](Group_commit) Fix group commit regression test failure ( #27380 )
2023-11-22 18:55:20 +08:00
c7e3d74ffc
[minor](stats) Report error with more friendly meesage when timeout ( #27197 )
2023-11-22 04:50:09 -06:00
cfb6af295f
[fix](stats) Fix creating too many tasks on new env #27364
...
If there exists huge datasets with many database and may tables and many columns, Auto collector might be submit too many jobs which would occupy too much of FE memory.
In this PR, limit job each round could submit up to 5
2023-11-22 16:53:31 +08:00
6a48abeb80
[feature](Nereids) support queries tvf ( #27138 )
2023-11-22 02:47:16 -06:00
fd3c42d8cf
[fix](test) order by clause in test_map ( #27390 )
2023-11-22 16:43:31 +08:00
732a3fa9c8
[fix](stats) fix auto collector always create sample job no matter the table size ( #26968 )
2023-11-22 02:42:40 -06:00
127525ebe2
[hotfix](jdbc catalog) fix realColumnNames serialize npe ( #27280 )
...
In the previous PR #27124 , we used `objectMapper.readValue` for deserialization. However, this method does not handle null fields, which can lead to issues when upgrading from older versions. Specifically, if a required field is missing in the persistent data, `String realColumnNamesJson = serializeMap.get(REAL_COLUMNS);` will return null, resulting in deserialization errors and frontend startup failure. This issue is likely to occur when upgrading from an older version that uses Jdbc Catalog to a new version including PR #27124 . As this represents a specific upgrade scenario involving compatibility with old version data structures, it was not covered in the regular PR test cases. Given the specificity and difficulty in replicating such a scenario, no special test cases were added for this PR.
2023-11-22 15:22:06 +08:00
39663119ca
[minor](doc) Add sql manual for stats #27176
2023-11-22 13:15:42 +08:00
e06e976a8b
[test](case) delete duplicate pipelineX cases ( #27381 )
2023-11-22 12:58:30 +08:00
5442e8d1fc
[pipelineX](dependency) split different dependencies ( #27366 )
2023-11-22 12:50:39 +08:00
604842526b
[improvement](expr) improve if expr performance ( #27296 )
2023-11-22 12:48:06 +08:00
1441387e5b
[improvement](doris compose) improve start be container speed ( #27368 )
2023-11-22 11:04:04 +08:00
b541de7a03
do not push down agg on aggregate column ( #27356 )
...
do not push down agg on aggregate column
2023-11-22 10:53:29 +08:00
b821672f8b
[test](regression) add 'sync' for som stream load ( #27357 )
2023-11-22 10:52:34 +08:00
