Commit Graph

18429 Commits

Author SHA1 Message Date
3837e7b779 [opt](filecache) do not sync segment data into storage system (#25691)
File cache will return the reading data only when its writer has finished the write operation and close the segment file. However there's no need to call fdatasync when closing segment file. fdatasync takes a lot of time, and severely impact on cache performance.
2023-10-24 18:08:56 +08:00
ade475a52b [regression](outfile)add regression for select outfile with underscore prefix #25797 2023-10-24 17:58:38 +08:00
b7c4cc0667 [opt](Nereids) let DecimalV2Literal overflow check same with V3 (#25699) 2023-10-24 04:40:32 -05:00
4cd0dae4b3 [improvement](auth) support show all properties (#25645)
support `show all properties`
2023-10-24 17:27:59 +08:00
Pxl
091cb0ce37 [Bug](materialized-view) add limit for group by with float/double on create mv (#25823)
doris do not support float/double key type on storage engine.
2023-10-24 17:06:45 +08:00
5e5a331de4 [fix](trigger) fix pipeline bug that does not trigger Doris_Performance_Clickbench_ClickbenchNew (#25827)
Co-authored-by: stephen <hello-stephen@qq.com>
2023-10-24 16:28:01 +08:00
Pxl
2972daaed9 [Bug](status) process error status on es_scroll_parser and compaction_action (#25745)
process error status on es_scroll_parser and compaction_action
2023-10-24 15:51:01 +08:00
9160834606 [FIX](resize) fix array and map offsets resize with default value (#25669) 2023-10-24 02:50:01 -05:00
57b2c2abc5 [opt](metric) add jvm jsonMetric (#25774)
The "http://fe_host:http_port/metrics?type=json" interface is missing the JVM metric.
2023-10-24 15:25:13 +08:00
a2d82220e2 [fix](tablet clone) clone add replica prefer choose the same medium (#25640) 2023-10-24 15:18:32 +08:00
c0f8c0af39 [FIX](collectiontype) fix collection type with char which without length (#25703)
fix create complex type like array/map/struct with char which without length
2023-10-24 02:16:37 -05:00
3c0fd5029d [fix](Nereids): support complex project in PushdownTopNThroughJoin (#25748) 2023-10-24 14:52:30 +08:00
0c8bce4292 [fix](partial update) fix some bugs about delete sign (#25712) 2023-10-24 14:33:33 +08:00
1c144d440d [regression](nereids)tpcds 1T plan shape check (#25599)
ds64 is not stable, it will be fixed in other pr
2023-10-24 14:26:40 +08:00
51bc49a727 [docs](truncate-table) load may fail when truncating table (#25793) 2023-10-24 14:10:26 +08:00
76fd566403 [Improve](topn opt) change multiget_data RPC worker pool from _heavy_work_pool to _light_work_pool (#25741)
Under some workload the `multiget_data` maybe stuck and raise rpc timeout.
Inorder to to minimize the latency of point queries, so it should be placed in `_light_work_pool`, since
it's typically finished in hundreds of millisecond
2023-10-24 14:07:52 +08:00
87b414cdae [Fix](query execution) Fix result sink fragment can't be cancelled in non-pipeline (#25524) 2023-10-24 11:30:29 +08:00
215c1625b2 [chore](fragmentid) rename fragment id to fragment instance id in thrift definition file (#25787)
* rename fragment id to fragment instance id in thrift definition file

* f

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2023-10-24 11:26:52 +08:00
0e73d061c3 [fix](regression) fix auth case for move-memtable streamload test (#25659)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
2023-10-24 10:54:48 +08:00
f9f539221f [fix](datetime) Added datetime compatibility logic (#25791) 2023-10-24 10:37:57 +08:00
f23fdcbbef [typo](doc)Adjust tablet_rowset_stale_sweep_time_sec parameter default value to 300 (#25584) 2023-10-24 10:32:08 +08:00
a4c9beba85 [fix](move-memtable) fallback if partial update (#25801) 2023-10-24 10:29:59 +08:00
5c9f3ab6ee [fix](nereids)do not generate min-max runtime filter for A<=>B and A!=B #25676 2023-10-24 10:23:22 +08:00
d62e914205 [opt](profile) set datalake profile level as 1 (#25686)
Follow #25491, only the profile marked as 1 will be shown in simplified profile.
2023-10-24 09:55:25 +08:00
0e0f8090f7 [refactor](text_convert)Use serde to replace text_convert. (#25543)
Remove text_convert and use serde to replace it.
2023-10-24 09:52:43 +08:00
08832d9f3a [Fix](exec) Fix date dict dead loop. (#25570) 2023-10-24 02:51:43 +08:00
9006e2b8a5 [fix](prefetch-read) make prefetch range correct to accelerate S3 load and fix its speed unbalance (#25775) 2023-10-23 20:02:24 +08:00
5f6371bf0f [Improve](datatype) change check_column to check data type (#25466)
* change check_column to check data type

* fix is_number contains is_decimal

* fix array element
2023-10-23 18:36:37 +08:00
28c799ce35 [Docs](partial update) Fix a typo in docs in partial update for insert statement (#25776) 2023-10-23 17:54:47 +08:00
206aeabe9a [pipelineX](minor) remove unused timer (#25766) 2023-10-23 17:50:46 +08:00
267c11207b [feature](paimon)paimon catalog supports complex types (#25364) 2023-10-23 17:32:13 +08:00
6a6e10c182 [fix](java udf) make executor class thread local (#25758) 2023-10-23 16:55:15 +08:00
b5ee4a9dbb [enhancement](profilev2) add some fields for profile v2 (#25611)
Add 3 counters for ExecNode:

ExecTime - Total execution time(excluding the execution time of children).
OutputBytes - The total number of bytes output to parent.
BlockCount - The total count of blocks output to parent.
2023-10-23 15:55:40 +08:00
5cb5121cf6 [coverage](pipeline) Remove unless code and add call method for coverage (#25552)
Remove unless code and add call method for coverage
2023-10-23 15:52:43 +08:00
b8452812df [bug](function) fix regexp_extract_all can't handle empty str (#25717) 2023-10-23 15:47:12 +08:00
2c3bc65fae [feature](Nereids): generate left deep tree when stats is unknown (#25620)
generate left deep tree when stats is unknown
2023-10-23 15:41:55 +08:00
6f7f0a24c5 [doc])(sidebae)Update partial-update sidebars.json (#25357) 2023-10-23 15:15:59 +08:00
57340a4187 [feature](nereids) add function array_agg (#25630) 2023-10-23 02:05:54 -05:00
75000a5f6e [enhancement](stmt-exec) make CTAS use insert timeout fix forward timeout (#25731) 2023-10-23 14:57:02 +08:00
ed85c441b7 [Fix](partial update) Fix wrong comment in .proto file (#25742)
1. remove deprecated comment on fields that is wrongly added in #25147. These fields will be used when coordinator BE send infos to executor BEs. They will only be used during RPC and will not be persisted.
2. eliminate some unnecessary copys.
2023-10-23 14:39:54 +08:00
d0da94e22b [refactor](streamload) refactor stream load executor (#25615) 2023-10-23 14:34:26 +08:00
09b2593035 [enhancement](Nereids): when rule return original plan, skip copyIn() (#25730) 2023-10-23 12:38:43 +08:00
Pxl
6714966df2 [Chore](function) remove bit_cast/bit_helper (#25700)
remove bit_cast/bit_helper
2023-10-23 11:54:14 +08:00
cbc5c91aec [fix](datetime) fix unstable str_to_date function result (#25707)
fix unstable str_to_date function result
2023-10-23 11:52:08 +08:00
4889841ff7 [thirdparty](import) import avx2neon library (#25383)
import avx2neon library
2023-10-23 11:51:54 +08:00
7de3d9882c [regresstion-test](jdbc catalog)Mariadb compatible test (#25664) 2023-10-23 11:51:03 +08:00
144e12ae78 [fix](rpc) Rebuild failed channel to avoid connection refused (#25688) 2023-10-23 11:32:24 +08:00
Pxl
e69b8abb86 [Feature](materialized-view) support delete stmt on materialized-view (#25710)
support delete stmt on materialized-view
2023-10-23 10:44:55 +08:00
c51146df10 [Fix](segment) need to rebuild col_id_to_predicates when true predicates encountered (#25685) 2023-10-22 21:26:52 -05:00
Pxl
2e2d5bcba2 [Improvements](status) catch some error status (#25677)
catch some error status
2023-10-23 10:19:08 +08:00