23a75d0277
[FIX](decimalv3) Fix decimalv3 with abnormal value same with mysql result ( #24499 )
...
Fix decimalv3 with abnormal value same with mysql result
2023-09-18 11:12:26 +08:00
f04bc05a7e
[fix](agg) The offset value was added twice in 'pack_fixed' ( #24506 )
2023-09-18 10:24:32 +08:00
591aeaa98d
Revert "[schedule](pipeline) Remove wait schedule time in pipeline query engine ( #23994 )" ( #24472 )
...
This reverts commit 32a7eef96a09799c8336c1964bfe7d676b7e4c98.
2023-09-18 09:57:38 +08:00
7dcc68736d
[enhancement](disk) refine io error and report bad when disk is abnormal ( #24390 )
2023-09-17 11:07:05 +08:00
4b5cea1ef8
[enhancement](fix)change ordinary type null value is \N,complex type null value is null ( #24207 )
2023-09-16 21:46:42 +08:00
88adab3114
[fix](Nereids): fix be core when array_map is not nullable ( #24488 )
...
fix be core when array_map is not nullable
2023-09-16 20:39:15 +08:00
990d6c02ec
[Feature](new function) Add a uuid-numeric function, returns uuid in largerint type, 20x faster than uuid ( #24395 )
2023-09-16 18:26:13 +08:00
643d09de06
[fix](index compaction)skip index compaction when no output segment ( #24468 )
2023-09-16 16:42:39 +08:00
76ac77b1d0
[fix](compaction) compaction should catch exception when read next block ( #24484 )
2023-09-16 16:25:55 +08:00
8ce109bda7
[pipelineX](profile) phase 2: refine profile ( #24467 )
2023-09-16 14:28:20 +08:00
4dad7c94da
[fix](orc) fix the count(*) pushdown issue in orc format ( #24446 )
...
In previous, when querying hive table in orc format, and the file is splitted.
the result of select count(*) may be multiple of the real row number.
This is because the number of rows should be got after orc strip prune,
otherwise, it may return wrong result
2023-09-16 09:57:39 +08:00
cac089c7cd
[fix](compile) fix mac compile sort failed #24453
2023-09-16 09:52:20 +08:00
29824ccd9d
[Fix](Status) Disable printing stacktrace for InvalidArgument in BitShufflePageDecoder::seek_to_position_in_page #24419
2023-09-15 19:58:21 +08:00
b9ddcbf729
[feature](merge-cloud) Rewrite code related to IOContext ( #24269 )
2023-09-15 19:57:58 +08:00
ab69416922
[Bug](pipelineX) fix streaming agg ( #24449 )
...
fix streaming agg
2023-09-15 19:22:54 +08:00
07d4769134
[fix](bitmap) fix coredump of bitmap_from_array caused by null array literal ( #24404 )
2023-09-15 18:36:33 +08:00
7fd72351f9
[fix](agg) windown_funnel compatibility issue with multi backends ( #24385 )
2023-09-15 17:22:47 +08:00
b4d446055a
[fix](agg) need to call 'set_version' in nested functions ( #24381 )
...
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-15 17:20:20 +08:00
d24f3efd4a
[pipelineX](profile) Phase 1: refactor pipelineX detailed profile ( #24322 )
2023-09-15 16:14:05 +08:00
6dbe07bd3b
[Enhancement](inverted index) use conjunction query to accelerate fulltext equal query ( #24373 )
2023-09-15 15:34:57 +08:00
08740b47cd
[FIX](decimalv3) fix decimalv3 value with leading zeros ( #24416 )
...
now we make error if we deal with leading zeros in decimal value , type_precision >= precision will make value overflow and DCHECK will fail , so if here has leading zero we should only make type_precision > precision to make value right
2023-09-15 13:35:20 +08:00
29fe87982f
[improve](outfile) add file_suffix options for outfile ( #24334 )
2023-09-15 12:58:41 +08:00
df5b5ae0cb
[improvement](create tablet) backend create tablet round robin among disks ( #23218 )
...
Backend choose disk by disk available bytes and tablet num. If both are equal, round robin among them.
2023-09-15 11:39:43 +08:00
2976e9d8e5
[imrovement](iterators) reduce memory for union iterators ( #24197 )
2023-09-15 11:35:56 +08:00
c5e7f55b63
[performance](executor) optimize time_round function ( #23058 )
...
optimize time_round function
2023-09-15 10:49:22 +08:00
23f01ddf3a
[feature](profile) support simply profile ( #23377 )
...
A Simplified Version of the Profile
Divided into three levels:
Level 2: The original profile.
Level 1: Instances with identical structures are merged, utilizing concatenation for info strings, and recording the extremum for time types.
Note that currently, this is purely experimental, simplifying the profile on the frontend (you can view profiles at any level).
Subsequently, we will transition the simplification process to the backend. At that point, due to the simplification being done on the backend, viewing profiles at other levels won't be possible.
Due to the issue with the pipeline structure, the active time does not accurately reflect the time of the operators.
```
set enable_simply_profile = false;
set enable_simply_profile = true;
```
2023-09-15 10:25:14 +08:00
9c681692bd
Revert "[fix] fix http_stream retry mechanism ( #23969 )" ( #24407 )
...
This reverts commit 05e365ea137eb8c92b8e7eedc7d1435e83f065ae.
2023-09-15 10:07:53 +08:00
05e365ea13
[fix] fix http_stream retry mechanism ( #23969 )
...
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-14 21:41:11 +08:00
d20365cdcf
[fix](transaction) fix publish txn fake succ ( #24273 )
2023-09-14 21:04:59 +08:00
0c30720c99
[Hotfix](merge-on-write) Fix when DeltaWriter don't report num_filtered_rows in TTabletCommitInfo ( #24352 )
2023-09-14 20:58:08 +08:00
927de33166
[config](log) disable StreamLoad log default and enable in regression pipeline ( #24354 )
...
disable StreamLoad log default and enable in regression pipeline
2023-09-14 20:47:26 +08:00
3ee89aea35
[Feature](merge-on-write)Support ignore mode for merge-on-write unique table ( #21773 )
2023-09-14 18:03:51 +08:00
35c5d71549
[Improvement](join) some improvement of hash join ( #23972 )
...
some improvement of hash join
2023-09-14 17:55:35 +08:00
9c6734e68e
[bugfix](index) Fix build index limitations ( #24358 )
...
1. skip existed index on column with different id on build index
2. allow build index for CANCELED or FINISHED state
2023-09-14 17:53:22 +08:00
4fbb25bc55
[Enhancement](function) Support date_trunc(date) and use it in auto partition ( #24341 )
...
Support date_trunc(date) and use it in auto partition
2023-09-14 16:53:09 +08:00
8e7f7c9566
[fix](profile) move probe time to pull and add LoopGenerateJoin time #24302
2023-09-14 16:41:01 +08:00
d8feca2530
[Enhancement]The page cache can be parameterized by the session variable of fe. ( #23981 )
2023-09-14 14:28:19 +08:00
1ef22d7f7c
[Feature](variant) add variant type ( #24170 )
...
Add variant type for metadata Add persistent information for variant, including the path of variant sub-columns, persisting them to the segment footer and tablet schema of the rowset.
2023-09-14 14:21:53 +08:00
049032b4b3
Refactor Slice move/copy ctor && assignment to default ( #24169 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-14 14:18:10 +08:00
268c867679
[Improve](serde)replace function_cast from_string to serde ( #24087 )
...
Now we can not support streamload with column which is map/array nested map/array
serde can do this now , so we can replace it
Notice. if item data in complex type data is empty we just return error, instead of makeup default value , because now we can not define right default for complex type
2023-09-14 13:53:16 +08:00
ed108d48fa
[fix](invert index) fix query use char filter ( #24268 )
2023-09-14 11:42:47 +08:00
5dede120db
[Enhancement](inverted index) fix compound predicates error ( #24300 )
2023-09-14 09:21:41 +08:00
9b7f041bea
[Bug](function) fix explode_json_array_int can't handle min/max values ( #24284 )
...
the json str get value maybe beyond max/min of Int64,
so add some check to limit the value, and return the max/min of Int64
2023-09-14 09:20:59 +08:00
539a7c2975
[fix](agg) Add the unimplemented functions in 'AggregateFunctionCountNotNullUnaryOld' ( #24310 )
...
Similar to #24211
2023-09-14 09:19:02 +08:00
11afd321cb
[fix](es catalog) fix issue with select and insert from es catalog core ( #24318 )
...
Issue Number: close #24315
The root cause of this issue is that Elasticsearch's long type allows inserting floats and strings. Doris did not handle these cases when doing type conversion. The current strategy is to take the integer before the decimal point if a float or string is found.
2023-09-13 23:07:31 +08:00
07dd6830e8
[pipelineX](refactor) add union node in pipelineX ( #24286 )
2023-09-13 20:39:58 +08:00
86aa3802cf
[log](config) set streamload record default to enable
2023-09-13 16:32:30 +08:00
ccfc912ec0
[Fix](merge-on-write) Check the returned filtered rows from different replicas ( #24191 )
2023-09-13 16:03:17 +08:00
563c3f75ff
[feature](move-memtable) share delta writer v2 among sinks ( #24066 )
2023-09-13 14:39:29 +08:00
335064f897
[feature](Nereids) add lambda argument and array_map function ( #23598 )
...
add array_map function
SELECT ARRAY_MAP(x->x+1, ARRAY(87, 33, -49))
+----------------------------------------------------------------------+
| array_map([x] -> (x + 1), x#1 of array(87, 33, -49)) |
+----------------------------------------------------------------------+
| [88, 34, -48] |
+----------------------------------------------------------------------+
2023-09-13 14:24:16 +08:00
