5e884bc065
[Fix](bitmap index) fix is_like_predicate for bitmap index evaluate ( #25961 )
2023-10-27 20:23:42 +08:00
606223ab62
Revert "[refactor](pipeline) simplify runtime state ctor ( #25995 )" ( #26029 )
...
This reverts commit a01922cdc55e2b3a63d9a9aafb38ac5ed64c6dd3.
2023-10-27 18:15:30 +08:00
340a37116f
[cleanup](load) remove unused dynamic schema code ( #25932 )
2023-10-27 16:21:40 +08:00
a01922cdc5
[refactor](pipeline) simplify runtime state ctor ( #25995 )
2023-10-27 15:45:29 +08:00
a6d64c6b25
[refine](profilev2) format profilev2 ( #25963 )
2023-10-27 14:26:38 +08:00
4ee24d8cb1
[FIX](upgrade)fix upgrade for predict column delete collection type will make core #26006
2023-10-27 14:25:45 +08:00
46d40b1952
[refactor](executor)Remove empty group logic #26005
2023-10-27 14:24:41 +08:00
ae8e6fbe59
[Fix](inverted index) fix empty array index writer bug ( #25984 )
2023-10-27 11:27:44 +08:00
cedab51676
[enhancement](UT) add unit test cases about bitmap ( #25867 )
...
* [fix](bitmap) incorrect result of operator ==
* [enhancement](UT) add unit test cases about bitmap
2023-10-27 11:27:14 +08:00
bac523956f
[Update](clucene) update clucene version to latest ( #25981 )
2023-10-27 10:42:56 +08:00
0eb86919cc
[fix](block-convertor) clear filter bitmap per batch to get the correct filtered rows ( #25989 )
2023-10-27 10:40:07 +08:00
c86fad7cbd
[Fix](orc-reader) Fix orc decimal128 scale issue. ( #25977 )
2023-10-26 08:50:18 -05:00
d9a3aa5c06
[pipelineX](improvement) improve local shuffle ( #25964 )
2023-10-26 21:42:43 +08:00
69015df767
[Fix](inverted index) reorder ConjunctionQuery deconstruct order ( #25972 )
2023-10-26 08:34:09 -05:00
2679fa4ea7
[improvement](tablet clone) furthur repair replicas should be check even if they are versions catchup ( #25551 )
2023-10-26 18:14:40 +08:00
c3527672a5
[refactor & pipelineX][pick fix] Pick fix of predicate pushdown to pipelineX ( #25953 )
...
Co-authored-by: JackDrogon <jack.xsuperman@gmail.com >
2023-10-26 18:04:43 +08:00
c1d64a7128
[Feature](datatype) Add IPv4/v6 data type for doris ( #24965 )
2023-10-26 17:33:28 +08:00
1ba8a9bae4
[feature-wip](executor)Fe send topic info to be ( #25798 )
2023-10-26 15:52:48 +08:00
d6c64d305f
[chore](log) Add log to trace query execution #25739
2023-10-26 14:09:25 +08:00
005a36322e
[opt](index compaction) optimize checks before index compaction ( #25486 )
2023-10-25 22:21:46 -05:00
6e1a4dbda2
[Fix](predicate pushdown) Common expression not acting on any slot should not be pushed down ( #25901 )
2023-10-26 11:20:12 +08:00
31d2a9a4f5
[Enhancement](function) support fractions for convert_tz(datetimev2) ( #25915 )
...
mysql> select convert_tz('2019-08-01 01:01:02.123' , '+00:00', '+07:00');
+----------------------------------------------------------------------------------+
| convert_tz(cast('2019-08-01 01:01:02.123' as DATETIMEV2(3)), '+00:00', '+07:00') |
+----------------------------------------------------------------------------------+
| 2019-08-01 08:01:02.123 |
+----------------------------------------------------------------------------------+
1 row in set (0.18 sec)
2023-10-26 10:46:47 +08:00
ad1313cce6
[refactor](pipelineX) refine _build_side_pipelines ( #25871 )
2023-10-26 10:32:23 +08:00
78165a3f6b
[refine](pipelineX) use finish dependency in task ( #25881 )
2023-10-26 10:32:13 +08:00
6dd60c6ebb
[Enhance](BE) Add -Wshadow-field compile option to avoid unexpected shadowing behavior ( #25698 )
...
* Fix `Tablet::_meta_lock` shadows member inherited from `BaseTablet`
* Add -Wshadow-field compile option to avoid unexpected shadowing behavior
2023-10-26 10:00:28 +08:00
da4de17d5c
[improvement](function) improve date_trunc function performance when timeunit is const ( #25824 )
...
this PR #22602 have check function.
only support date_trunc(column, const), so the second must be const literal
and no need to check time unit every row.
2023-10-26 09:51:21 +08:00
77f727e0a1
[chore](compaction) Print roswet size when compaction finishes successfully ( #25891 )
2023-10-26 09:49:28 +08:00
4434b3f32e
[fix](move-memtable) use pthread mutex in LoadStreamMgr ( #25882 )
2023-10-26 09:19:59 +08:00
0dcbc5ee18
[fix](backup) missing use_path_style properties for minio ( #25803 )
...
Follow #25496 .
In #25496 , I fixed the issue that the aws s3 properties are invalid when passing from FE to BE.
But it missed the `use_path_style` property, which is useful for minio access.
This PR fix it.
2023-10-26 01:19:28 +08:00
7f66be84d5
[fix](Outfile) Infer the column name if the column is expression in select into outfile ( #25854 )
...
This pr do two things:
1. Infer the column name if the column is expression in `select into outfile`. The rule for column name generation can be refered in pr: #24990
2. fix bug that it will core dump if the `_schema` fails to build in the open phase in vorc_transformer.cpp
TODO:
1. Support infer the column name if the column is expression in `select into outfile` in new optimizer(Nereids).
2023-10-25 22:49:04 +08:00
e783ef716f
[fix](multi-table) fix unknown source slot descriptor when load multi table ( #25762 )
2023-10-25 21:52:01 +08:00
f31c1d858a
[fix](merge-on-write) fix duplicate key in schema change ( #25705 )
...
It should be ensured that the obtained versions are continuous when calculate delete bitmap calculations in publish.
The remaining NOTREADY tablet in the schema change failure should be dropped.
When a rowset was deleted, the delete bitmap cannot be deleted until there are no read requests to use the rowset.
2023-10-25 05:59:48 -05:00
e8f479882d
[pipelineX](local exchange) Add local exchange operator ( #25846 )
2023-10-25 18:45:02 +08:00
8a436d8ecc
[FIX](collectiontype) fix shrink char column in map/struct ( #25725 )
...
fix shrink char column in map/struct
before we has char with specific length defined in map or struct field
we select map or struct , the char column in which one has been padding if we just insert less than specific length chars
but in mysql here just show inserted chars not padding specific length chars
---------
Co-authored-by: yiguolei <676222867@qq.com >
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-10-25 17:16:13 +08:00
693982fd1a
[feature](decimal) support decimal256 ( #25386 )
2023-10-25 15:47:51 +08:00
97c2fe75d1
[feature](pipelineX) use expected<T, Status> in local_state ( #25878 )
2023-10-25 15:23:17 +08:00
49b73483fd
[fix](field) fix coredump of field function when the first argument is const ( #25859 )
2023-10-25 14:14:32 +08:00
235ae9ded4
[improvement](fragment) optimize to get query context logic ( #25621 )
2023-10-25 14:03:47 +08:00
e3317ac1b9
[fix](compile) fix BE compile failure on Mac ( #25876 )
2023-10-25 12:55:00 +08:00
0068783e88
[fix](merge-on-write) change some static_cast<void> to RETURN_IF_ERROR ( #25863 )
2023-10-25 11:23:06 +08:00
411fae951b
[fix](trash core) fix get trash directory core when stop be ( #25428 ) ( #25829 )
2023-10-25 11:05:25 +08:00
5e3277e8fb
[improvement](routine-load) add routine load rows check ( #25818 )
2023-10-25 11:04:28 +08:00
552091f21f
[performance](pipelineX) optimize pipelineX ( #25713 )
2023-10-25 10:13:17 +08:00
6b2eed779c
[feature](AuditLog) add scanRows scanBytes in auditlog ( #25435 )
2023-10-25 10:00:35 +08:00
88dd480c2e
[enhancement](CSV-reader) enhance err log for csv reading containing enclose or escape ( #25816 )
2023-10-24 22:10:08 +08:00
69c3e08699
[improve](load) set load id in signal handler ( #25813 )
2023-10-24 21:58:39 +08:00
bab7581054
[fix](delete) fix potential delete fail after adding columns ( #25817 )
2023-10-24 21:45:21 +08:00
d4fca3c67e
[fix](load) fix load rpc timeout ( #25701 )
2023-10-24 19:50:44 +08:00
b16af25f7b
[pipelineX](fix) fix union operator which return only const values ( #25837 )
2023-10-24 18:51:41 +08:00
0147561c88
[Update](clucene) sync clucene version to latest ( #25821 )
2023-10-24 18:22:42 +08:00