Commit Graph

7154 Commits

Author SHA1 Message Date
21ce85dc14 [fix](money_format) fix money_format #31883 2024-03-07 16:53:19 +08:00
da5a40077f [fix](http stream) http stream support memtable_on_sink_node header (#31866) 2024-03-07 16:53:19 +08:00
9bf22a872a [Bug](fix) fix or and "<=>" cause coredump in query (#31884) 2024-03-07 16:53:19 +08:00
ff8c679851 [fix](group commit) group commit may heap-use-after-free if execute plan failed (#31839) 2024-03-07 16:12:23 +08:00
28f0b7eb32 [Improvement](profile)Add tvf active_be_tasks() #31815 2024-03-07 16:12:23 +08:00
538032a75c [fix](partition) add log when tablet partition id eq 0 (#31796) 2024-03-07 16:11:25 +08:00
2e94512e07 [fix](build)Fix index_tool build error (#31834)
Co-authored-by: Luennng <luennng@gmail.com>
2024-03-07 16:11:25 +08:00
Pxl
2913a111f6 [Bug](top-n) init query_ctx runtime predicate before _build_pipelines #31895 2024-03-07 10:19:42 +08:00
Pxl
b4dbb087c0 [Bug](top-n) init query_ctx runtime predicate before operators prepare #31876 2024-03-06 19:09:10 +08:00
1dcb99519d [fix](move-memtable) use tuple desc from schema param for delta writer (#31747) 2024-03-06 13:08:30 +08:00
4f174c4fb9 [feature](function) Support for aggregate function foreach combiner (#31526) 2024-03-06 13:08:30 +08:00
9af64d848f [fix](pipelineX) fix error distribution in DistinctStreamingAggOperatorX (#31804) 2024-03-06 13:08:30 +08:00
c43bc8349f [fix](move-memtable) free resources when fail to open stream (#31762) 2024-03-06 13:07:59 +08:00
eea9b56f69 [fix](group commit) handle group commit create plan error (#31757) 2024-03-06 13:07:59 +08:00
808563470f [pipelineX](debug) Refactor code and complete debug string (#31733) 2024-03-06 13:07:49 +08:00
7c30cb20fd [Fix](partial update) Fix partial update load false when schema includes auto increment column (#31725)
Problem:
When partially updating columns without specifying the auto-increment column, and the imported data contains new keys, an error stating the auto-increment column could not be found occurs.

Reason:
The logic for partial column updates does not account for new keys in auto-increment columns. Since auto-increment columns can be generated by the system, it's possible to omit this column data during import. However, partial column updates treat this as a regular column, expecting it to be nullable or have a default value for automatic filling, overlooking the fact that auto-increment columns can also be auto-filled. This oversight leads to the error.

Solution:
Incorporate a check for auto-increment columns into the partial column update logic, and include the logic for generating auto-increment column values in the process of completing partial updates.
2024-03-06 13:06:27 +08:00
cca0773261 [feature](function) round function defaults to rounding normally 2024-03-06 13:06:26 +08:00
231768db0d [Performance](exec) Support runtime filter in <=> join (#31754) 2024-03-06 13:06:26 +08:00
Pxl
25d1934289 [Feature](topn) support multiple topn filter on backend (#31665)
support multiple topn filter on backend
2024-03-06 13:05:22 +08:00
3777ffb43f [enhancement](nereids)support null partition for list partition (#31613) 2024-03-06 13:05:22 +08:00
91efb6a43d Revert "[fix](meta-tool) Fix compile meta tool (#31457)"
This reverts commit 60de835d48536977e25c1841f4eed6abb0f2a311.
2024-03-04 21:49:07 +08:00
65d45daf8a [Bug](coredump) fix regresstion test coredump in multi thread access map (#31664) 2024-03-03 19:30:55 +08:00
4386a71709 [bugfix](wgcore) map at only get reference and it will core in multithread
f
2024-03-03 15:54:26 +08:00
b248d3a27e [Refactor](rf) Refactor the rf code interface to remove update filter v1 (#31643) 2024-03-02 17:12:49 +08:00
0794fe3e21 [Bug](regression) fix bug of null in topn opt (#31669) 2024-03-02 17:12:34 +08:00
ff5e9341bf [fix](pipelineX)error output_block settings result in excessive memory usage. #31680 2024-03-02 01:09:10 +08:00
8a44c180bf [opt](scan) read scan ranges in the order of partitions (#31630) 2024-03-02 01:09:10 +08:00
daa171ee3a [Update](cloud) add inverted index tmp dir support (#31484) 2024-03-02 01:08:51 +08:00
4654ec7226 [fix](profile)Fix load profile print by default (#31677)
only enable_profile is true, print profile.
2024-03-02 01:08:51 +08:00
846246e90b [pipelineX](bug) cancel pipeline tasks if timeout (#31635) 2024-03-01 16:59:43 +08:00
7d1db6cd1f [refactor](exception safe) Refactor delete handler and block column predicates to make sure exception safe (#31618) 2024-03-01 14:21:17 +08:00
8ac1adf183 [Fix](Variant) fix variant root may be emtpy in OlapColumnDataConvertorVariant::set_source_column (#31572)
When compaction, if some segments miss variant root, there is chance to get emtpy root variant.So add some defence
code in OlapColumnDataConvertorVariant to prevent from accessing null root

```
5# doris::vectorized::ColumnObject::Subcolumn::get_finalized_column_ptr() const at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/vec/columns/column_object.cpp:556
 6# doris::vectorized::OlapBlockDataConvertor::OlapColumnDataConvertorVariant::set_source_column(doris::vectorized::ColumnWithTypeAndName const&, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src
/vec/olap/olap_data_convertor.cpp:1076
 7# doris::vectorized::OlapBlockDataConvertor::set_source_content(doris::vectorized::Block const*, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/vec/olap/olap_data_convertor.cpp:207
 8# doris::segment_v2::SegmentWriter::append_block(doris::vectorized::Block const*, unsigned long, unsigned long) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/olap/rowset/segment_v2/segment_writer.cpp:727
 9# doris::VerticalBetaRowsetWriter::add_columns(doris::vectorized::Block const*, std::vector > const&, bool, unsigned int) at /mnt/ssd01/selectdb-doris-package/enterprise-core/be/src/olap/row
set/vertical_beta_rowset_writer.cpp:125
```
2024-03-01 14:19:28 +08:00
81a537ed78 [pipelineX](bug) Fix aggregate crash if open failed (#31625) 2024-03-01 14:19:28 +08:00
d8b9909675 [Fix](Status) Handle returned Status correctly #31434 2024-03-01 04:25:43 +08:00
1398f11246 [improvement](group_commit) Empty wal should be deleted when replaying it (#31427)
* [improvement](group_commit) Corrupt wal should be deleted when replaying it

* edit
2024-03-01 04:25:43 +08:00
07703633dd [pipelineX](conf) enable pipelineX by default (#29894)
* update

* update
2024-03-01 04:25:43 +08:00
ae926d0d8c [pipelineX](bug) Fix core dump if union has no children (#31611) 2024-03-01 04:25:43 +08:00
819ab6fc00 [feature](sink) support paritition tablet sink shuffle (#30914)
Co-authored-by: morrySnow <morrysnow@126.com>
2024-03-01 04:25:43 +08:00
0aa7108ee2 [fix](merge-on-write) incorrect result caused by key range filter with pk (#31456) 2024-02-29 19:51:47 +08:00
4a05e5a275 [fix](load) delete bytes_appended debug point which may cause bad page (#31602) 2024-02-29 19:51:18 +08:00
92e3b31f50 [feature](invert index) match_phrase_edge feature added (#31142) 2024-02-29 19:51:18 +08:00
c72e55d867 [enhancement](core) throw exception instead of core during insert_range_from method (#31592)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-02-29 19:51:18 +08:00
e7de2ba0ac [refactor](raw ptr) disable some raw pointer usage and some unused code (#31595)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-02-29 19:51:18 +08:00
c40c16b8b3 [improve](conf)refactor fuzzy mode in BE (#31412)
refactor the code of fuzzy in BE, and will be add more variables in it, then could test case at different mode.
2024-02-29 19:51:07 +08:00
0b5b7175d6 [fix](multi-catalog) add max compute custom odps and tunnel url (#31390)
add max compute custom odps and tunnel url
2024-02-29 16:44:40 +08:00
9c4708ee74 [function](random_bytes)add random_bytes function (#31547)
SELECT random_bytes(10);

random_bytes(10) |
----------------------+
0x9b8ea00b7d1084bc5b26|
2024-02-29 16:44:39 +08:00
4636b6195b [Fix](JNI) fix BE core when using JNI to query the empty map type value (#31502) 2024-02-29 14:03:38 +08:00
ff3c7765d6 [Bug](Func) Fix negative number in bitmap return error result (#31563) 2024-02-29 12:38:03 +08:00
82add8dfc1 [Fix](timezone) Introduce a config to use Doris tzdata directly (#31561) 2024-02-29 12:38:03 +08:00
2b7fa9d6bb [pipelineX](refactor) Rebuild relationship between dep and operator (#31487) 2024-02-29 12:38:03 +08:00