74e452f19c
[bug](bitmap) fix bitmap value copy operator not call reset ( #26451 )
...
when a empty bitmap assign to other bitmap
the other bitmap should reset self firstly, and then set empty type.
2023-11-09 10:05:09 +08:00
58bf79f79e
[fix](move-memtable) pass load stream num to backends ( #26198 )
2023-11-08 16:16:33 +08:00
519b48648e
[fix](move-memtable) handle status when possible ( #26526 )
2023-11-08 10:09:06 +08:00
32b36d3c9c
[refactor](move-memtable) rename proto OpenStreamSink to OpenLoadStream ( #26527 )
2023-11-07 22:41:20 +08:00
1e2a614a46
[fix](workflow) Fix failure test cases in BE UT (macOS) ( #26425 )
...
1. Fix memory issues in LoadStreamMgrTest.
2. Skip S3FileWriterTest by default because it depends on the environment in teamcity.
3. Fix VTimestampFunctionsTest.convert_tz_test.
2023-11-06 10:44:44 +08:00
8bd06aff7e
[Chore](MoW) remove unused code about rowset tree ( #26282 )
2023-11-02 20:25:27 +08:00
a5ef90dacc
[enhancement](recover) support skipping missing version in select by session variable ( #25654 )
2023-11-02 20:01:51 +08:00
a4e415ab09
[feature](hive)Support hive tables after alter type. ( #25138 )
...
1.Reconstruct the logic of decode to read parquet. The parquet reader first reads the data according to the parquet physical type, and then performs a type conversion.
2.Support hive alter table.
2023-11-02 00:24:21 +08:00
3e10e5af39
[Fix](Serde) Fix content displayed by complex types in MySQL Client ( #25946 )
...
This pr makes three changes to the display of complex types：
1. NULL value in complex types refers to being displayed as `null`, not `NULL`
2. struct type is displayed as "column_name": column_value
3. Time types such as `datetime` and `date`, are displayed with double quotes in complex types. like
`{1, "2023-10-26 12:12:12"}`
This pr also do a code refactor:
1. nesting_level is set to a member variable of the `DataTypeSerDe`, rather than a parameter in methods.
What's more, this pr fix a bug that fileSize is not correct, introduced by this pr: #25854
2023-11-01 23:48:55 +08:00
bfca1bf206
[Enhancement] Implement format methods for Status ( #26133 )
2023-11-01 16:55:25 +08:00
0449a240f4
[Fix](from_unixtime) Keep consistent with MySQL & bug fix ( #25966 )
...
Bug fix: implicit convert from int32 -> int64 makes negative time stamp valid, so change signature to int64
Consistent: keep consistent with mysql.
2023-10-31 14:31:24 +08:00
8f320944a8
[fix](move-memtable) fix DeltaWriterV2 profile use-after-free ( #26110 )
...
The sink who creates the delta writer may be closed while other sinks still using this delta writer.
The parent profile is deconstructed and when the last sink trying to update the profile, it will meet use-after-free.
To address this issue, we record the profile number in delta writer,
and the last sink who close the delta writer will create and update the profile.
2023-10-31 13:52:18 +08:00
6761dc4113
[coverage](test) improve test coverage ( #26096 )
...
improve test coverage
2023-10-30 18:01:55 +08:00
6a85f46ff3
[refactor](move-memtable) rename open_stream_sink rpc to open_load_stream ( #25883 )
2023-10-29 10:07:14 +08:00
cedab51676
[enhancement](UT) add unit test cases about bitmap ( #25867 )
...
* [fix](bitmap) incorrect result of operator ==
* [enhancement](UT) add unit test cases about bitmap
2023-10-27 11:27:14 +08:00
2679fa4ea7
[improvement](tablet clone) furthur repair replicas should be check even if they are versions catchup ( #25551 )
2023-10-26 18:14:40 +08:00
da4de17d5c
[improvement](function) improve date_trunc function performance when timeunit is const ( #25824 )
...
this PR #22602 have check function.
only support date_trunc(column, const), so the second must be const literal
and no need to check time unit every row.
2023-10-26 09:51:21 +08:00
693982fd1a
[feature](decimal) support decimal256 ( #25386 )
2023-10-25 15:47:51 +08:00
9160834606
[FIX](resize) fix array and map offsets resize with default value ( #25669 )
2023-10-24 02:50:01 -05:00
08832d9f3a
[Fix](exec) Fix date dict dead loop. ( #25570 )
2023-10-24 02:51:43 +08:00
cbc5c91aec
[fix](datetime) fix unstable str_to_date function result ( #25707 )
...
fix unstable str_to_date function result
2023-10-23 11:52:08 +08:00
9519d7ede9
[enhancement](be-ut)Add more indexed column reader be unit test ( #25652 )
...
Added more unit tests
1. key exists or does not exist in a single page
2. key exists or does not exist in multiple pages
3. key is between two pages.
2023-10-23 10:12:53 +08:00
642c149e6a
remove datetime_value and move vecdatetime_value to doris namespace ( #25695 )
...
remove datetime_value and move vecdatetime_value to doris namespace
2023-10-20 22:08:17 +08:00
9b64286f2d
[enhancement](mow-ut)Add compaction commit delete bitmap unit test ( #25569 )
2023-10-20 19:54:12 +08:00
9a675fcdfc
[chore](be) Add default timezone files ( #25097 )
2023-10-20 13:12:24 +08:00
b964ab76b3
[refactor](shuffle) Simplify hash partitioning strategy ( #25596 )
2023-10-19 19:28:22 +08:00
9c9fc84f39
[feature](merge-cloud) Abstract BaseTablet for CloudTablet ( #24929 )
2023-10-18 20:29:04 +08:00
6cb947f72b
[refactor](unused code) delete unused method from field.h ( #25554 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-10-18 13:11:14 +08:00
b0e0a0569a
[Fix](row store) Real default value should be used instead of default… ( #25230 )
...
Before this PR the default value is not correct, we should use default value in Frontend schema.
2023-10-18 10:13:44 +08:00
cda8fb6b8b
[fix](load) return Status when error in RowsetWriter::build ( #25381 )
2023-10-17 09:40:23 +08:00
59ebbb351e
[feature](merge-cloud) Enable write into cache when uploading file to s3 using s3 file writer ( #24364 )
2023-10-16 21:31:02 +08:00
7ea456ef91
[fix](insert) make group commit wal_manager exit elegantly ( #25250 )
2023-10-14 23:14:06 +08:00
e5ef0aa6d4
[refactor](mysql result format) use new serde framework to tuple convert ( #25006 )
2023-10-14 19:46:42 +08:00
6f9a084d99
[Fix](Outfile) Use data_type_serde to export data to parquet file format ( #24998 )
2023-10-13 13:58:34 +08:00
73c3e3ab55
[Feature](x-load) support config min replica num for loading data ( #21118 )
2023-10-11 21:07:35 +08:00
c6b1c903e4
[fix](Regression-test) fix that the String type in a nested type should contain double quotes and add regression-test ( #25115 )
2023-10-11 18:30:26 +08:00
9e31cb26bb
[fix](parse_url) fix parse_url is not working in some case to extract the HOST ( #25040 )
...
Issue Number: close #24452
2023-10-09 00:14:58 +08:00
b91335dbb8
[refactor](columndecimal) is_decimal_v2 member is useless because column decimal could detect by itself ( #25110 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-10-08 18:09:19 +08:00
0df32c8e3e
[Fix](Outfile) Use data_type_serde to export data to csv file format ( #24721 )
...
Modify the outfile logic, use the data type serde framework.
2023-10-07 22:50:44 +08:00
cb0076e585
[fix](insert) fix group commit be ut ( #24968 )
2023-10-07 19:50:05 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
68087f6c82
[fix](json function) Fix the slow performance of get_json_path when processing JSONB ( #24631 )
...
When processing JSONB, automatically convert to jsonb_extract_string
2023-09-27 21:17:39 +08:00
5d138b6928
[remove](function) make execute_impl const and remove running_difference function ( #24935 )
2023-09-27 18:17:28 +08:00
ded8ba108f
[test](be-ut) skip some be ut case ( #24917 )
...
skip be ut "VTimestampFunctionsTest.convert_tz_test"
2023-09-26 19:51:15 +08:00
082bcd820b
[feature](insert) Support wal for group commit insert ( #23053 )
2023-09-26 14:46:24 +08:00
8191cd1dad
[Bug](ScanNode) Fix potential incorrect query result caused by concurrent NewOlapScanNode initialization and Compaction ( #24638 )
...
* Optimize fetch delete predicates
* Fix incorrect query result when compaction eliminate delete predicates between `NewOlapScanNode::_init_scanners` and `NewOlapScanner::init`
* Fix be ut
2023-09-25 22:24:35 +08:00
8679095e5c
[feature](debug) support debug point used in debug code ( #24502 )
2023-09-25 17:56:12 +08:00
22616d125d
[function](bitmap) add function alias bitmap_andnot and bitmap_andnot_count ( #24771 )
2023-09-22 12:18:31 +08:00
8eb14eec7c
[enhancement](baddisk) record bad disk in be_custom.conf to handle ( #24639 )
2023-09-21 18:31:58 +08:00
85fb46bb71
[refactor](cache) Refactor preloaded timezone global cache ( #24694 )
...
Refactor preloaded timezone global cache
2023-09-21 17:26:41 +08:00
