9a675fcdfc
[chore](be) Add default timezone files ( #25097 )
2023-10-20 13:12:24 +08:00
b964ab76b3
[refactor](shuffle) Simplify hash partitioning strategy ( #25596 )
2023-10-19 19:28:22 +08:00
9c9fc84f39
[feature](merge-cloud) Abstract BaseTablet for CloudTablet ( #24929 )
2023-10-18 20:29:04 +08:00
6cb947f72b
[refactor](unused code) delete unused method from field.h ( #25554 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-10-18 13:11:14 +08:00
b0e0a0569a
[Fix](row store) Real default value should be used instead of default… ( #25230 )
...
Before this PR the default value is not correct, we should use default value in Frontend schema.
2023-10-18 10:13:44 +08:00
cda8fb6b8b
[fix](load) return Status when error in RowsetWriter::build ( #25381 )
2023-10-17 09:40:23 +08:00
59ebbb351e
[feature](merge-cloud) Enable write into cache when uploading file to s3 using s3 file writer ( #24364 )
2023-10-16 21:31:02 +08:00
7ea456ef91
[fix](insert) make group commit wal_manager exit elegantly ( #25250 )
2023-10-14 23:14:06 +08:00
e5ef0aa6d4
[refactor](mysql result format) use new serde framework to tuple convert ( #25006 )
2023-10-14 19:46:42 +08:00
6f9a084d99
[Fix](Outfile) Use data_type_serde to export data to parquet file format ( #24998 )
2023-10-13 13:58:34 +08:00
73c3e3ab55
[Feature](x-load) support config min replica num for loading data ( #21118 )
2023-10-11 21:07:35 +08:00
c6b1c903e4
[fix](Regression-test) fix that the String type in a nested type should contain double quotes and add regression-test ( #25115 )
2023-10-11 18:30:26 +08:00
9e31cb26bb
[fix](parse_url) fix parse_url is not working in some case to extract the HOST ( #25040 )
...
Issue Number: close #24452
2023-10-09 00:14:58 +08:00
b91335dbb8
[refactor](columndecimal) is_decimal_v2 member is useless because column decimal could detect by itself ( #25110 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-10-08 18:09:19 +08:00
0df32c8e3e
[Fix](Outfile) Use data_type_serde to export data to csv file format ( #24721 )
...
Modify the outfile logic, use the data type serde framework.
2023-10-07 22:50:44 +08:00
cb0076e585
[fix](insert) fix group commit be ut ( #24968 )
2023-10-07 19:50:05 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
68087f6c82
[fix](json function) Fix the slow performance of get_json_path when processing JSONB ( #24631 )
...
When processing JSONB, automatically convert to jsonb_extract_string
2023-09-27 21:17:39 +08:00
5d138b6928
[remove](function) make execute_impl const and remove running_difference function ( #24935 )
2023-09-27 18:17:28 +08:00
ded8ba108f
[test](be-ut) skip some be ut case ( #24917 )
...
skip be ut "VTimestampFunctionsTest.convert_tz_test"
2023-09-26 19:51:15 +08:00
082bcd820b
[feature](insert) Support wal for group commit insert ( #23053 )
2023-09-26 14:46:24 +08:00
8191cd1dad
[Bug](ScanNode) Fix potential incorrect query result caused by concurrent NewOlapScanNode initialization and Compaction ( #24638 )
...
* Optimize fetch delete predicates
* Fix incorrect query result when compaction eliminate delete predicates between `NewOlapScanNode::_init_scanners` and `NewOlapScanner::init`
* Fix be ut
2023-09-25 22:24:35 +08:00
8679095e5c
[feature](debug) support debug point used in debug code ( #24502 )
2023-09-25 17:56:12 +08:00
22616d125d
[function](bitmap) add function alias bitmap_andnot and bitmap_andnot_count ( #24771 )
2023-09-22 12:18:31 +08:00
8eb14eec7c
[enhancement](baddisk) record bad disk in be_custom.conf to handle ( #24639 )
2023-09-21 18:31:58 +08:00
85fb46bb71
[refactor](cache) Refactor preloaded timezone global cache ( #24694 )
...
Refactor preloaded timezone global cache
2023-09-21 17:26:41 +08:00
dc9fa1a4f1
[Refactor](Sink) convert to tablet sink to tablet writer ( #24474 )
2023-09-20 14:47:18 +08:00
8aea31e383
[fix](timezone) fix timezone parse when there is no tzfile ( #24578 )
2023-09-20 14:28:12 +08:00
4b5cea1ef8
[enhancement](fix)change ordinary type null value is \N,complex type null value is null ( #24207 )
2023-09-16 21:46:42 +08:00
b9ddcbf729
[feature](merge-cloud) Rewrite code related to IOContext ( #24269 )
2023-09-15 19:57:58 +08:00
268c867679
[Improve](serde)replace function_cast from_string to serde ( #24087 )
...
Now we can not support streamload with column which is map/array nested map/array
serde can do this now , so we can replace it
Notice. if item data in complex type data is empty we just return error, instead of makeup default value , because now we can not define right default for complex type
2023-09-14 13:53:16 +08:00
563c3f75ff
[feature](move-memtable) share delta writer v2 among sinks ( #24066 )
2023-09-13 14:39:29 +08:00
c7ae2a7d22
[Refactor & Bugfix](static variables) move some static vairables to exec_env ( #24029 )
2023-09-13 09:27:03 +08:00
d8ef9dda59
[feature](merge-cloud) Rewrite FS interface ( #23953 )
2023-09-12 19:20:25 +08:00
4bb9a12038
[function](bitmap) support bitmap_remove ( #24190 )
2023-09-12 14:52:04 +08:00
bdacefa734
[Fix](status)Fix leaky abstraction and shield the status code END_OF_FILE from upper layers ( #24165 )
2023-09-12 11:10:52 +08:00
1228995dec
[improvement](segment) reduce memory footprint of column_reader and segment ( #24140 )
2023-09-11 21:54:00 +08:00
dbb9365556
[Enhance](ip)optimize priority_ network matching logic for be ( #23795 )
...
Issue Number: close #xxx
If the user has configured the wrong priority_network, direct startup failure to avoid users mistakenly assuming that the configuration is correct
If the user has not configured p_ n. Select only the first IP from the IPv4 list, rather than selecting from all IPs, to avoid users' servers not supporting IPv4
extends #23784
2023-09-11 18:32:31 +08:00
a0fcc30764
[Fix](Status) Handle status code correctly and add a new error code ENTRY_NOT_FOUND ( #24139 )
2023-09-11 09:32:11 +08:00
f9a75b5c4f
[feature](csv_serde)1.append csv serde for serialize to csv and deserialize from csv. 2.let csvReader use csv serde not text_converter. ( #23352 )
...
1. append csv serde for serialize to csv and deserialize from csv.
2. let csvReader use csv serde not text_converter.
2023-09-10 00:16:21 +08:00
537369f4e2
[Fix](http) Fix curl return HTTP_ERROR && Add not_found HttpClientTest, fix ( #23984 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-09-07 10:10:51 +08:00
2f8b075b71
[improvement](bitmap) support version for ser/deser of bitmap ( #23959 )
2023-09-07 09:55:29 +08:00
d183e08f6d
[opt](MergedIO) optimize merge small IO, prevent amplified read ( #23849 )
...
There were two vulnerabilities in the previous fix(https://github.com/apache/doris/pull/20305 ):
1. `next_content` may not necessarily be a truly readable range
2. The last range of the merged data may be the hollow
This PR fundamentally solves the problem of reading amplification by rechecking the calculation range. According to the algorithm, there is only one possibility of generating read amplification, with only a small content of data within the 4k(`MIN_READ_SIZE `) range. However, 4k is generally the minimum IO size and there is no need for further segmentation.
2023-09-06 22:45:31 +08:00
95ae5376f3
[Fix](BinaryPrefixPage) stop to read values when current pos reached the end of the page in BinaryPrefixPageDecoder::next_batch ( #23855 )
2023-09-06 16:34:38 +08:00
a96adc01aa
[Chore](function) refactor of quantile_state ( #23862 )
...
refactor of quantile_state
2023-09-06 15:39:19 +08:00
09bcedb116
[feature](merge-cloud) Remove deprecated old cache ( #23881 )
...
* Remove deprecated old cache
2023-09-06 08:07:05 +08:00
a542f107db
[feature](move-memtable) buffer messages in load stream stub ( #23721 )
2023-09-02 13:42:34 +08:00
75e2bc8a25
[function](bitmap) support bitmap_to_base64 and bitmap_from_base64 ( #23759 )
2023-09-02 00:58:48 +08:00
eaf2a6a80e
[fix](date) return right date value even if out of the range of date dictionary( #23664 )
...
PR(https://github.com/apache/doris/pull/22360 ) and PR(https://github.com/apache/doris/pull/22384 ) optimized the performance of date type. However hive supports date out of 1970~2038, leading wrong date value in tpcds benchmark.
How to fix:
1. Increase dictionary range: 1900 ~ 2038
2. The date out of 1900 ~ 2038 is regenerated.
2023-09-01 14:40:20 +08:00
25b6e4deb2
[fix](daemon) Fix incorrect initialization order of daemon services ( #23578 )
...
Current initialization dependency:
Daemon ───┬──► StorageEngine ──► ExecEnv ──► Disk/Mem/CpuInfo
│
│
BackendService ─┘
However, original code incorrectly initialize Daemon before StorageEngine.
This PR also stop and join threads of daemon services in their dtor, to ensure Daemon services release resources in reverse order of initialization via RAII.
2023-08-31 19:46:38 +08:00
