bf8793de70
[fix](load) fix merged row number miscounting because of race condition ( #26470 )
...
row numbers miscounting because of race condition, will cause load to
fail sometimes with warning 'the rows number written doesn't match'.
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-11-06 22:50:32 +08:00
c9d90b636e
[feature](pipelineX) add time unit when slow_dependency need to log ( #26466 )
2023-11-06 19:58:07 +08:00
bd89028306
[bug](pipelineX) Fix potential bug using broadcast shuffle ( #26458 )
2023-11-06 17:33:20 +08:00
1a83a39aec
Revert "[fix](auto-partition) Fix auto partition concurrent conflict ( #26166 )" ( #26448 )
...
This reverts commit f22611769944e78c28f1b0a1eeb7b7414a16e8db.
2023-11-06 16:39:19 +08:00
c0d9a8d53c
[minor](pipelineX) refine error message for broadcast shuffle buffer ( #26442 )
2023-11-06 15:10:13 +08:00
2cc68381ec
[feature](binlog) Add ingest_binlog/http_get_snapshot limit download speed && Add async ingest_binlog ( #26323 )
2023-11-06 11:14:44 +08:00
1e2a614a46
[fix](workflow) Fix failure test cases in BE UT (macOS) ( #26425 )
...
1. Fix memory issues in LoadStreamMgrTest.
2. Skip S3FileWriterTest by default because it depends on the environment in teamcity.
3. Fix VTimestampFunctionsTest.convert_tz_test.
2023-11-06 10:44:44 +08:00
f226117699
[fix](auto-partition) Fix auto partition concurrent conflict ( #26166 )
2023-11-06 10:34:26 +08:00
a5b9d61f43
[bug](udf) fix java-udf function const column without arguments ( #26409 )
2023-11-06 10:34:09 +08:00
99de6c7afe
[fix](invert index) Fix the timing error when opening the searcher ( #26401 )
2023-11-04 01:52:35 -05:00
6ef2e62600
[FIX](struct) fix struct be nested when read will make core ( #26270 )
2023-11-03 09:55:39 -05:00
f92b572a97
[fix](invert index) optimize SeekTime profile ( #26353 )
2023-11-03 03:03:29 -05:00
3d403b061c
[test](coverage) Improve test coverage for runtime filter ( #26314 )
2023-11-03 12:17:03 +08:00
b19f275714
[improvement](insert) refactor group commit insert into ( #25795 )
2023-11-03 12:02:40 +08:00
509723c1d6
[bug](bitmap) fix bitmap value not clear get wrong data ( #26321 )
2023-11-03 10:25:13 +08:00
03ab822ba6
[fix](backup) support aws_token for backup/restore ( #26242 )
2023-11-03 10:18:37 +08:00
91946dc8b0
[minor](serde) 'null' in the serde should be represented by constants, instead of a string variable ( #26301 )
2023-11-02 23:13:10 +08:00
93a934e775
[Improve](map) support map cast with map literal and implicate nested scala cast ( #26126 )
2023-11-02 09:56:42 -05:00
3f47eb5e89
[Fix](inverted index) fix compound query result error when disable inverted_index_query session variable ( #26327 )
2023-11-02 08:36:08 -05:00
8bd06aff7e
[Chore](MoW) remove unused code about rowset tree ( #26282 )
2023-11-02 20:25:27 +08:00
a5ef90dacc
[enhancement](recover) support skipping missing version in select by session variable ( #25654 )
2023-11-02 20:01:51 +08:00
6828250207
[profile](refactor) Fix invalid shuffle profile ( #26298 )
2023-11-02 17:07:05 +08:00
dd8bcc831c
[keyword](decimalv2) Add DecimalV2 keyword ( #26283 )
2023-11-02 16:27:12 +08:00
a4e415ab09
[feature](hive)Support hive tables after alter type. ( #25138 )
...
1.Reconstruct the logic of decode to read parquet. The parquet reader first reads the data according to the parquet physical type, and then performs a type conversion.
2.Support hive alter table.
2023-11-02 00:24:21 +08:00
3e10e5af39
[Fix](Serde) Fix content displayed by complex types in MySQL Client ( #25946 )
...
This pr makes three changes to the display of complex types：
1. NULL value in complex types refers to being displayed as `null`, not `NULL`
2. struct type is displayed as "column_name": column_value
3. Time types such as `datetime` and `date`, are displayed with double quotes in complex types. like
`{1, "2023-10-26 12:12:12"}`
This pr also do a code refactor:
1. nesting_level is set to a member variable of the `DataTypeSerDe`, rather than a parameter in methods.
What's more, this pr fix a bug that fileSize is not correct, introduced by this pr: #25854
2023-11-01 23:48:55 +08:00
f8a594c25d
fix column is decimalv3 cast to decimalv2 make be core ( #26204 )
2023-11-01 22:30:30 +08:00
d7ea4d31fb
[Chore](hash-table) remove unused code about HashTableTraits ( #26202 )
...
remove unused code about HashTableTraits
2023-11-01 21:36:50 +08:00
1018f8918c
[pipelineX](bug) Fix build side output flag ( #26233 )
2023-11-01 20:13:41 +08:00
aafd53766b
[chore](file-reader) rm unused interface from generic reader ( #26205 )
2023-11-01 18:43:14 +08:00
f0f9c3a160
[improvement](drop tablet) impr gc shutdown tablet lock ( #26151 )
2023-11-01 18:42:21 +08:00
be7a10162a
[enhance](S3) Add timeout for s3 buffer allocation and corresponding observability ( #26125 )
2023-11-01 17:55:11 +08:00
49439175a0
[fix](move-memtable) init delta writer pool in sink prepare ( #26108 )
2023-11-01 17:52:10 +08:00
ec85e22506
[enhance](scanner) pass the tablet in NewOlapScanner's ctor ( #26167 )
2023-11-01 17:50:14 +08:00
eb9ba59996
[improvement](show trash) Fix be restart slow when too many trash files ( #26147 )
2023-11-01 17:43:24 +08:00
bfca1bf206
[Enhancement] Implement format methods for Status ( #26133 )
2023-11-01 16:55:25 +08:00
387e33fa34
[enhancement](group commit)Add group commit block queues memory back pressure ( #26045 )
2023-11-01 16:29:45 +08:00
4644191fd0
[fix](broker-read) refactor broker reading process to avoid null broker connection ( #26050 )
2023-11-01 15:58:30 +08:00
f2874b9452
[bug](shared scan) Fix use-after-free when enable pipeline shared scanning ( #26199 )
...
When enable shared scan, all scanners will be created by one instance. When the main instance reach eos and quit, all states of it will be released. But other instances are still possible to get block from those scanners. So we must assure scanners will not be dependent on any states of the main instance after it quit.
2023-11-01 15:51:20 +08:00
7ba4f91258
[fix](log) avoid redundent log printing ( #26188 )
...
Co-authored-by: yiguolei <676222867@qq.com >
2023-11-01 13:49:08 +08:00
8f15f9adf6
[test](case) add test case to improve code coverage ( #25516 )
...
[test](case) add test case to improve code coverage (#25516 )
2023-11-01 12:51:12 +08:00
7914b7b19e
[fix](seek) add SeekCount and SeekTime profile ( #26009 )
2023-11-01 11:29:29 +08:00
696ecc8c83
[Chore](log) adjust error code on too many filtered rows ( #26168 )
2023-11-01 00:15:56 +08:00
9d83948987
[feature](pipelineX) Use dependency instead of block queue in the runtime filter ( #26078 )
2023-10-31 22:44:18 +08:00
8c454a3287
[bug](scanner) Fix scanner core dump ( #26156 )
2023-10-31 22:23:32 +08:00
aadd220eff
[FIX](decimalv3) fix large int cast to decimalv3 #26159
...
fix large int cast to decimalv3 , before if we make data more than max int64 cast to decimalv3 will make result overflow and incorrect
such as
mysql> select CAST(12345678901234567890123456789012345678 AS DECIMALV3(38, 0));
+------------------------------------------------------------------+
| CAST(12345678901234567890123456789012345678 AS DECIMALV3(38, 0)) |
+------------------------------------------------------------------+
| -4302749291975740594 |
+------------------------------------------------------------------+
2023-10-31 18:24:09 +08:00
b98744ae90
[Bug](iceberg)fix read partitioned iceberg without partition path ( #25503 )
...
Iceberg does not require partition values to exist on file paths, so we should get the partition value from `PartitionScanTask.partition`.
2023-10-31 18:09:53 +08:00
b137f03921
[feature](profile) add MaxActiveTime and add exectime in pipelineX ( #26148 )
2023-10-31 17:53:52 +08:00
973657d163
[fix](compile) be cannot compile on MacOS ( #26155 )
...
build on MacOS meet error: reference to 'detail' is ambiguous.
Because there is a detail namespace under std
2023-10-31 17:36:00 +08:00
b619982c3a
[Enhancement](metrics) Avoid update_process_fd_num reporting no such file error indiscriminately. ( #26013 )
...
Avoid `update_process_fd_num` reporting `no such file error `indiscriminately.
2023-10-31 17:28:43 +08:00
ea1554374c
[fix](multicast) fix DCHECK failure of block mem reuse for multicast ( #26127 )
...
* [fix](multicast) fix DCHECK failure of block mem reuse for multicast
2023-10-31 16:35:26 +08:00
