bc0f5dfd8f
[Chore](checks) move sonar config file to be( #24712 )
...
move sonar config file to be
2023-09-21 15:16:26 +08:00
00b994fea2
[chore](exception) Add config item 'exit_on_exception' ( #24529 )
2023-09-21 14:51:05 +08:00
e34ec094cf
[fix](memory) Fix Allocator check mem tracker limit #24711
2023-09-21 14:19:24 +08:00
ee5b307e63
[Fix](binlog) Add more log for ingest_binlog && Fix ingest_binlog not rewrite rowset_meta tablet_uid ( #24617 )
...
* Add more log for ingest_binlog && Fix ingest_binlog not rewrite
rowset_meta tablet_uid
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
* Add lost thrift TDebugProtocol
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
---------
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-09-21 10:40:08 +08:00
f2f591e280
[fix](memory) Optimize memory exceed limit logs ( #22655 )
...
After memory exceeds the limit, print the top 15 task trackers with the largest memory.
After memory exceeds the limit, more detailed GC logs in stages.
fix large memory check.
2023-09-21 10:38:17 +08:00
d62b59b620
[pipelineX](profile) Complete load profile ( #24690 )
2023-09-21 09:57:34 +08:00
3650d870d4
[fix](spill) avoid printing too much status stack trace if gc dir does not exist ( #24688 )
2023-09-21 08:24:59 +08:00
294062d519
[bug](function) fix width bucket function return wrong result ( #24673 )
2023-09-20 20:37:22 +08:00
67e789e025
[Fix](point query) Fix point query unstable ( #24570 )
2023-09-20 18:07:07 +08:00
8c8c563c3c
[Chore](status) adjust some error status print log ( #24660 )
...
adjust some error status print log
2023-09-20 17:42:51 +08:00
81e65f4a12
[feature](function) Support SHA family functions ( #24342 )
2023-09-20 17:21:45 +08:00
1405b7ca82
[improve](scan) support lower the thread priority of scan thread ( #24526 )
...
The configuration item is used to lower the priority of the scanner thread,
typically employed to ensure CPU scheduling for write operations.
2023-09-20 17:00:24 +08:00
862c939ca2
[Bug](pipelineX) fix AnalyticDependency concurrent problem ( #24671 )
2023-09-20 16:39:49 +08:00
dc9fa1a4f1
[Refactor](Sink) convert to tablet sink to tablet writer ( #24474 )
2023-09-20 14:47:18 +08:00
fc12362a6d
[feature-wip](arrow-flight)(step2) FE support Arrow Flight server ( #24314 )
...
This is a POC, the design documentation will be updated soon
2023-09-20 14:42:54 +08:00
e9435c14f8
[Improve](array-func)improve array union support multi params ( #24327 )
2023-09-20 14:29:48 +08:00
8aea31e383
[fix](timezone) fix timezone parse when there is no tzfile ( #24578 )
2023-09-20 14:28:12 +08:00
26ca0b2780
Add some block counter ( #24465 )
...
Add some block counter (#24465 )
2023-09-20 13:23:01 +08:00
c0df8fca20
[pipelineX](fix) Fix potential concurrent problem ( #24651 )
2023-09-20 13:00:58 +08:00
c704497d02
[fix](csv_reader)Fixed bug when parsing multi-character delimiters. ( #24572 )
...
Fixed bug when parsing multi-character delimiters.
2023-09-20 12:41:35 +08:00
a2e29d171a
[enhancement](be-meta) sync rocksdb by default to protect data ( #24571 )
...
If performance of user's disks is low, users can change the config
to false, this way users know what would happen if a kernel panic.
2023-09-20 11:41:26 +08:00
8316aad417
[chore](macOS) Fix linkage errors ( #24642 )
...
Issue Number: close #24643
2023-09-20 10:50:10 +08:00
c3b3f0f00a
[enhancement](serialize) add dcheck to ensure pb type is set ( #24645 )
...
should check the pb's type is set, or the deserialize will core.
should not return unknown type because deserialize will core.
---------
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-09-20 10:42:28 +08:00
49f6eda843
[fix](nested_join) incorrect result of semi/anti mark join ( #24616 )
2023-09-20 10:41:06 +08:00
14bd290aec
[feature](jsonb)support json_length and json_contains function ( #24332 )
2023-09-20 10:40:44 +08:00
e59aa49f28
[feature](datetime-func)support milliseconds_add/sub/diff and microseconds_diff ( #24114 )
2023-09-20 10:38:56 +08:00
a71d7f2beb
[pipelineX](operator) support partition sort operator and distinct streaming agg operator ( #24544 )
2023-09-20 09:50:51 +08:00
71dcb58db9
[improvement](scanner_schedule) reduce memory consumption of scanner ( #24199 )
...
* [improvement](scanner_schedule) reduce memory consumption of scanner
1. limit scanner by memory consumptin rather than blocks.
2. scheduler run correcty instread of at lest 1.
2023-09-19 21:36:23 +08:00
8c502f65f2
[Fix](metrics) fix wrong timer metrics for _seek_columns ( #24622 )
2023-09-19 20:59:09 +08:00
e54c4ef258
[pipelineX](dependency) refactor write dependency ( #24555 )
2023-09-19 18:01:42 +08:00
3cac6806b4
[fix](txn) persist txn record of single replica load and ccr ingestion ( #24543 )
...
Otherwise txn would be dropped when a be reboots.
2023-09-19 15:10:38 +08:00
b092bdaabf
[feature](load) collect loaded rows on table level after txn published ( #24346 )
...
As title.
Stream load 20 lines
```
2023-09-14 11:40:04,186 DEBUG (PUBLISH_VERSION|23) [DatabaseTransactionMgr.updateCatalogAfterVisible():1769] table id to loaded rows:{51016=20}
```
```
mysql> select count(*) from dup_tbl_basic;
+----------+
| count(*) |
+----------+
| 20 |
+----------+
1 row in set (0.05 sec)
```
2023-09-19 12:00:08 +08:00
6a33e4639a
[schedule](pipeline) Remove wait schedule time in pipeline query engine and change current queue to std::mutex ( #24525 )
...
This reverts commit 591aeaa98d1178e2e277278c7afeafef9bdb88d6.
2023-09-18 23:57:56 +08:00
96f197114c
[Improve](explode) improve explode func with array nested other type ( #24455 )
...
improve explode func with array nested other type
2023-09-18 16:05:30 +08:00
23a75d0277
[FIX](decimalv3) Fix decimalv3 with abnormal value same with mysql result ( #24499 )
...
Fix decimalv3 with abnormal value same with mysql result
2023-09-18 11:12:26 +08:00
f04bc05a7e
[fix](agg) The offset value was added twice in 'pack_fixed' ( #24506 )
2023-09-18 10:24:32 +08:00
591aeaa98d
Revert "[schedule](pipeline) Remove wait schedule time in pipeline query engine ( #23994 )" ( #24472 )
...
This reverts commit 32a7eef96a09799c8336c1964bfe7d676b7e4c98.
2023-09-18 09:57:38 +08:00
7dcc68736d
[enhancement](disk) refine io error and report bad when disk is abnormal ( #24390 )
2023-09-17 11:07:05 +08:00
4b5cea1ef8
[enhancement](fix)change ordinary type null value is \N,complex type null value is null ( #24207 )
2023-09-16 21:46:42 +08:00
88adab3114
[fix](Nereids): fix be core when array_map is not nullable ( #24488 )
...
fix be core when array_map is not nullable
2023-09-16 20:39:15 +08:00
990d6c02ec
[Feature](new function) Add a uuid-numeric function, returns uuid in largerint type, 20x faster than uuid ( #24395 )
2023-09-16 18:26:13 +08:00
643d09de06
[fix](index compaction)skip index compaction when no output segment ( #24468 )
2023-09-16 16:42:39 +08:00
76ac77b1d0
[fix](compaction) compaction should catch exception when read next block ( #24484 )
2023-09-16 16:25:55 +08:00
8ce109bda7
[pipelineX](profile) phase 2: refine profile ( #24467 )
2023-09-16 14:28:20 +08:00
4dad7c94da
[fix](orc) fix the count(*) pushdown issue in orc format ( #24446 )
...
In previous, when querying hive table in orc format, and the file is splitted.
the result of select count(*) may be multiple of the real row number.
This is because the number of rows should be got after orc strip prune,
otherwise, it may return wrong result
2023-09-16 09:57:39 +08:00
cac089c7cd
[fix](compile) fix mac compile sort failed #24453
2023-09-16 09:52:20 +08:00
29824ccd9d
[Fix](Status) Disable printing stacktrace for InvalidArgument in BitShufflePageDecoder::seek_to_position_in_page #24419
2023-09-15 19:58:21 +08:00
b9ddcbf729
[feature](merge-cloud) Rewrite code related to IOContext ( #24269 )
2023-09-15 19:57:58 +08:00
ab69416922
[Bug](pipelineX) fix streaming agg ( #24449 )
...
fix streaming agg
2023-09-15 19:22:54 +08:00
07d4769134
[fix](bitmap) fix coredump of bitmap_from_array caused by null array literal ( #24404 )
2023-09-15 18:36:33 +08:00
