Commit Graph

5683 Commits

Author SHA1 Message Date
034582bb64 [pipelineX](fix) Fix broadcast dependency hanging (#24740) 2023-09-22 12:24:32 +08:00
d82b603b53 [bug](jsonb) fix non simd int128 overflow #24750 2023-09-22 12:23:43 +08:00
22616d125d [function](bitmap) add function alias bitmap_andnot and bitmap_andnot_count (#24771) 2023-09-22 12:18:31 +08:00
c8655d1dae [enhancement](compaction) print correct error messsage & avoid unnecessary stacktrace (#24758) 2023-09-22 11:58:11 +08:00
8a85a75b8b [chore](scanner) check columns' nullable with schema (#24724)
Add a validation to prevent potential schema inconsistency issues.
2023-09-22 11:34:53 +08:00
37a7532a49 [fix](pipelineX) get sink local state in distinctstreamingagg (#24752) 2023-09-22 11:16:46 +08:00
e9ef6c7da7 [chore](workflow) Fix security issues in Code Checks (#24761)
The workflow `Code Checks` needs write permissions granted by the event `pull_request_target` to comment on pull requests. However, if the workflow ran users' code, the malicious code would do some dangerous actions on our repository.

The following changes are made in this PR:
1. Instead of applying patches, we use `sed` to modify the `entrypoint.sh` in action-sh-checker explicitly in the workflow.
2. Revoke the write permissions when generating `compile_commands.json` which is produced by executing the build script `build.sh`.
2023-09-22 10:39:39 +08:00
a9576df74a [typo](comments) Change the Chinese comments to English #24659 2023-09-22 08:56:56 +08:00
09e03247ec [chore](readability) Better readability of ExecNode.cpp #24733 2023-09-22 08:54:57 +08:00
665e878811 [fix](Compile) fix BE complie error #24756 2023-09-22 08:53:30 +08:00
c9b2f4cb92 [workload](pipeline) Add cgroup cpu controller (#24052) 2023-09-21 21:49:33 +08:00
58ab25ccaa Revert "[Feature](merge-on-write)Support ignore mode for merge-on-write unique table (#21773)" (#24731)
This reverts commit 3ee89aea35726197cb7e94bb4f2c36bc9d50da84.
2023-09-21 21:01:28 +08:00
ce14183c3a [fix](compile) fix GHA mac ut compile failure (#24738) 2023-09-21 21:00:23 +08:00
a48b19ceb6 [feature](Outfile) select into outfile supports to export struct/map/array type data to orc file format (#24350)
We do not support nested complex type in this pr.
2023-09-21 20:15:18 +08:00
7630fe7b7b [bug](node)fix dense_rank function in partition sort node return wrong rows (#24727) 2023-09-21 19:13:30 +08:00
8eb14eec7c [enhancement](baddisk) record bad disk in be_custom.conf to handle (#24639) 2023-09-21 18:31:58 +08:00
ec987b1b7d [fix](index compaction)ignore doc which dose not exist in destination segment (#24729) 2023-09-21 18:27:08 +08:00
85fb46bb71 [refactor](cache) Refactor preloaded timezone global cache (#24694)
Refactor preloaded timezone global cache
2023-09-21 17:26:41 +08:00
b9997d69fa [refactor](pipelineX) return error when local_state can not find id (#24360) 2023-09-21 16:04:08 +08:00
36c9366a8b [improve](tablet schema) add config to modify tablet schema recycle interval (#24602) 2023-09-21 15:57:11 +08:00
2098670001 [Fix](merge-on-write) Skip to check delete bitmap correctness in commit phase if the current tablet is converting (#24675) 2023-09-21 15:48:02 +08:00
5a463fedb8 [optimize](match) optimize unnecessary conversions (#24389) 2023-09-21 15:29:10 +08:00
4eb09ce1b2 [enhancement](config) do not abort when a disk is broken (#24692) 2023-09-21 15:21:42 +08:00
d31d99bf34 [pipeline](load) opt the pipeline load code (#24708)
opt the pipeline load code
2023-09-21 15:20:31 +08:00
Pxl
bc0f5dfd8f [Chore](checks) move sonar config file to be(#24712)
move sonar config file to be
2023-09-21 15:16:26 +08:00
00b994fea2 [chore](exception) Add config item 'exit_on_exception' (#24529) 2023-09-21 14:51:05 +08:00
e34ec094cf [fix](memory) Fix Allocator check mem tracker limit #24711 2023-09-21 14:19:24 +08:00
ee5b307e63 [Fix](binlog) Add more log for ingest_binlog && Fix ingest_binlog not rewrite rowset_meta tablet_uid (#24617)
* Add more log for ingest_binlog && Fix ingest_binlog not rewrite
rowset_meta tablet_uid

Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>

* Add lost thrift TDebugProtocol

Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>

---------

Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
2023-09-21 10:40:08 +08:00
f2f591e280 [fix](memory) Optimize memory exceed limit logs (#22655)
After memory exceeds the limit, print the top 15 task trackers with the largest memory.
After memory exceeds the limit, more detailed GC logs in stages.
fix large memory check.
2023-09-21 10:38:17 +08:00
d62b59b620 [pipelineX](profile) Complete load profile (#24690) 2023-09-21 09:57:34 +08:00
3650d870d4 [fix](spill) avoid printing too much status stack trace if gc dir does not exist (#24688) 2023-09-21 08:24:59 +08:00
294062d519 [bug](function) fix width bucket function return wrong result (#24673) 2023-09-20 20:37:22 +08:00
67e789e025 [Fix](point query) Fix point query unstable (#24570) 2023-09-20 18:07:07 +08:00
Pxl
8c8c563c3c [Chore](status) adjust some error status print log (#24660)
adjust some error status print log
2023-09-20 17:42:51 +08:00
81e65f4a12 [feature](function) Support SHA family functions (#24342) 2023-09-20 17:21:45 +08:00
1405b7ca82 [improve](scan) support lower the thread priority of scan thread (#24526)
The configuration item is used to lower the priority of the scanner thread,
typically employed to ensure CPU scheduling for write operations.
2023-09-20 17:00:24 +08:00
862c939ca2 [Bug](pipelineX) fix AnalyticDependency concurrent problem (#24671) 2023-09-20 16:39:49 +08:00
dc9fa1a4f1 [Refactor](Sink) convert to tablet sink to tablet writer (#24474) 2023-09-20 14:47:18 +08:00
fc12362a6d [feature-wip](arrow-flight)(step2) FE support Arrow Flight server (#24314)
This is a POC, the design documentation will be updated soon
2023-09-20 14:42:54 +08:00
e9435c14f8 [Improve](array-func)improve array union support multi params (#24327) 2023-09-20 14:29:48 +08:00
8aea31e383 [fix](timezone) fix timezone parse when there is no tzfile (#24578) 2023-09-20 14:28:12 +08:00
26ca0b2780 Add some block counter (#24465)
Add some block counter (#24465)
2023-09-20 13:23:01 +08:00
c0df8fca20 [pipelineX](fix) Fix potential concurrent problem (#24651) 2023-09-20 13:00:58 +08:00
c704497d02 [fix](csv_reader)Fixed bug when parsing multi-character delimiters. (#24572)
Fixed bug when parsing multi-character delimiters.
2023-09-20 12:41:35 +08:00
a2e29d171a [enhancement](be-meta) sync rocksdb by default to protect data (#24571)
If performance of user's disks is low, users can change the config
to false, this way users know what would happen if a kernel panic.
2023-09-20 11:41:26 +08:00
8316aad417 [chore](macOS) Fix linkage errors (#24642)
Issue Number: close #24643
2023-09-20 10:50:10 +08:00
c3b3f0f00a [enhancement](serialize) add dcheck to ensure pb type is set (#24645)
should check the pb's type is set, or the deserialize will core.
should not return unknown type because deserialize will core.
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2023-09-20 10:42:28 +08:00
49f6eda843 [fix](nested_join) incorrect result of semi/anti mark join (#24616) 2023-09-20 10:41:06 +08:00
14bd290aec [feature](jsonb)support json_length and json_contains function (#24332) 2023-09-20 10:40:44 +08:00
e59aa49f28 [feature](datetime-func)support milliseconds_add/sub/diff and microseconds_diff (#24114) 2023-09-20 10:38:56 +08:00