database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
13,663 Commits 1 Branch 0 Tags
034582bb64bb083ca23d91c5ce4efa7119665cd5
Commit Graph

13663 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Gabriel
034582bb64 [pipelineX](fix) Fix broadcast dependency hanging (#24740) 2023-09-22 12:24:32 +08:00
Liqf
d82b603b53 [bug](jsonb) fix non simd int128 overflow #24750 2023-09-22 12:23:43 +08:00
TengJianPing
22616d125d [function](bitmap) add function alias bitmap_andnot and bitmap_andnot_count (#24771) 2023-09-22 12:18:31 +08:00
zhannngchen
c8655d1dae [enhancement](compaction) print correct error messsage & avoid unnecessary stacktrace (#24758) 2023-09-22 11:58:11 +08:00
morrySnow
b5f6ace204 [fix](planner) ctas should not change any meta of column in source table (#24767) 
if previous PR #22770. we try to fix incorrect nullable in target table.
However we changed nullable info of column in source table unexpectly
 2023-09-22 11:49:38 +08:00
Jerry Hu
8a85a75b8b [chore](scanner) check columns' nullable with schema (#24724) 
Add a validation to prevent potential schema inconsistency issues.
 2023-09-22 11:34:53 +08:00
zhangguoqiang
6f961ba0e9 [Enhance](external)add prepare hive data in case (#24703) 2023-09-22 11:19:46 +08:00
Mryange
37a7532a49 [fix](pipelineX) get sink local state in distinctstreamingagg (#24752) 2023-09-22 11:16:46 +08:00
Calvin Kirs
181a218280 Revert "[Chore](ci)Temporarily cancel the mandatory restrictions of shellCheck (#24765)" (#24770) 
This reverts commit 016dd2a45ff278bd4776018f6d608a6ce5e5bb21.
 2023-09-22 11:14:46 +08:00
zhangguoqiang
f5c07ad6da [enhance](external)add tools for generate orc and parquet file (#24713) 2023-09-22 11:13:58 +08:00
zhangstar333
79fe9d58b0 [bug](expr) forget write date_liter expr code info (#24687) 
[bug](expr) forget write date_liter expr code info
 2023-09-22 11:08:41 +08:00
Adonis Ling
e9ef6c7da7 [chore](workflow) Fix security issues in Code Checks (#24761) 
The workflow `Code Checks` needs write permissions granted by the event `pull_request_target` to comment on pull requests. However, if the workflow ran users' code, the malicious code would do some dangerous actions on our repository.

The following changes are made in this PR:
1. Instead of applying patches, we use `sed` to modify the `entrypoint.sh` in action-sh-checker explicitly in the workflow.
2. Revoke the write permissions when generating `compile_commands.json` which is produced by executing the build script `build.sh`.
 2023-09-22 10:39:39 +08:00
Calvin Kirs
016dd2a45f [Chore](ci)Temporarily cancel the mandatory restrictions of shellCheck (#24765) 2023-09-22 10:20:13 +08:00
xu tao
a718f1f6cd [fix](lock): do not use instance lock to protect static data (#24611) 2023-09-22 10:16:54 +08:00
Calvin Kirs
c832e018d0 [Dependence](Fe)Upgrade Fe dependencies (#24606) 
* be scanner
- Upgrade avro to 1.11.2
fe
- Upgrade quartz to 2.5.0-rc1
- Upgrade maxcompute to 0.45-2-publish
- Binding  avro-ipc  to 1.11.2

* Binding hbase  version to 2.5.5
binding nimbusds version to 9.35
 2023-09-22 10:14:42 +08:00
yuanyuan8983
cec3fcdf78 [typo](doc) modifying old parameters (#24565) 
* modifying old parameters

* Supplementary demo
 2023-09-22 09:09:06 +08:00
slothever
269b9eaf8b [typo](docs)add FAQ for broker load error: Cannot locate default realm (#24693) 2023-09-22 09:06:36 +08:00
amory
090be20ca4 [cases](regresstests) add negative case for agg table and fix agg table support replace typ… #24715 
add negative case for agg table
fix agg table support replace agg type for complex type , and Now We only support complex type with agg state for replace only
fix test output
 2023-09-22 09:05:20 +08:00
xu tao
e4c55cc5aa [fix](web): field in Controller is singleton, which would introduce thread safe problem, so remove it (#24667) 
Co-authored-by: yiguolei <676222867@qq.com>
 2023-09-22 08:58:01 +08:00
HHoflittlefish777
a9576df74a [typo](comments) Change the Chinese comments to English #24659 2023-09-22 08:56:56 +08:00
zhiqqqq
09e03247ec [chore](readability) Better readability of ExecNode.cpp #24733 2023-09-22 08:54:57 +08:00
Tiewei Fang
665e878811 [fix](Compile) fix BE complie error #24756 2023-09-22 08:53:30 +08:00
Jibing-Li
6685875e72 [Improvement](statistics)Mark unfinished analysis job failed after master reboot 
Before, the Pending/Running analysis tasks/jobs will stay in the unfinished status for ever after FE reboot, which is misleading.
In this pr, jobs/tasks are only logged to editlog when they finish. So the unfinished tasks/jobs are abandoned after reboot.
Also return without retry when analyze table cancelled by user in with sync mode.
 2023-09-21 23:11:50 +08:00
minghong
48f3614ce8 [fix](nereids) a bug in estimation of intersect ndv (#24664) 2023-09-21 23:06:31 +08:00
morrySnow
a17034b7ff [fix](planner) do not support UDF without paramter (#24730) 
for example:
CREATE ALIAS FUNCTION f() WITH PARAMETERS() AS now();
 2023-09-21 22:23:21 +08:00
wangbo
c9b2f4cb92 [workload](pipeline) Add cgroup cpu controller (#24052) 2023-09-21 21:49:33 +08:00
Yongqiang YANG
94907ca0f2 [improvement](brpc) change parking slot to 32 (#24567) 2023-09-21 21:35:46 +08:00
Siyang Tang
b8d8cfadfe [enhancement](delete) avoid null txn state after delete job committed (#24741) 2023-09-21 21:21:06 +08:00
bobhan1
58ab25ccaa Revert "[Feature](merge-on-write)Support ignore mode for merge-on-write unique table (#21773)" (#24731) 
This reverts commit 3ee89aea35726197cb7e94bb4f2c36bc9d50da84.
 2023-09-21 21:01:28 +08:00
zclllyybb
ce14183c3a [fix](compile) fix GHA mac ut compile failure (#24738) 2023-09-21 21:00:23 +08:00
Luwei
3bd341a1be [enhancement](schema) Add schema consistency check when add partition (#24707) 2023-09-21 20:35:45 +08:00
airborne12
232226e75a [Improve](count on index) improve performance for count on index other than match (#24678) 2023-09-21 20:30:27 +08:00
wuwenchi
6c19e106ad [fix](rest catalog)support set region for s3 (#24566) 
Use REST Catalog to access S3 and support setting up regions：
```
CREATE CATALOG iceberg_rest_s3 PROPERTIES (
    "type"="iceberg",
    "iceberg.catalog.type"="rest",
    "uri" = "http://127.0.0.1:8181",
    "s3.endpoint" = "http://127.0.0.1:8010",
    "s3.access_key" = "admin",
    "s3.secret_key" = "password",
    "s3.region" = "us-east-1"
);
```
 2023-09-21 20:19:43 +08:00
Tiewei Fang
a48b19ceb6 [feature](Outfile) select into outfile supports to export struct/map/array type data to orc file format (#24350) 
We do not support nested complex type in this pr.
 2023-09-21 20:15:18 +08:00
Dongyang Li
8a226bbd63 [fix](start_be) ignore output from command -v (#24739) 2023-09-21 19:57:43 +08:00
zhangstar333
7630fe7b7b [bug](node)fix dense_rank function in partition sort node return wrong rows (#24727) 2023-09-21 19:13:30 +08:00
Yongqiang YANG
8eb14eec7c [enhancement](baddisk) record bad disk in be_custom.conf to handle (#24639) 2023-09-21 18:31:58 +08:00
qiye
ec987b1b7d [fix](index compaction)ignore doc which dose not exist in destination segment (#24729) 2023-09-21 18:27:08 +08:00
shuke
cbf2e913e8 [test](config) change desired_max_waiting_jobs in regression pipeline (#24710) 2023-09-21 17:27:52 +08:00
zclllyybb
85fb46bb71 [refactor](cache) Refactor preloaded timezone global cache (#24694) 
Refactor preloaded timezone global cache
 2023-09-21 17:26:41 +08:00
Mryange
b9997d69fa [refactor](pipelineX) return error when local_state can not find id (#24360) 2023-09-21 16:04:08 +08:00
lihangyu
36c9366a8b [improve](tablet schema) add config to modify tablet schema recycle interval (#24602) 2023-09-21 15:57:11 +08:00
bobhan1
2098670001 [Fix](merge-on-write) Skip to check delete bitmap correctness in commit phase if the current tablet is converting (#24675) 2023-09-21 15:48:02 +08:00
AKIRA
aa92c2ddfb [minor](test) Add some ut for optimizer rule (#24562) 
Add ut for

* ExistsApplyToJoin
* SimplifyDecimalV3Comparison
* SimplifyArithmeticComparisonRule
* SimplifyCastRule
 2023-09-21 15:46:35 +08:00
zzzxl
5a463fedb8 [optimize](match) optimize unnecessary conversions (#24389) 2023-09-21 15:29:10 +08:00
morrySnow
ce57b99ce7 [fix](Nereids) colocate join could not work well on full outer join (#24700) 
in previous PR #22979, we fix the output deriver of join. But we forgot
to change the util method JoinUtils#shouldColocateJoin to adjust the
change of physical properties derive.
we could not use join distribution type anymore since join could output
any distribute for full outer join.
 2023-09-21 15:26:59 +08:00
Yongqiang YANG
4eb09ce1b2 [enhancement](config) do not abort when a disk is broken (#24692) 2023-09-21 15:21:42 +08:00
HappenLee
d31d99bf34 [pipeline](load) opt the pipeline load code (#24708) 
opt the pipeline load code
 2023-09-21 15:20:31 +08:00
Pxl
bc0f5dfd8f [Chore](checks) move sonar config file to be(#24712) 
move sonar config file to be
 2023-09-21 15:16:26 +08:00
zhiqqqq
61578f92e6 [chore](function name order) reorder math functions in doris_builtins_functions #24716 2023-09-21 15:07:50 +08:00