database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
20,912 Commits 1 Branch 0 Tags
4f45fefea28b4591e57eef5ae1d31cecde66b6cc
Commit Graph

9587 Commits

Author SHA1 Message Date
zhangdong
4f45fefea2 [enhance](mtmv)Optimize MTMV lock logic (#44967) (#45076) 
pick: https://github.com/apache/doris/pull/44967
 2024-12-06 17:17:32 +08:00
github-actions[bot]
bea9564e38 branch-2.1: [fix](Export) Fix the problem of exporting stuck #44944 (#45094) 
Cherry-picked from #44944

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-06 17:01:45 +08:00
github-actions[bot]
3018e9af4c branch-2.1: [fix](routine load) fix invalid EOF tasks scheduling delay #44949 (#45088) 
Cherry-picked from #44949

Co-authored-by: hui lai <laihui@selectdb.com>
 2024-12-06 17:01:17 +08:00
Socrates
53291bd040 branch-2.1: [fix](hudi) upgrade hudi to 0.15.0 (#44267)(#44995) (#45041) 
cherry-pick pr: #44267 #44995
 2024-12-05 23:18:37 -08:00
github-actions[bot]
f0324e2a56 branch-2.1: [improvement](information_schema)Support show default value in information_schema. #44849 (#45080) 
Cherry-picked from #44849

Co-authored-by: James <lijibing@selectdb.com>
 2024-12-06 14:54:09 +08:00
Xinyi Zou
2ed306d0b1 [pick](branch-2.1) pick #44286 (#45055) 2024-12-06 14:33:47 +08:00
github-actions[bot]
d3c10f01e3 branch-2.1: [Chore](Job)Add scheduling logs for periodic jobs. #44843 (#45071) 
Cherry-picked from #44843

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-06 14:09:15 +08:00
github-actions[bot]
f038f28682 branch-2.1: [fix](mtmv) Fixed an error in setting variables in nested materialize views #44960 (#45038) 
Cherry-picked from #44960
 2024-12-06 14:04:13 +08:00
github-actions[bot]
a67bbf3c58 branch-2.1: [Fix](job)Fix CAS competition failure leading to message publishing failure. #45018 (#45030) 
Cherry-picked from #45018

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-06 09:32:15 +08:00
yujun
041a1fe095 branch-2.1: [fix](nereids) fix compare with long min for simplify comparison rule (#44922) 2024-12-06 09:31:02 +08:00
Xinyi Zou
fa633d751d [pick](branch-2.1) pick #44489 #44894 (#45024) 
### What problem does this PR solve?

pick #44489 #44894
 2024-12-05 17:04:15 +08:00
github-actions[bot]
a8f36a4813 branch-2.1: [fix](ctas) fix wrong resultType of column typeDef #43828 (#44985) 
Cherry-picked from #43828

Co-authored-by: TsukiokaKogane <cby141994@gmail.com>
 2024-12-04 22:10:11 +08:00
github-actions[bot]
823c24d7b5 branch-2.1: [fix](mtmv) Fix filter position different but same causing rewritten by materialized view fail #44575 (#44900) 
Cherry-picked from #44575

Co-authored-by: seawinde <wusi@selectdb.com>
 2024-12-04 22:03:26 +08:00
github-actions[bot]
b94baf1f76 branch-2.1: [fix](profile) Change the check of whether the username is admin and root to check whether the user specifically corresponds to admin permissions #41714 (#44865) 
Cherry-picked from #41714

Co-authored-by: xyf <116467462+xyfsjq@users.noreply.github.com>
 2024-12-04 22:02:54 +08:00
github-actions[bot]
191c86bb8b branch-2.1: [fix](nereids) fix merge_percentile_to_array when has same agg function #44783 (#44879) 
Cherry-picked from #44783

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2024-12-04 22:02:16 +08:00
daidai
60dde858b9 [fix](maxcompute)add mc catalog read partition table partition prune(#44508) (#44830) 2024-12-04 18:06:31 +08:00
zhangdong
385cd1fcdb [fix](auth)Fix the need for low-level table permissions when querying… (#44842) 
… views in certain situations (#44621)

pick: https://github.com/apache/doris/pull/44621
 2024-12-04 18:01:28 +08:00
hui lai
19b63bb437 [fix](load) fix load cast throw exception when plan (#44968) 
### What problem does this PR solve?

Use the load command with the following columns mapping:
```
curl --location-trusted -u root: \
    -H "Expect:100-continue" \
    -H "column_separator:," \
    -H "columns:cache_key,result_cnt,result,result=bitmap_from_base64(result)" \
    -T 1.txt \
    -XPUT http://10.16.10.6:48733/api/mutong/task_result_dev/_stream_load 
```

```
{
    "TxnId": 37092,
    "Label": "54b9e25b-853d-4ecc-aca9-82bd4ed91875",
    "Comment": "",
    "TwoPhaseCommit": "false",
    "Status": "Fail",
    "Message": "[ANALYSIS_ERROR]TStatus: errCode = 2, detailMessage = can not cast from origin type bitmap to target type=varchar(65533)",
    "NumberTotalRows": 0,
    "NumberLoadedRows": 0,
    "NumberFilteredRows": 0,
    "NumberUnselectedRows": 0,
    "LoadBytes": 0,
    "LoadTimeMs": 0,
    "BeginTxnTimeMs": 1,
    "StreamLoadPutTimeMs": 2,
    "ReadDataTimeMs": 0,
    "WriteDataTimeMs": 0,
    "CommitAndPublishTimeMs": 0
} 
```

The pr aims to fix this issue.

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
 2024-12-04 17:45:05 +08:00
github-actions[bot]
5c686c32a2 branch-2.1: [fix](mtmv) Fix mv rewrite fail when base table add column #44867 (#44956) 
Cherry-picked from #44867

Co-authored-by: seawinde <wusi@selectdb.com>
 2024-12-04 17:43:49 +08:00
github-actions[bot]
bbd0dcb26e branch-2.1: [fix](ForkJoinPool) we should not new a thread pool every call #44891 (#44940) 
Cherry-picked from #44891
 2024-12-04 11:23:56 +08:00
github-actions[bot]
e10f1e9889 branch-2.1: [fix](unique key) getEnableUniqueKeyMergeOnWrite should check keys type #44692 (#44896) 
Cherry-picked from #44692

Co-authored-by: zhannngchen <zhangchen@selectdb.com>
 2024-12-03 20:17:19 +08:00
zhangyuan
d10cb19b07 [fix](sync mv) fix rewrite wrongly with sync mv (#44866) 
Cherry-picked from https://github.com/apache/doris/pull/39284
 2024-12-03 19:59:41 +08:00
feiniaofeiafei
3e1692298b [Feat](nereids) support pull up predicate from set operator (#39450) (#44056) 
cherry-pick #39450 to branch-2.1
 2024-12-03 16:24:52 +08:00
github-actions[bot]
d9ef316cdb branch-2.1: [fix](catalog) Fix infinity partition key toSql #44834 (#44890) 
Cherry-picked from #44834

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-03 14:12:47 +08:00
bobhan1
f612290597 branch-2.1: [Fix](TPartitionVersionInfo) Fix duplicate TPartitionVersionInfo in PublishVersionTask.partitionVersionInfos #44846 (#44885) 
pick https://github.com/apache/doris/pull/44846
 2024-12-03 10:47:49 +08:00
github-actions[bot]
4b7f5f8035 branch-2.1: [chore](binlog) Save table type in CreateTableRecord #44735 (#44836) 
Cherry-picked from #44735

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-03 10:03:07 +08:00
htyoung
eee4f59f3d [fix](cache) fix same sql return wrong result when switch database with use db and enable sql cache (44782) (#44847) 
It will return wrong result when running same sql in different db with `enable_sql_cache=true`

for example, the `db1` and `db2` has the same table `tbl` but the data are not equals, 
if execute the below sql in `db1` and cache the result, then execute it in `db2`, it will return the wrong result
```sql
select count(*) from tbl
```
 2024-12-02 18:29:17 +08:00
Gabriel
7278a86c20 [profile](pipeline) Add key metrics for pipeline initialization (#35073) (#44738) 
pick #35073
 2024-12-02 16:02:19 +08:00
github-actions[bot]
8843b17a28 branch-2.1: [improve](routine load) ensure load balance after scaling up BE nodes #44693 (#44799) 
Cherry-picked from #44693

Co-authored-by: hui lai <laihui@selectdb.com>
 2024-12-02 15:04:11 +08:00
github-actions[bot]
54e2249a56 branch-2.1: [Fix](http)Enhanced Security Checks for Audit Log File Names #44612 (#44833) 
Cherry-picked from #44612

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-02 14:56:20 +08:00
github-actions[bot]
abf1d5f07d branch-2.1: [improvement](mysql)Support mysql COM_RESET_CONNECTION command. #44747 (#44788) 
Cherry-picked from #44747

Co-authored-by: James <lijibing@selectdb.com>
 2024-12-02 12:58:38 +08:00
924060929
a8a86f82d4 [fix](sql_cache) fix sql cache result wrong of from_unixtime(col, 'yyyy-MM-dd HH:mm:ss') (#44631) (#44810) 
fix sql cache result wrong of from_unixtime(col, 'yyyy-MM-dd HH:mm:ss') which introduced by #33262

the wrong result: is `yyyy-MM-dd HH:mm:ss`
 2024-12-02 11:46:37 +08:00
924060929
6b74db7cdc [fix](nereids) fix months_add/ months_sub/ years_add/years_sub compute wrong result because SimplifyArithmeticComparisonRule (#44725) (#44812) 
cherry pick from #44725
 2024-12-02 11:28:18 +08:00
github-actions[bot]
e322955286 branch-2.1: [fix](jdbc catalog) set enable_jdbc_cast_predicate_push_down default true #44548 (#44760) 
Cherry-picked from #44548

Co-authored-by: zy-kkk <zhongyongkang@selectdb.com>
 2024-12-02 09:33:46 +08:00
github-actions[bot]
f9b3863848 branch-2.1: [Fix](Job)Fix some issues in the Insert job. #44543 (#44597) 
Cherry-picked from #44543

---------

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-11-30 11:18:55 +08:00
yujun
4d023cf0b2 [fix](nereids) fix UnknownValue's reference in simplify range rule #44637 (#44771) 
cherry pick from #44637
 2024-11-29 20:58:40 +08:00
zhangdong
e03517e4e5 [enhance](mtmv)External partition prune #44415 #44567 #44673 (#44767) 
pick: https://github.com/apache/doris/pull/44673 
https://github.com/apache/doris/pull/44415
https://github.com/apache/doris/pull/44567
 2024-11-29 20:53:01 +08:00
github-actions[bot]
9533bd3e8b branch-2.1: (fix)[db] Fix create database and create table data race #44600 (#44683) 
Cherry-picked from #44600

Co-authored-by: deardeng <dengxin@selectdb.com>
 2024-11-29 20:50:10 +08:00
starocean999
22b7c4ca21 [feature](nereids)support show view command in nereids (#44698) 2024-11-29 20:48:30 +08:00
github-actions[bot]
6f868e4f1e branch-2.1: [fix](planner) FunctionCallExpr clone should be deep copy #44678 (#44711) 
Cherry-picked from #44678

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2024-11-29 14:06:30 +08:00
walter
fc942c435f [feat](binlog) Support drop rollup binlog #44677 (#44743) 
cherry pick from #44677
 2024-11-29 11:30:37 +08:00
lihangyu
82c7a9d15a [Fix](Variant) create table should not automatically add variant to key (#44736) 
#36609
 2024-11-29 09:34:43 +08:00
github-actions[bot]
68e6cbf033 branch-2.1: [feat](backup) Add config backup_handler_update_interval_millis #44628 (#44640) 
Cherry-picked from #44628

Co-authored-by: walter <maochuan@selectdb.com>
 2024-11-28 18:43:48 +08:00
xzj7019
2120115e84 [fix](nereids) fix ptopN push down under multi winexprs with partial forbidden type (#44655) 
pick from https://github.com/apache/doris/pull/44617
 2024-11-28 16:04:38 +08:00
github-actions[bot]
c1437ea192 branch-2.1: [improve](backup) Limit the output size of show backup/restore job progress #44681 (#44707) 
Cherry-picked from #44681

Co-authored-by: walter <maochuan@selectdb.com>
 2024-11-28 14:27:34 +08:00
github-actions[bot]
dd4708af47 branch-2.1: [fix](backup) Automatic adapt upload/download snapshot batch size #44560 (#44641) 
Cherry-picked from #44560

Co-authored-by: walter <maochuan@selectdb.com>
 2024-11-28 13:43:33 +08:00
walter
f2689ccba1 [feat](binlog) Support rename rollup & partition binlogs #44526 (#44662) 
cherry pick from #44526
 2024-11-28 10:12:17 +08:00
walter
1a2a91a03a [fix](index) Fix CREATE/DROP INDEX stmt toSql #44494 (#44661) 
cherry pick from #44494
 2024-11-28 10:10:12 +08:00
github-actions[bot]
05b5a3738c branch-2.1: [fix](build index)Fix non-master nodes cannot see the latest build index job status #44544 (#44630) 
Cherry-picked from #44544

Co-authored-by: qiye <luen@selectdb.com>
 2024-11-27 22:51:10 +08:00
wuwenchi
88cfaedb16 [opt](paimon)Optimize the storage location of the serialized paimon table for 2.1 (#44274) (#44660) 
bp: #44274
 2024-11-27 20:35:35 +08:00