database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,350 Commits 1 Branch 0 Tags
13964bb1eee094e1105eea9ebcbcaba00f426cb6
Commit Graph

21350 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Uniqueyou
13964bb1ee branch-2.1: [fix](sql) Wrong result of tosql for drop column with rollup #47153 (#47206) 
pick: https://github.com/apache/doris/pull/47153
 2025-01-24 17:28:27 +08:00
Uniqueyou
4c0f3d7631 branch-2.1: [fix](ccr) Wrong tosql for alt tbl enable feature #46620 (#47212) 
pick: https://github.com/apache/doris/pull/46620
 2025-01-24 17:18:34 +08:00
zgxme
511adb8ea3 branch-2.1:[Opt](regression) Add more test cases to external communit… (#47383) 
### What problem does this PR solve?
bp https://github.com/apache/doris/pull/46897
Add more test cases to external community pipeline
 2025-01-24 16:35:49 +08:00
Thearas
baaf026e82 [fix](hive docker)Reserve host port for hive2 namenode and datanode (#47262) (#47354) 
Problem Summary:

The [External hive

CI](http://43.132.222.7:8111/buildConfiguration/Doris_External_Regression/612304?buildTab=log&linesState=3650&logView=flowAware)
failed because of `namenode` error( 50070 port already in used), docker
logs:
```txt
2025-01-21T04:22:37.955682469Z java.net.BindException: Port in use: 0.0.0.0:50070
2025-01-21T04:22:37.955686106Z 	at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:940)
2025-01-21T04:22:37.955689402Z 	at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:876)
2025-01-21T04:22:37.955692708Z 	at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
2025-01-21T04:22:37.955697828Z 	at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:760)
2025-01-21T04:22:37.955701444Z 	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:639)
2025-01-21T04:22:37.955704831Z 	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:819)
2025-01-21T04:22:37.955708237Z 	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:803)
2025-01-21T04:22:37.955711674Z 	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1500)
2025-01-21T04:22:37.955715090Z 	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1566)
2025-01-21T04:22:37.955718446Z Caused by: java.net.BindException: Address already in use
2025-01-21T04:22:37.955722013Z 	at sun.nio.ch.Net.bind0(Native Method)
2025-01-21T04:22:37.955725460Z 	at sun.nio.ch.Net.bind(Net.java:433)
2025-01-21T04:22:37.955729227Z 	at sun.nio.ch.Net.bind(Net.java:425)
2025-01-21T04:22:37.955733074Z 	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
2025-01-21T04:22:37.955736600Z 	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
2025-01-21T04:22:37.955740197Z 	at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
2025-01-21T04:22:37.955743884Z 	at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:934)
2025-01-21T04:22:37.955747391Z 	... 8 more
2025-01-21T04:22:37.961686454Z 25/01/21 04:22:37 INFO util.ExitUtil: Exiting with status 1
```

The best choice is avoid the services using server port at range
`/proc/sys/net/ipv4/ip_local_port_range` (32768-60999). But since the
namenode [hardcode exposing port `50070` in docker
image](https://hub.docker.com/layers/bde2020/hadoop-datanode/2.0.0-hadoop2.7.4-java8/images/sha256-5623fca5e36d890983cdc6cfd29744d1d65476528117975b3af6a80d99b3c62f),
so we add the port to `net.ipv4.ip_local_reserved_ports` and introduce a
new flags `--reserve-ports` to control it (default false, because not
everyone want to modify system reserved ports).

Change-Id: I03a81e9931cb555695199436b6f0517cccf83588
 2025-01-24 16:12:03 +08:00
Thearas
3aad9e5f67 [opt](oceanbase docker)Use LTS docker image and print unhealthy docker logs (#46647) (#47349) 
### What problem does this PR solve?

Problem Summary:
Oceanbase container sometimes start failed.
<img width="653" alt="image"

src="https://github.com/user-attachments/assets/d95c66cf-7e04-4179-a565-9b9dd8b87128"
/>

We do two things:
1. Print last 100 lines docker logs of unhealthy container for debugging
2. Upgrade Oceanbase docker image to the newest `4.2.1-lts`, since it is
7 months newer than `4.2.1`, more stable
 2025-01-24 11:22:02 +08:00
github-actions[bot]
896fd7d6bc branch-2.1: [Opt](test) export/outfile case supports multi-kerberos env #47189 (#47239) 
Cherry-picked from #47189

Co-authored-by: zgxme <zhenggaoxiong@selectdb.com>
 2025-01-23 15:19:44 +08:00
zgxme
50b3303385 branch-2.1:[fix](docker) Start kerberos docker correctly (#47315) 
### What problem does this PR solve?

Wrongly started kerberos twice that may cause container name conflict.

Related PR: https://github.com/apache/doris/pull/46858
 2025-01-22 17:55:37 +08:00
github-actions[bot]
7568b21273 branch-2.1: [fix](docker) solve kerberos docker conflict #47260 (#47273) 
Cherry-picked from #47260

Co-authored-by: zgxme <zhenggaoxiong@selectdb.com>
 2025-01-22 10:17:39 +08:00
xy720
fe182c7148 branch-2.1: [fix](bug) Fix dead lock in Tablet Stat Mgr (#47242) 2025-01-21 20:45:37 +08:00
airborne12
9e460a0c63 [chore](submodule) align clucene submodule branch with doris branch-2.1 (#47268) 2025-01-21 15:29:29 +08:00
yiguolei
52396fbc88 2.1.8-rc01 (#47232) 2025-01-20 14:30:42 +08:00
Yulei-Yang
32ad2d930c [fix](coldheat) fix missing partition's storage policy in create_table_like stmt (#47133) 
bp: #47009
 2025-01-20 09:28:06 +08:00
Mingyu Chen (Rayner)
700d9aed44 branch-2.1: [fix](test) add debug info (#47170) 
And some debug info to trace the issue when creating catalog with use_meta_cache=false
and sometimes the database list can not be fetched.
 2025-01-19 10:53:13 +08:00
lihangyu
4f9562650d Branch-2.1 [Fix](Variant) fix variant serialize to string (#47121) (#47147) 
cherry-pick from #47121
 2025-01-18 09:12:39 +08:00
github-actions[bot]
9dffe5992e branch-2.1: [fix](json) fix parsing double in jsonb #46977 (#47065) 
Cherry-picked from #46977

Co-authored-by: Sun Chenyang <sunchenyang@selectdb.com>
 2025-01-18 00:25:13 +08:00
github-actions[bot]
43bfca9ba5 branch-2.1: [test](move-memtable) mitigate flaky injection test skip_two_backends #47082 (#47111) 
Cherry-picked from #47082

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
 2025-01-17 20:48:09 +08:00
github-actions[bot]
df020058a7 branch-2.1: [regression-test](framework) fix bug when sql returns two column with same name #47087 (#47137) 
Cherry-picked from #47087

Co-authored-by: shuke <shuke@selectdb.com>
 2025-01-17 20:45:16 +08:00
yagagagaga
77c9385040 branch-2.1: [fix](regression-test) fix failed in regression-test: doc/table-design/tiered-storage/remote-storage.md (#46733) (#47109) 2025-01-17 20:44:10 +08:00
meiyi
ca2b8d1613 branch-2.1: [fix](case) fix group commit case (#47143) 
pick https://github.com/apache/doris/pull/47141
 2025-01-17 20:41:59 +08:00
morrySnow
257e07ae16 branch-2.1: [fix](Nereids) insert lock all target tables #47033 (#47172) 
pick from master #47033
 2025-01-17 20:36:26 +08:00
minghong
f2fe07a0b9 [fix](regression) join condition is missing in tpcds query24 (#47158) 2025-01-17 20:31:28 +08:00
github-actions[bot]
490e04a88a branch-2.1: [fix](Nereids) bind schema table qualified column failed #46960 (#47156) 
Cherry-picked from #46960

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2025-01-17 17:30:10 +08:00
morrySnow
4139764bef branch-2.1: [fix](test) eager agg test use be num as 1 for stable shape #46558 (#47099) 
pick from master #46558
 2025-01-17 10:55:26 +08:00
github-actions[bot]
aaf9016832 branch-2.1: [regression-test](fix) fix backup and restore case #47058 (#47107) 
Cherry-picked from #47058

Co-authored-by: yagagagaga <zhangminke@selectdb.com>
 2025-01-17 10:39:30 +08:00
Mingyu Chen (Rayner)
3504ddb2ec [fix](test) fix unstable test cases (#47051) (#47120) 
bp #47051
 2025-01-17 09:44:08 +08:00
github-actions[bot]
4bd55b2f8b branch-2.1: [Opt](external-docker) Modify kerberos network mode to host #47043 (#47095) 
Cherry-picked from #47043

Co-authored-by: zgxme <zhenggaoxiong@selectdb.com>
 2025-01-16 23:12:05 +08:00
Mryange
adc9e9a161 [fix](function) Fix undefined behavior caused by bit_shift_left exceeding the 64-bit range. (#47080) 
### What problem does this PR solve?
It is part of this PR's https://github.com/apache/doris/pull/35769
content.


```
SELECT a, b, bit_shift_left(nullable(a), nullable(b)) from t01;
+----------------------+-----+-----------------------------------------------------------+
| a                    | b   | bit_shift_left(nullable(a), cast(nullable(b) as TINYINT)) |
+----------------------+-----+-----------------------------------------------------------+
| -4388843650233597359 | 127 | -9223372036854775808                                      |
| 306567258363819813   | 3   | 2452538066910558504                                       |
| 306567258363819813   | 127 | -9223372036854775808                                      |
| 3456789123456789123  | 127 | -9223372036854775808                                      |
+----------------------+-----+-----------------------------------------------------------+ 
```
now
```
SELECT a, b, bit_shift_left(nullable(a), nullable(b)) from t01;
+----------------------+-----+-----------------------------------------------------------+
| a                    | b   | bit_shift_left(nullable(a), cast(nullable(b) as TINYINT)) |
+----------------------+-----+-----------------------------------------------------------+
| -4388843650233597359 | 127 | 0                                                         |
| 306567258363819813   | 3   | 2452538066910558504                                       |
| 306567258363819813   | 127 | 0                                                         |
| 3456789123456789123  | 127 | 0                                                         |
+----------------------+-----+-----------------------------------------------------------+
```
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
 2025-01-16 21:13:24 +08:00
shuke
9decc111e0 [regression-test](fix) fix workload_manager_p0 case bug (#47100) 2025-01-16 21:11:38 +08:00
github-actions[bot]
171251cf42 branch-2.1: [test](mtmv) Modify wrong test method and add some log in debug mode test case #46907 (#47091) 
Cherry-picked from #46907

Co-authored-by: seawinde <wusi@selectdb.com>
 2025-01-16 17:48:14 +08:00
lihangyu
29bcb249eb [Branch-2.1](regression-test) fix unstable connection reset lead to case failure (#47073) 2025-01-16 17:37:10 +08:00
minghong
48465688ac [fix](regression)Tpcds q24_1 missing join condition (#47085) 2025-01-16 17:36:40 +08:00
github-actions[bot]
70079feaa8 branch-2.1: [Bug](mtmv) update mapping relation when mtmv occur alter #46983 (#47063) 
Cherry-picked from #46983

Co-authored-by: shee <13843187+qzsee@users.noreply.github.com>
Co-authored-by: garenshi <garenshi@tencent.com>
 2025-01-16 17:07:15 +08:00
Xin Liao
ce98073a1b branch-2.1: [opt](regression-test) Adjust the stream load timeout check of the regression framework #47037 (#47049) 
cherry pick from #47037
 2025-01-16 17:02:16 +08:00
Pxl
a85b5eb9d0 [Bug](runtime-filter) fix bloom_filter_func use after free on get_build_bf_cardinality #47034 (#47050) 
pick from #47034
 2025-01-16 14:22:36 +08:00
Pxl
05e0bff137 [Bug](scan) do not ignore non-rf predicate which acting same column with rf #46789 (#47015) 
pick from #46789
 2025-01-15 16:38:35 +08:00
lihangyu
c6ffa1f4eb [Fix](PreparedStatement) fix incorrect query result with prepared statment (#47012) 
cherry-pick from #46994
 2025-01-15 14:42:04 +08:00
Gabriel
664bbeb10c [fix](data stream) Fix dead loop in VDataStreamMgr's de-constructor (… (#47000) 2025-01-15 13:53:20 +08:00
github-actions[bot]
14c822716a branch-2.1: [fix](export) fix error in show export outfile info column #46850 (#46954) 
Cherry-picked from #46850

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
 2025-01-15 13:50:57 +08:00
qiye
385589c92b [fix](regression)Fix unstable compaction related cases (#46920) (#47003) 
bp #46920
 2025-01-15 13:42:04 +08:00
bobhan1
aad4ad9ae3 branch-2.1: [Fix](regression) Fix flaky test test_partial_update_compaction_with_higher_version #46916 (#46940) 
pick https://github.com/apache/doris/pull/46916
 2025-01-14 22:48:50 +08:00
zhangdong
465c187000 [case](mtmv)wait task finish before select (#38553) (#46944) 
pick https://github.com/apache/doris/pull/38553
 2025-01-14 22:16:35 +08:00
bobhan1
c60627250d branch-2.1: [Fix](schema change) Fix NPE when rename column on table which has sequence type column #46906 (#46942) 
pick https://github.com/apache/doris/pull/46906
 2025-01-14 19:25:22 +08:00
Pxl
b1a2846b78 [Chore](schema-change) return error when tablet_schema get null function #46790 (#46962) 
pick from #46790
 2025-01-14 15:27:17 +08:00
shuke
a8995b883f [regression-test](case) mv tpcds 100 to nonConccurrent (#46936) 2025-01-14 14:25:01 +08:00
Pxl
58415c3591 [Chore](case) add test case for cityhash #46928 (#46957) 
pick from #46928
 2025-01-14 14:03:19 +08:00
Pxl
989f189486 [test](join) Fuzzy disable runtime filters in BE #45654 (#46931) 
pick from  #45654

---------

Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
 2025-01-14 12:46:56 +08:00
github-actions[bot]
f4515727d3 branch-2.1: [fix](session var) add need forward for disable_inverted_index_v1_for_variant #46845 (#46869) 
Cherry-picked from #46845

Co-authored-by: airborne12 <jiangkai@selectdb.com>
 2025-01-14 12:46:39 +08:00
Lijia Liu
a12f4d7a09 [fix](pipelineX) bp #46493 and add some regresstion tests (#46865) 
### What problem does this PR solve?

bp #46493
Add some regresstion tests for #46493 and #46541

Co-authored-by: liulijia <liulijia1029@gmail.com>
 2025-01-14 10:11:58 +08:00
github-actions[bot]
3d1afd326d branch-2.1: [Chore](Notice)Update Notice year #46908 (#46933) 
Cherry-picked from #46908

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2025-01-14 09:50:30 +08:00
Xin Liao
ae9d3391be branch-2.1: [improve](move-memtable) reduce flush token num #46001 (#46926) 
cherry pick from #46001

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
 2025-01-14 09:44:30 +08:00