database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,201 Commits 1 Branch 0 Tags
03a3f37cc4e1e4cdddf080fefa4ac0a8f440edeb
Commit Graph

21201 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
airborne12
03a3f37cc4 [fix](index meta) make has_inverted_index function more robust #46364 (#46428) 
cherry pick from #46364
 2025-01-07 09:36:22 +08:00
morrySnow
ccb6c2610a branch-2.1: [fix](nereids)fix bug of PushDownFilterThroughSetOperation (#46370) (#46456) 
pick from master #46370

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2025-01-06 21:34:40 +08:00
github-actions[bot]
53889cbbb6 branch-2.1: [enhance](auth)Reduce the scope of permission locks #46115 (#46451) 
Cherry-picked from #46115

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-01-06 18:51:09 +08:00
Yongqiang YANG
4b69673e4e [fix](fe.conf) use g1 by default for jdk17 (#46395) 2025-01-06 17:52:35 +08:00
github-actions[bot]
dda058c433 branch-2.1: [fix](test)fix unstable case correctness_p0/test_mv_case/test_mv_case #46101 (#46431) 
Cherry-picked from #46101

Co-authored-by: starocean999 <lichi@selectdb.com>
 2025-01-06 17:42:40 +08:00
github-actions[bot]
6958dec242 branch-2.1: [fix](regression)Fix schema change statistics case. Neredis not allow change MV schema. #46433 (#46448) 
Cherry-picked from #46433

Co-authored-by: James <lijibing@selectdb.com>
 2025-01-06 16:50:52 +08:00
zfr95
7b8a93879c [test](mtmv)Test and check the differences between MTMV and OLAP (#44793) 
pick from #36520 
pick from #44417 

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-01-06 09:57:59 +08:00
github-actions[bot]
12350ca867 branch-2.1: [Improve](mtmv) skip the generation of invalid task for refresh mtmv #46280 (#46392) 
Cherry-picked from #46280

Co-authored-by: shee <13843187+qzsee@users.noreply.github.com>
Co-authored-by: garenshi <garenshi@tencent.com>
 2025-01-05 08:59:11 +08:00
github-actions[bot]
a4c328c4cd branch-2.1: [fix](compile) fix fe compile failed by code too large #46408 (#46420) 
Cherry-picked from #46408

Co-authored-by: 924060929 <lanhuajian@selectdb.com>
 2025-01-05 05:07:49 +08:00
github-actions[bot]
3d6ad47d08 branch-2.1: [fix](test) fix unstable lower case test #46410 (#46416) 
Cherry-picked from #46410

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
 2025-01-04 22:28:29 +08:00
github-actions[bot]
eb867f593a branch-2.1: [opt](iceberg) opt the error msg when create db which already exists #46334 (#46414) 
Cherry-picked from #46334

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
 2025-01-04 19:05:52 +08:00
924060929
1405c48a77 [opt](coordinator) optimize parallel degree of shuffle when use nereids (#44754) (#46397) 
cherry pick from #44754
 2025-01-04 19:04:17 +08:00
github-actions[bot]
1b1d7e2f29 branch-2.1: [fix](test) fix test_autoinc_broker_load.groovy #46320 (#46338) 
Cherry-picked from #46320

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
 2025-01-04 14:17:31 +08:00
minghong
2358dc4403 [fix](nereids) Create Runtime filter even if equal.right is not in aliasTransferMap (branch-2.1) (#46407) 
### What problem does this PR solve?

pick #46406
Related PR: #40815
 2025-01-04 11:54:08 +08:00
github-actions[bot]
012848060b branch-2.1: [fix](test) Fix mysql catalog check db test #46263 (#46343) 
Cherry-picked from #46263

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
 2025-01-04 10:45:26 +08:00
github-actions[bot]
714b90a7fe branch-2.1: [fix](arrow-flight-sql) Fix arrow-flight-sql ConnectContext to use a unified ID #46284 (#46389) 
Cherry-picked from #46284

Co-authored-by: Xinyi Zou <zouxinyi@selectdb.com>
 2025-01-04 10:36:09 +08:00
wuwenchi
8b45258ae6 [fix](external)using saved member variables for 2.1 (#46156) (#46400) 
bp: #46156
 2025-01-04 09:01:14 +08:00
lihangyu
db224ba15f [fix](variant) fix schema change for variant from not null to null (#46403) 
cherry-pick from #46279
 2025-01-04 09:00:43 +08:00
github-actions[bot]
d8c94d6392 branch-2.1: [fix](regression)fix hive translation unstable case. #46385 (#46409) 
Cherry-picked from #46385

Co-authored-by: daidai <changyuwei@selectdb.com>
 2025-01-04 08:59:56 +08:00
zy-kkk
e9921d7a07 branch-2.1: [fix](external catalog) Fixed non-master FE log replay during refresh (#46373) 
cherry-pick #46369
 2025-01-03 22:03:30 +08:00
github-actions[bot]
69de40ca27 branch-2.1: [fix](regression-test) fix injection would not be removed when exception #46357 (#46360) 
Cherry-picked from #46357

Co-authored-by: hui lai <laihui@selectdb.com>
 2025-01-03 22:02:50 +08:00
github-actions[bot]
f93452dba7 branch-2.1: [improve](move-memtable) disable stack trace in load stream reply #46318 (#46332) 
Cherry-picked from #46318

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
 2025-01-03 22:01:21 +08:00
walter
08cb06396b branch-2.1: [Fix](index build) should not append index to meta while column id is -1 #46307 (#46345) 
cherry pick from #46307

Co-authored-by: airborne12 <jiangkai@selectdb.com>
 2025-01-03 21:59:55 +08:00
wangbo
384b78fa4e [Fix]delete internal group (#46351) 2025-01-03 21:59:36 +08:00
amory
333b54eaba [fix](ip) fix ip nullable param without check (#44700) (#46252) 
if we use ipv6_cidr_to_range function with nullable func which with
invalid ipv6 will make be core
```
mysql> select id, ipv6_cidr_to_range(nullable(''), 32) from fn_test_ip_nullable order by id;
```
 2025-01-03 21:24:37 +08:00
Mingyu Chen (Rayner)
26f570f40e [test](test) fix unstable paimon test cases (#46383) 
cherry-pick #46381
 2025-01-03 20:04:59 +08:00
Siyang Tang
c2a17b8ad9 [fix](schema-change) Fix job replay failure when partitions added to table after job finish (#46166) (#46367) 
Cherry-picked from #46166
 2025-01-03 19:25:43 +08:00
github-actions[bot]
ff68859546 branch-2.1: [improvement](http) improve table schema api for catalog table #45933 (#45982) 
Cherry-picked from #45933

Co-authored-by: wudi <wudi@selectdb.com>
 2025-01-03 16:40:12 +08:00
github-actions[bot]
05292563ca branch-2.1: [fix](statistics)Fix sample all tablets scale factor incorrect bug. #46306 (#46329) 
Cherry-picked from #46306

Co-authored-by: James <lijibing@selectdb.com>
 2025-01-03 16:28:59 +08:00
github-actions[bot]
18846751d5 branch-2.1: [Bug](scan) do not release tablet_reader on NewOlapScanner::close #46296 (#46355) 
Cherry-picked from #46296

Co-authored-by: Pxl <xl@selectdb.com>
 2025-01-03 16:26:33 +08:00
daidai
98a8738a7d [fix](metaCache)fix bug that names cache can not invalidate.(#46287) (#46349) 
bp #46287
 2025-01-03 14:51:40 +08:00
Mingyu Chen (Rayner)
025038410c [opt](test) add more debug info in test_jdbc_catalog_ddl.groovy (#46323) 
cherry-pick #46322
 2025-01-03 09:14:54 +08:00
Gabriel
34f9072ab6 [Improvement](local shuffle) Reduce locking scope in local exchanger … (#46294) 
…(#46251)

Reduce lock scope from global level to data queue level.
 2025-01-03 09:14:22 +08:00
github-actions[bot]
79955e3d94 branch-2.1: [fix](regression-test) flush out file to fix hudi p2 #46258 (#46317) 
Cherry-picked from #46258

Co-authored-by: Socrates <suyiteng@selectdb.com>
 2025-01-03 09:13:48 +08:00
Mingyu Chen (Rayner)
86f2050af7 [fix](test) use different catalog name for test_hive_parquet_skip_page (#46314) 
cherry-pick #46315
 2025-01-03 09:13:06 +08:00
zhiqiang
a12fa2881f [fix](metrics) Fix negative scanner cnt (#46291) 
### What problem does this PR solve?
Fix 

![image](https://github.com/user-attachments/assets/c78e4978-2292-46c2-8cc1-59da4c05cf41)

Related PR: https://github.com/apache/doris/pull/41314

Scanner has two constructor function on branch-2.1, but on master it
just has one, so cherrypick introduced bug.
 2025-01-03 09:07:06 +08:00
github-actions[bot]
e5aeacae59 branch-2.1: [test](case) skip unstable case in cloud mode #46274 (#46298) 
skip unstable case in cloud mode
 2025-01-02 20:32:28 +08:00
github-actions[bot]
c385293ee9 branch-2.1: [opt](nereids) improve prune partition with lots of in (xxx) #46261 (#46286) 
improve prune partition with lots of `in (xxx)`

this can reduce from 35s to 300ms when there have 4000 options
 2025-01-02 18:52:31 +08:00
Jerry Hu
7206ca39ec [fix](DECIMAL) error DECIMAL cat to BOOLEAN (#44326) (#46275) 
In the past, there were issues with converting `double` and `decimal` to
`boolean`.
For example, a `double` value like 0.13 would first be cast to `uint8`,
resulting in 0.
Then, it would be converted to `bool`, yielding 0 (incorrect, as the
expected result is 1).

Similarly, `decimal` values were directly cast to `uint8`, leading to
non-0/1 values for `bool`.
This issue arises because Doris internally uses `uint8` to represent
`boolean`.

before
```
mysql> select cast(40.123 as BOOLEAN);
+-------------------------+
| cast(40.123 as BOOLEAN) |
+-------------------------+
|                      40 |
+-------------------------+
```

now
```
mysql> select cast(40.123 as BOOLEAN);
+-------------------------+
| cast(40.123 as BOOLEAN) |
+-------------------------+
|                       1 |
+-------------------------+
```

### What problem does this PR solve?

pick #44326
Related PR: #[44326](https://github.com/mrhhsg/doris/tree/pick_44326)

Problem Summary:
 2025-01-02 18:42:04 +08:00
github-actions[bot]
068ff8deae branch-2.1: [opt](show) let all types table support show index #45861 (#45898) 
Cherry-picked from #45861

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2025-01-02 17:13:58 +08:00
walter
2c7e5cae9a branch-2.1: [fix](catalog) Fix mark handling for failed tasks to maintain getLeftMarks #46205 (#46256) 
cherry pick from #46205
 2025-01-02 16:39:43 +08:00
github-actions[bot]
f6d98a6061 branch-2.1: [Bug](auto-partition) fix auto partition could set storage_medium properties #45955 (#46260) 
Cherry-picked from #45955

Co-authored-by: zhangstar333 <zhangsida@selectdb.com>
 2025-01-02 16:38:55 +08:00
Gabriel
df6935ad04 [Improvement](fragment) Improvement map performance in fragment mgr (#46245) 
pick #46235
 2025-01-02 15:11:56 +08:00
github-actions[bot]
bfab6361f7 branch-2.1: [fix](report) report queue size based on the number of Bes and config #46190 (#46243) 
Cherry-picked from #46190

Co-authored-by: deardeng <dengxin@selectdb.com>
 2025-01-02 15:11:03 +08:00
github-actions[bot]
a52c0e0cc4 branch-2.1: [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size… #34105 (#46248) 
Cherry-picked from #34105

Co-authored-by: lihangyu <15605149486@163.com>
 2025-01-02 15:10:25 +08:00
github-actions[bot]
fbc361ec7c branch-2.1: [opt](arrow-flight-sql) Support arrow-flight-sql protocol getStreamCatalogs, getStreamSchemas, getStreamTables #46217 (#46268) 
Cherry-picked from #46217

Co-authored-by: Xinyi Zou <zouxinyi@selectdb.com>
 2025-01-02 15:07:04 +08:00
github-actions[bot]
7e615afbce branch-2.1: [fix](regression-test) fix test_outfile_csv_with_names_and_types case #46214 (#46272) 
Cherry-picked from #46214

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2025-01-02 15:06:39 +08:00
github-actions[bot]
b5beaf4eb1 branch-2.1: [fix](mtmv)The refresh method for MTMV is commit. If the status is PAUSED, no more tasks should be generated #46020 (#46265) 
Cherry-picked from #46020

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2025-01-02 14:03:28 +08:00
Gabriel
ffb8077ecb [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size… (#46249) 
… from default to 2048 (#34105)

since 50 may cause performance issue introduced by #33853

Co-authored-by: lihangyu <15605149486@163.com>
 2025-01-02 10:50:12 +08:00
zhiqiang
5deeb42f6d branch-2.1: [opt] Optimization for short circuit of CompoundPred #45422 (#46241) 
cherry pick from #45422
 2025-01-02 10:11:47 +08:00