database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,418 Commits 1 Branch 0 Tags
13c8b1797dbf5ea85ff91db3fbd2484d556cc0ea
Commit Graph

21418 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
xzj7019
13c8b1797d [fix](nereids)fix logical repeat computefd (#47798) 2025-02-13 16:27:30 +08:00
github-actions[bot]
058929528c branch-2.1: [fix](mv) Fix use sync mv wrongly when use rbo materialized view rewrite rule #47650 (#47835) 
Cherry-picked from #47650

Co-authored-by: seawinde <wusi@selectdb.com>
 2025-02-13 16:10:20 +08:00
yujun
c4a10849d5 branch-2.1: [fix](nereids) fix nereids dead loop due to simplify range output in-predicate's options in random order #47830 (#47828) 
### What problem does this PR solve?

cherry-pick: #47830

#45181 introduce a dead loop for nereids optimizer, then cause error
'Nereids cost too much time'.

simplify range process in-predicate steps as follow:
1.  Extract in-predicate's options into a set S1;
2. Use a discrete value desc to hold the value, use a new set S2, and
S2.addAll(S1);
3. Turn discrete value desc back to a new in-predicate, the new
in-predicate's options add all S2.

Before #45181, S2 is an order set(TreeSet)， so the result in-predicate's
options are always order. But this PR change S2 as a unorder
set(HashSet). Then will cause dead loop: in-predicate => S1 => new S2 =>
new in-predicate => new S1 => new S2 => ...

fix: 
1. S1 use linked hash set;
2. don't use a new S2, just let S2 = S1;

then the result in-predicate's  options' order will be kept.
 2025-02-13 11:10:22 +08:00
github-actions[bot]
f8fb5f90b8 branch-2.1: [fix](Nereids) not release lock if schema changed when insert #47733 (#47833) 
Cherry-picked from #47733

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2025-02-12 19:52:41 +08:00
github-actions[bot]
8c6c642462 branch-2.1: [fix](nereids)keep at least one hash output slot when prune slots in hash join node #47318 (#47683) 
Cherry-picked from #47318

Co-authored-by: starocean999 <lichi@selectdb.com>
 2025-02-12 17:53:30 +08:00
github-actions[bot]
48bcdf539a branch-2.1: [fix](table) Supply rollup for get ddl for sync #47732 (#47796) 
Cherry-picked from #47732

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2025-02-12 16:19:22 +08:00
shuke
eee254efab [regression-test](case) remove test_auto_partition_behavior before fix (#47818) 2025-02-12 15:23:45 +08:00
github-actions[bot]
f85176bee0 branch-2.1: [improve](move-memtable) improve error log and message for "not enough streams" #47470 (#47722) 
Cherry-picked from #47470

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
 2025-02-12 14:42:11 +08:00
github-actions[bot]
cb3e77379d branch-2.1: [fix](backup) filter the staled task response by job id #47416 (#47445) 
Cherry-picked from #47416

Co-authored-by: walter <maochuan@selectdb.com>
 2025-02-12 14:41:32 +08:00
github-actions[bot]
e8531621c0 branch-2.1: [feat](binlog) Support getting binlogs in batch #47557 (#47640) 
Cherry-picked from #47557

Co-authored-by: walter <maochuan@selectdb.com>
 2025-02-12 14:38:55 +08:00
morrySnow
3f1a9db94f branch-2.1: [fix](Nereids) Use the schema saved during planning as the schema of the original target table #47337 (#47773) 
pick from master #47337
 2025-02-12 09:59:47 +08:00
github-actions[bot]
f55fba7cea branch-2.1: [debug](move-memtable) add debug logs for skip_two_backends injection cases #46826 (#46945) 
Cherry-picked from #46826

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
 2025-02-12 09:58:57 +08:00
github-actions[bot]
818e675b72 branch-2.1: [fix](restore) Cut down restore timeout when create replicas failed #47278 (#47496) 
Cherry-picked from #47278

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2025-02-12 09:58:10 +08:00
Pxl
217e6cef34 [Bug](join) return eof when join build sink awakend by downstream source #47380 (#47709) 
pick from #47380
 2025-02-12 09:41:11 +08:00
zy-kkk
3ca0fc3784 branch-2.1: [fix](external catalog) Persisting the External Catalog comment field… (#47569) 
cherry-pick (#46946)
 2025-02-12 09:20:30 +08:00
zy-kkk
da3222e7e1 branch-2.1: [fix](external catalog) Fix missing fields when rebuilding metadata from image (#47751) 
cherry-pick (#47603)
 2025-02-12 09:19:02 +08:00
github-actions[bot]
a3e93fa3b6 branch-2.1: [Fix](job)Fix for Duplicate Scheduling of Tasks #46872 (#46899) 
Cherry-picked from #46872

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2025-02-12 09:17:35 +08:00
Calvin Kirs
de27cbb9ce branch-2.1: [Chore](dependencies)upgrade dependencies #47127 (#47765) 
pick #47127
 2025-02-12 09:17:10 +08:00
github-actions[bot]
b4af671347 branch-2.1: [Fix](catalog)Fixes query failures for Paimon tables stored in Kerberized HDFS #47192 (#47694) 
Cherry-picked from #47192

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2025-02-12 09:16:30 +08:00
Socrates
b4f03c0eb3 [charry-pick](branch-2.1) add more hudi jni test cases #47431 (#47764) 2025-02-11 22:13:53 +08:00
starocean999
b03d966398 [fix](nereids)use visitNullableAggregateFunction for NullableAggregateFunction (#47716) 2025-02-11 22:11:48 +08:00
github-actions[bot]
3ee7ad9b81 branch-2.1: [fix](test) fix test_routine_load case unstable #47601 (#47752) 
Cherry-picked from #47601

Co-authored-by: hui lai <laihui@selectdb.com>
 2025-02-11 22:06:00 +08:00
LiBinfeng
402570f603 [fix](case) disable testSelect in StmtExecutorTest (#47760) 2025-02-11 22:03:17 +08:00
seawinde
5fade75891 [test](mtmv)Pick some test pr to 21 #46299 #46787 #46546 (#47098) 2025-02-11 21:56:40 +08:00
github-actions[bot]
a121566ce1 branch-2.1: [fix](Nereids) fix log bug and add more numeric arithmetic function cases #47228 (#47749) 
Cherry-picked from #47228

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
 2025-02-11 21:44:37 +08:00
qiye
7b579c75c6 [fix](ES Catalog)Make sure ES meta is synced before using (#46781) (#47711) 
bp #46781
 2025-02-11 21:00:08 +08:00
James
e2f9b436a4 [fix](nereids)Add catalog/db/table filter info in SchemaScanNode (#46864) (#47759) 
backport: https://github.com/apache/doris/pull/46864
 2025-02-11 19:05:27 +08:00
Gabriel
964c940131 [fix](coordinator) Fix wrong recvrId in fragment contains BHJ (#47727) (#47729) 
In Coordinator, a shuffle map consists of `recvrId` in each instance.
For example, if 3 BEs exist in a cluster, for a shuffled hash join, we
get 3 maps for a fragment sent to each BE:
BE0: {0:0, 1:1}
BE1: {2:0, 3:1}
BE2: {4:0, 5:1}
In this example, parallelism is 2. Keys in shuffle map indicate the
global shuffle id and the values indicate the instance id in current BE.
In Coordinator, the `recvrId` is the global shuffle id of each instance
so we may get a wrong result if it is wrong.

This bug is caused by `recvrId` set by a BHJ fragment. If a fragment
contains both BHJ and SHJ, `recvrId` should be set by SHJ and BHJ should
be ignored.
 2025-02-11 18:49:34 +08:00
github-actions[bot]
6a3c630ee0 branch-2.1: [chore](binlog) Save properties in CreateTableRecord #47551 (#47639) 
Cherry-picked from #47551

Co-authored-by: walter <maochuan@selectdb.com>
 2025-02-11 16:57:20 +08:00
bobhan1
c8ccada010 branch-2.1: [Fix](memory) Add try catch block for Segment::load_pk_index_and_bf… (#47742) 
pick https://github.com/apache/doris/pull/47715
 2025-02-11 16:56:13 +08:00
wangbo
2f7e0f0b76 Revert "[branch-2.1]downgrade resource tag when there is not queryabl… (#47746) 
revert #45387
 2025-02-11 16:51:07 +08:00
Mingyu Chen (Rayner)
9eb6c2fa60 [fix](jni) pass krb5 conf to jni (#47679) 
### What problem does this PR solve?

Related PR: #47299

Problem Summary:

This pick part of #47299, only related to `jni-util.cpp`.
To pass the krb5.conf config to Jni env
 2025-02-10 22:27:11 +08:00
github-actions[bot]
6ceb010195 branch-2.1: [fix](mv)Fix direct select mv pre agg bug. #47658 (#47700) 
Cherry-picked from #47658

Co-authored-by: James <lijibing@selectdb.com>
 2025-02-10 21:45:00 +08:00
walter
470030b878 [feat](clone) Speed clone tablet via batch small file downloading #45061 (#45218) 
cherry pick from #45061
 2025-02-10 19:38:40 +08:00
wangbo
f4e92d75f5 [branch-2.1] fix select * from variables system table (#34529) (#47660) 
pick #34529

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
Co-authored-by: xueweizhang <zxw520blue1@163.com>
 2025-02-09 14:14:06 +08:00
yujun
8ff4ae879e branch-2.1: [fix](nereids) fix compare ipv4 / ipv6 always equals (#47514) 
### What problem does this PR solve?

fix compare ipv4 and ipv6 always equals.

for example, `select cast('127.0.0.1' as ipv4) = cast('192.168.10.10' as
ipv4)'` will return 1, but it should return 0;

Issue Number: close #xxx
 2025-02-09 04:43:07 +08:00
github-actions[bot]
3f250e55ce branch-2.1: [Enhancement](regression-test)Add regression test for database properties backup and restore #41925 (#47643) 
Cherry-picked from #41925

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2025-02-09 04:24:05 +08:00
walter
e47b398123 branch-2.1: [chore](binlog) Add download binlog related configs to BE #47412 (#47585) 
cherry pick from #47412
 2025-02-08 16:23:23 +08:00
walter
e681c055a4 [chore](binlog) Log download binlog cost (#47360) (#47575) 
cherry-pick #47360
 2025-02-08 16:22:23 +08:00
walter
b4f00be528 branch-2.1: [fix](restore) Make the DirMoveTask idempotent. #47313 (#47584) 
cherry pick from #47313
 2025-02-08 14:28:38 +08:00
github-actions[bot]
3ec723f2cb branch-2.1: [fix](prepared statement) fix protocol with TIME datatype #47389 (#47543) 
Cherry-picked from #47389

Co-authored-by: lihangyu <lihangyu@selectdb.com>
 2025-02-08 13:00:49 +08:00
zclllyybb
800288b7fe [branch-2.1](FoldFE) pick special date arithmetics of #37376 and #37766 (#47616) 
pick https://github.com/apache/doris/pull/37376 and
https://github.com/apache/doris/pull/37766
 2025-02-08 11:29:52 +08:00
zgxme
45c9daa063 branch-2.1:[fix](docker) Starting thirdpaty script with only the res… (#47592) 2025-02-08 10:11:32 +08:00
walter
9d3ee27e55 branch-2.1: [fix](restore) Add a local snapshot lock to protect snapshot dir #47279 (#47574) 
cherry pick from #47279
 2025-02-08 09:49:22 +08:00
github-actions[bot]
226f848ad8 branch-2.1: [fix](hive docker)Table partition_location_1 miss data #47539 (#47559) 
Cherry-picked from #47539

Co-authored-by: Thearas <gaozifeng@selectdb.com>
 2025-02-07 11:21:47 +08:00
github-actions[bot]
0cd2557882 branch-2.1: [Fix]Fix double-free when memtable agg #47523 (#47532) 
Cherry-picked from #47523

Co-authored-by: wangbo <wangbo@selectdb.com>
 2025-02-06 13:11:05 +08:00
walter
209ddb374e branch-2.1: [chore](io) Add debug log for critical file operations #46770 (#46859) 
cherry pick from #46770
 2025-02-06 09:41:45 +08:00
github-actions[bot]
328d23a825 branch-2.1: [fix](case)rm hms event use_meta_chache is false case. #47457 (#47492) 
Cherry-picked from #47457

Co-authored-by: daidai <changyuwei@selectdb.com>
 2025-02-05 18:04:46 +08:00
github-actions[bot]
5240e6fd36 branch-2.1: [regression-test](case) audit log case #47456 (#47485) 
Cherry-picked from #47456

Co-authored-by: shuke <shuke@selectdb.com>
 2025-02-05 11:43:19 +08:00
github-actions[bot]
13e88b8a15 branch-2.1: [Fix](test) test_cumu_compaction_with_delete case should be nonConcurrent #47372 (#47448) 
Cherry-picked from #47372

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
 2025-01-27 08:48:13 +08:00