database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,055 Commits 1 Branch 0 Tags
69704df447264b061802c55152dc1f087f54001a
Commit Graph

21055 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yiguolei
69704df447 [enhancement](blacklist) print the detail stack that the client is shutdown (#45850) 2024-12-24 14:52:58 +08:00
feiniaofeiafei
9c7280bd58 [test](case) add partition prune cases (#44722) (#45823) 
cherry-pick #44722 to branch-2.1
 2024-12-24 14:25:58 +08:00
zhiqiang
4514652aa2 [fix](profile) Fix clean profile (#45838) 
### What problem does this PR solve?
Clean all profile command does not clean runtime profile. Makes runtime
profile leak, and memory can not be released.

Problem Summary:

![img_v3_02hs_62c4ed81-fe1f-423f-ba92-a1762af5162g](https://github.com/user-attachments/assets/4cec62a5-9077-4e36-91a8-29e5fedd4560)
After clean all profile, summary profile is clear, but runtime profile
and counter still exists.

![img_v3_02hs_4de10ca2-b878-4722-9b6e-9738270e6a8g](https://github.com/user-attachments/assets/b30754f2-a401-4127-aa5f-ed053d9f5c75)

After fix:

![img_v3_02hs_750960cf-9ebd-41e1-8f13-b41e5bc094dg](https://github.com/user-attachments/assets/5a5edb0b-bd7d-439e-92c2-0ed69589a7b5)

![img_v3_02hs_7e111a74-bacb-43e0-8acb-ec406ce68d8g](https://github.com/user-attachments/assets/556af476-7ea0-4924-880e-183f2cf9e870)
 2024-12-24 14:25:03 +08:00
zzzxl
02f15a8ef0 [fix](inverted index) Fix Null Pointer Exception in function match(#45456)(#45774) 
pick: https://github.com/apache/doris/pull/45456
 2024-12-24 11:27:13 +08:00
shuke
1c47f5cf57 [regression-test](fix) fix case with invalid grammer (#45211) (#45791) 
Problem Summary:
Defining global variables in a test suite can easily introduce errors,
such as variable conflicts in concurrent scenarios. In #44576 , a method
for detecting global variables was introduced.

That approach conflicts with the function calling like
connect(user=user, password="pwd"). Furthermore, the connect(user=user,
password="pwd") method cannot specify assignments to parameters with
default values; values still need to be assigned according to the order
of parameters. Therefore, modifying these calling method.
 2024-12-24 11:10:28 +08:00
xzj7019
aa728aef66 [Improvement](tools) refine tools schema (#45825) 
pick from master #45778
 2024-12-24 10:27:08 +08:00
James
536ca0bfe6 [fix](auditlog)Fix auditlog NPE (#45772) (#45808) 
backport: https://github.com/apache/doris/pull/45772
 2024-12-23 21:22:41 +08:00
meiyi
3de3c6ff44 [fix](group commit) fix group commit session (#45800) 
if connect to observer, enable group commit and do insert overwrite,
will get:
```
ERROR 1105 (HY000): errCode = 2, detailMessage = errCode = 2, detailMessage = Nereids does not support group commit insert
```
 2024-12-23 19:09:54 +08:00
Mingyu Chen (Rayner)
901b93264c branch-2.1: [opt](log) add more info in nereids timeout log #45705 (#45793) 
cherry-pick #45705
 2024-12-23 17:57:38 +08:00
github-actions[bot]
6454ee6589 branch-2.1: [Fix](ccr) Incorrectly generated sql with NONE aggregate type #45452 (#45489) 
Cherry-picked from #45452

Co-authored-by: Uniqueyou <wangyixuan@selectdb.com>
 2024-12-23 16:48:29 +08:00
github-actions[bot]
412355b749 branch-2.1: [fix](nereids) fix comparison with date like #45735 (#45781) 
Cherry-picked from #45735

Co-authored-by: yujun <yujun@selectdb.com>
 2024-12-23 15:21:08 +08:00
github-actions[bot]
3006eea5cc branch-2.1: [Improve](Variant) pick random backend as coordinator #45754 (#45771) 
Cherry-picked from #45754

Co-authored-by: lihangyu <lihangyu@selectdb.com>
 2024-12-23 14:02:18 +08:00
Pxl
d70c17bdc0 [Improvement](scan) use loop to instead recursion on Level1Iterator::_normal_next #38005 (#45767) 
pick from  #38005
 2024-12-23 13:54:12 +08:00
Uniqueyou
fe3632aa02 branch-2.1: [Fix](ccr) Wrong result of tosql for add column with comment #45319 (#45727) 
pick: https://github.com/apache/doris/pull/45319
 2024-12-23 11:20:05 +08:00
wuwenchi
b845813e6f [opt](fs)add local file support for 2.1 (#45632) (#45702) 
bp: #45632
 2024-12-23 10:25:34 +08:00
Kaijie Chen
818fd88a10 [test](p0) force replica = 1 in p0 regression tests (#45684) 
### What problem does this PR solve?

Some tests in p0 does not set replica = 1, and will fail when BE number
is not enough.

This PR fixed this problem by set
`force_olap_table_replication_allocation` in p0 fe.conf
 2024-12-23 10:23:50 +08:00
github-actions[bot]
4a7e2911c7 branch-2.1: [fix](catelog) Unifies partition items string #45669 (#45700) 
Cherry-picked from #45669

---------

Co-authored-by: walter <maochuan@selectdb.com>
 2024-12-23 10:04:33 +08:00
lihangyu
ca9f0ade25 [Fix](ShortCircuit) fix prepared statement with partial arguments prepared (#45371) (#45732) 
(#45371)
 2024-12-23 10:03:34 +08:00
github-actions[bot]
608000b8ce branch-2.1: [enhance](mtmv)Change the way to verify the existence of partition names when refreshing MTMV #45290 (#45725) 
Cherry-picked from #45290

Co-authored-by: zhangdong <zhangdong@selectdb.com>
 2024-12-23 10:01:02 +08:00
github-actions[bot]
35bdd0019e branch-2.1: [fix](routine load) make routine load delay eof schedule work #45528 (#45724) 
Cherry-picked from #45528

Co-authored-by: hui lai <laihui@selectdb.com>
 2024-12-23 09:59:03 +08:00
Mingyu Chen (Rayner)
b612468ec8 branch-2.1: [fix](hudi) remove session variable field in HudiScanNode #45762 (#45764) 
cherry-pick #45762
 2024-12-22 21:45:59 +08:00
Mryange
367ecc3292 [fix](expr)Remove the _can_fast_execute flag from VExpr. (#45542) (#45662) 2024-12-22 21:26:32 +08:00
daidai
303557ac70 [fix](hive)fix hive insert only translaction table. (#45753) 
### What problem does this PR solve?
bp #44001 , but no hive4 acid table.

Problem Summary:
1. Fixed the issue that when reading insert translaction only tables,
there was no acid check, which caused multiple data reads (i.e., reading
data from the previous base_n).
2. Forbidden to create, insert data, and delete aicd tables.
 2024-12-22 21:23:21 +08:00
924060929
bb543b89d9 [opt](nereids) optimize rewrite of synchronize materialize view (#45748) (#45752) 
cherry pick from #45748
 2024-12-22 21:17:19 +08:00
minghong
7d9a751297 [feat](nereids) adjust min/max for partition key #41729 branch-2.1 (#45713) 
### What problem does this PR solve?
pick #41729
 2024-12-22 11:20:01 +08:00
Mingyu Chen (Rayner)
9fa94bbde9 [opt](catalog) cache the Configuration object (#45433)(#45756) (#45758) 2024-12-22 08:01:00 +08:00
lihangyu
39c69c766e [Optimize](Variant) optimize schema update performance (#45480) (#45731) 
(#45480)
 2024-12-21 23:41:03 +08:00
github-actions[bot]
1460af8e2a branch-2.1: [fix](nereids)use equals instead of == to compare String #45628 (#45708) 
Cherry-picked from #45628

Co-authored-by: starocean999 <lichi@selectdb.com>
 2024-12-20 20:39:43 +08:00
lihangyu
06efd5b4af [Opt](SegmentIterator) clear and release iterators memory footprint in advance when EOF (#44768) (#45734) 
(#44768)
 2024-12-20 20:38:56 +08:00
lw112
f733aa5dcf branch-2.1: [fix](fold) fixed an issue with be computing constants #43410 (#45712) 
Cherry-picked from #43410
 2024-12-20 20:26:27 +08:00
Yulei-Yang
2a5f4c7979 [fix](ranger) make RangerDorisAccessController as singleton to avoid more and more ranger policy refresher (#45645) 
Issue Number: close #45641
Problem Summary:
doris create new RangerDorisAccessController twice when do every
checkpoint, and the new RangerDorisAccessController instance create a
new ranger policy refresher. Too many policy refreshers will cause
ranger admin overload
 2024-12-20 17:13:23 +08:00
github-actions[bot]
17cc76e589 branch-2.1: [fix](variable) force update variable not work as expected #45648 (#45696) 
Cherry-picked from #45648

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
 2024-12-20 14:44:07 +08:00
github-actions[bot]
37c4de3cbf branch-2.1: [improve](variant) only sanitize in debug mode #45689 (#45698) 
Cherry-picked from #45689

Co-authored-by: lihangyu <lihangyu@selectdb.com>
 2024-12-20 14:25:49 +08:00
github-actions[bot]
7e5d880431 branch-2.1: [fix](iceberg) Fill in the detailed error information #45415 (#45688) 
Cherry-picked from #45415

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
 2024-12-20 13:32:02 +08:00
Xinyi Zou
b39358fd0a [Fix](branch-2.1) Fix arrow-flight-sql to use pipeline (#45661) 
### What problem does this PR solve?

Fix arrow-flight-sql to use pipeline
 2024-12-20 11:22:15 +08:00
morrySnow
afb59f5f0d [opt](Nereids) lock table in ascending order of table IDs (#45045) (#45679) 
pick from master #45045
 2024-12-20 11:02:03 +08:00
yujun
2f62954525 branch-2.1: [fix](create table) fix create table fail msg #45623 (#45651) 
cherry pick from #45623
 2024-12-20 10:58:54 +08:00
Mingyu Chen (Rayner)
19c0e89da7 [enchement](iceberg)support read iceberg partition evolution table. (#45367) (#45569) 
cherry-pick #45367

Co-authored-by: daidai <changyuwei@selectdb.com>
 2024-12-20 08:56:51 +08:00
walter
c459ad7382 [fix](binlog) Avoid clear binlog dir #45581 (#45620) 
cherry pick from #45581
 2024-12-19 23:42:54 +08:00
github-actions[bot]
cc691b6e01 branch-2.1: [Fix](Job)Fix redundant job scheduling by preventing same state transitions (e.g., RUNNING → RUNNING) #45495 (#45647) 
Cherry-picked from #45495

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
 2024-12-19 23:28:37 +08:00
HappenLee
9272c650b4 [Refactor](query) refactor lock in fragment mgr and change std::unorder_map to phmap (#45069) 
### What problem does this PR solve?

Related PR: #44821
 2024-12-19 22:27:33 +08:00
github-actions[bot]
e91a810df8 branch-2.1: [fix](sql cache) fix prepare statement with sql cache throw NullPointerException #45640 (#45650) 
fix prepare statement with sql cache throw NullPointerException:
```shell
java.lang.NullPointerException: Cannot read field "originStmt" because the return value of "org.apache.doris.analysis.StatementBase.getOrigStmt()" is null
```
 2024-12-19 20:01:40 +08:00
Xujian Duan
4b7c2eaa7d [branch-2.1](fix) fix incorrect result of hash join with const column (#45630) 2024-12-19 19:14:38 +08:00
github-actions[bot]
f966088fd0 branch-2.1: [fix](nereids) fix ExtractAndNormalizeWindowExpression bug #45553 (#45635) 
Cherry-picked from #45553

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2024-12-19 19:13:03 +08:00
Sun Chenyang
299bb8735c [opt](test) Make the case stable. #44195 (#45638) 2024-12-19 17:44:45 +08:00
wangbo
55e5e69a81 [branch-2.1]Fix test_audit_log_behavior failed (#45636) 2024-12-19 17:43:11 +08:00
github-actions[bot]
d6c629d293 branch-2.1: [fix](tvf) Tvf supports to parse the enclose character in csv files #45407 (#45570) 
Cherry-picked from #45407

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
 2024-12-19 16:23:44 +08:00
walter
9b80695e31 [fix](suites) Enable common expr pushdown in the restore inverted idx case #45547 (#45622) 
cherry pick from #45547
 2024-12-19 14:09:23 +08:00
github-actions[bot]
7f8ec3e679 branch-2.1: [fix](export) Make enable_outfile_to_local available for export command #45241 (#45515) 
Cherry-picked from #45241

Co-authored-by: Siyang Tang <tangsiyang@selectdb.com>
 2024-12-19 14:08:33 +08:00
github-actions[bot]
7957e6fe0f branch-2.1: [Fix] Add column with default value string throw exception #45000 (#45316) 
Cherry-picked from #45000

Co-authored-by: Uniqueyou <134280716+wyxxxcat@users.noreply.github.com>
 2024-12-19 14:07:43 +08:00