database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
17,498 Commits 1 Branch 0 Tags
5539f85fec2ef8135bce956fbbc8d311d8a6912e
Commit Graph

17498 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jeffrey
5539f85fec [fix](ui) fix database cannot be choosed bug (#32091) 2024-03-13 16:21:13 +08:00
Mingyu Chen
6d2924668e [fix](audit-loader) fix invalid token check logic (#32095) 
The check of the token should be forwarded to Master FE.
I add a new RPC method `checkToken()` in Frontend for this logic.
Otherwise, after enable the audit loader, the log from non-master FE can not be loaded to audit table
with `Invalid token` error.
 2024-03-12 22:52:11 +08:00
Pxl
fa111c371b [Chore](top-n) check runtime predicate inited when scan operator open (#32140) 
check runtime predicate inited when scan operator open
 2024-03-12 22:52:10 +08:00
yiguolei
5da7cd0fba [bugfix](becore) has to use value to capture lambda value to avoid core during callback (#32132) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-03-12 22:51:44 +08:00
zhangdong
84af8e0a53 [enhance](mtmv)mtmv support hive default partition (#32051) 2024-03-12 22:51:11 +08:00
abmdocrt
6acdd9cd48 The issue introduced by the recently added auto-increment column works fine on a single node but may result in discontinuous auto-increment IDs when running on a cluster. This PR has been modified to check for the uniqueness of the auto-increment column values instead of checking for equality to a fixed value. (#32115) 2024-03-12 21:51:36 +08:00
yiguolei
0159a75ced [bugfix](becore) be will core when stop because the map is modified during iterator (#32105) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-03-12 18:50:26 +08:00
Jerry Hu
473bd3ee64 [fix](function) incorrect result of eq_for_null (#32103) 2024-03-12 18:50:26 +08:00
xueweizhang
4956d5de83 [fix](planner) remove input slot for aggregate slot which is not materialized (#32092) 
introduced by #26886

run this sql:
SELECT
        caseId
    FROM
        (
            SELECT
                caseId,
                count(judgementDateId)
            FROM
                (
                    SELECT
                        abs(caseId) AS caseId,
                        id as judgementDateId
                    FROM
                        dr_user_test_t2
                ) AGG_RESULT
            GROUP BY
                caseId
        ) TOTAL
        order by 1;


will get:

ERROR 1105 (HY000): errCode = 2, detailMessage = (172.17.0.1)[INTERNAL_ERROR]couldn't resolve slot descriptor 1, desc: tuples:
Tuple(id=5 slots=[Slot(id=10 type=DOUBLE col=-1, colname=, nullable=1), Slot(id=11 type=VARCHAR col=-1, colname=id, nullable=1)] has_varlen_slots=1)
Tuple(id=4 slots=[Slot(id=8 type=DOUBLE col=-1, colname=, nullable=1)] has_varlen_slots=0)
Tuple(id=2 slots=[Slot(id=4 type=DOUBLE col=-1, colname=caseId, nullable=1)] has_varlen_slots=0)
Tuple(id=0 slots=[Slot(id=0 type=VARCHAR col=-1, colname=caseId, nu
 2024-03-12 18:50:26 +08:00
feiniaofeiafei
781a45d93c [Fix](nereids) fix date function rewrite (#32060) 2024-03-12 18:50:26 +08:00
HHoflittlefish777
6610307eb0 [opt](routine-load) end Kafka consume when meets partition EOF #32046 2024-03-12 18:50:06 +08:00
谢健
2da57526a3 [feat](Nereids): use table map to construct struct info (#32058) 2024-03-12 18:50:06 +08:00
shuke
45824d959c [release](build script) fix build release bug when build multiple version on same machine #32104 2024-03-12 18:50:06 +08:00
924060929
cf04c9c300 [enhancement](Nereids) refine and speedup analyzer (#31792) (#32111) 
## Proposed changes
1. check data type whether can applied should not throw exception when real data type is subclass of signature data type
2. merge `SlotBinder` and `FunctionBinder` to `ExpressionAnalyzer` to skip rewrite the whole expression tree multiple times.
3. `ExpressionAnalyzer.buildCustomSlotBinderAnalyzer()` provide more refined code to bind slot by different parts and different priority
4. the origin slot binder has O(n^2) complexity, this pr use `Scope.nameToSlot` to support O(n) bind
5. modify some `Collection.stream()` to `ImmutableXxx.builder()` to remove some method call which are difficult to inline by jvm in the hot path, e.g. `Expression.<init>` and `AbstractTreeNode.<init>`
6. modify some `ImmutableXxx.copyOf(xxx)` to `Utils.fastToImmutableList(xxx)` to skip addition copy of the array
7. set init size to `Immutable.builder()` to skip some useless resize
8. lazy compute and cache some heavy operations, like `Scope.nameToSlot` and `CaseWhen.computeDataTypesForCoercion()`

(cherry picked from commit 83c2f5a95827136aac4f0a78c5e841e9a099858c)
 2024-03-12 17:09:38 +08:00
qiye
5f125bbaaa [improvement](binlog)Support inverted index in CCR (#31743) (#32101) 2024-03-12 15:34:08 +08:00
Gabriel
61928f7df5 [pipelineX](scanner) Use the actual instances num when ignore data distribution (#32081) 2024-03-12 14:20:39 +08:00
AlexYue
ffa904c487 [enhance](Cooldown) Skip cooldown if the tablet is dropped (#32079) 2024-03-12 14:20:39 +08:00
Mingyu Chen
2ffcfb4bc5 [fix](doc) fix wrong download link (#32082) 2024-03-12 14:20:39 +08:00
lihangyu
ae206596c9 [DOC](Variant) add bloom filter description and correct some benchmark results (#31998) 2024-03-12 14:20:39 +08:00
Mingyu Chen
65835cdd2b [doc](sql-dialect) update sql convertor tool to 1.0.1 (#32077) 2024-03-12 14:20:39 +08:00
minghong
da60a111d0 [refactor](nereids) rename PlanNode.distributeExprLists to childrenDistributeExprLists #32069 2024-03-12 14:20:39 +08:00
wangbo
194f3432ab [Improvement](executor)Routine load support workload group #31671 2024-03-12 14:20:18 +08:00
TengJianPing
b41b17ad0a [fix](spill) fix storage engine type cast error (#32071) 2024-03-12 14:20:18 +08:00
FreeOnePlus
a937c54b2b [fix](docker)Fix the registration logic of Doris On Docker (#32026) 
* Refactor upgrade documentation

* fix docker be entry point shell

---------

Co-authored-by: Yijia Su <suyijia@selectdb.com>
 2024-03-12 14:20:18 +08:00
FreeOnePlus
2ee12b8678 [improvement](docker)Optimize Dockerfile content for FE and BE (#32027) 
* Refactor upgrade documentation

* Optimize Dockerfile content for FE and BE.

* Optimize Dockerfile content for FE and BE.

---------

Co-authored-by: Yijia Su <suyijia@selectdb.com>
 2024-03-12 14:20:18 +08:00
Tiewei Fang
aea9ddc3cb [Fix](Outfiel) fix be core when the open method of vfile_result_writer failed #32042 2024-03-12 14:20:18 +08:00
walter
dc7d80860f [fix](case) fix export data consistency table key type (#32045) 2024-03-12 14:20:18 +08:00
wuwenchi
926908ece2 [fix](hive) fix spelling mistakes for "separatorChar" #32061 2024-03-12 14:20:18 +08:00
Xinyi Zou
4268634115 [fix](memory) Fix Allocator cancel pipelinex query #32048 2024-03-12 14:20:18 +08:00
Benjaminwei
ccd21a6ea4 [Improve](InPredict) enhance in predict with array type (#31828) 2024-03-12 14:19:14 +08:00
FreeOnePlus
1509fbd538 [feature](docker)Doris On Docker All In One (#31735) 
* Refactor upgrade documentation

* Doris On Docker All In One

---------

Co-authored-by: Yijia Su <suyijia@selectdb.com>
 2024-03-12 14:19:14 +08:00
Mryange
68a5319da3 [fix](pipelineX) _local_channel_dependency is null in non pipelineX (#32054) 2024-03-12 14:19:04 +08:00
camby
a7a85dd330 [chore](config) support select experimental session variable (#31837) 
support select experimental variables:

Before change:


Before change:
select @@experimental_enable_nereids_planner;
ERROR 1193 (HY000): errCode = 2, detailMessage = Unknown system variable 'experimental_enable_nereids_planner'

show variables like 'experimental_enable_nereids_planner';
+-------------------------------------+-------+---------------+---------+
| Variable_name                       | Value | Default_Value | Changed |
+-------------------------------------+-------+---------------+---------+
| experimental_enable_nereids_planner | false | true          | 1       |
+-------------------------------------+-------+---------------+---------+

After change:
> select @@experimental_enable_nereids_planner;
+---------------------------------------+
| @@experimental_enable_nereids_planner |
+---------------------------------------+
|                                     1 |
+---------------------------------------+
 2024-03-12 14:18:26 +08:00
zy-kkk
fe3988c686 [fix](compile) fix BE compile failure on Mac (#32044) 2024-03-12 14:17:55 +08:00
zy-kkk
31ee448c87 [test](fix) Fix one missing line of output in out file (#32036) 2024-03-12 14:17:55 +08:00
Mryange
c0f2d0188b [feature](pipelineX) add mem control in local exchange sink (#31982) 2024-03-12 14:17:48 +08:00
minghong
ab21d85e8c [nereids](topn-filter) support multi-topn filter (FE part) (#31485) 
support multi-topn-filter
 2024-03-12 14:17:48 +08:00
Mryange
b0b7161ad0 [feature](rf) add filter info profile when rf run as expr (#31822) 2024-03-12 14:17:48 +08:00
HappenLee
2470634859 [RuntimeFilter] fix <=> runtime filter failed bug (#32003) 2024-03-12 14:13:13 +08:00
TengJianPing
3358f76a7f [feature](spill) Implement spill to disk for hash join, aggregation and sort for pipelineX (#31910) 
Co-authored-by: Jerry Hu <mrhhsg@gmail.com>
 2024-03-12 14:12:09 +08:00
zy-kkk
cf6b22c621 [fix](jdbc catalog) fix type conversion error in MySQL JDBC Driver 5.x (#31880) 2024-03-12 14:07:57 +08:00
zy-kkk
1fee736ca4 [fix](jdbc catalog) Clean up the connection pool after failure to initialize the client (#31949) 2024-03-12 14:07:00 +08:00
abmdocrt
27eed5399d [Fix](auto-inc) Fix partial update auto inc publish case failure #31987 2024-03-12 14:07:00 +08:00
KassieZ
15f859272f [docs](docs) Update 2.0.6 release note and 1.2.8 release note(#32090) 2024-03-12 13:15:21 +08:00
KassieZ
81a22ccb27 [docs](docs) Update 2.1 release note (#32056) 2024-03-11 17:35:51 +08:00
Gabriel
ae6003504c [pipelineX](partition sort) Add some nessacery metrics (#32020) 
Add some necessary metrics
 2024-03-09 19:55:48 +08:00
wangbo
c5390d00bb [Improvement]Add schema table backend_active_tasks (#31945) 2024-03-09 19:55:48 +08:00
Pxl
38caa35a73 [Chore](third-party) update clucene version (#32014) 
update clucene version
 2024-03-09 19:55:48 +08:00
TengJianPing
d2e7a68d11 [enhancement](util) print if using nereids planner when be coredump (#31981) 2024-03-09 19:55:47 +08:00
seawinde
d5bf20c96e [improvement](mtmv) Improve the performance for query rewritting by materialized view (#31886) 
- Limit the number of times for the query rewritting to the group
- Remove the unnecessary log and explain detail info in query
 2024-03-09 19:55:47 +08:00