6bc9316ac1
[Bug] Fix the merge error result in group concat sort ( #11322 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-07-29 14:12:07 +08:00
92bb7d0720
[improvement]Remove the website build framework from the docs directory ( #11081 )
...
Remove the website build framework from the docs directory
2022-07-29 13:51:57 +08:00
8eac06134f
[Doc]Add Introduction to Apache Doris ( #11114 )
...
Add Introduction to Apache Doris
2022-07-29 13:41:16 +08:00
6d0c59d4f0
[doc]Added auto_broadcast_join_threshold variable description ( #11323 )
...
Add auto_broadcast_join_threshold variable description
2022-07-29 13:05:30 +08:00
a60cfab844
[feature](Nereids) Add subquery analyze ( #11300 )
...
Increase the parsing of subquery.
Add LogicalApply and LogicalCorrelatedJoin and LogicalEnforceSingleRow.
(These structures are temporarily in use, in preparation for the follow-up)
LogicalApply:
Apply Node for subquery.
Use this node to display the subquery in the relational algebra tree.
refer to "Orthogonal Optimization of Subqueries and Aggregation"
LogicalCorrelatedJoin:
A relational algebra node with join type converted from apply node to subquery.
LogicalEnforceSingleRow:
Guaranteed to return a result of 1 row.
2022-07-29 12:44:04 +08:00
f70bbd274e
[doc]Correct jump link error in flink-doris-connector ( #11074 )
...
* Correct jump link error in flink-doris-connector
2022-07-29 12:12:19 +08:00
c256a689e8
[doc](website)Update node status column name for show backends command ( #11312 )
...
[doc](website)Update node status column name for `show backends` command
2022-07-29 12:03:58 +08:00
8d31745415
[Regression](planner) Add tpch plan check ( #11181 )
...
Add plan check for tpch so that we can sense any changes to the final plan opportunely.
2022-07-29 10:45:36 +08:00
3c44d84c93
[refactor] (datetimev2) refactor FEFunctions for datev2/datetimev2 ( #11296 )
2022-07-29 10:22:25 +08:00
bac280e803
[Vectorized] Support both distinct and order by of group_concat ( #11278 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-07-29 09:11:34 +08:00
91424a4a4e
[community](*): remove type in checklist. ( #11295 )
2022-07-29 09:10:54 +08:00
951320256b
[enhancement](Nereids)enable explain query for nereids planner ( #11210 )
...
Support explain syntax. And generate explain tree string by nereids' planner.
2022-07-28 17:23:17 +08:00
70c7e3d7aa
[feature-wip](unique-key-merge-on-write) remove AggType on unique table with MoW, enable preAggreation, DSIP-018[5/2] ( #11205 )
...
remove AggType on unique table with MoW, enable preAggreation
2022-07-28 17:03:05 +08:00
97874dd125
[improvement](profile) add json profile and add session context ( #11279 )
...
1. Add a new session varible "session_context"
2. support export profile in json format
2022-07-28 15:48:00 +08:00
b260a02215
[fix](be): fix stack overflow in unhex function ( #11204 )
...
* [fix](be): fix stack overflow in unhex function
2022-07-28 14:59:54 +08:00
19b34c09b1
[fix] (mem tracker) Fix runtime instance tracker null pointer ( #11272 )
2022-07-28 14:58:13 +08:00
75451ab0ed
[feature](nereids) Add stats derive framework for new optimizer ( #11179 )
...
Implement a visitor to derive stats for each operator which would be used for CBO.
2022-07-28 14:38:19 +08:00
ef25459fa1
[fix](workflow) Fix the wrong name of concurrency group ( #11275 )
2022-07-28 14:23:07 +08:00
083125812c
[testcase] Fix regression test case failure ( #11286 )
2022-07-28 14:12:56 +08:00
6ffdd0cbdd
[Fix] Coredump in column dictionary insert data from DefaultValueColumnIterator ( #11217 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-07-28 14:08:24 +08:00
5eb4b402e4
[demo]add sync full database ( #11276 )
...
Co-authored-by: wudi <>
2022-07-28 14:06:59 +08:00
328a225050
[feature-wip] (datetimev2) support window funnel and modify valid dat… ( #11277 )
...
* [feature-wip] (datetimev2) support window funnel and modify valid date range
2022-07-28 14:06:26 +08:00
a2948811fe
[fix](github) Fix the configuration of requirement checks ( #11281 )
2022-07-28 14:03:23 +08:00
89ca436561
[github] modify the github checks' requirement ( #11269 )
2022-07-28 10:55:39 +08:00
1b4a2c287e
[Improvement][chore] replace from_decv2_to_packed128 to decv2.value ( #11261 )
2022-07-28 10:41:27 +08:00
dfaed52d32
[docker] Update compile Dockerfile in developer ( #10339 )
...
Co-authored-by: manyi <fop@freeoneplus.com >
2022-07-28 10:35:56 +08:00
d4b4c9a9bf
[feature-wip](unique-key-merge-on-write) update counter, DSIP-018 ( #11252 )
2022-07-28 10:32:26 +08:00
0b1d06bfd6
[Vectorized] Support order by aggregate function ( #11187 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-07-28 09:12:58 +08:00
fccc5e3097
[improvement](log) Avoid too many 'not found query' warn log ( #11048 )
2022-07-28 09:12:25 +08:00
9013d5cc09
[enhancement](workflow) Optimize workflows ( #11145 )
...
1. Fine tune the trigger conditions for workflows.
2. Introduce concurrency group to cancel previous workflow trigged by the same pr.
2022-07-28 08:32:33 +08:00
28b56cf461
[community] Remove build-extension checks temporarily ( #11267 )
2022-07-28 08:31:03 +08:00
72d2feae99
[feature-wip] Support all date functions for datev2/datetimev2 ( #11265 )
...
* [feature-wip] (datetimev2) support convert_tz function
* [feature-wip] Support all date functions for datev2/datetimev2
2022-07-28 08:18:59 +08:00
87b1f4c071
[feature](multi-catalog) Support es datasource ( #10565 )
2022-07-27 23:16:17 +08:00
8128e5d4f0
[feature-wip](multi-catalog) support pruning buckets for hive bucket table ( #11156 )
...
1. Spark currently does not populate bucketed output which is compatible with Hive, so spark bucket table is not supported in current implementation.
2. Hive 3.0 introduced bucket version 2, but doris still uses hive 2.3.7 which lacks the hash function of version 2, so I refer to the implementation of Trino and copy the hash function from hive.
3. Current implementation doest not support the table with multiple bucketed columns, and only support `Equal` and `In` predicates.
2022-07-27 23:16:00 +08:00
4e6a59df4c
[Improvement][chore] add const to all operator== ( #11251 )
2022-07-27 21:46:47 +08:00
85d7b3089c
[docker] ADD Arm Compile Dockerfile ( #10600 )
...
Add the Dockerfile file of the Docker compiled image under the ARM architecture
2022-07-27 19:55:42 +08:00
a2f39278e2
[feature](Nereids): add MultiJoin. ( #11254 )
...
Add MultiJoin.
In addtion, when (joinInputs.size() >= 3 && !conjuncts.isEmpty()), conjunct still can contains onPredicate.
Like:
```
A join B on A.id = B.id where A.sid = B.sid
```
2022-07-27 19:26:02 +08:00
b6bdb3bdbc
[fix] (mem tracker) Fix MemTracker accuracy ( #11190 )
2022-07-27 18:59:24 +08:00
5913c7c52c
[feature-wip](array-type) add function array_slice ( #11054 )
...
array_slice function returns a slice of the array.
2022-07-27 18:43:52 +08:00
42d76b54dc
[fix](compile)fix compile failed after merge #11117 #10479 and #11162 ( #11253 )
...
fix the compile failed after merge #11117 #10479 and #11162
2022-07-27 17:25:06 +08:00
be2ac6aa59
[fix](auth) Forbid grant USAGE_PRIV to database.table ( #11234 )
2022-07-27 16:51:15 +08:00
4ea2c04676
Optimize regexp and like using hyperscan ( #11116 )
...
* use hyperscan instead of re2 for regexp and like function
2022-07-27 16:43:58 +08:00
d4fb27125a
[feature-wip](unique-key-merge-on-write) row id conversion for compaction ( #11149 )
2022-07-27 16:32:13 +08:00
01e108cb7b
[feature-wip](unique-key-merge-on-write) update delete bitmap while publish version ( #11195 )
...
1.make version publish work in version order
2.update delete bitmap while publish version, load current version rowset
primary key and search in pre rowsets
3.speed up publish version task by parallel tablet publish task
Co-authored-by: yixiutt <yixiu@selectdb.com >
2022-07-27 16:26:42 +08:00
461a31b1f6
[enhancement][Storage] refactor create predicate ( #11017 )
2022-07-27 16:12:23 +08:00
daf2e27202
[feature] (Nereids) add rule to push down predicate through aggregate ( #11162 )
...
add rule to push predicates down to aggregation node
add PushDownPredicatesThroughAggregation.java
add ut for PushDownPredicatesThroughAggregation
For example:
```
Logical plan tree:
any_node
|
filter (a>0 and b>0)
|
group by(a, c)
|
scan
```
transformed to:
```
project
|
upper filter (b>0)
|
group by(a, c)
|
bottom filter (a>0)
|
scan
```
Note:
'a>0' could be push down, because 'a' is in group by keys;
but 'b>0' could not push down, because 'b' is not in group by keys.
2022-07-27 15:16:15 +08:00
2db642d9d3
ignore antlr generated ( #11211 )
...
This PR proposes to ignore tracking the following file and dir auto-generated by ANTLR4:
fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisLexer.tokens
fe/fe-core/src/main/antlr4/org/apache/doris/nereids/gen/
2022-07-27 15:07:56 +08:00
d9fab77100
[fix](planner)LateralViewRef#toSql throw NPE if it is not analyzed ( #11221 )
2022-07-27 14:44:27 +08:00
a1599e3f6a
[regression test]update test_conditional_function ( #11244 )
2022-07-27 14:39:40 +08:00
93b0e002d1
[feature-wip](unique-key-merge-on-write) add delete bitmap in read path, DSIP-018[2/3] ( #11136 )
2022-07-27 14:18:21 +08:00
