Commit Graph

6608 Commits

Author SHA1 Message Date
5999666115 [fix](planner)do not change non-null to nullable for outer join table slot (#11268)
* remove nullable for outer join table

* fix ut

* remove useless comment

* fix for original engine
2022-07-29 21:34:24 +08:00
c1fbee7fe1 [fix] the nullable info is lost in ifnull expr (#11212)
ifnull function has defect when processing nullable column or const column in some case
2022-07-29 21:33:58 +08:00
5215d95064 [enhancement](workflow) Use ccache to speed the BE UT (Clang) up (#11339) 2022-07-29 21:19:26 +08:00
a46f94320d [fix](ci): add checkout to fix PR-title-checker (#11336) 2022-07-29 21:09:41 +08:00
e7fae413dd [feature](nereids) add scalar subquery expression (#11332)
scalar subquery:
A subquery that will return only one row and one column.

A limit has been added, where a = subquery returns a result of 1 row and 1 column.
Here, the first limit is to return 1 column.

TODO: the subsequent return will limit the return to 1 row
2022-07-29 21:05:19 +08:00
8483660fe7 [opt] unify stop script (#11337) 2022-07-29 21:04:03 +08:00
e7635e54ee [doc](unique key) add suggestion for replace_if_not_null (#11223) 2022-07-29 20:02:18 +08:00
a7e7df658c [Doc] update FAQ about ODBC (#11263) 2022-07-29 19:18:28 +08:00
d6f937cb01 (performance)[scanner] Isolate local and remote queries using different scanner… (#11006) 2022-07-29 19:14:46 +08:00
84ce2a1e98 [feature-wip](multi-catalog)(fix) partition value error when a block contains multiple splits (#11260)
`FileArrowScanner::get_next` returns a block when full, so it maybe contains multiple
splits in small files or crosses two splits in large files.
However, a block can only fill the partition values from one file. Different splits may be
from different files, causing the error of embed partition values.
2022-07-29 18:48:59 +08:00
cb7eb725fe Optimize flink oracle cdc, add flink read es to doris sample code (#11274) 2022-07-29 18:11:18 +08:00
4cbfd7822a update flink connecotr problem (#11075)
update flink connecotr problem
2022-07-29 17:22:59 +08:00
ea2fac597e update json import with read json by line (#11061)
update json import with read json by line
2022-07-29 17:04:45 +08:00
a7199fb98e [improvement]Use phmap::flat_hash_set in AggregateFunctionUniq (#11257) 2022-07-29 16:55:22 +08:00
d3c88471ad [tracing] Support opentelemtry collector. (#10864)
* [tracing] Support opentelemtry collector.

1. support for exporting traces to multiple distributed tracing system via collector;
2. support using collector to process traces.
2022-07-29 16:49:40 +08:00
934fe77c06 [refactor](be)remove redundant code in column writer (#10915) 2022-07-29 16:48:59 +08:00
337a2fe2b9 [Doc] Add alter table comment doc (#11294)
Add alter table comment doc
2022-07-29 16:47:16 +08:00
303963cfdd [doc]Stream load doc fix (#11328)
Stream load doc fix
2022-07-29 16:46:44 +08:00
512ff192bf [Doc] Resolve Historical Conflict Documents (#10997)
* Resolve Historical Conflict Documents
2022-07-29 16:33:59 +08:00
3fe7b21ac8 [Improvement](vectorized) Remove row-based conjuncts on vectorized nodes (#11324) 2022-07-29 15:42:06 +08:00
4f8e66c4b3 [doc][fix]Modify docs/community to keep the same as the website site directory structure (#11327)
Modify docs/community to keep the same as the website site directory structure
2022-07-29 14:51:37 +08:00
14bb6088da [community](actions): add action to check PR title (#11304) 2022-07-29 14:49:44 +08:00
63bdf8497e ADD: backup by minio (#11245)
ADD: backup by minio
2022-07-29 14:47:31 +08:00
018665aba2 [feature-wip](unique-key-merge-on-write) some followup of #11057 (#11290) 2022-07-29 14:44:48 +08:00
a6537a90cd [Enhancement] Garbage collection of unused data on remote storage backend (#10731)
* [Feature](cold_on_s3) support unused remote rowset gc

* return aborted when skip drop tablet

* perform unused remote rowset gc
2022-07-29 14:38:39 +08:00
eb4721cd80 [enhance](*): replace with StringBuild (#11146) 2022-07-29 14:31:35 +08:00
e4bc3f6b6f [feature-wip] (parquet-reader) add parquet reader impl template (#11285) 2022-07-29 14:30:31 +08:00
642499265c [fe-package]reject illegal import (#11311) 2022-07-29 14:22:23 +08:00
Pxl
6c2337483b [compile]remove all fpic on thirdpatry build (#11298) 2022-07-29 14:16:43 +08:00
8edbe39de8 [project-node]add projection thrift (#11309) 2022-07-29 14:15:06 +08:00
e40c68e913 [Fix](metric) Fix FE max_instances_num_per_user metric (#11313) 2022-07-29 14:14:05 +08:00
d13406d59e [Bug] (outer join) Fix wrong types in outer join (#11315) 2022-07-29 14:13:09 +08:00
6bc9316ac1 [Bug] Fix the merge error result in group concat sort (#11322)
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
2022-07-29 14:12:07 +08:00
92bb7d0720 [improvement]Remove the website build framework from the docs directory (#11081)
Remove the website build framework from the docs directory
2022-07-29 13:51:57 +08:00
8eac06134f [Doc]Add Introduction to Apache Doris (#11114)
Add Introduction to Apache Doris
2022-07-29 13:41:16 +08:00
6d0c59d4f0 [doc]Added auto_broadcast_join_threshold variable description (#11323)
Add auto_broadcast_join_threshold variable description
2022-07-29 13:05:30 +08:00
a60cfab844 [feature](Nereids) Add subquery analyze (#11300)
Increase the parsing of subquery.

Add LogicalApply and LogicalCorrelatedJoin and LogicalEnforceSingleRow.
(These structures are temporarily in use, in preparation for the follow-up)

LogicalApply:
Apply Node for subquery.
Use this node to display the subquery in the relational algebra tree.
refer to "Orthogonal Optimization of Subqueries and Aggregation"

LogicalCorrelatedJoin:
A relational algebra node with join type converted from apply node to subquery.

LogicalEnforceSingleRow:
Guaranteed to return a result of 1 row.
2022-07-29 12:44:04 +08:00
f70bbd274e [doc]Correct jump link error in flink-doris-connector (#11074)
* Correct jump link error in flink-doris-connector
2022-07-29 12:12:19 +08:00
c256a689e8 [doc](website)Update node status column name for show backends command (#11312)
[doc](website)Update node status column name for `show backends` command
2022-07-29 12:03:58 +08:00
8d31745415 [Regression](planner) Add tpch plan check (#11181)
Add plan check for tpch so that we can sense any changes to the final plan opportunely.
2022-07-29 10:45:36 +08:00
3c44d84c93 [refactor] (datetimev2) refactor FEFunctions for datev2/datetimev2 (#11296) 2022-07-29 10:22:25 +08:00
bac280e803 [Vectorized] Support both distinct and order by of group_concat (#11278)
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
2022-07-29 09:11:34 +08:00
91424a4a4e [community](*): remove type in checklist. (#11295) 2022-07-29 09:10:54 +08:00
951320256b [enhancement](Nereids)enable explain query for nereids planner (#11210)
Support explain syntax. And generate explain tree string by nereids' planner.
2022-07-28 17:23:17 +08:00
70c7e3d7aa [feature-wip](unique-key-merge-on-write) remove AggType on unique table with MoW, enable preAggreation, DSIP-018[5/2] (#11205)
remove AggType on unique table with MoW, enable preAggreation
2022-07-28 17:03:05 +08:00
97874dd125 [improvement](profile) add json profile and add session context (#11279)
1. Add a new session varible "session_context"
2. support export profile in json format
2022-07-28 15:48:00 +08:00
b260a02215 [fix](be): fix stack overflow in unhex function (#11204)
* [fix](be): fix stack overflow in unhex function
2022-07-28 14:59:54 +08:00
19b34c09b1 [fix] (mem tracker) Fix runtime instance tracker null pointer (#11272) 2022-07-28 14:58:13 +08:00
75451ab0ed [feature](nereids) Add stats derive framework for new optimizer (#11179)
Implement a visitor to derive stats for each operator which would be used for CBO.
2022-07-28 14:38:19 +08:00
ef25459fa1 [fix](workflow) Fix the wrong name of concurrency group (#11275) 2022-07-28 14:23:07 +08:00