Commit Graph

6008 Commits

Author SHA1 Message Date
9caaa4bfbd [fix](memory) fix set disable_chunk_allocator_in_vec=false performance #12092 2022-08-26 14:28:12 +08:00
89d6f1231f [fix](projection)join node should always output at least one column (#12080) 2022-08-26 12:15:51 +08:00
ccff3f5711 [bugfix](light weight schema change) support delete condition in schema change (#11869)
* [bugfix](light weight schema change) support delete condition in schema change


Co-authored-by: yiguolei <yiguolei@gmail.com>
2022-08-26 11:45:55 +08:00
e478f096ed [typo](doc) fix some typo in docs #12054 2022-08-26 11:44:22 +08:00
82ca62dfcc [fix](memory) Fix disable_mem_pools to disable cache #12087 2022-08-26 11:43:19 +08:00
0f4a1e811b [Enhancement](table_function) table function node enhancement (#12038)
* table function node enhancement

* also avoid copy for non-vec table function node

* fix table function node output slots calculation while lateral view involves subquery

Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
2022-08-26 10:37:15 +08:00
ba11d8dc67 [feature-wip](unique-key-merge-on-write) fix bugs on tablet clone #12067 2022-08-26 10:37:00 +08:00
de148465bc [feature-wip](unique-key-merge-on-write) unique key table with MOW supports update (#11882) 2022-08-26 09:44:37 +08:00
0c16740f5c [feature-wip](parquet-reader) parquert scanner can read data (#11970)
Co-authored-by: jinzhe <jinzhe@selectdb.com>
2022-08-26 09:43:46 +08:00
721d418a2f [feature-wip](unique-key-merge-on-write) fix that version is awlays 0 when update delete bitmap (#12044) 2022-08-26 09:41:55 +08:00
0bacbb95c2 [typo](doc)website sidebar Menu order (#12073)
menu order
2022-08-26 09:41:45 +08:00
e5bfbbe761 [feature-wip](unique-key-merge-on-write) support alter table column for MoW (#12052) 2022-08-26 09:40:11 +08:00
8deead66cd [feature-wip](unique-key-merge-on-write) add pk_uk correctness check case (#12060)
Co-authored-by: yixiutt <yixiu@selectdb.com>
2022-08-26 09:38:38 +08:00
17b809210a [Bug](runtime filter) fix bug for late-arrival runtime filters (#12049) 2022-08-26 09:13:10 +08:00
98d82915d3 [fix](bdbje) add reserved disk config to avoid too many reserved bdbje files (#12043) 2022-08-26 08:12:27 +08:00
2e216b9359 [fix](ut) fix ctas regression test case (#12076) 2022-08-26 08:12:11 +08:00
e3ab2caef8 [improvement](sink) Support local exchange for multi fragment instances (#12017) 2022-08-25 19:28:23 +08:00
f19c344328 [behavior change](planner)change Doris's query organization syntax to standard sql (#9745) 2022-08-25 17:17:13 +08:00
858cb74bef [typo](doc)Window funnel fix (#12064)
window funnel fix
2022-08-25 15:46:47 +08:00
588dc5f12a [feature](cold_on_s3) Show remote data usage via SHOW BACKENDS and SHOW TABLETS statements (#11450) 2022-08-25 15:36:15 +08:00
4217b9c1d3 [feature] (dbt) add incremental and init interactive command line (#11870)
add dbt-doris incremental model and init interactive command line
2022-08-25 15:03:28 +08:00
aec24d4da1 [feature](http) get create table stmt for a given query (#11979)
This API can help user to get all create table statement of a given SQL.
So that it will be easier to run the case in other Doris cluster.
See document for details
2022-08-25 15:02:05 +08:00
003fdf2b36 [fix](scan) use serial scan thread token only for scan node (#12058)
Only the scan node's limit is less than 1024, we can use serial thread token to submit scanners.
Or it will slow down the query.
2022-08-25 14:54:02 +08:00
9d165797c5 [ci](shellcheck)shellcheck include ssb-tools and tpch-tools (#12039) 2022-08-25 11:52:13 +08:00
Pxl
620d33a763 [Enchancement](optimize) set result_size_hint to filter_block (#11972) 2022-08-25 11:42:52 +08:00
b505d6cf66 [improvement](doc test) add docs for window_funnel and refine tests (#12059)
add docs for window_funnel and refine tests
2022-08-25 11:26:40 +08:00
4017f64994 [feature](Nereids) support non-equal predicates in Join (#11812)
Currently, the join on conditions are denoted by Join.conditions as one expression.
It is not convenient to get equal-predicates for hash table.

This pr add a rule FindHashConditionForJoin to split on-conditions into two parts:
- hashJoinPredicates
- otherJoinConditions
And store them as two attributes in LogicalJoin and PhysicalJoin.

JoinReorder rule is impacted by this change, since the way we get the equal conditions between join children are changed.
In this pr, we changed the output of multiJoin slightly. Equations like A=1 are moved from join condition to upper filter.
For more detail, refer to fe/fe-core/src/test/java/org/apache/doris/nereids/datasets/ssb/SSBJoinReorderTest.java.
2022-08-25 11:08:31 +08:00
73a3471fbd [minor](conjuncts) remove row-based conjuncts from vectorized engine (#12053) 2022-08-25 10:13:20 +08:00
6e6de1853c [Bug](ctas): Ctas use default DEFAULT CURRENT_TIMESTAMP insert error (#12056) 2022-08-25 09:00:00 +08:00
0a450d96a5 [Fix] fix cast(array<not_null> as array<>) causes be core dump (#11649) 2022-08-24 22:51:30 +08:00
ec6400f0dc [feature-wip](unique-key-merge-on-write) add regression case (#11731)
Co-authored-by: yixiutt <yixiu@selectdb.com>
2022-08-24 21:27:58 +08:00
5219d2aab0 [fix](union)the result exprs of union node should substitute by child node's smap (#11933)
union node's result exprs should be substitued by child node's smap first, then the following "computePassthrough" method would have correct information to do its job.
2022-08-24 19:43:40 +08:00
87dd9c6b8b [typo](doc) Change wrong words #11778 2022-08-24 18:34:04 +08:00
b32aac9195 [feature](Nereids)add normalize aggregate rule (#12013) 2022-08-24 18:30:18 +08:00
54fc038dc5 [Fix](remote) Fix thread safety issue in cache (#11984) 2022-08-24 18:14:14 +08:00
2057edbea0 [fix](ut) Fix fe ut npe for DeleteHandlerTest (#12033) 2022-08-24 18:09:02 +08:00
b619bb2000 [enhancement](ldap) optimize LDAP authentication. (#11948)
* [enhancement](ldap) optimize LDAP authentication.

1. Support caching LDAP user information.
2. HTTP authentication supports LDAP.
3. LDAP temporary users support default user property.
4. LDAP configuration supports the `admin show config` and `admin set config` commands.
2022-08-24 17:08:14 +08:00
d87ab69ead [bug](vectorized) fix bug of tuple is null null side do not set (#12012) 2022-08-24 16:19:43 +08:00
8b4f693ad5 [fix](grouping)fix grouping function bug (#11861) 2022-08-24 15:05:25 +08:00
f875684345 [fix](agg) Crashing caused by serialization in streaming aggregation (#12027) 2022-08-24 14:38:25 +08:00
Pxl
d8e401cfba [Chore](script) support custom python version on build script (#11954) 2022-08-24 14:31:05 +08:00
9cceddaeb3 [tools](ssb and tpch)optimize tools (#11975) 2022-08-24 14:29:38 +08:00
81b6c8d9f9 [fix](sort)the sort expr nullable info is wrong in some case (#12003) 2022-08-24 14:26:09 +08:00
1304a17600 [fix](memtracker) Improve performance of tracking real physical memory of PodArray #12021 2022-08-24 14:24:14 +08:00
52be50972f [regression-test](p0) add case for window function at min/max when vectorized (#11989)
Co-authored-by: xiaojunjie <xiaojunjie@baidu.com>
2022-08-24 14:20:18 +08:00
fb3c00c943 [Improvement](storage) reuse schema and rowblockv2 on single scanner_thread (#11392)
* support reuse rowblockv2 on single thread
2022-08-24 13:42:10 +08:00
29dd6ccb11 [typo](doc)Adding Missing Documents (#12022)
Adding Missing Documents
2022-08-24 12:35:13 +08:00
f737ff742e [enhancement](Nereids)support max function (#11795)
- add aggregate function max to Nereids
- add function P0 regression test for Nereids
2022-08-24 10:54:51 +08:00
47dfd915c6 [doc](faq) add Problem with the SSL CA cert FAQ (#11982) 2022-08-24 09:13:16 +08:00
ba85c06a68 [feature-wip](unique-key-merge-on-write) fix that IndexedColumnIterator next batch may return empty result (#11928) 2022-08-24 08:53:44 +08:00