9950501fdf
[fix](profile) close eof scanner before transfer done ( #11705 )
...
We should close eof scanners before transfer done, otherwise,
they are closed until scannode is closed. Because plan is closed
after the plan is finished, so query profile would leak stats from
scanners closed by scannode::close. e.g. SegmentTotalNum in profile
is less.
2022-08-12 11:28:43 +08:00
4c8cc7f03e
[fix](storage)fix column dict incorrect result ( #11694 )
...
Co-authored-by: Wang Bo <wangbo36@meituan.com >
2022-08-12 11:05:57 +08:00
f5fe622a1b
[Bug](materialized view) fix create materialized view fail
...
1. remove referenced_column(seems unused now).
2. fix mv slot ref id wrong.
3. add type check for hll_hash.
4. enable non-nullable column change to nullable column.
2022-08-12 09:49:16 +08:00
0f555e90cb
[deps](brpc) Upgrade Brpc to 1.2.0 fix _dl_sym undefined reference on new verison of glibc ( #11688 )
2022-08-12 09:07:57 +08:00
5d66839035
[feature-wip](unique-key-merge-on-write) push down runtime filter on unique key with merge on write table ( #11695 )
2022-08-11 22:50:13 +08:00
2d5ffac590
[fix](optimization) InferFiltersRule bug: a self inner join on a view, which contains where clause, will cause mis-inference. ( #11566 )
2022-08-11 17:13:26 +08:00
9214346603
[Bug] fix cancel fragment bug ( #11683 )
...
Co-authored-by: chenjie <chenjie@cecdat.com >
2022-08-11 16:48:18 +08:00
a72e20da69
[chore](check) update sonarcloud workflow files ( #11674 )
...
update sonarcloud workflow files try to trigger workflow after merge
2022-08-11 16:22:02 +08:00
aa24c8f973
[Feature](multi-catalog) Support refresh catalog metadata ( #11656 )
2022-08-11 15:14:05 +08:00
ea57bf6370
[refactor](delete predicate) Unify delete to segmentiterator ( #11650 )
...
* remove seek columns and unify delete columns in rowset reader
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-08-11 15:12:43 +08:00
7e828ad85b
[Enhancement](profile format) Print fragment and instance in a better format ( #11671 )
2022-08-11 14:05:41 +08:00
180cc35815
[Feature](nereids) support sub-query and alias in FromClause ( #11035 )
...
Support sub-query and alias for TPC-H，for example:
select * from (select * from (T1) A join T2 as B on T1.id = T2.id) T;
2022-08-11 12:42:19 +08:00
d831322806
[refactor](planner): make Table abstract. ( #11642 )
2022-08-11 12:07:25 +08:00
2068bf2dea
[Refactor](predicate) Use primitive type as template argument for predicate ( #11647 )
2022-08-11 12:06:44 +08:00
56ce8c0c5c
[feature](http) add api for showing current queries and kill query ( #11657 )
2022-08-11 10:32:46 +08:00
27f652aaff
[extension](feature)Mysql database import doris by external tables ( #10905 )
2022-08-11 10:18:45 +08:00
8f5aed27ec
[feature-wip](parquet-reader)read and decode parquet physical type ( #11637 )
...
# Proposed changes
Read and decode parquet physical type.
1. The encoding type of boolean is bit-packing, this PR introduces the implementation of bit-packing from Impala
2. Create a parquet including all the primitive types supported by hive
## Remaining Problems
1. At present, only physical types are decoded, and there is no corresponding and conversion methods with doris logical.
2. No parsing and processing Decimal type / Timestamp / Date.
3. Int_8 / Int_16 is stored as Int_32. How to resolve these types.
2022-08-11 10:17:32 +08:00
7fb0913d35
Usage example of modifying the "storage_root_path" parameter ( #11659 )
...
Usage example of modifying the "storage_root_path" parameter
2022-08-11 09:57:50 +08:00
200b558156
[typo](doc)spark load uses kerberos authentication method ( #11662 )
...
spark load uses kerberos authentication method
2022-08-11 09:57:26 +08:00
04d26ddf22
[feature-wip](multi-catalog)Support use catalog.db and show databases from catalog stmt ( #11338 )
...
Support use catalog.db and show databases from catalog stmt.
2022-08-11 09:50:32 +08:00
5d99abb3ec
MOD: label with cte doc ( #11661 )
...
insert label with cte doc
2022-08-11 09:45:59 +08:00
02a3f21b65
[fix](analyzer) InferFilterRule bug: equations in on clause of outer/anti join are not inferable. ( #11515 )
2022-08-11 09:36:43 +08:00
d60afe82a4
FIX: doc error ( #11660 )
...
es doc fix
2022-08-11 09:20:06 +08:00
5d02f70a0f
[remote-udaf](python-samples) use python to impl remote avg and sum s… ( #11655 )
2022-08-10 22:13:37 +08:00
a3714981fd
[Bug](schema change) Fix bug for vectorized schema change ( #11652 )
2022-08-10 21:42:51 +08:00
6c9d158e9b
[fix](script) Fix hdfs-site.xml file name typo. #11653
2022-08-10 21:42:08 +08:00
d8427037be
[Bug](doe) Fix some bug ( #11594 )
2022-08-10 21:00:05 +08:00
290f0400d3
[docs] Fix Chinese description in En dos ( #11512 )
2022-08-10 20:28:05 +08:00
70b39475cf
[fix](scanner) delete predicates might be inconsistent with rowset readers ( #11598 )
2022-08-10 19:40:54 +08:00
976e7685db
[minor](*): remove redundant log and unused code. ( #11620 )
2022-08-10 19:28:04 +08:00
adf61a77bd
[docs](query profile)add show query profile ( #11635 )
2022-08-10 19:26:58 +08:00
8c344d33e6
[Enhancement](meta) sort result by tablename when show tables like show data ( #11638 )
...
* [improvement] sort result by tablename when show tables like 'show data'
2022-08-10 19:26:30 +08:00
a153af9698
[chore](regression-test) Add drop table in aggregate_count1 ( #11632 )
2022-08-10 19:25:43 +08:00
c8418d13b5
[improvement](config)Use session variable to replace configuration for 'enable_function_pushdown' ( #11641 )
2022-08-10 19:25:02 +08:00
c6f520fab4
[thirdparty](brpc) fix _dl_sym undefined reference on Ubuntu22.04 ( #11643 )
...
Co-authored-by: qcloud <ubuntu@localhost.localdomain >
2022-08-10 19:23:10 +08:00
89d3809a0e
[feature](Nereids): Enable the costAndEnforcerJob ( #11604 )
...
1. Enable the costAndEnforcerJob
2. Fix some bug of enforcer.
3. polish property name and method
2022-08-10 15:17:15 +08:00
0291f84a9e
[fix](like-predicate) Add missing functions in LikeColumnPredicate ( #11631 )
2022-08-10 15:03:14 +08:00
71d9b383d4
[Enhancement](hdfs) Support loading hdfs config for be from hdfs-site.xml ( #11634 )
...
* [Enhancement](hdfs) Support loading hdfs config for be from hdfs-site.xml
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-08-10 14:49:50 +08:00
a478e1d669
[doc][fix] fix the duplicate partition name in example of CREATE TABLE ( #11188 )
2022-08-10 10:26:12 +08:00
b3d476eebb
[fix](ui)source map files not included in production builds ( #11612 )
...
Co-authored-by: wangyf0555 <wangyongfeng@flywheels.com >
2022-08-10 08:19:07 +08:00
ae90d45594
[Bug](show data skew)fix show data skew logic ( #11616 )
...
Co-authored-by: wuhangze <wuhangze@jd.com >
2022-08-10 08:18:39 +08:00
aaaf6915e4
[feature-wip](unique-key-merge-on-write) fix rowid conversion ut that may create a directory under an incorrect path ( #11628 )
2022-08-10 08:17:47 +08:00
601f28dd90
[fix](regexpr)regexpr functions' contexts should be THREAD_LOCAL ( #11595 )
2022-08-10 06:58:24 +08:00
01e4522612
[fix]collect_list/collect_set without GROUP BY for NOT NULL column ( #11529 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-08-09 20:49:37 +08:00
df47b6941d
[feature-wip](array-type) support the array type in reverse function ( #11213 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-09 20:49:09 +08:00
169996d8e4
[feature](information_schema) add rowsets table into information_s… ( #11266 )
...
* [feature](information_schema) add 'segments' table into information_schema
2022-08-09 18:15:54 +08:00
7b67661262
add plan checker ( #11619 )
...
This PR proposes to add a plan checker to facilitate plan checking in unit tests.
Usage of plan checker is like below:
```java
new PlanChecker()
.plan(myPlan)
.applyBottomUp(myRule)
.matches(expectedPattern);
```
2022-08-09 17:19:30 +08:00
583b44dfa8
[enhancement](broker) Improve the availability of broker load ( #10699 )
2022-08-09 17:00:48 +08:00
cc6c92935a
[minor](log) add a warn log to observer invalid query profile ( #11588 )
...
I try to fix the bug in #10095 . the error occurred when I first create a empty table and query it.
But I can't reproduced it again.
So I add a warn log here to observer
2022-08-09 14:10:03 +08:00
2cadf85988
[improvement](alter) modify table's default replica if table is unpartitioned ( #11550 )
...
Before, if a table is unpartitioned, when executing following alter stmt:
```
alter table tbl1 set ("replication_num" = "1");
```
Only the tbl1 partition's replication_num is changed
(for unpartitioned table, it also has a single partition with same name as table's)
But the table's default replication_num is unchanged.
So when executing `show create table tbl1`, you will find that the replication_num is still the origin value.
This CL mainly changes:
1. For unpartitioned table, if user change it's replication num, both table's and partition's replication_num will be changed.
2022-08-09 14:09:38 +08:00
