b91bb9f503
[fix](alter table property) fix alter property if rpc failed ( #22845 )
...
* fix alter property
* add regression case
* do not repeat
2023-08-17 18:02:34 +08:00
11d76d0ebe
[fix](Nereids) non-inner join should not merge dist info ( #22979 )
...
1. left join should use left dist info.
2. right join should use right dist info.
3. full outer join should return ANY dist info.
2023-08-17 17:48:50 +08:00
330f369764
[enhancement](file-cache) limit the file cache handle num and init the file cache concurrently ( #22919 )
...
1. the real value of BE config `file_cache_max_file_reader_cache_size` will be the 1/3 of process's max open file number.
2. use thread pool to create or init the file cache concurrently.
To solve the issue that when there are lots of files in file cache dir, the starting time of BE will be very slow because
it will traverse all file cache dirs sequentially.
2023-08-17 16:52:08 +08:00
d7a6b64a65
[Fix](Planner) fix case function with null cast to array null ( #22947 )
2023-08-17 16:37:07 +08:00
b252c49071
[fix](hash join) fix heap-use-after-free of HashJoinNode ( #23094 )
2023-08-17 16:29:47 +08:00
47aac84549
Revert "[pipeline](branch-2.0) pr to branch-2.0 also run checks ( #23004 )" ( #23101 )
...
This reverts commit 41a52d45d33be6c1770531cef230aafe676bcce7.
2023-08-17 15:53:22 +08:00
a248cb720c
[fix](jdbc catalog) fix DefaultValueExpr in Jdbc table column when CTAS ( #22978 )
2023-08-17 15:52:20 +08:00
f092afc946
[Regression](pipeline) update p1 pipeline to required 0817 ( #23100 )
...
update p1 pipeline to required 0817
2023-08-17 15:47:40 +08:00
e289e03a1a
[fix](executor)fix no return with old type in time_round
2023-08-17 15:34:26 +08:00
cf1865a1c8
[Bug](scan) fix core dump due to store_path_map ( #23084 )
...
fix core dump due to store_path_map
2023-08-17 15:24:43 +08:00
3fe419eafa
[Fix](statistics)Fix update cached column stats bug ( #23049 )
...
`show column cached stats` sometimes show wrong min/max value:
```
mysql> show column cached stats hive.tpch100.region;
+-------------+-------+------+----------+-----------+---------------+------+------+--------------+
| column_name | count | ndv | num_null | data_size | avg_size_byte | min | max | updated_time |
+-------------+-------+------+----------+-----------+---------------+------+------+--------------+
| r_regionkey | 5.0 | 5.0 | 0.0 | 24.0 | 4.0 | N/A | N/A | null |
| r_comment | 5.0 | 5.0 | 0.0 | 396.0 | 66.0 | N/A | N/A | null |
| r_name | 5.0 | 5.0 | 0.0 | 40.8 | 6.8 | N/A | N/A | null |
+-------------+-------+------+----------+-----------+---------------+------+------+--------------+
```
This pr is to fix this bug. It is because while transferring ColumnStatistic object to JSON, it doesn't contain the minExpr and maxExpr attribute.
2023-08-17 15:20:02 +08:00
d59c2f763f
[fix](test) add sync for test_pk_uk_case ( #23067 )
2023-08-17 15:18:07 +08:00
bf2b92f5e8
[fix](Nereids): PushdownDistinctThroughJoin don't push distinct for relation ( #23066 )
...
* [fix](Nereids): PushdownDistinctThroughJoin don't push distinct for relation.
* fix test
2023-08-17 14:50:34 +08:00
f5da9f4ccc
[fix](muti-catalog)convert to s3 path when use aws endpoint ( #22784 )
...
Convert to s3 path when use aws endpoint
For compatibility， we can also use s3 client to access other cloud by setting s3 endpoint properties
2023-08-17 14:28:00 +08:00
6e51632ca9
[docs](kerberos)add FAQ cases and enable krb5 debug ( #22821 )
2023-08-17 14:25:09 +08:00
8b51da0523
[Fix](load) fix partiotion Null pointer exception ( #22965 )
2023-08-17 14:09:47 +08:00
41bce29ae3
[docs](docs)Rename Title and URL of Bitwise Functions ( #22722 )
2023-08-17 11:18:02 +08:00
92c8f842f7
[fix](nereids) dphyper join reorder use wrong method to get hash and other conjuncts ( #22966 )
...
should use getHashJoinConjuncts() and getOtherJoinConjuncts() to get hash and other conjuncts of hash join node instead of categorizing them by checking if it's 'EqualTo' expression
2023-08-17 11:03:45 +08:00
a288377118
[fix](regresstion) Fix sql server external case ( #23031 )
2023-08-17 10:54:54 +08:00
d71b99b88a
[fix](dbt) fix dbt doris user non-root user permission for show frintends sql ( #22815 )
2023-08-17 09:40:53 +08:00
343a6dc29d
[improvement](hash join) Return result early if probe side has no data ( #23044 )
2023-08-17 09:17:09 +08:00
a77e9fbc99
(chores)(ui) download profile filename add profile_id ( #23065 )
2023-08-17 09:11:01 +08:00
7a9ff47528
[Improve](CI)Modify Deadline-check trigger mode, and add maven cache for Sonarcheck ( #23069 )
...
There are a lot of deadlinks in stock, we will reopen it after a full repair…
2023-08-16 22:31:50 +08:00
814acbf331
[pipeline](exec) disable pipeline load in master code ( #23061 )
...
disable pipeline load in master code
2023-08-16 21:53:58 +08:00
390c52f73a
[Improve](complex-type) update for array/map element_at with nested complex type with local tvf ( #22927 )
2023-08-16 20:47:36 +08:00
a5c73c7a39
[fix](partial update) set io_ctx.reader_type when reading columns for partial update ( #22630 )
2023-08-16 19:34:39 +08:00
0aa57d159e
[Fix](Partial update) Fix wrong position using in segment writer ( #22782 )
2023-08-16 19:31:06 +08:00
0594acfcf1
[fix](Nereids) scan should output all invisiable column ( #23003 )
2023-08-16 18:07:59 +08:00
b815cf327a
[enhancement](merge-on-write) Add more log info when delete bitmap correctness check failed ( #22984 )
2023-08-16 17:25:11 +08:00
f1880d32d9
[fix](nereids)bind slot failed because of "default_cluster" #23008
...
slot bind failed for following querys:
select tpch.lineitem.* from lineitem
select tpch.lineitem.l_partkey from lineitem
the unbound slot is tpch.lineitem.l_partkey, but the bounded slot is default_cluster:tpch.lineitem.l_partkey. They are not matched.
we need to ignore default_cluster: when compare dbName
2023-08-16 17:22:44 +08:00
92f443b3b8
[enhancement](Nereids): count(1) to count(*) #22999
...
add a rule to transform count(1) to count(*)
2023-08-16 17:19:23 +08:00
2dbca7a688
[Fix](Planner) fix multi phase analysis failed in multi instance environment substitution ( #22840 )
...
Problem:
When executing group_concat with order by inside in view, column can not be found when analyze.
Example:
create view if not exists test_view as select group_concat(c1,',' order by c1 asc) from table_group_concat;
select * from test_view;
it will return an error like: "can not find c1 in table_list"
Reason:
When we executing this sql in multi-instance environment, Planner would try to create plan in multi phase
aggregation. And because we analyze test_view independent with tables outside view. So we can not get
table informations inside view.
Solution:
Substitute order by expression of merge aggregation expressions.
2023-08-16 16:46:26 +08:00
7adb2be360
[Fix](Nereids) fix insert into return npe from follower node. ( #22734 )
...
insert into table command run at a follower node, it will forward to the master node, and the parsed statement is not set to the cascades context, but set to the executor::parsedStmt, we use the latter to get the user info.
2023-08-16 16:37:17 +08:00
6cf1efc997
[refactor](load) use smart pointers to manage writers in memtable memory limiter ( #23019 )
2023-08-16 16:34:57 +08:00
4512569a3a
[docs](releasenote)Update en release note 2.0.0 ( #23041 )
2023-08-16 15:13:09 +08:00
5148bc6fa7
[fix](partial update)allow delete sign column in partial update in planForPipeline ( #23034 )
2023-08-16 14:20:39 +08:00
4510e16845
[improvement](delete) support delete predicate on value column for merge-on-write unique table ( #21933 )
...
Previously, delete statement with conditions on value columns are only supported on duplicate tables. After we introduce delete sign mechanism to do batch delete, a delete statement with conditions on value columns on unique tables will be transformed into the corresponding insert into ..., __DELETE_SIGN__ select ... statement. However, for unique table with merge-on-write enabled, the overhead of inserting these data can be eliminated. So this PR add the ability to allow delete predicate on value columns for merge-on-write unique tables.
2023-08-16 12:18:05 +08:00
3efa06e63e
[Fix](View)varchar type conversion error ( #22987 )
2023-08-16 11:49:04 +08:00
c41179b8e9
[fix](regression) Improve the robustness when close target connection ( #23012 )
2023-08-16 11:42:58 +08:00
221e7bdd17
[test](jdbc external) fix mysql and pg external regression test ( #22998 )
2023-08-16 10:44:47 +08:00
a2095b7d9e
[fix](docs) add enable_single_replica_load on be config doc ( #22948 )
2023-08-16 10:31:01 +08:00
d5df3bae25
[Bug](exchange) fix dcheck fail when VDataStreamRecvr input empty block ( #22992 )
...
fix dcheck fail when VDataStreamRecvr input empty block
2023-08-16 10:21:19 +08:00
3b8981bee7
[chore](third-party) Speed the download up for aws-crt-cpp ( #22997 )
...
The package aws-sdk-cpp was upgraded in #20252 . We can speed the download up for aws-crt-cpp.
2023-08-16 09:47:18 +08:00
da097629ea
[chore](build) Fix the build with MySQL support ( #23020 )
2023-08-16 09:28:56 +08:00
cb6678adb9
[fix](case) Update repositoryAffinityList1.sql ( #22941 )
2023-08-16 09:23:46 +08:00
c8c46e042d
[Improve](regress-test)add regress test for map_agg with nested type and insert to doris inner table #23006
2023-08-16 09:21:02 +08:00
d3dddeea8a
[fix](load) remove incorrect DCHECK in BetaRowsetWriter dtor ( #23016 )
...
The DCHECK may not always be right in case of Vertical compaction.
remove it to let DEBUG run.
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-08-15 23:55:02 +08:00
423002b20a
[fix](nereids) partitionTopN & Window estimation ( #22953 )
...
* partitionTopN & winExpr estimation
* tpcds 44/47/57
2023-08-15 20:19:03 +08:00
fe08db191f
[typo](docs) Optimize the release note 2.0.0 ( #22926 )
2023-08-15 20:09:56 +08:00
61d2f37bdc
[fix](jdbc catalog) fix string type insert into odbc table ( #22961 )
2023-08-15 20:09:38 +08:00
