database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
19,529 Commits 1 Branch 0 Tags
54787f51c7ed454feff1663c4e4255c011749421
Commit Graph

5017 Commits

Author SHA1 Message Date
zfr95
d0a9e5656d [fix](auth)Add some log in auth case (#38289) 
pick from master #37362 

## Proposed changes

[fix](auth)Add some log in auth case
 2024-07-25 14:46:01 +08:00
zzzxl
e2bb86e7f8 [fix](inverted index) fixed in_list condition not indexed on pipelinex (#38178) 
## Proposed changes

https://github.com/apache/doris/pull/36565
https://github.com/apache/doris/pull/37842
https://github.com/apache/doris/pull/37921
https://github.com/apache/doris/pull/37386

<!--Describe your changes.-->
 2024-07-25 14:42:34 +08:00
lihangyu
73fc55b203 [Pick](Variant) fix some issue by RQG (#38336) 
#38318 
#38291
 2024-07-25 12:19:07 +08:00
zhangstar333
70cde39fe0 [cherry-pick](branch-21) fix conv function get wrong result as parse overflow (#38001) (#38309) 
## Proposed changes

cherry-pick from https://github.com/apache/doris/pull/38001

<!--Describe your changes.-->
 2024-07-25 12:06:46 +08:00
zhangstar333
e9052e2180 [cherry-pick](branch-21) fix mod function cause core dump (#37999) (#38308) 
## Proposed changes
cherry-pick from master https://github.com/apache/doris/pull/37999

<!--Describe your changes.-->

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-25 12:06:21 +08:00
zhangstar333
57864e8554 [cherry-pick](branch-21) fix collect_set function core dump without arena pool (#38234) (#38307) 
## Proposed changes

cherry-pick from master #38234

<!--Describe your changes.-->
 2024-07-25 12:05:52 +08:00
Yulei-Yang
c23228e331 [Improvement](profile) add catalog info in profile (#38302) 
bp #38283
 2024-07-25 11:57:42 +08:00
Jerry Hu
d19b3a5cb6 [fix](function) the bucket number arg of width_bucket should be a positive integer value (#37892) (#38295) 
## Proposed changes

pick #37892
 2024-07-25 11:56:47 +08:00
zclllhhjj
bc7fc4106d [branch-2.1](function) fix FE impl of some time functions (#37746) (#38316) 
pick https://github.com/apache/doris/pull/37746

before:
```sql
mysql> select date_ceil("2020-12-12 12:12:12.123", interval 2 second);
+-----------------------+
| '2020-12-12 12:12:12' |
+-----------------------+
| 2020-12-12 12:12:12   |
+-----------------------+
1 row in set (0.10 sec)

mysql> select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/Galapagos');
+------+
| NULL |
+------+
| NULL |
+------+
1 row in set (0.09 sec)

mysql [(none)]>select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/GalapaGoS');
+-----------------------------------------------------------------------------------------------------------+
| convert_tz(cast('9999-12-31 23:59:59.999999' as DATETIMEV2(6)), 'Pacific/Galapagos', 'Pacific/GalapaGoS') |
+-----------------------------------------------------------------------------------------------------------+
| 9999-12-31 23:59:59.999999                                                                                |
+-----------------------------------------------------------------------------------------------------------+
1 row in set (0.08 sec) --- gone to BE
```
after:
```sql
mysql> select date_ceil("2020-12-12 12:12:12.123", interval 2 second);
+------------------------------+
| '2020-12-12 12:12:14.000000' |
+------------------------------+
| 2020-12-12 12:12:14          |
+------------------------------+
1 row in set (0.11 sec)

mysql> select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/Galapagos');
+-----------------------------------------------------------------------------------------------------------+
| convert_tz(cast('9999-12-31 23:59:59.999999' as DATETIMEV2(6)), 'Pacific/Galapagos', 'Pacific/Galapagos') |
+-----------------------------------------------------------------------------------------------------------+
| 9999-12-31 23:59:59.999999                                                                                |
+-----------------------------------------------------------------------------------------------------------+
1 row in set (0.23 sec)

mysql> select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/GalapaGoS');
+------------------------------+
| '9999-12-31 23:59:59.999999' |
+------------------------------+
| 9999-12-31 23:59:59.999999   |
+------------------------------+
1 row in set (0.11 sec) --- finished in FE
```
 2024-07-25 11:38:27 +08:00
zclllhhjj
21b3fc3d1e [branch-2.1](function) fix coredump for MULTI_MATCH_ANY (#37959) (#38314) 
pick https://github.com/apache/doris/pull/37959

[INVALID_ARGUMENT][E33] Compile regexp expression failed. got Embedded
start anchors not supported.. some expressions may be illegal
 2024-07-25 11:34:22 +08:00
zclllhhjj
79a6496bb6 [branch-2.1](function) fix wrong result when convert_tz is out of bound (#37358) (#38313) 
## Proposed changes

pick https://github.com/apache/doris/pull/37358

before:
```sql
mysql> select CONVERT_TZ(cast('0000-01-01 00:00:00.00001'  as DATETIMEV1), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533)));
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| convert_tz(cast('0000-01-01 00:00:00.00001' as DATETIME), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533))) |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| q535-12-31 08:01:19                                                                                                                               |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.12 sec)
```
now:
```sql
mysql> select CONVERT_TZ(cast('0000-01-01 00:00:00.00001'  as DATETIMEV1), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533)));
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| convert_tz(cast('0000-01-01 00:00:00.00001' as DATETIME), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533))) |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                              |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.09 sec)
```
 2024-07-25 11:32:44 +08:00
xzj7019
8ad4390edb [fix](nereids) refine row count estimation for mark join (#38270) (#38297) 
pick from master #38270
 2024-07-25 10:19:13 +08:00
meiyi
e23c1339a8 [fix](group commit) Fix prepare stmt setNull return too many filtered rows error (#38262) (#38276) 
Pick https://github.com/apache/doris/pull/38262
 2024-07-24 19:02:59 +08:00
morrySnow
17c33665e5 [fix](agg_state) adjust nullable should apply on agg_state inner type too (#37489) (#38281) 
pick from master #37489

after adjust nullable, some children nullable has changed. so, we need
to update agg_state type inner type nullable too.
 2024-07-24 13:55:09 +08:00
Calvin Kirs
c73d40f869 [Fix](test)Fix the job's erroneous test case for asynchronous tests of periodic tasks. (#38264) 
…

Since there might be delays in execution, taskCount should be set to
>=1.

## Proposed changes

Issue Number: close #xxx

#38263
 2024-07-23 21:22:16 +08:00
zfr95
62d2f0a05e [fix](mtmv)Fix mtmv name to resolve conflicts in regression test (#38056) 
pick from master #36902 

## Proposed changes

[fix](mtmv)Fix mtmv name to resolve conflicts

Co-authored-by: Dongyang Li <hello_stephen@qq.com>
 2024-07-23 20:57:29 +08:00
kkop
a04583c9a1 [enhancement](regression-test) schema reordering case to 2.1 (#38131) 
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
 2024-07-23 19:42:37 +08:00
Jensen
ca7d8325af [Fix](Nereids) TopN should forbid two-phase topN if child is DistributionSpecGather (#36877) (#38164) 
pick from master #36877
 2024-07-23 16:27:55 +08:00
yujun
e28dcda0e2 [fix](regression test) fix test_report_version_missing due to set force_olap_table_replication_num #38211 (#38232) 
cherry pick from #38211
 2024-07-23 14:15:34 +08:00
walter
fdc8b454d2 [chore](backup) Remove delete_if_exists properties for creating repository (#38192) 
delete_if_exists is a temporary solution introduced in #25847, to avoid
concurrent testing conflicts.

Cherry-pick #38190
 2024-07-23 11:09:02 +08:00
Yulei-Yang
41b355721f [fix](multicatalog) make lastdbofcatalog a session variable (#38114) 
bp #37828
 2024-07-23 10:34:40 +08:00
daidai
193be20c86 [feature](csv)Supports reading CSV data using LF and CRLF as line separators. (#37687) (#38099) 
bp #37687
 2024-07-22 22:53:04 +08:00
Dongyang Li
9eac4f2797 [regression](case) fix typo (#38142) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

Co-authored-by: stephen <hello-stephen@qq.com>
 2024-07-22 14:26:30 +08:00
zfr95
5ab038cd89 [test](mtmv)Add group by aggregate negative case (#38055) 
pick from master #36562 

## Proposed changes

[test](mtmv)Add group by aggregate negative case
 2024-07-20 10:14:25 +08:00
amory
947d7594c8 [fix](func)fix array_with_const with larger than max_array_size (#38152) 
## Proposed changes
backport: https://github.com/apache/doris/pull/37495
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-20 00:19:00 +08:00
lihangyu
d9fd419e47 [Fix](JsonReader) fix json with duplicate key entry may result out of bound exception (#38147) 
#38146
 2024-07-19 22:53:02 +08:00
amory
22b9cc6eb2 [fix](mysql)fix mysql row buf (#38145) 
## Proposed changes
backport: https://github.com/apache/doris/pull/37936
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-19 22:18:42 +08:00
Calvin Kirs
d4d1688df2 [improve](test)Using Awaitility instead of Thread.sleep (#37812) (#38108) 
## Proposed changes

Awaitility: Waits until a specific condition is met, which makes the
tests more reliable and less prone to intermittent failures. It ensures
that the test only proceeds when the expected condition is true.
Thread.sleep: Introduces a fixed delay, which can lead to flaky tests.
If the condition is met sooner than the sleep time, the test
unnecessarily waits. Conversely, if the condition is met after the sleep
time, the test will fail.

(cherry picked from commit 8d249a2562b15825a06a53a5a530a532a0ca2454)

## Proposed changes

Issue Number: close #37812

<!--Describe your changes.-->
 2024-07-19 15:32:03 +08:00
abmdocrt
53ca312751 [cherry-pick](branch-2.1) Pick "[Fix](delete) Fix delete on value case due to compaction (#37917)" (#38116) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

Pick #37917
 2024-07-19 13:51:39 +08:00
Mingyu Chen
bb2b7774df [feature](iceberg) iceberg write support insert overwrite and optimize hive write transaction statistics and (#37191) (#38097) 
bp #37191

Co-authored-by: kang <35803862+ghkang98@users.noreply.github.com>
Co-authored-by: lik40 <lik40@chinatelecom.cn>
 2024-07-19 09:45:41 +08:00
zhangdong
4d03e288c2 [fix](case)fix 2.1 s3 case (#38088) 
extends : https://github.com/apache/doris/pull/37995
 2024-07-19 04:00:56 +08:00
feiniaofeiafei
301ff6af22 [Fix](nereids) add backquote and qualifier to udf, column, column alias and table alias when create view (#37237) (#37984) 
cherry-pick #37237 to branch-2.1

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
 2024-07-19 00:56:26 +08:00
Dongyang Li
90466cacc5 [regression](case) fix bad base (#38084) 
## Proposed changes

replace hardcode s3 properties
<!--Describe your changes.-->

---------

Co-authored-by: stephen <hello-stephen@qq.com>
 2024-07-18 23:52:06 +08:00
starocean999
5cddb709e0 [fix](test)fix regression test case failure (#38066) 
## Proposed changes

pick from master https://github.com/apache/doris/pull/36391

<!--Describe your changes.-->
 2024-07-18 23:51:25 +08:00
camby
de2272ce48 [fix](round) fix round decimal128 overflow (#37733) (#37963) 
cherry-pick #37733 to branch-2.1
 2024-07-18 23:50:23 +08:00
yujun
6d8377653d [fix](regression test) test_alter_colocate_group due to force_olap_table_replication_num #35835 (#38092) 
cherry pick from #35835
 2024-07-18 22:33:02 +08:00
Calvin Kirs
4f03bde1e8 [Feat](job)scheduled job allows the time to be set in the past (#36732) (#37573) 
## Proposed changes

In some cases, users want to set the start time to a time in the past.

**For periodic scheduling tasks only, the start time of a one-time task
must be set to the future or present time**
**If the start time is the past time, then the next execution time
should be the start time + time interval.**

(cherry picked from commit fa6061070f6d4063b1966e99fc285e4e6b9c3750)



#36732
 2024-07-18 19:15:10 +08:00
zfr95
bd00f56b10 [fix](auth)fix mtmv name to resolve conflicts (#38057) 
pick from master #36958 

## Proposed changes

[fix](auth)fix mtmv name to resolve conflicts
 2024-07-18 19:13:55 +08:00
zfr95
ff593806b8 [test](mtmv)add increment create mtmv case (#38054) 
pick from master #35707 

## Proposed changes

[test](mtmv)add increment create mtmv case
 2024-07-18 19:10:14 +08:00
zfr95
10a8cf6fec [test](mtmv)add join infer and derive test case (#38053) 
pick from master #32860 

## Proposed changes

[test](mtmv)add join infer and derive test case
 2024-07-18 17:50:23 +08:00
lihangyu
8c6ff22e04 [Pick](Variant) fix heap use after free and optimize cases #37991 #37976 (#38037) 2024-07-18 16:53:09 +08:00
bobhan1
c30c1d2436 [branch-2.1] Picks "[opt](delete) Delete job should retry for failure that is not DELETE_INVALID_XXX #37834" (#38032) 
## Proposed changes

picks https://github.com/apache/doris/pull/37834 and
https://github.com/apache/doris/pull/38043
 2024-07-18 14:50:30 +08:00
谢健
ea457aad77 [fix](Nereids) add order_qt in fuction groovy (#37542) (#38040) 
## Proposed changes

#37542
 2024-07-18 14:15:07 +08:00
zhangdong
20ee38ea52 [fix](case)fix s3 tvf case failed in pipeline of 2.1 (#37995) 
default value `enable_fallback_to_original_planner` is true, resource
priv check only support in nereids,so need set
enable_fallback_to_original_planner=false;
 2024-07-18 10:23:40 +08:00
starocean999
ebc178af23 [fix](nereids)acos function should return null literal instead of NaN value (#37996) 
pick from master https://github.com/apache/doris/pull/37932

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-18 09:28:56 +08:00
zzzxl
b16cd30a20 [opt](inverted index) set support_phrase default true if parser is set (#38028) 
## Proposed changes

https://github.com/apache/doris/pull/37949

<!--Describe your changes.-->
 2024-07-18 08:07:16 +08:00
Jibing-Li
2dbc996a1b [fix](regression)Fix test_agg_complex_type fail case. Improve analyze_stats time consumption. (#37895) (#38014) 
backport: https://github.com/apache/doris/pull/37895
 2024-07-17 22:15:21 +08:00
morrySnow
78d51ca320 [fix](Nereids) tablet prune wrong when decimal value scale is nagtive (#37889) (#38013) 
pick from master #37889

we use unscaled value of BigDecimal in tablet prune. So we need to
ensure BigDecimal's precision and scale is same with the literal
contains it.
 2024-07-17 20:12:14 +08:00
yujun
7180290d68 [fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924 (#37964) 
cherry-pick:  #37924
 2024-07-17 19:13:35 +08:00
Jibing-Li
4d359cd946 [improvement](regression)Use createMV to create materialized view. (#37837) (#37992) 
backport: https://github.com/apache/doris/pull/37837
 2024-07-17 17:16:04 +08:00