database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
19,529 Commits 1 Branch 0 Tags
54787f51c7ed454feff1663c4e4255c011749421
Commit Graph

19529 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kaijie Chen
54787f51c7 [log](load) print reason when LoadPathMgr failed to delete file (#38235) (#38340) 
backport #38235
 2024-07-25 17:28:09 +08:00
walter
3d6689d32c [fix](restore) Reset next version for restored partitions (#38343) 
Cherry-pick #38321
 2024-07-25 16:07:54 +08:00
abmdocrt
32530113cf [cherry-pick](branch-2.1) Fix some group commit forward to master problems (#38345) 
## Proposed changes

<!--Describe your changes.-->

Pick #38228 #38265
 2024-07-25 14:48:02 +08:00
Jerry Hu
4288f09e8c [fix](debug_point) Add debug point:reached_limit_early & return_empty_block (#38328) 
## Proposed changes

pick #38127 and #37629
 2024-07-25 14:46:40 +08:00
zfr95
d0a9e5656d [fix](auth)Add some log in auth case (#38289) 
pick from master #37362 

## Proposed changes

[fix](auth)Add some log in auth case
 2024-07-25 14:46:01 +08:00
Gabriel
a8139d9f39 [Improvement](profile) Provide more info for schedule time (#38290) (#38338) 
## Proposed changes

pick #38290

<!--Describe your changes.-->
 2024-07-25 14:43:52 +08:00
zzzxl
e2bb86e7f8 [fix](inverted index) fixed in_list condition not indexed on pipelinex (#38178) 
## Proposed changes

https://github.com/apache/doris/pull/36565
https://github.com/apache/doris/pull/37842
https://github.com/apache/doris/pull/37921
https://github.com/apache/doris/pull/37386

<!--Describe your changes.-->
 2024-07-25 14:42:34 +08:00
Qi Chen
a751372e76 [Feature](multi-catalog) Add memory tracker for orc reader/writer and arrow parquet writer。 (#37257) 
## Proposed changes

backport #37234
 2024-07-25 13:51:59 +08:00
lihangyu
73fc55b203 [Pick](Variant) fix some issue by RQG (#38336) 
#38318 
#38291
 2024-07-25 12:19:07 +08:00
AlexYue
e396f853a0 Pick "[enhance](Cooldown) Use config to control whether use cooldown replica for scanning first" (#38322) 
## Proposed changes

<!--Describe your changes.-->

Same as master #37492
 2024-07-25 12:17:38 +08:00
zhangstar333
70cde39fe0 [cherry-pick](branch-21) fix conv function get wrong result as parse overflow (#38001) (#38309) 
## Proposed changes

cherry-pick from https://github.com/apache/doris/pull/38001

<!--Describe your changes.-->
 2024-07-25 12:06:46 +08:00
zhangstar333
e9052e2180 [cherry-pick](branch-21) fix mod function cause core dump (#37999) (#38308) 
## Proposed changes
cherry-pick from master https://github.com/apache/doris/pull/37999

<!--Describe your changes.-->

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-07-25 12:06:21 +08:00
zhangstar333
57864e8554 [cherry-pick](branch-21) fix collect_set function core dump without arena pool (#38234) (#38307) 
## Proposed changes

cherry-pick from master #38234

<!--Describe your changes.-->
 2024-07-25 12:05:52 +08:00
Yulei-Yang
c23228e331 [Improvement](profile) add catalog info in profile (#38302) 
bp #38283
 2024-07-25 11:57:42 +08:00
Jerry Hu
d19b3a5cb6 [fix](function) the bucket number arg of width_bucket should be a positive integer value (#37892) (#38295) 
## Proposed changes

pick #37892
 2024-07-25 11:56:47 +08:00
zclllhhjj
bc7fc4106d [branch-2.1](function) fix FE impl of some time functions (#37746) (#38316) 
pick https://github.com/apache/doris/pull/37746

before:
```sql
mysql> select date_ceil("2020-12-12 12:12:12.123", interval 2 second);
+-----------------------+
| '2020-12-12 12:12:12' |
+-----------------------+
| 2020-12-12 12:12:12   |
+-----------------------+
1 row in set (0.10 sec)

mysql> select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/Galapagos');
+------+
| NULL |
+------+
| NULL |
+------+
1 row in set (0.09 sec)

mysql [(none)]>select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/GalapaGoS');
+-----------------------------------------------------------------------------------------------------------+
| convert_tz(cast('9999-12-31 23:59:59.999999' as DATETIMEV2(6)), 'Pacific/Galapagos', 'Pacific/GalapaGoS') |
+-----------------------------------------------------------------------------------------------------------+
| 9999-12-31 23:59:59.999999                                                                                |
+-----------------------------------------------------------------------------------------------------------+
1 row in set (0.08 sec) --- gone to BE
```
after:
```sql
mysql> select date_ceil("2020-12-12 12:12:12.123", interval 2 second);
+------------------------------+
| '2020-12-12 12:12:14.000000' |
+------------------------------+
| 2020-12-12 12:12:14          |
+------------------------------+
1 row in set (0.11 sec)

mysql> select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/Galapagos');
+-----------------------------------------------------------------------------------------------------------+
| convert_tz(cast('9999-12-31 23:59:59.999999' as DATETIMEV2(6)), 'Pacific/Galapagos', 'Pacific/Galapagos') |
+-----------------------------------------------------------------------------------------------------------+
| 9999-12-31 23:59:59.999999                                                                                |
+-----------------------------------------------------------------------------------------------------------+
1 row in set (0.23 sec)

mysql> select CONVERT_TZ('9999-12-31 23:59:59.999999', 'Pacific/Galapagos', 'Pacific/GalapaGoS');
+------------------------------+
| '9999-12-31 23:59:59.999999' |
+------------------------------+
| 9999-12-31 23:59:59.999999   |
+------------------------------+
1 row in set (0.11 sec) --- finished in FE
```
 2024-07-25 11:38:27 +08:00
zclllhhjj
21b3fc3d1e [branch-2.1](function) fix coredump for MULTI_MATCH_ANY (#37959) (#38314) 
pick https://github.com/apache/doris/pull/37959

[INVALID_ARGUMENT][E33] Compile regexp expression failed. got Embedded
start anchors not supported.. some expressions may be illegal
 2024-07-25 11:34:22 +08:00
zclllhhjj
79a6496bb6 [branch-2.1](function) fix wrong result when convert_tz is out of bound (#37358) (#38313) 
## Proposed changes

pick https://github.com/apache/doris/pull/37358

before:
```sql
mysql> select CONVERT_TZ(cast('0000-01-01 00:00:00.00001'  as DATETIMEV1), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533)));
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| convert_tz(cast('0000-01-01 00:00:00.00001' as DATETIME), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533))) |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| q535-12-31 08:01:19                                                                                                                               |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.12 sec)
```
now:
```sql
mysql> select CONVERT_TZ(cast('0000-01-01 00:00:00.00001'  as DATETIMEV1), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533)));
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| convert_tz(cast('0000-01-01 00:00:00.00001' as DATETIME), cast('Asia/Shanghai' as VARCHAR(65533)), cast('America/Los_Angeles' as VARCHAR(65533))) |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                              |
+---------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.09 sec)
```
 2024-07-25 11:32:44 +08:00
Mingyu Chen
3ea26a8c95 [fix](external) record not found file number (#38253) (#38285) 
bp #38253
 2024-07-25 11:03:19 +08:00
xzj7019
8ad4390edb [fix](nereids) refine row count estimation for mark join (#38270) (#38297) 
pick from master #38270
 2024-07-25 10:19:13 +08:00
Luwei
9a40cd5f9f [fix](compaction) fix duplicate key in agg/mor table caused by ordered data compaction (#38224) (#38299) 
pick master #38224
 2024-07-24 19:03:40 +08:00
meiyi
e23c1339a8 [fix](group commit) Fix prepare stmt setNull return too many filtered rows error (#38262) (#38276) 
Pick https://github.com/apache/doris/pull/38262
 2024-07-24 19:02:59 +08:00
Qi Chen
ef00dad680 [Fix](multi-catalog) Fix some undefined behaviors. (#38274) 
## Proposed changes

backport #37845
 2024-07-24 16:14:34 +08:00
zzzxl
c6cd1e2e3d [opt](inverted index) opt value extraction from column to string (#38179) 
## Proposed changes

https://github.com/apache/doris/pull/37395
 2024-07-24 15:38:41 +08:00
Xinyi Zou
10c5c336d8 [branch-2.1](arrow-flight-sql) Add config arrow_flight_result_sink_buffer_size_rows (#38223) 
pick #38221
 2024-07-24 15:15:39 +08:00
airborne12
bb2bc77717 [Pick 2.1](inverted index) skip index compaction for inverted index V2 (#38278) 
Enabling index compaction in the inverted index V2 format currently
causes unexpected errors, especially in the case of tables with hybrid
indexes, such as BKD index and Fulltext index together.

backport #38209
 2024-07-24 14:38:25 +08:00
morrySnow
17c33665e5 [fix](agg_state) adjust nullable should apply on agg_state inner type too (#37489) (#38281) 
pick from master #37489

after adjust nullable, some children nullable has changed. so, we need
to update agg_state type inner type nullable too.
 2024-07-24 13:55:09 +08:00
abmdocrt
792bd7c74a [cherry-pick](branch-2.1) Pick "[Enhancement](group commit)Optimize be select for group commit #35558" (#37830) 
Pick #35558
 2024-07-24 09:21:07 +08:00
Pxl
cf2120a44a [Chore](brpc) add gc for abafreelist to avoid eagain and set brpc tim… (#38177) 
pick from #37888
 2024-07-23 21:24:36 +08:00
Calvin Kirs
c73d40f869 [Fix](test)Fix the job's erroneous test case for asynchronous tests of periodic tasks. (#38264) 
…

Since there might be delays in execution, taskCount should be set to
>=1.

## Proposed changes

Issue Number: close #xxx

#38263
 2024-07-23 21:22:16 +08:00
zfr95
62d2f0a05e [fix](mtmv)Fix mtmv name to resolve conflicts in regression test (#38056) 
pick from master #36902 

## Proposed changes

[fix](mtmv)Fix mtmv name to resolve conflicts

Co-authored-by: Dongyang Li <hello_stephen@qq.com>
 2024-07-23 20:57:29 +08:00
yujun
798b8573c9 [fix](load data) decommission replica don't load data when it misses versions #38198 (#38256) 
cherry pick from #38198
 2024-07-23 20:28:05 +08:00
meiyi
b591837e13 [fix](insert) Pick Insert init plan error may forget to abort txn (#34220) (#38260) 
Pick https://github.com/apache/doris/pull/34220
 2024-07-23 20:21:38 +08:00
kkop
a04583c9a1 [enhancement](regression-test) schema reordering case to 2.1 (#38131) 
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
 2024-07-23 19:42:37 +08:00
Jensen
ca7d8325af [Fix](Nereids) TopN should forbid two-phase topN if child is DistributionSpecGather (#36877) (#38164) 
pick from master #36877
 2024-07-23 16:27:55 +08:00
Siyang Tang
ba5d23aea8 [enhancement](log) Changed log of waiting previous transactions to info level for debug convenience (#38133) (#38230) 
## Proposed changes

As title.
 2024-07-23 14:16:04 +08:00
yujun
e28dcda0e2 [fix](regression test) fix test_report_version_missing due to set force_olap_table_replication_num #38211 (#38232) 
cherry pick from #38211
 2024-07-23 14:15:34 +08:00
Gabriel
33e04b12ff [conf](parallel) Reduce parallel tasks for large cluster (#38196) (#38233) 
For large cluster, too many parallel tasks will cause performance issue.
So this PR limit the max parallel tasks in Doris.

pick #38196

<!--Describe your changes.-->
 2024-07-23 13:42:31 +08:00
walter
fdc8b454d2 [chore](backup) Remove delete_if_exists properties for creating repository (#38192) 
delete_if_exists is a temporary solution introduced in #25847, to avoid
concurrent testing conflicts.

Cherry-pick #38190
 2024-07-23 11:09:02 +08:00
Yulei-Yang
41b355721f [fix](multicatalog) make lastdbofcatalog a session variable (#38114) 
bp #37828
 2024-07-23 10:34:40 +08:00
daidai
193be20c86 [feature](csv)Supports reading CSV data using LF and CRLF as line separators. (#37687) (#38099) 
bp #37687
 2024-07-22 22:53:04 +08:00
Gabriel
aff3f292a7 [fix](pipeline) Fix blocked tasks if query is canceled before opening (#38200) 
## Proposed changes

pick #38206

<!--Describe your changes.-->
 2024-07-22 18:22:22 +08:00
Siyang Tang
73199122c2 [enhancement](compaction) Control the parallelism for urgent compacton tasks (#37782) (#38189) 
## Proposed changes

For some urgent compaction tasks, their submittion should take
parallelism into account.

Currently, we apply the control policy for data loading in specific.
Other source of urgent tasks are considered as eager.
 2024-07-22 17:22:53 +08:00
Xin Liao
ce1c268743 [Fix](load) Fix uninitiated load_type (not a valid value for type) of StreamLoadContext when operate_txn_2pc #38033 (#38187) 
cherry pick from #38033
 2024-07-22 17:20:03 +08:00
Dongyang Li
9eac4f2797 [regression](case) fix typo (#38142) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

Co-authored-by: stephen <hello-stephen@qq.com>
 2024-07-22 14:26:30 +08:00
yiguolei
b6dd7bcc6d 2.1.5-rc02 (#38167) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-07-21 17:59:02 +08:00
Jensen
2e79612320 [env](compile) compile failed caused by <immintrin.h> (#37068) (#38130) 
pick from master #37068
 2024-07-20 14:10:31 +08:00
yiguolei
7b74e8d7ab add 2.1.5-rc01 (#38102) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-07-20 11:36:06 +08:00
Calvin Kirs
87306858a1 [Fix](JobManager)Release the lock immediately after modifying job metadata to avoid holding the lock for an extended period.#38162 (#38163) 
## Proposed changes
#38162

<!--Describe your changes.-->
 2024-07-20 10:52:21 +08:00
zfr95
5ab038cd89 [test](mtmv)Add group by aggregate negative case (#38055) 
pick from master #36562 

## Proposed changes

[test](mtmv)Add group by aggregate negative case
 2024-07-20 10:14:25 +08:00