c0fda8c5c2
[improve](group commit) Add a swicth to wait internal group commit lo… ( #26734 )
...
* [improve](group commit) Add a swicth to make internal group commit load finish
* modify group commit tvf plan
2023-11-13 10:35:35 +08:00
7332b1b371
[fix](decimal) fix undefined behaviour of divide by zero when cast string to decimal ( #26822 )
...
* [fix](decimal) fix undefined behaviour of divide by zero when cast string to decimal
* fix format
2023-11-13 10:09:06 +08:00
d34dc1c133
[enhancement](regression test) stream load support direct load to be ( #26829 )
2023-11-13 10:07:10 +08:00
183c74f6ae
[decimal](test case) porting postgres regression test cases ( #26836 )
2023-11-13 10:06:43 +08:00
d9e0a9fa2e
[enhancement](230) print max version and spec version when -230 happens ( #26643 )
...
More information is provided.
2023-11-13 09:57:22 +08:00
fa8c3aec07
[opt](load) catch Throwable to make load error msg more clear ( #26821 )
...
When doing LoadPendingTask or LoadLoadingTask, there may be some Error thrown,
such as `NoClassDefFoundError`, but previously, we only catch java's `Exception`, so
other kind of error can not be shown clearly.
2023-11-13 09:39:29 +08:00
4230b8c36c
[doc](hive) fix hive.version doc ( #26806 )
2023-11-12 19:38:12 +08:00
07f1114ffa
[chore](fs) Don't print the stack for file system and it's derived class ( #26814 )
2023-11-12 19:22:01 +08:00
b2dd58a666
[fix](disk migrate) migrate ignore not exists tablet ( #26779 )
2023-11-12 18:04:33 +08:00
66054a5c78
[opt](scanner) increase the connection num of s3 client ( #26795 )
2023-11-12 00:29:11 -06:00
8cf360fff7
[refactor](closure) remove ref count closure using auto release closure ( #26718 )
...
1. closure should be managed by a unique ptr and released by brpc , should not hold by our code. If hold by our code, we need to wait brpc finished during cancel or close.
2. closure should be exception safe, if any exception happens, should not memory leak.
3. using a specific callback interface to be implemented by Doris's code, we could write any code and doris should manage callback's lifecycle.
4. using a weak ptr between callback and closure. If callback is deconstruted before closure'Run, should not core.
2023-11-12 11:57:46 +08:00
ef880166bb
[regression-test](stream load)Invalid EXEC_MEM_LIMIT check ( #26717 )
2023-11-12 11:55:44 +08:00
8392e49983
[fix](hudi) fix wrong schema when query hudi table on obs ( #26789 )
2023-11-11 21:10:30 -06:00
2937b5166e
[fix](refresh) fix priv issue of refresh database and table operation ( #26793 )
2023-11-11 21:09:53 -06:00
b23dd27c5e
[chore](regression-test) Fix error add partition operation due to duplicate partition range ( #26742 )
2023-11-12 11:00:52 +08:00
ad754cb58f
[fix](fe ut) Fix set traceid failed #26808
...
related to #26605
2023-11-12 10:55:10 +08:00
12b2b0f366
[fix](s3) Prevent data race when finishing s3 file writer's _put_object operation ( #26811 )
2023-11-12 07:29:14 +08:00
c26f5a2bd2
[improvement](BE) Remove unnecessary error handling codes ( #26760 )
2023-11-12 00:02:51 +08:00
3044b8397e
[feature](fe) Add coverage tool for FE UT ( #26203 )
2023-11-11 19:54:04 +08:00
196fadc044
[enhancement](metrics) enhance visibility of flush thread pool ( #26544 )
2023-11-11 19:53:24 +08:00
8b33b0c4a4
[Fix](row store) cache invalidate key should not include sequence column ( #26771 )
2023-11-11 01:30:32 -06:00
ca47d75e83
[fix](regression) Add regression for group commit executed on observe… ( #26692 )
2023-11-10 18:53:45 +08:00
70fdd1f1af
[fix](ci) fix bug, tpch pipeline upload log ( #26627 )
...
* [fix](ci) fix bug, tpch pipeline upload log
Co-authored-by: stephen <hello-stephen@qq.com >
2023-11-10 18:01:40 +08:00
fd43e64a72
[Enhancement](sql-cache) Use update time of hive to avoid cache miss through multi fe nodes. ( #26424 )
...
Now the update time of hms table is generated by every FE node (Use `System.currentTimestamp()` separately), so the update time of a hms table may be different between FE nodes, always the same query can not hit the sql-cache if we submit it more than one times through different FE nodes. This pr mainly do following changes to avoid this problem.
- Use the `transient_lastDdlTime` instead of `System.currentTimestamp` as the `schemaUpdateTime` of hms tables
- Use the `eventTime` in hms event instead of `System.currentTimestamp` as the update time when processing hms events
2023-11-10 17:36:00 +08:00
8ee237c55a
[Enhance](regression)enhance case test_hdfs_json_load #26358
...
enhance case test_hdfs_json_load
2023-11-10 17:29:11 +08:00
0e0cd3b256
[fix](action) Update pr-approve-status.yml ( #26577 )
...
According to https://docs.github.com/en/rest/pulls/reviews?apiVersion=2022-11-28#list-reviews-for-a-pull-request ,
the number of results per page default is 30 (max 100).
review of APPROVED after 30 will not be listed,
change to 100 to fix it.
2023-11-10 17:01:37 +08:00
2712bb9f60
[Bug](decimalv2) getCmpType return decimalv2 when lhs/rhs type both is decimalv2 ( #26705 )
...
getCmpType return decimalv2 when lhs/rhs type both is decimalv2
2023-11-10 16:21:28 +08:00
59efebce3b
[opt](nereids) estimate join cost when col stats are not available ( #26086 )
...
no stats left zigzag
2023-11-10 16:13:53 +08:00
0749d632c4
[feature](diagnose) diagnose for cluster balance ( #26085 )
2023-11-10 15:31:58 +08:00
4ebb517af0
[fix](be-ut) Fix compilation errors caused by missing opentelemetry headers ( #26739 )
2023-11-10 14:58:46 +08:00
ce64f0c917
[enhancement](Nereids): add phase in shape string ( #26682 )
2023-11-10 14:56:28 +08:00
5c3fed216d
[fix](transaction) Fix publish txn wait too long when not meet quorum ( #26659 )
2023-11-10 14:55:26 +08:00
9f6c6ffc92
[regression-test](stream load)Invalid file format check ( #26713 )
2023-11-10 14:53:01 +08:00
899630d0eb
[chore](key_util) remove useless null_first parameter ( #26635 )
...
Doris always put null in the first when sorting key, the parameter null_first of encode_keys is useless.
2023-11-10 14:27:47 +08:00
cdba4936b4
[feature](nereids) Support group commit insert ( #26075 )
2023-11-10 14:20:14 +08:00
019fb956d3
[docs](cache) Refactor query-cache docs ( #26418 )
2023-11-10 13:57:20 +08:00
7878c08e15
[Revert](merge-on-write) Don't use delete bitmap to mark delete for rows with delete sign when sequence column doesn't exist ( #26721 )
2023-11-10 13:55:40 +08:00
27a21aa150
[fix](balance) Delete useless debug log ( #26732 )
2023-11-10 12:57:13 +08:00
c02c00974f
[Bug](agg-state) fix file load insert wrong data to agg_state ( #26581 )
...
fix file load insert wrong data to agg_state
2023-11-10 11:03:13 +08:00
7ce746654a
[test](jdbc) add doris and sqlserver jdbc catalog test case ( #26656 )
2023-11-10 10:32:09 +08:00
76c0a906e5
[regression test](stream load) load_to_single_tablet ( #26720 )
2023-11-10 10:20:24 +08:00
7754791146
[improvement](disk balance) Prevent duplicate disk balance tasks afte… ( #25990 )
2023-11-10 10:14:42 +08:00
2bf48d7829
Revert "[Coverage](BE) Delete vinfo_func in BE ( #26562 )" ( #26723 )
...
This reverts commit 01094fd25ed539a8025066d8823c1e907109048a.
2023-11-10 10:14:11 +08:00
d767804815
[feature](merge-cloud) Decouple rowset id generator and local rowsets gc implementation ( #25921 )
2023-11-10 10:07:02 +08:00
49cffd0bc9
[fix](JdbcCatalog) fix that the predicate column name does not have back quote when querying the JDBC appearance ( #26479 )
2023-11-10 09:54:39 +08:00
328e5b120b
[fix](group commit) Group commit support sequence column for unique table ( #26652 )
2023-11-09 22:43:37 +08:00
02fe71dcd6
[test](serialisation) Serialise some cases and enable str_to_date tests #26651
...
1 enable the cases about str_to_date, which have been muted because some parallel config influence.
2 serialise some cases which called admin set config
2023-11-09 21:53:32 +08:00
1722549381
[test](statistics)Add hive statistics all data type p0 test ( #26676 )
2023-11-09 21:48:18 +08:00
d988193d39
[pipelineX](shuffle) block exchange sink by memory usage ( #26595 )
2023-11-09 21:28:22 +08:00
0af8223894
[chore](ci) support to run regression pipeline mutiple times ( #26701 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2023-11-09 20:16:38 +08:00
