Commit Graph

14482 Commits

Author SHA1 Message Date
8f15f9adf6 [test](case) add test case to improve code coverage (#25516)
[test](case) add test case to improve code coverage (#25516)
2023-11-01 12:51:12 +08:00
b94e6d6c05 [doc](fix) update doc for rename column (#25832) 2023-11-01 11:30:03 +08:00
7914b7b19e [fix](seek) add SeekCount and SeekTime profile (#26009) 2023-11-01 11:29:29 +08:00
eaed0dea5e [refactor](executor)Add % suffix for cpu_hard_limit #26174 2023-11-01 10:27:48 +08:00
fef520c617 [regression](catalog)Add test case of paimon complex type (#25834)
Add Paimon complex nested type regression case.
Related pr:#25364
2023-11-01 09:59:55 +08:00
18dabe7386 [fix](compile) fe compile failed when generate doc and FE UT failed (#26164)
1. FE could not compile because below error. Intro by PR #25933
```
[INFO] --- exec:3.1.0:java (doc) @ fe-core ---
...
Failed to generate doc for ignoreRuntimeFilterIds
```

2. fix UT bugs intro by below PRs
> - #25951
> - #26031

3. because fe could not compile, FE UT CI do not work well. So, some UT failed be introduced by the PRs merged after PR #25933 merged. So this PR revert them to fix FE UT

> - Revert "[Bug](materialized-view) SelectMaterializedIndexWithAggregate do not change plan > when match ba… (#26145)"
> This reverts commit 8d7abf60f94d2d1208b71e96b9290ea02122b8d8.

> - Revert "[enhancement](Nereids): optimize GroupExpressionMatching (#26130)"
> This reverts commit 19122b55cd95af097b4ef7b6eb809f37db29765f.

> - Revert "[Performance](Nereids): optimize GroupExpressionMatching (#26084)"
> This reverts commit 0d956e90cf920039b8baa79c170a298be56a128d.
2023-10-31 20:50:44 -05:00
d3c475b06a disable branch-2.0 protection temporarily (#26186)
disable branch-2.0 protection temporarily for merge pr faster.
2023-10-31 20:37:49 -05:00
4eb9a52ace [regression](s3load) Add regression testing and modify description text for s3load (#25947) 2023-11-01 07:39:16 +08:00
Pxl
696ecc8c83 [Chore](log) adjust error code on too many filtered rows (#26168) 2023-11-01 00:15:56 +08:00
9d83948987 [feature](pipelineX) Use dependency instead of block queue in the runtime filter (#26078) 2023-10-31 22:44:18 +08:00
6f4570d3af [cases](regression-test) Add backup restore operation test (#26169)
1. restore overwrites an exists table
2. backup & restore with exclude table
3. restore to a new table
4. restore mix exists and new tables
5. restore with alias
2023-10-31 22:36:45 +08:00
8c454a3287 [bug](scanner) Fix scanner core dump (#26156) 2023-10-31 22:23:32 +08:00
ac7678926f [improvement](tablet clone) add config for decommission tablet wait time (#26000) 2023-10-31 20:36:26 +08:00
08c78a1135 [Feature](Job)Support manual and refactor some execution logic (#26082)
Supports manually triggered JOBs and Tasks
Optimize JOB&TASK display logic
Refactor the executor to support context passing
2023-10-31 20:35:55 +08:00
b87b09bb04 [Enhance](regression)enhance case test_broker_load_func (#26118) 2023-10-31 19:22:25 +08:00
2c4fa2d5b0 improve workload group regression stress test script (#26104) 2023-10-31 19:05:08 +08:00
aadd220eff [FIX](decimalv3) fix large int cast to decimalv3 #26159
fix large int cast to decimalv3 , before if we make data more than max int64 cast to decimalv3 will make result overflow and incorrect
such as

mysql> select CAST(12345678901234567890123456789012345678 AS DECIMALV3(38, 0));
+------------------------------------------------------------------+
| CAST(12345678901234567890123456789012345678 AS DECIMALV3(38, 0)) |
+------------------------------------------------------------------+
|                                             -4302749291975740594 |
+------------------------------------------------------------------+
2023-10-31 18:24:09 +08:00
b98744ae90 [Bug](iceberg)fix read partitioned iceberg without partition path (#25503)
Iceberg does not require partition values to exist on file paths, so we should get the partition value from `PartitionScanTask.partition`.
2023-10-31 18:09:53 +08:00
b137f03921 [feature](profile) add MaxActiveTime and add exectime in pipelineX (#26148) 2023-10-31 17:53:52 +08:00
973657d163 [fix](compile) be cannot compile on MacOS (#26155)
build on MacOS meet error: reference to 'detail' is ambiguous.
Because there is a detail namespace under std
2023-10-31 17:36:00 +08:00
Pxl
271b074f42 Bug](view) make forbiddenMVRewrite work on InlineViewRef (#26162)
make forbiddenMVRewrite work on InlineViewRef
2023-10-31 17:30:59 +08:00
b619982c3a [Enhancement](metrics) Avoid update_process_fd_num reporting no such file error indiscriminately. (#26013)
Avoid `update_process_fd_num` reporting `no such file error `indiscriminately.
2023-10-31 17:28:43 +08:00
3eac2a75cb [fix](docs) modify docs abort outfile and export (#26033) 2023-10-31 17:25:44 +08:00
6f316b117f [Fix](Checkpoint)AnalysisMgrV2 does not implement the corresponding read and write interface (#26161) 2023-10-31 17:24:35 +08:00
9633d0a83b [case](iceberg)add test case (#26107) 2023-10-31 17:23:22 +08:00
994db8b400 [fix](multi-catalog)add the FAQ for Aliyun DLF and add the fs.xx.impl check (#25594)
1. add the FAQ for Aliyun DLF,include the DLF configuration and Jindo SDK locations
2. add the fs.xx.impl check when load cache files
2023-10-31 17:09:52 +08:00
a698e14fb2 [cases](regression-test) Add backup & restore with multi tables test (#26040) 2023-10-31 17:08:55 +08:00
958c7fdfd9 [fix](planner)should keep at least one slot materialized in agg node (#26116) 2023-10-31 16:52:45 +08:00
a6e010f722 [opt](nereids) use rowcount to compute runtime filter size if ndv is not available (#26022) 2023-10-31 16:52:17 +08:00
97646b098e [compile](submodule) move submodule update to BE compile (#26109)
orc and clucene is only used by BE, thus move the update to BE compile part
2023-10-31 16:51:36 +08:00
d698fb9225 [regression-test](fix) fix two regression test case bug (#26071) 2023-10-31 03:48:29 -05:00
ea1554374c [fix](multicast) fix DCHECK failure of block mem reuse for multicast (#26127)
* [fix](multicast) fix DCHECK failure of block mem reuse for multicast
2023-10-31 16:35:26 +08:00
3864dd99aa [fix](Nereids): refresh the shape of q64 (#26135) 2023-10-31 16:32:26 +08:00
a259ae9417 [fix](mtmv)add mtmvJobManager to DEPRECATED_MODULE_NAMES (#26137)
Inherited from:26041
2023-10-31 16:28:43 +08:00
19122b55cd [enhancement](Nereids): optimize GroupExpressionMatching (#26130)
1. pattern can't be SubTreePattern in CBO phase.
2. optimize getInputSlotExprId()
2023-10-31 15:47:13 +08:00
111b8e2b4f [minor](planner) remove len on integral type toSql (#25951) 2023-10-31 02:37:08 -05:00
feefebe0da [chore](log opt) opt mysql load log (#26149) 2023-10-31 14:59:52 +08:00
95c765f5fe [fix](Nereids) values list could not process only one column (#26123) 2023-10-31 01:58:54 -05:00
ea1e8fa15d [Fix](Nereids) fix create table as select of view with unknowed length character type (#25471)
Problem:
when create table as select from a view with unknown length character type, be would return an error of inserting data failed

Example:
doris/regression-test/suites/ddl_p0/test_ctas.groovy

Reason & Solved:
BE can not derive varchar length automaticly so FE should tell BE to maximize the size of varchar type
2023-10-31 01:50:28 -05:00
0449a240f4 [Fix](from_unixtime) Keep consistent with MySQL & bug fix (#25966)
Bug fix: implicit convert from int32 -> int64 makes negative time stamp valid, so change signature to int64
Consistent: keep consistent with mysql.
2023-10-31 14:31:24 +08:00
Pxl
8d7abf60f9 [Bug](materialized-view) SelectMaterializedIndexWithAggregate do not change plan when match ba… (#26145)
* SelectMaterializedIndexWithAggregate do not change plan when match base index

* forbid table withh alias
2023-10-31 14:11:08 +08:00
7e6644b1ee [pipelineX](profile) Improve exchange sink profile (#26117) 2023-10-31 14:10:42 +08:00
3d295f0eb0 [Update](regression) add failure injection in inverted index writer (#26121)
* [Update](regression) add failure injection in inverted index writer
2023-10-31 14:09:20 +08:00
8f320944a8 [fix](move-memtable) fix DeltaWriterV2 profile use-after-free (#26110)
The sink who creates the delta writer may be closed while other sinks still using this delta writer.
The parent profile is deconstructed and when the last sink trying to update the profile, it will meet use-after-free.

To address this issue, we record the profile number in delta writer,
and the last sink who close the delta writer will create and update the profile.
2023-10-31 13:52:18 +08:00
588d4c150f [bugfix](DateTimeV2Literal) The start and end dates of daylight saving time vary from year to year, which can lead to different test results at different times (#26083)
The start and end dates of daylight saving time vary depending on the year. Daylight saving time usually starts on the last Sunday in March and ends on the last Sunday in October. During this time, the offset for Europe/London is UTC+1. Outside of daylight saving time, the Europe/London offset is UTC+0.
2023-10-31 13:39:38 +08:00
1e02de1846 [feature](nestedType)add nested data type to create table (#26129) 2023-10-31 13:35:29 +08:00
809510f8b2 [bug](udf) Fix method invoking (#26131) 2023-10-31 11:46:14 +08:00
462db3d5be [fix](compile) fix macos compile error (#25944) 2023-10-31 11:44:56 +08:00
78204f7c92 [Fix](statistics)Fix external couldn't analyze database bug (#26025) 2023-10-31 11:32:47 +08:00
3184060fa7 [chore](page) print the file path to the log when encountering corruption data pages (#26134) 2023-10-31 10:17:54 +08:00