927de33166
[config](log) disable StreamLoad log default and enable in regression pipeline ( #24354 )
...
disable StreamLoad log default and enable in regression pipeline
2023-09-14 20:47:26 +08:00
c6a92955ca
[refacotr](optimizer) Remove useless check #24237
...
Check stats table status at first
Comment histgram_tbl check since it useless for now
Do preheat both in master and follower
2023-09-14 19:35:56 +08:00
6fe207eb4b
[fix](broker) do not close filesystem( #24357 )
...
same as #24128
To avoid Filesystem closed error
2023-09-14 18:36:09 +08:00
eb65cc6954
[Fix](nereids) eliminate_outer_join regression case fix #24262
2023-09-14 18:22:17 +08:00
55de937651
[Chore](check) fix NoSuchFileException: /github/workspace/build_Release/compile_commands.json ( #24380 )
...
fix NoSuchFileException: /github/workspace/build_Release/compile_commands.json
2023-09-14 18:12:23 +08:00
3ee89aea35
[Feature](merge-on-write)Support ignore mode for merge-on-write unique table ( #21773 )
2023-09-14 18:03:51 +08:00
68b13ab50f
[Fix](Full compaction) Fix full compaction by table id case ( #24265 )
2023-09-14 18:03:28 +08:00
35c5d71549
[Improvement](join) some improvement of hash join ( #23972 )
...
some improvement of hash join
2023-09-14 17:55:35 +08:00
9c6734e68e
[bugfix](index) Fix build index limitations ( #24358 )
...
1. skip existed index on column with different id on build index
2. allow build index for CANCELED or FINISHED state
2023-09-14 17:53:22 +08:00
eaa35649bc
[fix](bdbje) handle ReplicaWriteException in BDBJEJournal.write ( #24259 )
...
* When BDBJEJournal.write meet `ReplicaWriteException`, we should not
retry. Because at the monment the bdbje node state is `REPLICA` (not `MASTER`)
if we still retry write, at the same time trigger election, the orgin `REPLICA`
node may transfer to `MASTER` and will cause incorrect journalId
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-14 17:49:28 +08:00
85e5b49d4c
update structured streaming doc ( #24016 )
2023-09-14 17:47:27 +08:00
3827549aba
[Chore](checks) change SonarCloud Scan projectBaseDir to be to avoid include .java file ( #24377 )
...
change SonarCloud Scan projectBaseDir to be to avoid include .java file
2023-09-14 17:26:23 +08:00
d035a58374
[feature](nereids) support unnest subquery in LogicalOneRowRelation ( #24355 )
...
select (select 1);
before :
ERROR 1105 (HY000): errCode = 2, detailMessage = Subquery is not supported in the select list.
after:
mysql> select (select 1);
+---------------------------------------------------------------------+
| (SCALARSUBQUERY) (LogicalOneRowRelation ( projects=[1 AS `1`#0] )) |
+---------------------------------------------------------------------+
| 1 |
+---------------------------------------------------------------------+
1 row in set (0.61 sec)
2023-09-14 17:22:08 +08:00
0be0b8ff58
[opt](stats) Support display of auto analyze jobs ( #24135 )
...
### Support dispaly of auto analyze jobs
After this PR, users and DBA could use such grammar to check the execution status of auto analyze jobs:
```sql
SHOW AUTO ANALYZE [tbl_name] [WHERE STATE='SOME STATE']
```
Record count of history auto analyze job could be configured by setting FE option: auto_analyze_job_record_count, default value is 2000
### Enhance auto analyze
After this PR, auto jobs those created automatically will no longer execute beyond a specific time frame.
2023-09-14 17:10:04 +08:00
4fbb25bc55
[Enhancement](function) Support date_trunc(date) and use it in auto partition ( #24341 )
...
Support date_trunc(date) and use it in auto partition
2023-09-14 16:53:09 +08:00
f303a99250
[Chore](checks) set compile_commands.json path on sonar cloud config ( #24374 )
...
set compile_commands.json path on sonar cloud config
2023-09-14 16:52:30 +08:00
b6d7116dea
[fix](datetime) fix compare of DatetimeLiteral ( #24343 )
...
fix compare of DatetimeLiteral
2023-09-14 16:51:50 +08:00
8e7f7c9566
[fix](profile) move probe time to pull and add LoopGenerateJoin time #24302
2023-09-14 16:41:01 +08:00
7ff76c5a1e
[test](Nereids) add normalize sort test ( #24230 )
2023-09-14 16:33:36 +08:00
7b634d8817
[Chore](checks) fix SonarCloud Scan config define ( #24370 )
...
fix SonarCloud Scan config define
2023-09-14 16:17:52 +08:00
ace3e79498
[test](Nereids) add test for uncorrelatedApplyFilter #24220
...
add test for uncorrelatedApplyFilter rule
2023-09-14 16:10:08 +08:00
4efc68a33d
[fix](test)disable join reorder for test_bitmap_filter regression test ( #23150 )
...
the nereids planner may reorder the join without any statistics info. This could lead to very bad join order that cause the query timeout. This pr disable join reorder for this sql.
2023-09-14 16:05:09 +08:00
ccba5a729a
[fix](planner)cast string to float like type should return NULL literal if it fails ( #24222 )
2023-09-14 15:59:20 +08:00
c1b4e132d6
[Chore](checks) add sonar config on cde checks ( #24367 )
...
add sonar config on cde checks
2023-09-14 15:54:46 +08:00
40e1c2af45
[fix](nereids)the common type of decimalv2 and decimalv3 shoud be decimalv3 in BinaryArithmetic operator ( #24215 )
...
the common type of decimalv2 and decimalv3 shoud be decimalv3 in BinaryArithmetic operator
2023-09-14 15:53:23 +08:00
51a5895464
[Feature](RoutineLoad) Support max filter ratio for routine load ( #24035 )
2023-09-14 15:30:40 +08:00
a68ed24d20
[Chore](workflow) add sonar cloud on cpp workflow ( #24189 )
...
add sonar cloud on cpp workflow
2023-09-14 15:14:05 +08:00
51811f72b3
[doc](partial update) add complete doc for partial update ( #24317 )
2023-09-14 14:49:24 +08:00
d8feca2530
[Enhancement]The page cache can be parameterized by the session variable of fe. ( #23981 )
2023-09-14 14:28:19 +08:00
1ef22d7f7c
[Feature](variant) add variant type ( #24170 )
...
Add variant type for metadata Add persistent information for variant, including the path of variant sub-columns, persisting them to the segment footer and tablet schema of the rowset.
2023-09-14 14:21:53 +08:00
ec7b1790f9
[Improvement](ddl) make create table with mv column name report error msg more readable ( #24349 )
...
make create table with mv column name report error msg more readable
2023-09-14 14:18:49 +08:00
049032b4b3
Refactor Slice move/copy ctor && assignment to default ( #24169 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-14 14:18:10 +08:00
42ca0fc857
[Improvement](delete) cast delete binary predicate rhs type to lhs type ( #24321 )
...
cast delete binary predicate rhs type to lhs type
2023-09-14 14:15:27 +08:00
268c867679
[Improve](serde)replace function_cast from_string to serde ( #24087 )
...
Now we can not support streamload with column which is map/array nested map/array
serde can do this now , so we can replace it
Notice. if item data in complex type data is empty we just return error, instead of makeup default value , because now we can not define right default for complex type
2023-09-14 13:53:16 +08:00
d23d1870a2
[fix](Nereids): fix regression-test ( #24329 )
2023-09-14 13:21:50 +08:00
b044ff0556
[test](Nereids): add ut for PullUpProjectUnderApply ( #24331 )
2023-09-14 12:56:27 +08:00
f8692bef4b
[fix](io): use try with resource make io stream close automatically to avoid resource leak ( #24297 )
2023-09-14 11:51:30 +08:00
25763d0ed9
[typo](doc) fix error description about load_to_single_tablet ( #24270 )
...
* fix error description about load_to_single_tablet
* fix review
2023-09-14 11:48:06 +08:00
adde012de0
[enhancement](fe) Add more detail log for replayJournal ( #24218 )
2023-09-14 11:45:48 +08:00
4eccf72bdd
[Fix](S3 tvf) fix that S3 tvf can not run properly ( #24289 )
...
This bug is caused by this PR: #23635
2023-09-14 11:45:29 +08:00
ed108d48fa
[fix](invert index) fix query use char filter ( #24268 )
2023-09-14 11:42:47 +08:00
1f0844b992
[fix](env)mock env.isCheckpointThread #24280
...
ssue Number: close #xxx
ShowTableStmtTest.testNoDb and DropDbStmtTest.testNoPriv are unstable cases，error msg is:
java.lang.Exception: Unexpected exception, expected<org.apache.doris.common.AnalysisException> but was<mockit.internal.expectations.invocation.MissingInvocation>
reason is missing mock env.isCheckpointThread
2023-09-14 11:37:01 +08:00
354cb3970b
[feature](Nereids): normalize two-digit basic date/datetime ( #24333 )
...
normalize two-digit basic date/datetime
220201 -> 20220201
220201T010101 -> 20220201T010101
......
2023-09-14 11:25:00 +08:00
46f5988245
[fix](Nereids) set operation children output order not same ( #24060 )
...
we generate project for all set operation's children to ensure the order
of all children are not changed. However, some rules, such as
PushDownProjectThroughLimit could remove these projects involuntarily.
When it happen, the column order is wrong and lead to BE core dump.
This PR use a new variable in SetOperation to save the output order of
children of set operation. Then the children's output order could be
changed and never affect to SetOperation at all.
2023-09-14 11:09:58 +08:00
64337a8698
[Improve](metadata)Start the script to set metadata_failure_recovery ( #24308 )
2023-09-14 10:02:35 +08:00
1a4929b59e
[fix](planner) having clause analyze bug #24288
2023-09-14 09:54:09 +08:00
eb2db1bfb0
[enhance](Tools) update tpch tools ( #24291 )
...
update tpch tools:
1) extend data scale to sf1/sf100/sf1000/sf10000
2) add table schema, sql, opt config for all different scale.
3) refine result output
2023-09-14 09:47:50 +08:00
5dede120db
[Enhancement](inverted index) fix compound predicates error ( #24300 )
2023-09-14 09:21:41 +08:00
9b7f041bea
[Bug](function) fix explode_json_array_int can't handle min/max values ( #24284 )
...
the json str get value maybe beyond max/min of Int64,
so add some check to limit the value, and return the max/min of Int64
2023-09-14 09:20:59 +08:00
539a7c2975
[fix](agg) Add the unimplemented functions in 'AggregateFunctionCountNotNullUnaryOld' ( #24310 )
...
Similar to #24211
2023-09-14 09:19:02 +08:00
