f1a7f9a70f
[opt](Nereids)choose better column for count star ( #31227 )
2024-02-22 19:51:20 +08:00
9f8906269b
[regression-test](VariantType) fix and disable unstable case ( #31269 )
2024-02-22 19:51:20 +08:00
a6c0be611c
[fix](mtmv) fix mtmv workload group case failed ( #31218 )
2024-02-22 19:51:20 +08:00
4c3a96e7df
[fix](memory) Fix LRU cache frequent prune ( #31220 )
2024-02-22 19:51:20 +08:00
64056bb96b
[Fix](seq-col) Fix sequence column check fail #31252
...
When FE generates plans and reaches the sequence column for rule judgment, an insertion statement that should have been correctly processed fails. This failure occurs because the judgment logic for the sequence part is case-sensitive to column names: the column name is in lowercase in the create table statement, but in uppercase in the insertion statement, causing the sequence column not to be correctly identified. However, Doris itself is case-insensitive to column names. This PR fixes the issue through the use of the ignoreCase method.
2024-02-22 19:51:20 +08:00
260568db17
[update](hudi) update hudi version to 0.14.1 and compatible with flink hive catalog ( #31181 )
...
1. Update hudi version from 0.13.1 to .14.1
2. Compatible with the hudi table created by flink hive catalog
2024-02-22 19:51:20 +08:00
a5ee1b3c87
[fix](keyword) add BELONG as reserve keyword ( #31230 )
...
This #27994 introduce a new keyword BELONG, need to add it as reserve keyword
2024-02-22 19:51:20 +08:00
241a2fc25c
[nereids] downgrade bucket shuffle if tablet num < instance num ( #31222 )
2024-02-22 19:51:20 +08:00
8e24b42d7a
Revert "[chore](ci) Update .asf.yaml ( #31272 )" ( #31281 )
...
This reverts commit 223419ff67275a5201924ffa261482c02f9382f1.
Co-authored-by: stephen <hello-stephen@qq.com >
2024-02-22 19:51:20 +08:00
86c800ce59
[doc](doc)add some k8s doc ( #31194 )
...
* add some k8s doc
* fix
2024-02-22 19:51:20 +08:00
b898b83667
[chore](ci) Update .asf.yaml ( #31272 )
2024-02-22 19:51:20 +08:00
98c3cb825f
[fix](Nereids) simplify airthmetic should not change return type ( #31237 )
2024-02-22 19:50:47 +08:00
fa83a8f86a
[fix][doc] one of the Chinese document references is missing #31236
...
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com >
2024-02-22 19:50:07 +08:00
7647cec509
[Fix](Job)TVF Query JOB Concurrent Reading and Writing Causes Exception ( #31248 )
2024-02-22 19:50:07 +08:00
e3b4b83bca
[test](regression) add regression test for schange change of complex type ( #31207 )
...
Add regression test for #31128
2024-02-22 19:50:07 +08:00
389c702a3f
[improvement](hudi)Obtain partition information through HMS's API ( #30962 )
...
When a Hudi table is synchronized to HMS, the partition information is also synchronized, so even if the metastore is not enabled in the Hudi table (for example, if the Metastore is false for a Hudi table created with Flink), you can still obtain the partition information through the HMS API.
2024-02-22 19:50:07 +08:00
99697c5bcb
Update multi-tenant.md ( #31256 )
2024-02-22 19:50:07 +08:00
ef22bd3318
[fix](txn insert) Txn insert can not write to table with mv ( #31167 )
2024-02-22 13:01:49 +08:00
90ab5ec2d9
[fix](invert index) fix the error issue in the unit test remove_element_only_in_table ( #31238 )
2024-02-22 13:01:49 +08:00
ad07dec0ed
[Improve](InPredict) enhance in predict with struct type ( #30840 )
2024-02-22 13:01:49 +08:00
6096227fea
[bugfix](docs)Fix some spelling mistakes in english doc ( #31241 )
2024-02-22 13:01:49 +08:00
90a7f04349
[refine](pipelinex) get sink local state does not require an id. #31195
2024-02-22 13:01:49 +08:00
52b9af06fb
[pipelineX](refactor) Delete subclasses inherited from Dependency ( #31216 )
2024-02-22 13:01:48 +08:00
bb73561b71
[doc](create table) add since version for some new features ( #30506 )
2024-02-22 13:01:48 +08:00
b66583551c
[fix](group_commit)Fix bound checking problem when reading wal block ( #31112 )
2024-02-22 13:01:48 +08:00
d080fe8c89
[log](query) add debug log for check query visible version ( #31217 )
2024-02-22 13:01:48 +08:00
6ef90b2ad9
Window function sum/avg does not support distinct document modification ( #31066 )
2024-02-22 13:01:48 +08:00
70dc40ab3c
[fix](audit) The time field in the audit log table is set to the millisecond level ( #31096 )
2024-02-22 13:01:48 +08:00
f2a38e6345
[chore](columns) remove update_hashes_with_value for SipHash ( #31224 )
2024-02-22 13:01:48 +08:00
98a1b12ac6
[Enhancement] [plsql] support drop store procedure ( #30966 ) ( #31001 )
2024-02-22 13:01:48 +08:00
c56cb0ac3e
[Exec](RF) Support merge remote rf local first ( #31067 )
2024-02-22 13:01:48 +08:00
8a496bf554
[regression test]Optimize testUniqueModelSchemaKeyChange ( #31150 )
2024-02-22 13:01:48 +08:00
9c096710fa
[Enhancement](group commit) Add bvar and log for group commit ( #31017 )
2024-02-22 13:01:32 +08:00
2069f9ff63
[fix](Nereids): OuterJoinAssoc reject literal condition ( #31172 )
2024-02-22 13:01:32 +08:00
e183e9ac46
[fix](stream-load) print stream load profile for pipeline and pipelinex ( #31198 )
2024-02-22 13:01:32 +08:00
57f3ea6d7b
Example Modify audit log documents ( #31192 )
2024-02-22 13:01:32 +08:00
6bbe6c9a59
[fix](statistics)Release StmtExecutor in AnalysisTask object when sql execution finished to release memory. #31212
2024-02-21 19:18:45 +08:00
eaf22cf3d3
[regression-test] Analyze each table after loading all tables ( #31175 )
...
Analyze may rely on row count reported by BEs, if we analyze immediately
after loading to a table, the row count of the table may be still 0
which may lead to improper behavior of analyze manager.
This change will introduce extra 70 seconds wait time for the cases affected.
"70s" is slightly lager than default value (60s) of
tablet_stat_update_interval_second fe.conf.
To reduce this duration, change tablet_stat_update_interval_second
to a smaller value, say 10 seconds and change 70s to 15s.
2024-02-21 19:18:45 +08:00
ca89ac0c23
[fix](regression) insert_group_commit_into_unique is unstable when cluster has multi BE ( #31188 )
2024-02-21 19:18:45 +08:00
29ae497871
Modify the flink version corresponding to flink doris connector 1.0.3 version ( #31211 )
2024-02-21 19:18:45 +08:00
49dd411f87
[fix](datetime) fix datetime round on BE ( #31205 )
...
with tmp as (
select CONCAT(
YEAR('2024-02-06 03:37:07.157'), '-',
LPAD(MONTH('2024-02-06 03:37:07.157'), 2, '0'), '-',
LPAD(DAY('2024-02-06 03:37:07.157'), 2, '0'), ' ',
LPAD(HOUR('2024-02-06 03:37:07.157'), 2, '0'), ':',
LPAD(MINUTE('2024-02-06 03:37:07.157'), 2, '0'), ':',
LPAD(SECOND('2024-02-06 03:37:07.157'), 2, '0'), '.', "123456789" )
AS generated_string)
select generated_string, cast(generated_string as DateTime(6)) from tmp
before (incorrect round)
+-------------------------------+-----------------------------------------+
| generated_string | cast(generated_string as DATETIMEV2(6)) |
+-------------------------------+-----------------------------------------+
| 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123456 |
+-------------------------------+-----------------------------------------+
after (round up, keep consistent with mysql):
+-------------------------------+-----------------------------------------+
| generated_string | cast(generated_string as DATETIMEV2(6)) |
+-------------------------------+-----------------------------------------+
| 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123457 |
+-------------------------------+-----------------------------------------+
1 row in set (0.03 sec)
same work with #30744 but implemented on BE
2024-02-21 19:18:45 +08:00
eb5e6a829a
[fix](nereids)should normalize window expression by bottom project's output ( #31115 )
2024-02-21 19:18:45 +08:00
8d889e434b
[fix](topn) Fix key topn block reverse is missed in some cases ( #31199 )
...
* move reverse block row order operation after _next_batch_internal
* add testcase
2024-02-21 19:18:45 +08:00
e14bcbd947
[test](auto partition)add auto partitions p2 case ( #31202 )
2024-02-21 19:18:45 +08:00
8fc9d80479
[compatibility](MySQL) update charset to utf8mb4, collation to utf8mb4_0900_bin ( #31046 )
...
Doris's behaviour is more like utf8mb4 and utf8mb4_0900_bin than utf8 and utf8_general_ci
2024-02-21 17:01:39 +08:00
f1fbfeba2f
[fix](nereids) removeRuntimeFilter() removes more than one RFs if there are different types of RF from the buildNode to the target ( #31197 )
...
this bug can be produced on tpcds 95, when set runtime filter type: min-max + bloom
2024-02-21 17:01:39 +08:00
49411a3139
[fix](testcase) enable multi_thread_load auto partition test in p1 group ( #31085 )
...
enable multi_thread_load auto partition test in p1 group
2024-02-21 17:01:30 +08:00
98106ad60f
[fix](nereids) fix bug of unnest subuqery with having clause ( #31152 )
...
1. run PushDownFilterThroughAggregation, PushDownFilterThroughProject and MergeFilters before subquery unnesting
2. should keep plan unchanged even left semi join's condition is true (because the right table may be empty())
3. PushDownFilterThroughProject need check if filter's input slots are all coming from project's output
2024-02-21 17:01:30 +08:00
1abe9d4384
[fix](memory) Fix LRU cache stale sweep ( #31122 )
...
Remove LRUCacheValueBase, put last_visit_time into LRUHandle, and automatically update timestamp to last_visit_time during cache insert and lookup.
Do not rely on external modification of last_visit_time, which is often forgotten.
2024-02-21 17:01:29 +08:00
18955174e9
Fix analyze mv and mtmv p0 case. ( #31191 )
2024-02-21 17:01:19 +08:00
