6096227fea
[bugfix](docs)Fix some spelling mistakes in english doc ( #31241 )
2024-02-22 13:01:49 +08:00
90a7f04349
[refine](pipelinex) get sink local state does not require an id. #31195
2024-02-22 13:01:49 +08:00
52b9af06fb
[pipelineX](refactor) Delete subclasses inherited from Dependency ( #31216 )
2024-02-22 13:01:48 +08:00
bb73561b71
[doc](create table) add since version for some new features ( #30506 )
2024-02-22 13:01:48 +08:00
b66583551c
[fix](group_commit)Fix bound checking problem when reading wal block ( #31112 )
2024-02-22 13:01:48 +08:00
d080fe8c89
[log](query) add debug log for check query visible version ( #31217 )
2024-02-22 13:01:48 +08:00
6ef90b2ad9
Window function sum/avg does not support distinct document modification ( #31066 )
2024-02-22 13:01:48 +08:00
70dc40ab3c
[fix](audit) The time field in the audit log table is set to the millisecond level ( #31096 )
2024-02-22 13:01:48 +08:00
f2a38e6345
[chore](columns) remove update_hashes_with_value for SipHash ( #31224 )
2024-02-22 13:01:48 +08:00
98a1b12ac6
[Enhancement] [plsql] support drop store procedure ( #30966 ) ( #31001 )
2024-02-22 13:01:48 +08:00
c56cb0ac3e
[Exec](RF) Support merge remote rf local first ( #31067 )
2024-02-22 13:01:48 +08:00
8a496bf554
[regression test]Optimize testUniqueModelSchemaKeyChange ( #31150 )
2024-02-22 13:01:48 +08:00
9c096710fa
[Enhancement](group commit) Add bvar and log for group commit ( #31017 )
2024-02-22 13:01:32 +08:00
2069f9ff63
[fix](Nereids): OuterJoinAssoc reject literal condition ( #31172 )
2024-02-22 13:01:32 +08:00
e183e9ac46
[fix](stream-load) print stream load profile for pipeline and pipelinex ( #31198 )
2024-02-22 13:01:32 +08:00
57f3ea6d7b
Example Modify audit log documents ( #31192 )
2024-02-22 13:01:32 +08:00
6bbe6c9a59
[fix](statistics)Release StmtExecutor in AnalysisTask object when sql execution finished to release memory. #31212
2024-02-21 19:18:45 +08:00
eaf22cf3d3
[regression-test] Analyze each table after loading all tables ( #31175 )
...
Analyze may rely on row count reported by BEs, if we analyze immediately
after loading to a table, the row count of the table may be still 0
which may lead to improper behavior of analyze manager.
This change will introduce extra 70 seconds wait time for the cases affected.
"70s" is slightly lager than default value (60s) of
tablet_stat_update_interval_second fe.conf.
To reduce this duration, change tablet_stat_update_interval_second
to a smaller value, say 10 seconds and change 70s to 15s.
2024-02-21 19:18:45 +08:00
ca89ac0c23
[fix](regression) insert_group_commit_into_unique is unstable when cluster has multi BE ( #31188 )
2024-02-21 19:18:45 +08:00
29ae497871
Modify the flink version corresponding to flink doris connector 1.0.3 version ( #31211 )
2024-02-21 19:18:45 +08:00
49dd411f87
[fix](datetime) fix datetime round on BE ( #31205 )
...
with tmp as (
select CONCAT(
YEAR('2024-02-06 03:37:07.157'), '-',
LPAD(MONTH('2024-02-06 03:37:07.157'), 2, '0'), '-',
LPAD(DAY('2024-02-06 03:37:07.157'), 2, '0'), ' ',
LPAD(HOUR('2024-02-06 03:37:07.157'), 2, '0'), ':',
LPAD(MINUTE('2024-02-06 03:37:07.157'), 2, '0'), ':',
LPAD(SECOND('2024-02-06 03:37:07.157'), 2, '0'), '.', "123456789" )
AS generated_string)
select generated_string, cast(generated_string as DateTime(6)) from tmp
before (incorrect round)
+-------------------------------+-----------------------------------------+
| generated_string | cast(generated_string as DATETIMEV2(6)) |
+-------------------------------+-----------------------------------------+
| 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123456 |
+-------------------------------+-----------------------------------------+
after (round up, keep consistent with mysql):
+-------------------------------+-----------------------------------------+
| generated_string | cast(generated_string as DATETIMEV2(6)) |
+-------------------------------+-----------------------------------------+
| 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123457 |
+-------------------------------+-----------------------------------------+
1 row in set (0.03 sec)
same work with #30744 but implemented on BE
2024-02-21 19:18:45 +08:00
eb5e6a829a
[fix](nereids)should normalize window expression by bottom project's output ( #31115 )
2024-02-21 19:18:45 +08:00
8d889e434b
[fix](topn) Fix key topn block reverse is missed in some cases ( #31199 )
...
* move reverse block row order operation after _next_batch_internal
* add testcase
2024-02-21 19:18:45 +08:00
e14bcbd947
[test](auto partition)add auto partitions p2 case ( #31202 )
2024-02-21 19:18:45 +08:00
8fc9d80479
[compatibility](MySQL) update charset to utf8mb4, collation to utf8mb4_0900_bin ( #31046 )
...
Doris's behaviour is more like utf8mb4 and utf8mb4_0900_bin than utf8 and utf8_general_ci
2024-02-21 17:01:39 +08:00
f1fbfeba2f
[fix](nereids) removeRuntimeFilter() removes more than one RFs if there are different types of RF from the buildNode to the target ( #31197 )
...
this bug can be produced on tpcds 95, when set runtime filter type: min-max + bloom
2024-02-21 17:01:39 +08:00
49411a3139
[fix](testcase) enable multi_thread_load auto partition test in p1 group ( #31085 )
...
enable multi_thread_load auto partition test in p1 group
2024-02-21 17:01:30 +08:00
98106ad60f
[fix](nereids) fix bug of unnest subuqery with having clause ( #31152 )
...
1. run PushDownFilterThroughAggregation, PushDownFilterThroughProject and MergeFilters before subquery unnesting
2. should keep plan unchanged even left semi join's condition is true (because the right table may be empty())
3. PushDownFilterThroughProject need check if filter's input slots are all coming from project's output
2024-02-21 17:01:30 +08:00
1abe9d4384
[fix](memory) Fix LRU cache stale sweep ( #31122 )
...
Remove LRUCacheValueBase, put last_visit_time into LRUHandle, and automatically update timestamp to last_visit_time during cache insert and lookup.
Do not rely on external modification of last_visit_time, which is often forgotten.
2024-02-21 17:01:29 +08:00
18955174e9
Fix analyze mv and mtmv p0 case. ( #31191 )
2024-02-21 17:01:19 +08:00
a8d8c6a271
[fix](file-writer) opt s3 file writer and fix empty file related issue #28983 #30703 #31169 ( #31213 )
...
* (feature)(cloud) Use dynamic allocator instead of static buffer pool for better elasticity. (#28983 )
* [fix](outfile) Fix unable to export empty data (#30703 )
Issue Number: close #30600
Fix unable to export empty data to hdfs / S3, this behavior is inconsistent with version 1.2.7,
version 1.2.7 can export empty data to hdfs/ S3, and there will be exported files on S3/HDFS.
* [fix](file-writer) avoid empty file for segment writer (#31169 )
---------
Co-authored-by: AlexYue <yj976240184@gmail.com >
Co-authored-by: zxealous <zhouchangyue@baidu.com >
2024-02-21 16:48:54 +08:00
33925a738d
[improvement](schemachange) add schema change log ( #31145 ) ( #31203 )
2024-02-21 14:15:02 +08:00
c27692fb3b
[Enhancement](jdbc catalog) Add security check on driver when creating Jdbc Catalog ( #31153 )
2024-02-21 13:53:40 +08:00
a4f9eec810
[chore](third-party) Link protobuf with zlib statically ( #31173 )
...
We should link protobuf with libz.a explicitly, otherwise protoc may not be executable due to the missing libz.1.dylib.
2024-02-21 13:53:39 +08:00
f121ee907f
[fix](invert index) fix the inaccurate rows_inverted_index_filtered in the profile ( #31158 )
2024-02-21 13:53:39 +08:00
728b12cfdf
[regression-test](point query) make test stable ( #31140 )
2024-02-21 13:53:32 +08:00
278b232e76
[Bug](json reader) object should stop processing when encounter error ( #31159 )
...
If DATA_QUALITY_ERROR encountered we should stop processing this document any more.Otherwise there will be UB in simdjson.
2024-02-21 13:53:32 +08:00
8b6d6d0165
[pipelineX](refactor) refactor streaming agg structure ( #31151 )
2024-02-21 13:53:32 +08:00
cd7230885f
[fix](nereids)push more than one runtime filters into cte ( #30901 )
...
* push rf into cte, used by tpcds95
2024-02-21 13:53:32 +08:00
c734e79d14
[docs](docs) fix doc MySQL Load format ( #30182 )
...
* chore: fix doc MySql Load format
* chore: modify mysql-load-manual.md
* chore: modify to MySQL
2024-02-21 13:53:32 +08:00
1e3968fe7e
[fix](group_commit) Need to wait wal to be deleted when creating MaterializedView ( #30956 )
2024-02-21 13:53:19 +08:00
ccac4208e1
[fix](regression test) fix test_dynamic_partition_with_alter #31154
2024-02-21 13:53:19 +08:00
69c7750db2
[Improment](executor)Create workload thread pool without cgroup #31170
2024-02-21 13:53:18 +08:00
1d6dc9a5f0
[fix](catalog recycle bin) Forbid recover partition if table schame is changed #31146
2024-02-21 13:53:18 +08:00
872e1f6687
[fix](backup) fix concurrent upload and release snapshot crash ( #31144 )
...
In upload implementation, filesystem::size throws an exception
if the specified file, which is removed by the release snapshot
task, does not exist.
2024-02-21 13:53:18 +08:00
27ae96c5d0
[fix](case) adjust case if running on muti BEs ( #31160 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2024-02-21 13:53:18 +08:00
e2514c950c
Fix load stats cache FE ut case. ( #31162 )
2024-02-21 13:53:18 +08:00
7c1bb4cb22
[fix](docs) add joinHint.md to sidebars ( #31155 )
2024-02-21 13:53:18 +08:00
87b5ed187e
Fix hive p2 case ( #31149 )
2024-02-21 13:53:18 +08:00
99cdbc7e12
[fix](memory) Fix jemalloc lib name for thirdparty arrow ( #28843 )
...
after #28429
2024-02-21 13:52:10 +08:00
