179b933ccc
[test](regression) update some case in p2 ( #20683 )
2023-06-16 10:09:22 +08:00
c3e6db827c
[typo][docs] remove unuse config mysql_service_nio_enabled ( #20862 )
2023-06-16 09:58:33 +08:00
40050a46ca
[fix](java-udf)Fix cannot download pentaho-aggdesigner-algorithm jar in java udf and format it ( #20013 )
2023-06-16 09:40:48 +08:00
9daa277b0d
[typo](doc) Fix the description of the alter-table-partition document ( #20800 )
2023-06-15 21:27:59 +08:00
71aba93e19
[typo](doc) spark connector add new param and a way to write bitmap and hll col ( #20850 )
2023-06-15 21:27:37 +08:00
835a1e8af9
[typo](doc)delete document optimization ( #20748 )
2023-06-15 21:22:43 +08:00
6d4c16b497
[typo](doc) Fix formatting errors in CREATE-TABLE documents due to line indentation ( #20839 )
2023-06-15 21:22:01 +08:00
b38417358b
[chore](compile) Remove fs/benchmark/fs_benchmark_tool.cpp in IO_FILES ( #20845 )
2023-06-15 21:16:59 +08:00
f1af09ef87
[Enhancement](merge-on-write) parallel calculate delete bitmap when tablet has multi segments ( #20706 )
2023-06-15 21:11:39 +08:00
e4e4f11b14
[typo](docs) Optimize the JDBC Catalog document ( #20861 )
2023-06-15 21:09:22 +08:00
21bb7fea07
[minor](Nereids): convert if condition into a check ( #20855 )
2023-06-15 20:10:56 +08:00
4bfceb7acb
[Bug](pipeline) fix pipeline task call finish_p_dependency more than once ( #20851 )
...
fix pipeline task call finish_p_dependency more than once
When pipeline task meet eos->PENDING_FINISH->CANCELED, this task will call finish_p_dependency twice.
2023-06-15 19:21:40 +08:00
11e164e7a5
[typo](doc) Added a description of inconsistent results ( #20849 )
2023-06-15 17:17:24 +08:00
bb5d36c5cb
[Log](load) change VLOG to INFO when write replica failing ( #20783 )
2023-06-15 16:11:14 +08:00
37f8334811
[Bug](GA)fix the wrong job dependencies ( #20846 )
2023-06-15 15:57:57 +08:00
b6835840f7
[Bug](table-function) return InvalidArgument when explode_split meet empty delimiter ( #20795 )
...
return InvalidArgument when explode_split meet empty delimiter
2023-06-15 15:17:22 +08:00
d9b3c2aba2
[improvement](jdbc) support support get mysql information_schema's table and clickhouse system's table ( #20768 )
2023-06-15 14:53:51 +08:00
01e53f4e67
[Bug](materialized-view) fix problems about create mv on ssb_flat q4.1 failed ( #20658 )
...
fix problems about create mv on ssb_flat q4.1 failed
2023-06-15 14:38:21 +08:00
e031ead53a
[test](regression) support ccr regression ( #20818 )
...
add CI base conf to support ccr regression
2023-06-15 14:25:09 +08:00
15b9830859
[fix](partial-update) sequence column is not proceeded correctly #20813
...
When checking the keys in PrimaryKeyIndex, seq_col_length is not set to correct value, then we got a NOT_FOUND result for an existing key.
2023-06-15 14:07:00 +08:00
17a395f5e3
[Bug](runtime-filter) fix runtime filter not register on vdata_gen_scan_node ( #20787 )
...
fix runtime filter not register on vdata_gen_scan_node
2023-06-15 14:06:14 +08:00
2151f5d04d
[fix](bitmap) fix bug: incorrect orthogonal bitmap result in some cases ( #20819 ) ( #20822 )
...
Issue Number: close #20819
If there is only one aggregation (update finalize) phase, result field will not be updated.
This pr is aim to resolve it.
2023-06-15 14:05:24 +08:00
5b6761acb8
[enhencement](streamload) add on_close callback for httpserver ( #20826 )
...
Sometimes connection cannot be released properly during on_free. We need
on_close callback as the last resort.
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-06-15 13:44:02 +08:00
0dc1b50b5a
[Feature](GA)Latest-Master-Code-Check ( #20786 )
2023-06-15 13:05:43 +08:00
9716b87e36
[typo](docs) Update doris-future.md ( #20817 )
...
Change doris to Doris
2023-06-15 11:51:13 +08:00
5df7459435
[Community](links)Update join slack links ( #20816 )
2023-06-15 11:49:40 +08:00
4b18cde0c7
[Update](clucene) synchronize clucene version to improve clcuene performance ( #20794 )
...
Improve clucene performance by zero copy memory and SIMD string compare.
Related PR: apache/doris-thirdparty#87
2023-06-15 10:35:51 +08:00
1ce8f13837
[fix](memory) fix mem tracker in NodeChannel rpc callback ( #20779 )
2023-06-15 10:35:25 +08:00
5c4f6b4ca9
[fix](MOW)Fix publish timeout when enable MOW ( #20828 )
2023-06-15 10:34:20 +08:00
31c17f1088
[improvement](tvf)Support hdfs and s3 tvf for nereids ( #20829 )
...
Support hdfs and s3 tvf for nereids.
2023-06-15 10:30:09 +08:00
4bf15b9788
[fix](load) fix race condition problem when insert commitinfo ( #20823 )
...
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com >
2023-06-15 09:53:32 +08:00
71e8cb061c
[Log](query) Add log of fragment instance num for query ( #20597 )
...
Co-authored-by: weizuo <weizuo@xiaomi.com >
2023-06-15 09:52:13 +08:00
d8a38f8128
[community](action) modify auto trigger teamcity script ( #19095 )
2023-06-15 09:33:46 +08:00
460399f214
[fix](profile) remove same profile in join node ( #20734 )
2023-06-15 08:08:39 +08:00
2a2e485456
[Enhancement](compaction) time-series scenario cumulative compaction policy ( #20715 )
...
new compaction policy for log and time-series scenario
2023-06-14 23:48:44 +08:00
09d187ec77
[improvement](ck jdbc) Optimized reading of datetime and ip types of the ClickHouse JDBC Catalog ( #20804 )
2023-06-14 23:28:08 +08:00
bb617ee2cc
[fix](parquet-reader)fix page v2 header offset ( #20814 )
...
fix page v2 header offset.
get correct offset when read next page in file.
2023-06-14 23:27:31 +08:00
f82e43b96a
[Improvement](jdbc external table)Support jdbc external table for nereids. ( #20799 )
...
Nereids planner only support JDBC external catalog, this pr is to support JDBC external table for nereids.
2023-06-14 23:25:43 +08:00
4bee226698
[fix](regression-test) fix compile test_vertical_compaction_agg_keys failed ( #20792 )
...
fix compile test_vertical_compaction_agg_keys failed.
2023-06-14 23:25:17 +08:00
7ed03f6b86
[fix](Nereids) EmptySetRelation should be Gather not Any ( #20801 )
2023-06-14 19:24:33 +08:00
3c6a27daf0
[community](github) required at least 2 approval ( #20797 )
...
Make `Need_2_Approval` check as required.
After this PR merged, all PRs need at least 2 approvals to merge.
One must be committer, the other can be anyone.
2023-06-14 18:40:03 +08:00
3727483c06
[Chore](build) update ldb_toolchain to v0.18 ( #20802 )
...
* update ldb_toolchain to v0.18
* update
2023-06-14 18:38:35 +08:00
0ecc98df82
[Bug](rowset) expire delayed rowsets should be ignored and should not be deleted in _tablet_meta ( #20803 )
2023-06-14 18:30:13 +08:00
31a4f96f01
[refactor](exprcontext) move close to expr context's dector method ( #20747 )
...
The close method does nothing. But I am not sure we could remove it. So that I add it to dector method and remove many many calls.
2023-06-14 18:01:07 +08:00
b97537b04b
[Fix](MOW) Fix load data publish timeout when enable unique key MOW ( #20720 )
2023-06-14 17:56:02 +08:00
615778924e
[feature](fs) add fs benchmark tool framework ( #20770 )
...
Add an optional executable binary fs_benchmark_tool, for test the performance of file system such as hdfs, s3.
Usage:
./fs_benchmark_tool --conf my.conf --fs_type=s3 --operation=read --iterations=5
in my.conf, you can add any config key value with following format:
key1=value1
key2=value2
By default, this binary will not be built. Only build it when setting BUILD_FS_BENCHMARK=ON.
The binary will be installed in output/be/lib.
For developer, you can add new subclass of BaseBenchmark to add your own benchmark.
See be/src/io/fs/benchmark/s3_benchmark.hpp for an example
2023-06-14 17:50:06 +08:00
a0d4f11667
[Bug](function) catch error state in function cast to avoid core dump ( #20751 )
...
catch error state in function cast to avoid core dump
2023-06-14 17:34:34 +08:00
1c9f107185
[feature](nereids) support match syntax ( #20781 )
...
Support match syntax in nereids.
match syntax use like:
```sql
select * from test where msg match "hello";
select * from test where msg match_any "hello";
select * from test where msg match_all "hello hi";
select * from test where msg match_phrase "hello world";
```
`match` is same as `match_any`.
the pr of match syntax in original planner: https://github.com/apache/doris/pull/14211
2023-06-14 17:30:27 +08:00
d922a4a9fa
[Feature-WIP](inverted index) add inverted index file size method ( #20758 )
...
This PR calculates the size of the inverted index files. The changes consist of:
Introduction of a new get_inverted_index_size() method in different column writers such as ScalarColumnWriter, StructColumnWriter, ArrayColumnWriter, and MapColumnWriter. This method will fetch the size of the inverted index file associated with that column. If the file size cannot be fetched, it defaults to 0.
A new method file_size() has been added in InvertedIndexColumnWriter class which retrieves the size of the file stored on disk. If the file size cannot be fetched, it logs an error and returns -1.
Additionally, a new method get_inverted_index_file_size() is introduced in SegmentWriter which aggregates the inverted index file sizes of all the column writers.
2023-06-14 17:18:20 +08:00
dd5b82fe00
[Enhancement](merge-on-write) optimize contains_agg when calculate delete bitmap ( #20762 )
2023-06-14 16:25:11 +08:00
