777c9a4060
[typo](comment) Translate the code comments of gensrc ( #8308 )
2022-03-05 14:39:16 +08:00
450273cfc2
[typo]update spark build doc ( #8333 )
...
[typo]update spark build doc (#8333 )
2022-03-05 12:30:56 +08:00
0383001442
[Enhancement] Support Skipping compaction lower replica where select queryable replica for better scan performance ( #8146 )
2022-03-05 09:51:50 +08:00
46ca23f216
[Feature] Support Changing the bucketing mode of the table from Hash Distribution to Random Distribution ( #8259 )
...
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-03-04 09:05:23 +08:00
0ee53be883
[fix][improvement](runtime-filter) fix string type length limit error && add runtime filter decimal support ( #8282 )
2022-03-03 22:44:49 +08:00
538df28737
[improvement](routine-load) Support routine load task succeed with empty data consumed ( #8256 )
2022-03-03 22:35:50 +08:00
80e88159d9
[improvement](restore) allow query on part of partitions when others are in RESTORE ( #8245 )
2022-03-03 22:34:10 +08:00
e7c417505c
[fix] fix hash table insert() may be failed but not handle this error ( #8207 )
2022-03-03 22:33:05 +08:00
c56a372e06
[improvement][fix](grouping-set)(tablet-repair) optimize compaction too slow replica process, ( #8123 )
...
1. optimize compaction too slow replica process, will set to ok if the replica compaction is done.
And will not set bad if more than half replica is too slow,
2. fix field in grouping_id() is not the same name will cause error lile `select list expression not produced by
aggregation output (missing from GROUP BY clause?): id`
2022-03-03 22:30:35 +08:00
f5ab0553ff
[chore] remove some ut temp files and add some file to .gitignore ( #8309 )
2022-03-03 13:23:27 +08:00
f622ce0497
[refactor] remove types_test ( #8289 )
...
* [refactor] remove types_test
1. remove types_test, it will cause core dump in higher version GCC or
clang, because of memory align, some code will be vectorized in higher
GCC or clang
2. Change string type length to 2 GB instead of -1
3. modify inaccessible code
2022-03-03 09:31:35 +08:00
8be71b69d5
[refactor] remove pusher.cpp and related mock test code ( #8288 )
2022-03-03 09:30:54 +08:00
18098c5ceb
[fix](fe-ut) Fix FE unit test ( #8293 )
...
Fix following ut:
1. GlobalTransactionMgrTest
2. BackupJobTest
3. ReplicaTest
4. SparkLoadJobTest
Also remove old FE Meta version
2022-03-03 09:30:17 +08:00
09bfb8b9d3
[fix] (rpc-udf) Fixed the problem that the query could not be interrupted ( #8248 )
...
if an error occurred in the rpc server during the execution of rpc-udf.
Add java,cpp,python demo of rpc-udf server
2022-03-03 09:30:03 +08:00
114eb19518
[fix](ut) query stmt test error ( #8303 )
2022-03-03 09:29:42 +08:00
246ac4e37a
[fix] fix a bug of encryption function with iv may return wrong result ( #8277 )
2022-03-02 17:26:44 +08:00
b40e9144cb
[feature-wip][array-type] Refactor type info for nested array. ( #8279 )
2022-03-02 14:20:39 +08:00
b241bc4e9d
[fix][Vectorized] Fix exchange node merge sort null first order wrong ( #8291 )
2022-03-02 10:19:06 +08:00
efe88be087
[docs] Fix a typo in downloads.md ( #8274 )
2022-03-02 10:18:18 +08:00
77b21fba03
[chore] make options of build.sh and run-be-ut.sh work ( #8271 )
...
The h option of build.sh and j option of run-be-ut.sh do not work
in the docker with image
apache/incubator-doris:build-env-ldb-toolchain-latest.
2022-03-02 10:17:50 +08:00
f41316a3ec
[fix](fold-constant)(hive) fix constant-folding in order by and optimize logs in hive client ( #8268 )
...
fix : #7509
1. fix order by clause constant folding
2. optimize Hive exception message
3. change hive file status log type
2022-03-02 10:17:17 +08:00
315bfe2d0e
Revert "[chore](dependency) upgrade-grpc-version ( #8218 )" ( #8250 )
...
This reverts commit df7e848cbbc8170c7bd83d812d7cac58b5574570.
Reverts apache/incubator-doris#8218
Because when using grpc 1.44.1, the corresponding `protoc-gen-grpc-java` plugin
requried GLIBC_2.14, which is not found in CentOS 6.
So I suggest to revert this commit this time. And considering upgrading this component
after most systems have reached glibc version 2.14.
And for Mac M1, you may have to change this version manually for now
2022-03-02 10:16:25 +08:00
d5b6428c6d
[improvement] Upgrade MySQL version to 5.7.37 to reduce unnecessary CVE issues ( #8247 )
2022-03-02 10:16:02 +08:00
236105daa0
[feature][show-transaction] Support view transactions info for specified status by SHOW TRANSACTION stmt ( #8156 )
...
SHOW TRANSACTION WHERE STATUS = 'prepare/precommitted/committed/visible/aborted';
2022-03-02 10:14:42 +08:00
5cc62fa166
[docs] fix document date-time-functions typo ( #8053 )
...
1. en: add convert_tz.md
2. en: fix curdate.md, the fix is to modify the title
3. en: add curtime.md
4. en: fix str_to_date.md, the fix is to modify the title
5. zh-CN: fix convert_tz.md, the fix is to modify the description
6. zh-CN: fix curdate.md, the fix is to modify the title
2022-03-02 10:07:44 +08:00
940efc6014
[Fix]Remove duplicated destructor function in MinMaxFuncBase ( #8287 )
2022-03-01 18:38:09 +08:00
2b9b0fc1ec
[Fix] Function percentile input null return null ( #8238 )
2022-03-01 14:42:48 +08:00
ada39dd9ad
[improvement][vec] better memequal impl to speed up string compare ( #8229 )
...
like #8214
faster string compare operator in vec engine.
2022-03-01 11:25:12 +08:00
93c638f3a2
[fix][chore](insert)(fe) Fix analysis error of insert stmt and modify grpc-netty dependency ( #8265 )
...
This bug is introduced from #8112 .
Also , I change the `grpc-netty` dependency to `grpc-netty-shaded`, to avoid dependency conflict:
```
java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.
```
2022-03-01 11:12:10 +08:00
757e35744d
[refactor] remove unused new_in_predicate code ( #8263 )
...
remove unused code of new_in_predicate.h/cpp
2022-03-01 11:11:42 +08:00
7d0e36a054
[fix](be-ut) fix bitmap_ut result wrong && fix schema_change compile error ( #8261 )
2022-03-01 11:11:02 +08:00
0fce094080
[typo] fix listdb description error ( #8257 )
...
Co-authored-by: zhaolipan <zhaolipan@shizhuang-inc.com >
2022-03-01 11:08:34 +08:00
13f007bfd5
[doc] Modify document of compilation on ARM64 ( #8254 )
2022-03-01 11:05:18 +08:00
e77e2b0bf0
[improvement](lateral-view) Add number rows filtered in profile ( #8251 )
...
Add `RowsFiltered` counter in TableFunctionNode profile.
So that we can know the total number of rows that TableFunctionNode processed
2022-03-01 11:04:57 +08:00
01365f1a1d
[community] add more collaborators in .asf.yaml ( #8029 ) ( #8252 )
...
Add following 2 collaborators:
zuochunwei
thomascai126
2022-02-28 17:49:11 +08:00
27d2e3e949
[refactor](fe) Remove old fe meta version ( #8246 )
...
Remove old FE meta version < 100.
2022-02-28 17:47:01 +08:00
c66a9bf64b
[fix](be-ut) fix unit test bug for tablet_info_test ( #8253 )
...
introduced from #8041
2022-02-27 10:44:20 +08:00
7f3564cca6
[chore] Support aarch64 target with ldb_toolchain ( #8249 )
2022-02-27 10:38:17 +08:00
351fbbcba5
[fix](olap) add check statement to protect get_dict_word_info() from crash ( #8241 )
...
check _num_elems firstly at the beginning of get_dict_word_info for safe
2022-02-26 17:05:58 +08:00
30fbf1da68
[typo](doc)fix some confusing doc content ( #8239 )
2022-02-26 17:05:08 +08:00
385ccf7c8a
[fix](routine-load) fix show routine load task error ( #8195 )
2022-02-26 17:04:39 +08:00
87b96cfcd6
[feature](iceberg) Step3: Support query iceberg external table ( #8179 )
...
1. Add Iceberg scan node
2. Add Iceberg/Hive table type in thrift
3. Support querying Iceberg tables of format types `parquet` and `orc`
2022-02-26 17:04:11 +08:00
668188b91f
[improvement][vectorized] support es node predicate peel ( #8174 )
2022-02-26 17:02:54 +08:00
83521a826a
[Feature](create_table) Support create table with random distribution to avoid data skew ( #8041 )
...
In some scenarios, users cannot find a suitable hash key to avoid data skew, so we need to provide an additional data distribution for olap table to avoid data skew
example:
CREATE TABLE random_table
(
siteid INT DEFAULT '10',
citycode SMALLINT,
username VARCHAR(32) DEFAULT '',
pv BIGINT SUM DEFAULT '0'
)
AGGREGATE KEY(siteid, citycode, username)
DISTRIBUTED BY random BUCKETS 10
PROPERTIES("replication_num" = "1");
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-02-26 10:38:55 +08:00
a630e037b9
[Enhancement](routine_load) Support show routine load statement with like predicate ( #8188 )
...
* [Enhancement](routine_load) Support show routine load with like predicate
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-02-26 10:35:38 +08:00
40c1fa2335
[refactor] change mysql server version to avoid some cve issues ( #8223 )
...
5.1.0 -> 5.1.73
2022-02-25 11:14:57 +08:00
f7c18d300c
[Improvement] Add minimum fe meta version check ( #8203 )
...
There are many old codes in FE for old FE meta version such as `if (FeMetaVersion < VERSION_45) xxxxx`,
but the latest FE meta version is 107, these code maybe never reached,
but we do not remove these code because "sometimes" there are old code.
Add minimum required version check to allow us remove these old codes.
2022-02-25 11:14:00 +08:00
cce721ad5b
[improvement](olap) using placement-new to avoid dynamic mallocing for ParsedPage ( #8172 )
...
use C++ placement-new feature to save consuming, placement-new can separate
mallocing from constructing.
2022-02-25 11:09:53 +08:00
ddf08cc207
[refactor](fe) Remove version hash on FE side ( #8099 )
...
version hash is not used any more
2022-02-25 11:08:29 +08:00
6f4cf57b17
[Bug][Vectorized] Fix bug of decimal cast to double loss precision ( #8221 )
...
Co-authored-by: lihaopeng <lihaopeng@baidu.com >
2022-02-25 11:04:11 +08:00
