caa7af3d1f
[Metric] Standardise histogram metric output for prometheus ( #5671 )
...
Update histogram metric's output to prometheus standard, the output
like following:
test_registry_task_duration{quantile="0.50"} 50
test_registry_task_duration{quantile="0.75"} 75
test_registry_task_duration{quantile="0.90"} 95.8333
test_registry_task_duration{quantile="0.95"} 100
test_registry_task_duration{quantile="0.99"} 100
test_registry_task_duration_sum 5050
test_registry_task_duration_count 100
2021-04-20 09:14:28 +08:00
2b7d7e3385
fix typo ( #5652 )
2021-04-20 09:13:56 +08:00
d74c2b7092
update README.md about the version of docker image ( #5653 )
...
Co-authored-by: weizuo <weizuo@xiaomi.com >
2021-04-20 09:13:43 +08:00
bf4159c74d
Remove unused keyword ( #5676 )
2021-04-20 09:11:45 +08:00
b4a4c29651
( #5638 ) stale rowset can't be access after clone finish ( #5639 )
...
* (#5638 ) stale rowset can't be access after clone finish
* clear stale rowset after clone
2021-04-19 09:27:41 +08:00
4313639157
[Metric] Add metrics for routine load ( #5641 )
...
* [Metric] Add metrics for routine load
Add following metrics for routine load:
doris_fe_job{job="load", type="ROUTINE_LOAD", state="NEED_SCHEDULE"} 0
doris_fe_job{job="load", type="ROUTINE_LOAD", state="RUNNING"} 1
doris_fe_job{job="load", type="ROUTINE_LOAD", state="PAUSED"} 0
doris_fe_job{job="load", type="ROUTINE_LOAD", state="STOPPED"} 0
doris_fe_job{job="load", type="ROUTINE_LOAD", state="CANCELLED"} 0
* change UTC
2021-04-19 09:26:58 +08:00
6be03f339c
[Bug] Fix bug that tablets are not dropped when replacing tables ( #5627 )
...
When replacing table with swap = false, the origin table's tablets
should be removed from tablet inverted index.
Co-authored-by: xxiao2018 <benghua3_1@sina.com >
2021-04-19 09:26:19 +08:00
6f000c2ea4
( #5621 ) using KeyMayExist instead of Get when visit rocksdb ( #5622 )
2021-04-19 09:25:59 +08:00
b6c0767754
[Bug] Fix alter table failed when none of new load jobs succeed on alter replica ( #5617 )
...
* [Bug] Fix alter table failed when none of new load jobs succeed on altering replica
Co-authored-by: caiconghui <caiconghui@xiaomi.com >
2021-04-15 15:55:57 +08:00
892fbf6ded
Update s3_reader_test.cpp ( #5658 )
2021-04-15 10:59:30 +08:00
c4cc681d14
remove boost_foreach, using c++ foreach instead ( #5611 )
2021-04-15 10:52:29 +08:00
50ffae44b1
[BUG] Fix bug that Unique/AGG key will read all key columns when there are two rowsets ( #5632 )
2021-04-14 00:12:05 +08:00
9403157da4
[DOC] Add docs of warning of Docker env 1.3 of JDK 11 and some doc of FE config. ( #5628 )
2021-04-14 00:10:30 +08:00
489aae5021
[Doc] Update README.md about gcc version ( #5624 )
...
`BE`code can compile pass using `GCC 7.3.0`, but compiling `BE UT`code will encounter error using `GCC 7.3.0`. After upgrade gcc version to `10.2.1` which is the same version as in docker image, `BE UT` can be compiled successfully.
2021-04-14 00:10:08 +08:00
bb98c08489
[LICENSE] Remove unused font file and fix license ( #5642 )
...
* remove unused font file and fix license
2021-04-13 14:21:38 +08:00
70b0d113e1
fix license header ( #5630 )
2021-04-13 11:01:29 +08:00
75db273b93
[Doris On ES][WIP] Support external ES table with SSL secured and configurable node sniffing ( #5325 )
...
Support external ES table with `SSL` secured and configurable node sniffing
2021-04-12 11:23:49 +08:00
91043bb116
[BuildEnv] Update Dockerfile add libasan ( #5616 )
2021-04-11 22:02:49 +08:00
a25e3afa5b
[Colocate plan][Step1] Colocate join covers more situations ( #5521 )
...
The old colocate join can only cover the case where the child is hash or scan.
In fact, as long as the child's data distribution meets the requirements,
no matter what the plan node on the child node is, a colocate join can be performed.
2021-04-11 22:02:03 +08:00
9c7d8d2e98
[Bug] Fix bug that isPreAggregation is incorrectly set ( #5608 )
...
1. The MaterializedViewSelector should be reset for each scan node
2. On the BE side, columns with delete conditions must be added to the return column.
2021-04-09 14:13:06 +08:00
40f53ac71f
fix bitmap unit test failed ( #5610 )
2021-04-08 10:25:59 +08:00
2b5e4dc951
Add fmt library to speed up mysql text result serialization ( #5554 )
...
* Add fmt library to speed up mysql text result serialization
* use BUILD_SYSTEM instead of make
Co-authored-by: gaodayue <gaodayue@bytedance.com >
2021-04-08 09:16:58 +08:00
b423274f17
[Enhance] Make MemTracker more accurate ( #5515 ) ( #5516 )
...
* [Enhance] Make MemTracker more accurate (#5515 )
This PR main about:
1. Improve the readability of MemTrackers' name
2. Add the MemTracker of:
* Load
* Compaction
* SchemaChange
* StoragePageCache
* TabletManager
3. Change SchemaChange to a Singleon
* revise some code for Code Review
* change the name of mem_tracker
* keep reader_context have the same lifetime of rowset_reader in schema change.
* change vlog notice to log(warning) in schema change
2021-04-08 09:14:55 +08:00
514d245a1f
make like predicate operator public ( #5552 )
...
Co-authored-by: wangxixu <wangxixu@xiaomi.com >
2021-04-08 09:14:15 +08:00
904a2ac86a
[Bug] keytab file maybe not thread-safe ( #5578 )
...
* make keytab file thread-safe
* remove delte file code
Co-authored-by: wangxixu <wangxixu@xiaomi.com >
2021-04-08 09:12:45 +08:00
5a0a039026
[refacor] Remove minizip source code ( #5571 )
2021-04-08 09:12:22 +08:00
d641a26490
[Refactor] Remove boost filesystem ( #5579 )
...
* use std::filesystem instead of boost
Co-authored-by: Mingyu Chen <morningman.cmy@gmail.com >
2021-04-08 09:11:59 +08:00
1e8c4584ab
[Function] Add BE udf bitmap_min ( #2538 ) ( #5581 )
...
this function will return the min result of the input bitmap .
2021-04-08 09:11:32 +08:00
3e34fe2529
[FE] [BUG] GroupingFunctionCallExpr: realChildren should be copied too. ( #5584 )
2021-04-08 09:11:11 +08:00
771cb64290
Solve the situation that the hardware information of the Web UI home page cannot be loaded ( #5585 )
...
Solve the situation that the hardware information of the Web UI home page cannot be loaded
Co-authored-by: zhangjf@shuhaisc.com <zhangfeng800729>
2021-04-08 09:10:56 +08:00
79544d39cb
[Metrics][LOG] Update metrics of 'max_compaction_score' and log for compaction ( #5592 )
...
* optimize compaction metrics and log
Co-authored-by: weizuo <weizuo@xiaomi.com >
2021-04-08 09:10:40 +08:00
621c89f7b9
[Enhance] Filter all non-journal db when getting journal db names ( #5605 )
2021-04-08 09:09:56 +08:00
bef2904f28
[Refactor] refactor the destructor in olap_meta.cpp ( #5563 )
2021-04-06 22:28:04 +08:00
18c2553ef8
[FE][Bug] Update Spark version to fix a security issue ( #5593 )
...
Fix CVE-2020-9480: Apache Spark RCE vulnerability in
auth-enabled standalone master
https://spark.apache.org/security.html#CVE-2020-9480
2021-04-06 11:02:04 +08:00
862a189570
update readme.md ( #5596 )
...
Co-authored-by: weizuo <weizuo@xiaomi.com >
2021-04-06 11:00:40 +08:00
5012fdc049
[FE][Fix]Update commons-collections to fix a security issue ( #5595 )
...
Fix CVE-2017-15708
https://www.cvedetails.com/cve/CVE-2017-15708/
2021-04-06 11:00:19 +08:00
68303ea7f3
[FE][Bug]Update log4j-web to fix a security issue ( #5594 )
...
Fix CVE-2017-5645
In Apache Log4j 2.x before 2.8.2, when using the
TCP socket server or UDP socket server to receive
serialized log events from another application, a
specially crafted binary payload can be sent that,
when deserialized, can execute arbitrary code.
https://www.cvedetails.com/cve/CVE-2017-5645/
2021-04-06 10:59:40 +08:00
05487e38ae
[Bug] upgrade log4j version from 2.12.1 to 2.14.0 to fix performance issue in JDK11 using ZGC ( #5591 )
...
Co-authored-by: caiconghui <caiconghui@xiaomi.com >
2021-04-06 10:59:08 +08:00
dce66c7329
[bug-fix] Fix cluster property in hadoop/broker load ( #5587 )
...
The cluster property has been removed from load stmt which is incorrect. It caused user could not create hadoop/broker load.
Fix #5586
2021-04-02 11:54:46 +08:00
0490b156c8
[Bug] Fix bug that call frontend service failed when rpc_timeout is equal with publish_timeout ( #5564 )
...
* [Bug] Fix bug that call frontend service failed when rpc_timeout is equal with publish_timeout
*This PR is to fix bug that call frontend service failed when rpc_timeout is equal with publish_timeout and fix some small issues with log
Co-authored-by: caiconghui [蔡聪辉] <caiconghui@xiaomi.com >
2021-03-30 19:50:42 +08:00
08bfd1c762
[Bug] Fix some problem with downloading and building thirdparty ( #5439 )
2021-03-30 10:47:45 +08:00
e2c702c959
remove some unused file for compatible to older kernels ( #5568 )
2021-03-29 11:32:59 +08:00
1ddaac7832
[Compaction] Optimize cumulative compaction point calculate when after restart be ( #5561 )
...
This pr is to reduce a large number of useless cumulative compactions caused by
cumulative compaction point calculation problems after be restarts.
2021-03-27 18:59:50 +08:00
a56e7e2192
[Refactor] make uint24_t,OLAPIndexFixedHeader as a POD type ( #5559 )
2021-03-27 18:59:23 +08:00
86af8c76a3
[DOC] Add docs of load and export using S3 protocol ( #5551 )
...
Add docs of load and export using S3 protocol
2021-03-27 18:58:29 +08:00
ce015b364a
[Enhance] Support to show more details for 'SHOW TABLES' ( #5520 )
...
Support to show more details for 'SHOW TABLES', it's useful for thirdparty monitoring systems.
2021-03-27 18:58:14 +08:00
09879a2927
[DOC] Update gcc10 compile docs ( #5566 )
...
* update docs of gcc10
* update docs
* update docs
2021-03-26 09:34:21 +08:00
ad67dd34a0
update gcc to gcc 10 and support c++17 ( #5394 )
...
* update gcc to gcc 10 and support c++17
update brpc to 0.9.7
update boost to 1.73
remove third-party boost 1.54 for mysql
* update cmake version
* ignore jdk version
* remove unused patch
* avoid use SYS_getrandom call
2021-03-25 09:30:38 +08:00
23bd4a959a
remove some links that contians indecent content ( #5560 )
2021-03-24 11:56:49 +08:00
fa9e5c18dc
[FE] Improve StreamLoadPlanner error log. ( #5549 )
2021-03-24 09:33:08 +08:00
