Fixed: privilege logic error:

1. No one can set root password expect for root user itself
    2. NODE_PRIV cannot be granted.
    3. ADMIN_PRIV and GRANT_PRIV can only be granted or revoked on *.*
    4. No one can modifly privs of default role 'operator' and 'admin'.
    5. No user can be granted to role 'operator'.
Fixed: the running load limit should not be applied to replay logic. It will cause replay or loading image fail.
Changed: optimize the problem of too many directories under mini load directory.
Fixed: missing password and auth check when handling mini load request in Frontend.
Fixed: DomainResolver should start after Frontends transfer to a certain ROLE, not in Catalog construction methods.
Fixed: a stupid bug that no one can set password for root user... fix it: only root user can set password for root.
Fixed: read null data twice
    When reading data with a null value, in some cases, the same data will be read twice by the storage engine,
    resulting in a wrong result.The reason for this problem is that when splitting,
    and the start key is the minimum value, the data with null is read.
Fixed: add a flag to prevent DomainResovler thread start twice.
Fixed: fixed a mem leak of using ByteBuf when parsing auth info of http request.
Fixed: add a new config 'disable_hadoop_load', default is false, set to true to disable hadoop load.
Changed: add detail error msg of submitting hadoop load job in show load result.
Fixed: Backend process should be crashed if failed to saving header.
Added: exposure backend info to user when encounter error on Backend. for debugging it more convenient.
Fixed: Should remove fd from map when inputstream or outputstream is closed in Broker process.
Fixed: Change all files' LF to unix format.

Internal commit id: merge from dfcd0aca18eed9ff99d188eb3d01c60d419be1b8
This commit is contained in:
morningman
2018-10-01 19:58:41 +08:00
parent ae19fbfc8b
commit 65fe7f65c1
220 changed files with 20004 additions and 20022 deletions

View File

@ -38,7 +38,6 @@
#include "util/debug_util.h"
#include "agent/cgroups_mgr.h"
#include "common/resource_tls.h"
#include "olap/olap_reader.h"
#include <boost/variant.hpp>
using llvm::Function;
@ -573,8 +572,8 @@ Status OlapScanNode::split_scan_range() {
for (auto sub_range : sub_ranges) {
VLOG(1) << "SubScanKey=" << (sub_range.begin_include ? "[" : "(")
<< OlapScanKeys::to_print_key(sub_range.begin_scan_range)
<< " : " << OlapScanKeys::to_print_key(sub_range.end_scan_range) <<
<< sub_range.begin_scan_range
<< " : " << sub_range.end_scan_range <<
(sub_range.end_include ? "]" : ")");
_query_key_ranges.push_back(sub_range);
_query_scan_ranges.push_back(scan_range);
@ -957,8 +956,8 @@ bool OlapScanNode::select_scan_range(boost::shared_ptr<PaloScanRange> scan_range
}
Status OlapScanNode::get_sub_scan_range(
boost::shared_ptr<PaloScanRange> scan_range,
std::vector<OlapScanRange>* sub_range) {
boost::shared_ptr<PaloScanRange> scan_range,
std::vector<OlapScanRange>* sub_range) {
std::vector<OlapScanRange> scan_key_range;
RETURN_IF_ERROR(_scan_keys.get_key_range(&scan_key_range));
@ -970,10 +969,8 @@ Status OlapScanNode::get_sub_scan_range(
sub_range->resize(1);
}
} else {
EngineMetaReader olap_meta_reader(scan_range);
RETURN_IF_ERROR(olap_meta_reader.open());
if (!olap_meta_reader.get_hints(
if (!EngineMetaReader::get_hints(
scan_range,
config::palo_scan_range_row_count,
_scan_keys.begin_include(),
_scan_keys.end_include(),
@ -986,8 +983,6 @@ Status OlapScanNode::get_sub_scan_range(
sub_range->resize(1);
}
}
RETURN_IF_ERROR(olap_meta_reader.close());
}
return Status::OK;