486cf0ebd4
* [Schema Change] support fast add/drop column (#49) * [feature](schema-change) support fast schema change. coauthor: yixiutt * [schema change] Using columns desc from fe to read data. coauthor: Lchangliang * [feature](schema change) schema change optimize for add/drop columns. 1.add uniqueId field for class column. 2.schema change for add/drop columns directly update schema meta Co-authored-by: yixiutt <yixiu@selectdb.com> Co-authored-by: SWJTU-ZhangLei <1091517373@qq.com> [Feature](schema change) fix write and add regression test (#69) Co-authored-by: yixiutt <yixiu@selectdb.com> [schema change] be ssupport that delete use newest schema add delete regression test fix regression case (#107) tmp [feature](schema change) light schema change exclude rollup and agg/uniq/dup key type. [feature](schema change) fe olapTable maxUniqueId write in disk. [feature](schema change) add rpc iface for sc add column. [feature](schema change) add columnsDesc to TPushReq for ligtht sc. resolve the deadlock when schema change (#124) fix columns from fe don't has bitmap_index flag (#134) add update/delete case construct MATERIALIZED schema from origin schema when insert fix not vectorized compaction coredump use segment cache choose newest schema by schema version when compaction (#182) [bugfix](schema change) fix ligth schema change problem. [feature](schema change) light schema change add alter job. (#1) fix be ut [bug] (schema change) unique drop key column should not light schema change [feature](schema change) add schema change regression-test. fix regression test [bugfix](schema change) fix multi alter clauses for light schema change. (#2) [bugfix](schema change) fix multi clauses calculate column unique id (#3) modify PushTask process (#217) [Bugfix](schema change) fix jobId replay cause bdbje exception. [bug](schema change) fix max col unique id repeatitive. (#232) [optimize](schema change) modify pendingMaxColUniqueId generate rule. fix compaction error * fix be ut * fix snapshot load core fix unique_id error (#278) [refact](fe) remove redundant code for light schema change. (#4) [refact](fe) remove redundant code for light schema change. (#4) format fe core format be core fix be ut modify fe meta version fix rebase error flush schema into rowset_meta in old table [refactor](schema change) refact fe light schema change. (#5) delete the change of schemahash and support get max version schema * modify for review * fix be ut * fix schema change test
87 lines
3.2 KiB
C++
87 lines
3.2 KiB
C++
// Licensed to the Apache Software Foundation (ASF) under one
|
|
// or more contributor license agreements. See the NOTICE file
|
|
// distributed with this work for additional information
|
|
// regarding copyright ownership. The ASF licenses this file
|
|
// to you under the Apache License, Version 2.0 (the
|
|
// "License"); you may not use this file except in compliance
|
|
// with the License. You may obtain a copy of the License at
|
|
//
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
//
|
|
// Unless required by applicable law or agreed to in writing,
|
|
// software distributed under the License is distributed on an
|
|
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
// KIND, either express or implied. See the License for the
|
|
// specific language governing permissions and limitations
|
|
// under the License.
|
|
|
|
#include "olap/base_tablet.h"
|
|
|
|
#include "gutil/strings/substitute.h"
|
|
#include "olap/data_dir.h"
|
|
#include "util/doris_metrics.h"
|
|
#include "util/path_util.h"
|
|
#include "util/storage_backend_mgr.h"
|
|
|
|
namespace doris {
|
|
|
|
extern MetricPrototype METRIC_query_scan_bytes;
|
|
extern MetricPrototype METRIC_query_scan_rows;
|
|
extern MetricPrototype METRIC_query_scan_count;
|
|
|
|
BaseTablet::BaseTablet(TabletMetaSharedPtr tablet_meta, const StorageParamPB& storage_param,
|
|
DataDir* data_dir)
|
|
: _state(tablet_meta->tablet_state()),
|
|
_tablet_meta(tablet_meta),
|
|
_storage_param(storage_param),
|
|
_schema(tablet_meta->tablet_schema()),
|
|
_data_dir(data_dir) {
|
|
_gen_tablet_path();
|
|
|
|
std::stringstream ss;
|
|
ss << _tablet_meta->tablet_id() << "." << _tablet_meta->schema_hash() << "."
|
|
<< _tablet_meta->tablet_uid().to_string();
|
|
_full_name = ss.str();
|
|
|
|
_metric_entity = DorisMetrics::instance()->metric_registry()->register_entity(
|
|
strings::Substitute("Tablet.$0", tablet_id()),
|
|
{{"tablet_id", std::to_string(tablet_id())}}, MetricEntityType::kTablet);
|
|
INT_COUNTER_METRIC_REGISTER(_metric_entity, query_scan_bytes);
|
|
INT_COUNTER_METRIC_REGISTER(_metric_entity, query_scan_rows);
|
|
INT_COUNTER_METRIC_REGISTER(_metric_entity, query_scan_count);
|
|
}
|
|
|
|
BaseTablet::~BaseTablet() {
|
|
DorisMetrics::instance()->metric_registry()->deregister_entity(_metric_entity);
|
|
}
|
|
|
|
Status BaseTablet::set_tablet_state(TabletState state) {
|
|
if (_tablet_meta->tablet_state() == TABLET_SHUTDOWN && state != TABLET_SHUTDOWN) {
|
|
LOG(WARNING) << "could not change tablet state from shutdown to " << state;
|
|
return Status::OLAPInternalError(OLAP_ERR_META_INVALID_ARGUMENT);
|
|
}
|
|
_tablet_meta->set_tablet_state(state);
|
|
_state = state;
|
|
return Status::OK();
|
|
}
|
|
|
|
void BaseTablet::_gen_tablet_path() {
|
|
if (_data_dir != nullptr && _tablet_meta != nullptr) {
|
|
_tablet_path = fmt::format("{}/{}/{}/{}/{}", _data_dir->path(), DATA_PREFIX, shard_id(),
|
|
tablet_id(), schema_hash());
|
|
}
|
|
}
|
|
|
|
bool BaseTablet::set_tablet_schema_into_rowset_meta() {
|
|
bool flag = false;
|
|
for (RowsetMetaSharedPtr rowset_meta : _tablet_meta->all_mutable_rs_metas()) {
|
|
if (!rowset_meta->get_rowset_pb().has_tablet_schema()) {
|
|
rowset_meta->set_tablet_schema(&_schema);
|
|
flag = true;
|
|
}
|
|
}
|
|
return flag;
|
|
}
|
|
|
|
} /* namespace doris */
|