b129c9901b
Main changes: 1. If fqdn is enabled in the configuration file, when fe starts, localAddr will obtain fqdn instead of IP, priority_ Networks will fail 2. The IP and host names of Backend and Front are combined into one field, host. When fqdn is enabled, it represents the host name, and when not enabled, it represents the IP address 3. The communication between clusters directly uses fqdn, and various Connection pool add authentication mechanisms to prevent the IP address of the domain name from changing and the connection between nodes from making errors 4. No longer requires polling to verify if the IP has changed, delete fqdnManager 5. Change the method of verifying the legitimacy of nodes between FEs from obtaining client IP to displaying the identity of the transmitting node itself in the HTTP request header or the message body of the throttle 6. When processing the heartbeat, if BE finds that the host stored by itself is inconsistent with the host stored by the master, after verifying the legitimacy of the host, it will change its own host instead of directly reporting an error 7. Simplify the generation logic of fe name Scope of influence: 1. Establishing communication connections between clusters 2. Determine whether it is the same node through attributes such as IP 3. Print Log 4. Information display 5. Address Splicing 6. k8s deployment 7. Upgrade compatibility Test plan: 1. Change the IP address of the node, while keeping the fqdn unchanged, change the IP addresses of fe and be, and verify whether the cluster can read and write data normally 2. Use the master code to generate metadata, and use the previous metadata on the current pr to verify whether it is compatible with the old version (upgrading is no longer supported if fqdn has been enabled before) 3. Deploy fe and be clusters using k8s to verify whether the cluster can read and write data normally 4. According to https://doris.apache.org/zh-CN/docs/dev/admin-manual/cluster-management/fqdn?_highlight=fqdn#%E6%97%A7%E9%9B%86%E7%BE%A4%E5%90%AF%E7%94%A8fqdn Upgrading old clusters 5. Use streamload to specify the fqdn of fe and be to import data separately 6. Use different users to start transactions and write data using insert statements
75 lines
2.5 KiB
C++
75 lines
2.5 KiB
C++
// Licensed to the Apache Software Foundation (ASF) under one
|
|
// or more contributor license agreements. See the NOTICE file
|
|
// distributed with this work for additional information
|
|
// regarding copyright ownership. The ASF licenses this file
|
|
// to you under the Apache License, Version 2.0 (the
|
|
// "License"); you may not use this file except in compliance
|
|
// with the License. You may obtain a copy of the License at
|
|
//
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
//
|
|
// Unless required by applicable law or agreed to in writing,
|
|
// software distributed under the License is distributed on an
|
|
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
// KIND, either express or implied. See the License for the
|
|
// specific language governing permissions and limitations
|
|
// under the License.
|
|
// This file is copied from
|
|
// https://github.com/apache/impala/blob/branch-2.9.0/be/src/util/network-util.h
|
|
// and modified by Doris
|
|
|
|
#pragma once
|
|
|
|
#include <gen_cpp/Types_types.h>
|
|
#include <sys/un.h>
|
|
|
|
#include <string>
|
|
#include <vector>
|
|
|
|
#include "common/status.h"
|
|
|
|
namespace doris {
|
|
|
|
class InetAddress {
|
|
public:
|
|
InetAddress(std::string ip, sa_family_t family, bool is_loopback);
|
|
bool is_loopback() const;
|
|
std::string get_host_address() const;
|
|
bool is_ipv6() const;
|
|
|
|
private:
|
|
std::string _ip_addr;
|
|
sa_family_t _family;
|
|
bool _is_loopback;
|
|
};
|
|
|
|
// Looks up all IP addresses associated with a given hostname. Returns
|
|
// an error status if any system call failed, otherwise OK. Even if OK
|
|
// is returned, addresses may still be of zero length.
|
|
Status hostname_to_ip_addrs(const std::string& name, std::vector<std::string>* addresses);
|
|
|
|
bool is_valid_ip(const std::string& ip);
|
|
|
|
Status hostname_to_ip(const std::string& host, std::string& ip);
|
|
|
|
// Finds the first non-localhost IP address in the given list. Returns
|
|
// true if such an address was found, false otherwise.
|
|
bool find_first_non_localhost(const std::vector<std::string>& addresses, std::string* addr);
|
|
|
|
// Sets the output argument to the system defined hostname.
|
|
// Returns OK if a hostname can be found, false otherwise.
|
|
Status get_hostname(std::string* hostname);
|
|
|
|
Status get_hosts(std::vector<InetAddress>* hosts);
|
|
|
|
// Utility method because Thrift does not supply useful constructors
|
|
TNetworkAddress make_network_address(const std::string& hostname, int port);
|
|
|
|
Status get_inet_interfaces(std::vector<std::string>* interfaces, bool include_ipv6 = false);
|
|
|
|
std::string get_host_port(const std::string& host, int port);
|
|
|
|
std::string get_brpc_http_url(const std::string& host, int port);
|
|
|
|
} // namespace doris
|