Files

FreeOnePlus 34e64fbea9 [doc]Add ARM architecture compilation tutorial content (#9535 )

Co-authored-by: manyi <fop@freeoneplus.com>

2022-05-13 10:24:19 +08:00

22 KiB

Raw Blame History

Apache Doris ARM architecture compiled

本文档介绍如何在 ARM64 平台上编译 Doris。

注意，该文档仅作为指导性文档。在不同环境中编译可能出现其他错误。

KylinOS

Software and hardware environment

KylinOS Version：

$> cat /etc/.kyinfo
name=Kylin-Server
milestone=10-SP1-Release-Build04-20200711
arch=arm64
beta=False
time=2020-07-11 17:16:54
dist_id=Kylin-Server-10-SP1-Release-Build04-20200711-arm64-2020-07-11 17:16:54

CPU Model:

$> cat /proc/cpuinfo
model name  : Phytium,FT-2000+/64

Compile with ldb-toolchain

This method works for Doris versions after commit 7f3564.

Download ldb_toolchain_gen.aarch64.sh

For the subsequent compilation method, please refer to Compile with LDB toolchain

Note that both jdk and nodejs need to download the corresponding aarch64 version:

CentOS & Ubuntu

Hardware Environment

System version: CentOS 8.4, Ubuntu 20.04
System Architecture: ARM X64
CPU: 4C
Memory: 16 GB
Hard disk: 40GB (SSD), 100GB (SSD)

Software Environment

Software environment comparison table

component name	component version
Git	2.0+
JDK	1.8.0
Maven	3.6.3
NodeJS	16.3.0
LDB-Toolchain	0.9.1
常备环境： byacc patch automake libtool make which file ncurses-devel gettext-devel unzip bzip2 zip util-linux wget git python2	yum or apt can be installed automatically
autoconf	2.69
bison	3.0.4

Software environment installation command

CentOS 8.4

Create software download and installation package root directory and software installation root directory

# Create the root directory of the software download and installation package
mkdir /opt/tools
# Create software installation root directory
mkdir /opt/software

Git

# Save the trouble of compiling and install directly with yum
yum install -y git

JDK8

# Two ways, the first is to save additional download and configuration, directly use yum to install, install the devel package to get some tools, such as the jps command
yum install -y java-1.8.0-openjdk java-1.8.0-openjdk-devel

# The second is to download the installation package of the arm64 architecture, decompress and configure the environment variables and use
cd /opt/tools
wget https://doris-thirdparty-repo.bj.bcebos.com/thirdparty/jdk-8u291-linux-aarch64.tar.gz && \
tar -zxvf jdk-8u291-linux-aarch64.tar.gz && \
mv jdk1.8.0_291 /opt/software/jdk8

Maven

cd /opt/tools
# After the wget tool is downloaded, directly decompress the configuration environment variable to use
wget https://dlcdn.apache.org/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && \
tar -zxvf apache-maven-3.6.3-bin.tar.gz && \
mv apache-maven-3.6.3 /opt/software/maven

NodeJS

cd /opt/tools
# Download the installation package for arm64 architecture
wget https://doris-thirdparty-repo.bj.bcebos.com/thirdparty/node-v16.3.0-linux-arm64.tar.xz && \
tar -xvf node-v16.3.0-linux-arm64.tar.xz && \
mv node-v16.3.0-linux-arm64 /opt/software/nodejs

LDB-Toolchain

cd /opt/tools
# Download LDB-Toolchain ARM version
wget https://github.com/amosbird/ldb_toolchain_gen/releases/download/v0.9.1/ldb_toolchain_gen.aarch64.sh && \
sh ldb_toolchain_gen.aarch64.sh /opt/software/ldb_toolchain/

Configure environment variables

# Configure environment variables
vim /etc/profile.d/doris.sh
export JAVA_HOME=/opt/software/jdk8
export MAVEN_HOME=/opt/software/maven
export NODE_JS_HOME=/opt/software/nodejs
export LDB_HOME=/opt/software/ldb_toolchain
export PATH=$JAVA_HOME/bin:$MAVEN_HOME/bin:$NODE_JS_HOME/bin:$LDB_HOME/bin:$PATH

# save and exit and refresh environment variables
source /etc/profile.d/doris.sh

# test for success
java -version
> java version "1.8.0_291"
mvn -version
> Apache Maven 3.6.3
node --version
> v16.3.0
gcc --version
> gcc-11

Install other extra environments and components

# install required system packages
sudo yum install -y byacc patch automake libtool make which file ncurses-devel gettext-devel unzip bzip2 bison zip util-linux wget git python2

# install autoconf-2.69
cd /opt/tools
wget http://ftp.gnu.org/gnu/autoconf/autoconf-2.69.tar.gz && \
    tar zxf autoconf-2.69.tar.gz && \
    mv autoconf-2.69 /opt/software/autoconf && \
    cd /opt/software/autoconf && \
    ./configure && \
    make && \
    make install

Ubuntu 20.04

Update apt-get repository
```
apt-get update
```
Check the shell command set

Ubuntu's shell installs dash instead of bash by default. It needs to be switched to bash to execute. Run the following command to view the details of sh and confirm which program corresponds to the shell:
```
ls -al /bin/sh
```
The shell can be switched back to bash by:
```
sudo dpkg-reconfigure dash
```
Then select no or no and confirm

Doing so will reconfigure dash from being the default shell tool