参考:https://www.linuxidc.com/Linux/2018-03/151491.htm
一、环境准备
1.三台虚拟机
2.操作系统:Centos7 64位
3.Cloudera Manager:5.14.1 https://archive.cloudera.com/cm5/cm/5/cloudera-manager-centos7-cm5.14.1_x86_64.tar.gz
4.CDH:5.14.0 http://archive.cloudera.com/cdh5/parcels/5.14.0/
下载三个文件
5.JDK1.8
二、配置准备
1、网络配置
vi /etc/sysconfig/network
vi /etc/hosts
cdh1 cdh2 cdh3
2、SSH免**登录
ssh-****** -t rsa
ssh-copy-id
3、防火墙关闭
systemctl stop firewalld.service
systemctl disable firewalld.service
4、SELINUX关闭
setenforce 0
vi /etc/selinux/config (SELINUX=disabled)
5、安装JDK配置环境变量
export JAVA_HOME=/usr/java/jdk1.7.0_67
export PATH=$JAVA_HOME/bin:$PATH
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
6、安装NTP
设置开机启动 chkconfig ntpd on
设置时间同步
ntpdate 202.120.2.101
7、安装配置mysql
wget http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm
rpm -ivh mysql-community-release-el7-5.noarch.rpm
yum update
yum install mysql-server
mysqld --initialize
systemctl start mysqld
mysqladmin -u root password "root";
GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'root' WITH GRANT OPTION;
flush privileges;
8、下载第三方依赖包
yum install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb -y
三、Cloudera 安装
mkdir /opt/cloudera-manager
tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager
2、创建用户cloudera-scm
useradd --system --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm
3、配置CM Agent
修改文件/opt/cloudera-manager/cm-5.14.1/etc/cloudera-scm-agent/config.ini中server_host
4、配置CM Server数据库
拷贝mysql jar文件到目录 /usr/share/java/
注意jar包名称要修改为mysql-connector-java.jar
cd /opt/cloudera-manager/cm-5.14.1/share/cmf/schema/
./scm_prepare_database.sh mysql temp -h cdh1 -uroot -proot --scm-host cdh1 scm scm scm
格 式:数据库类型、数据库、数据库服务器、用户名、密码、cm server服务器
5、创建Parcel目录
Server节点
mkdir -p /opt/cloudera/parcel-repo
chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo
Agent节点
mkdir -p /opt/cloudera/parcels 三个节点都执行
chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
6、制作CDH本地源
下载好文件CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel、CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel.sha以及manifest.json,将这两个文件放到server节点的/opt/cloudera/parcel-repo下。
7、将/opt/cloudera-manager拷贝到另外两个节点
8、启动CM Server、Agent
cd /opt/cloudera-manager/cm-5.14.1/etc/init.d/
./cloudera-scm-server start
Sever首次启动会自动创建表以及数据,不要立即关闭或重启,否则需要删除所有表及数据重新安装
./cloudera-scm-agent start