参考:https://www.linuxidc.com/Linux/2018-03/151491.htm

一、环境准备

1.三台虚拟机

2.操作系统:Centos7 64位

3.Cloudera Manager:5.14.1  https://archive.cloudera.com/cm5/cm/5/cloudera-manager-centos7-cm5.14.1_x86_64.tar.gz

4.CDH:5.14.0    http://archive.cloudera.com/cdh5/parcels/5.14.0/

下载三个文件

cloudera安装

5.JDK1.8

二、配置准备

1、网络配置
vi /etc/sysconfig/network
vi /etc/hosts   
cdh1 cdh2 cdh3

2、SSH免**登录

ssh-****** -t rsa

ssh-copy-id

3、防火墙关闭
systemctl stop firewalld.service
systemctl disable firewalld.service

4、SELINUX关闭
setenforce 0
vi /etc/selinux/config (SELINUX=disabled)

5、安装JDK配置环境变量
export JAVA_HOME=/usr/java/jdk1.7.0_67
export PATH=$JAVA_HOME/bin:$PATH
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

6、安装NTP
设置开机启动 chkconfig ntpd on
设置时间同步
ntpdate 202.120.2.101

7、安装配置mysql
wget http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm
rpm -ivh mysql-community-release-el7-5.noarch.rpm
yum update
yum install mysql-server
mysqld --initialize
systemctl start mysqld
mysqladmin -u root password "root";
GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'root' WITH GRANT OPTION;
flush privileges;

8、下载第三方依赖包
yum install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb -y

三、Cloudera 安装

mkdir /opt/cloudera-manager
tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager

2、创建用户cloudera-scm
useradd --system --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

3、配置CM Agent
修改文件/opt/cloudera-manager/cm-5.14.1/etc/cloudera-scm-agent/config.ini中server_host
4、配置CM Server数据库
拷贝mysql jar文件到目录 /usr/share/java/
注意jar包名称要修改为mysql-connector-java.jar


cd /opt/cloudera-manager/cm-5.14.1/share/cmf/schema/
./scm_prepare_database.sh mysql  temp  -h cdh1 -uroot -proot --scm-host cdh1 scm scm scm
                  格 式:数据库类型、数据库、数据库服务器、用户名、密码、cm server服务器

5、创建Parcel目录
Server节点
mkdir -p /opt/cloudera/parcel-repo
chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo
Agent节点
mkdir -p /opt/cloudera/parcels  三个节点都执行
chown cloudera-scm:cloudera-scm /opt/cloudera/parcels


6、制作CDH本地源
下载好文件CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel、CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel.sha以及manifest.json,将这两个文件放到server节点的/opt/cloudera/parcel-repo下。 

7、将/opt/cloudera-manager拷贝到另外两个节点

8、启动CM Server、Agent
cd /opt/cloudera-manager/cm-5.14.1/etc/init.d/
./cloudera-scm-server start
Sever首次启动会自动创建表以及数据,不要立即关闭或重启,否则需要删除所有表及数据重新安装
./cloudera-scm-agent start

 

相关文章:

  • 2022-01-06
  • 2021-08-02
  • 2021-06-03
  • 2022-12-23
  • 2022-12-23
  • 2022-12-23
  • 2021-07-08
  • 2021-09-22
猜你喜欢
  • 2022-01-28
  • 2021-05-07
  • 2022-12-23
  • 2022-12-23
  • 2021-05-02
  • 2021-10-25
相关资源
相似解决方案