ambari本地源自动化安装

ambari本地源自动化安装hortonworks hadoop

环境配置

Hostname	IP	OS
Ambari	192.168.174.174	Centos X64 base install
Maste.hadoop	192.168.174.175	Centos X64 base install
Datanode1.hadoop	192.168.174.176	Centos X64 base install

操作系统建议以software server 方式安装，base 方式安装后，需要安装Development tools，本文以base举例。

一：制作ambari，hadoop本地源

首先需要有一台能够联网的linux机器

1：网络源制作ambari（1.4.1.25）本地源

wget http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/1.4.1.25/ambari.repo

cp ambari.repo /etc/yum.repos.d/
ambari本地源自动化安装

将网络源中的包同步到本地：

reposync -r HDP-UTILS-1.1.0.16

reposync -r Updates-ambari-1.4.1.25

reposync -r ambari-1.x

会得到相应的三个目录，每个目录中有相应的rpm包

准备一台http服务器，本文以172.16.235.164作为http服务器发布安装源

mkdir /var/www/html/ambari

将 HDP-UTILS-1.1.0.16 Updates-ambari-1.4.1.25 ambari-1.x复制到 /var/www/html/ambari下

cd /var/www/html/ambari

createrepo ./ #没有createrepo命令自己去安装

这样ambari安装源就做好了，下载好jdk-6u31-linux-x64.bin备用

2：准备hortonworks hadoop （HDP）2.0.6本地源

准备HDP网络源

vim /etc/yum.repos.d/HDP.repo，添加以下内容

[HDP-2.0.6]

name=HDP

baseurl=http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.0.6.0

enabled=1

gpgcheck=0

ambari本地源自动化安装

同步网络源到本地：

reposync -r HDP-2.0.6 #将近1G

讲 HDP-2.0.6 复制到http server的/var/www/html/hdp下

cd /var/www/html/hdp

createrepo ./

这样hadoop的本地源就做好了

3：制作系统本地源（安装ambari和hadoop时，可能会依赖些系统包，这时需要有系统的本地源来安装）

http server 挂载系统光盘

mount /dev/cdrom /var/www/html/centos/

如果已经本地已经挂载无需操作

4：JDK安装

tar -zxvf jdk-7u55-linux-x64.gz 安装jdk包

export JAVA_HOME=/jdk/jdk1.7.0_55 环境变量添加

export PATH=$JAVA_HOME/bin:$PATH 执行变量

source /etc/profile 配置立即生效

[[email protected] jdk]# java –version 查看java版本

java version "1.7.0_55"

Java(TM) SE Runtime Environment (build 1.7.0_55-b13)

Java HotSpot(TM) 64-Bit Server VM (build 24.55-b03, mixed mode)

二：安装ambari

系统准备：关闭iptables、selinux,启动ntpd服务

[[email protected] ]vim /etc/hosts

192.168.174.174 ambari

192.168.174.175 master.hadoop

192.168.174.176 datanode1.hadoop

配置与所有主机的无密码登入

[[email protected] .ssh]# ssh-****** -t rsa #一路回车（所有主机都要执行）

Generating public/private rsa key pair.

Enter file in which to save the key (/root/.ssh/id_rsa):

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

Your identification has been saved in /root/.ssh/id_rsa.

Your public key has been saved in /root/.ssh/id_rsa.pub.

The key fingerprint is:

7a:9c:b2:af:27:ad:10:56:b3:d8:1d:f3:37:77:96:0b [email protected]

The key's randomart image is:

+--[ RSA 2048]----+

| |

| o o |

| + + + .|

| + o S . oE..o|

| . . o . . o.o.|

| . o.+ . |

| ..+o |

| +*. |

+-----------------+

[[email protected] .ssh]# ssh-copy-id -i /root/.ssh/id_rsa.pub [email protected]

[email protected]'s password:

Now try logging into the machine, with "ssh '[email protected]'", and check in:

.ssh/authorized keys

to make sure we haven't added extra keys that you weren't expecting.

[[email protected] .ssh]# ssh wxl02

Last login: Mon Aug 1 01:57:44 2016 from wxl01

[[email protected] ~]# exit

logout

Connection to wxl02 closed.

本地安装与配置ambari服务：

[[email protected] ]vim /etc/yum.repos.d/ambari.repo 添加以下内容

[ambari-1.x]

name=Ambari 1.x

baseurl=file:///var/www/html/ambari/

gpgcheck=0

enabled=1

[HDP-UTILS-1.1.0.16]

name=Hortonworks Data Platform Utils Version - HDP-UTILS-1.1.0.16

baseurl=file:///var/www/html/ambari/

gpgcheck=0

enabled=1

[Updates-ambari-1.4.1.25]

name=ambari-1.4.1.25 - Updates

gpgcheck=0

baseurl=file:///var/www/html/ambari/

enabled=1

[[email protected] ]vim /etc/yum.repos.d/centos.repo 添加以下内容

[centos]

name = centos

baseurl=file:///var/www/html/centos/

enabled=1

gpgcheck=0

[[email protected] ]vim /etc/yum.repos.d/HDP.repo 添加以下内容

[HDP-2.0.6]

name=HDP

baseurl=file:///var/www/html/hdp

path=/

enabled=1

gpgcheck=0

4.执行安装ambari：

[[email protected] yum.repos.d]# yum -y install ambari-server

Loaded plugins: fastestmirror, security

Repository 'Updates-ambari-1.4.1.25': Error parsing config: Error parsing "gpgcheck = ''": invalid boolean value

Repository 'centos' is missing name in configuration, using id

Loading mirror speeds from cached hostfile

Setting up Install Process

Resolving Dependencies

--> Running transaction check

---> Package ambari-server.noarch 0:1.4.1.25-1 will be installed

--> Processing Dependency: postgresql-server >= 8.1 for package: ambari-server-1.4.1.25-1.noarch

--> Running transaction check

---> Package postgresql-server.x86_64 0:8.4.13-1.el6_3 will be installed

--> Processing Dependency: postgresql-libs(x86-64) = 8.4.13-1.el6_3 for package: postgresql-server-8.4.13-1.el6_3.x86_64

--> Processing Dependency: postgresql(x86-64) = 8.4.13-1.el6_3 for package: postgresql-server-8.4.13-1.el6_3.x86_64

--> Processing Dependency: libpq.so.5()(64bit) for package: postgresql-server-8.4.13-1.el6_3.x86_64

--> Running transaction check

---> Package postgresql.x86_64 0:8.4.13-1.el6_3 will be installed

---> Package postgresql-libs.x86_64 0:8.4.13-1.el6_3 will be installed

--> Finished Dependency Resolution

Dependencies Resolved

====================================================================================================================================

Package Arch Version Repository Size

====================================================================================================================================

Installing:

ambari-server noarch 1.4.1.25-1 HDP-UTILS-1.1.0.16 37 M

Installing for dependencies:

postgresql x86_64 8.4.13-1.el6_3 centos 2.8 M

postgresql-libs x86_64 8.4.13-1.el6_3 centos 200 k

postgresql-server x86_64 8.4.13-1.el6_3 centos 3.4 M

Transaction Summary

====================================================================================================================================

Install 4 Package(s)

Total download size: 43 M

Installed size: 88 M

Downloading Packages:

(1/4): ambari-server-1.4.1.25-1.noarch.rpm | 37 MB 00:00

(2/4): postgresql-server-8.4.13-1.el6_3.x86_64.rpm | 3.4 MB 00:00

(3/4): postgresql-libs-8.4.13-1.el6_3.x86_64.rpm | 200 kB 00:00

(4/4): postgresql-8.4.13-1.el6_3.x86_64.rpm | 2.8 MB 00:00

------------------------------------------------------------------------------------------------------------------------------------

Total 43 MB/s | 43 MB 00:00

Running rpm_check_debug

Running Transaction Test

Transaction Test Succeeded

Running Transaction

Installing : postgresql-libs-8.4.13-1.el6_3.x86_64 1/4

Installing : postgresql-8.4.13-1.el6_3.x86_64 2/4

Installing : postgresql-server-8.4.13-1.el6_3.x86_64 3/4

Installing : ambari-server-1.4.1.25-1.noarch 4/4

Verifying : postgresql-server-8.4.13-1.el6_3.x86_64 1/4

Verifying : postgresql-libs-8.4.13-1.el6_3.x86_64 2/4

Verifying : ambari-server-1.4.1.25-1.noarch 3/4

Verifying : postgresql-8.4.13-1.el6_3.x86_64 4/4

Installed:

ambari-server.noarch 0:1.4.1.25-1

Dependency Installed:

postgresql.x86_64 0:8.4.13-1.el6_3 postgresql-libs.x86_64 0:8.4.13-1.el6_3 postgresql-server.x86_64 0:8.4.13-1.el6_3

Complete!

5.开始配置ambari 服务：

首先上传jdk文件

[[email protected] ]cd /var/lib/ambari-server/resources 将jdk-6u31-linux-x64.bin上传到该目录

[[email protected] resources]# chmod +x jdk-6u31-linux-x64.bin

[[email protected] yum.repos.d]# ambari-server setup

Using python /usr/bin/python2.6

Initializing...

Setup ambari-server

Checking SELinux...

SELinux status is 'enabled'

SELinux mode is 'permissive'

WARNING: SELinux is set to 'permissive' mode and temporarily disabled.

OK to continue [y/n] (y)?

Customize user account for ambari-server daemon [y/n] (n)?

Adjusting ambari-server permissions and ownership...

Checking iptables...

WARNING: iptables is running. Confirm the necessary Ambari ports are accessible. Refer to the Ambari documentation for more details on ports.

OK to continue [y/n] (y)?

Checking JDK...

JDK already exists, using /var/lib/ambari-server/resources/jdk-6u31-linux-x64.bin

Installing JDK to /usr/jdk64

Successfully installed JDK to /usr/jdk64/jdk1.6.0_31

Downloading JCE Policy archive from http://public-repo-1.hortonworks.com/ARTIFACTS/jce_policy-6.zip to /var/lib/ambari-server/resources/jce_policy-6.zip

To download the JCE Policy files you must accept the license terms found at http://www.oracle.com/technetwork/java/javase/terms/license/index.htmlNot accepting will result in errors when configuring Kerberos security.

Do you accept the Oracle Binary Code License Agreement [y/n] (y)?

Successfully downloaded JCE Policy archive to /var/lib/ambari-server/resources/jce_policy-6.zip

Completing setup...

Configuring database...

Enter advanced database configuration [y/n] (n)?

Default properties detected. Using built-in database.

Checking PostgreSQL...

Running initdb: This may take upto a minute.

About to start PostgreSQL

Configuring local database...

Connecting to the database. Attempt 1...

Configuring PostgreSQL...