转载：
hadoop-2.5.0源码编译
第一步：解压hadoop-2.5.0-src.tar.gz至/opt/modules/目录下
[[email protected] hadoop-2.5.0]$ tar -zxvf /opt/softwares/hadoop-2.5.0-src.tzr.gz -C /opt/modules
[[email protected] hadoop-2.5.0]$ tar -zxvf /opt/softwares/jdk-7u67-linux-x64.tar.gz -C /opt/modules
第三步：配置java环境变量
export JAVA_HOME=/opt/modules/jdk1.7.0_67 export JRE_HOME=$JAVA_HOME/jre export PATH=$PATH:$JAVA_HOME/bin:JRE_HOME/bin
[[email protected] hadoop-2.5.0]# source /etc/profile [[email protected] hadoop-2.5.0]# su - qianxin [[email protected] hadoop-2.5.0]$ java -version java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
第四步：安装MAVEN、配置MAVEN环境变量
[[email protected] hadoop-2.5.0]$ tar -zxvf /opt/softwares/apache-maven-3.0.5-bin.tar.gz -C /opt/modules [[email protected] hadoop-2.5.0]$ su - root [[email protected] hadoop-2.5.0]# vi /etc/profile [[email protected] hadoop-2.5.0]# source /etc/profile [[email protected] hadoop-2.5.0]# su - qianxin [[email protected] hadoop-2.5.0]$ mvn -version Apache Maven 3.0.5 (r01de14724cdef164cd33c7c8c2fe155faf9602da; 2013-02-19 21:51:28+0800) Maven home: /opt/modules/apache-maven-3.0.5 Java version: 1.7.0_67, vendor: Oracle Corporation Java home: /opt/modules/jdk1.7.0_67/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "2.6.32-431.el6.x86_64", arch: "amd64", family: "unix"
第五步：安装gcc/gcc-c++/make
[[email protected] hadoop-2.5.0]$ su - root [[email protected] hadoop-2.5.0]# yum -y install gcc gcc-c++ [[email protected] hadoop-2.5.0]# yum install make
第六步：解压安装protobuf
[[email protected] hadoop-2.5.0]$ tar -zxvf protobuf-2.5.0.tar.gz -C /opt/modules/ [[email protected] hadoop-2.5.0]$ cd /opt/modules/protobuf-2.5.0/ [[email protected] protobuf-2.5.0]$ ./configure --prefix=/usr/local/protoc [[email protected] protobuf-2.5.0]$ make [[email protected] protobuf-2.5.0]$ su - root [[email protected] ~]# cd /opt/modules/protobuf-2.5.0 [[email protected] protobuf-2.5.0]# make install
第七步：配置protobuf环境变量
[[email protected] hadoop-2.5.0]$ sudo vim /etc/profile [[email protected] hadoop-2.5.0]$ su - root [[email protected] ~]# source /etc/profile [[email protected] ~]# su - qianxin [[email protected] hadoop-2.5.0]$ protoc --version libprotoc 2.5.0
第八步：下载安装CMake、openssl、ncurses
[[email protected] ~]$ su - root [[email protected] ~]# yum install cmake [[email protected] ~]# yum install openssl-devel [[email protected] ~]# yum install ncurses-devel
第九步：添加配置镜像
路径：/opt/modules/apache-maven-3.0.5/conf/setting.xml
第十步：开始编译hadoop源码包
[[email protected] ~]$ cd /opt/modules/hadoop-2.5.0-src/ [[email protected] ~]$ mvn package -DskipTests -Pdist,native
等待10分钟左右，即可看到以下编译成功的信息：
用编译后/opt/modules/hadoop-2.5.0-src/hadoop-dist/target/hadoop-2.5.0/lib目录下新的native文件夹，替换/opt/modules/hadoop-2.5.0/lib目录下旧的native文件夹即可解决执行hdfs相关命令时报的警告：
原文链接：https://www.2cto.com/net/201609/548976.html