Alluxio编译

来源:互联网 发布:mac添加pdf虚拟打印机 编辑:程序博客网 时间:2024/06/11 05:41

Alluxio的二进制发布包,是依赖于具体的hadoop版本的,截至本文撰写时,直接下载的alluxio二进制安装包是对应于hadoop 2.2.0的,如果你的hadoop基础环境不是这个版本,那就需要根据实际情况,下载alluxio源码,执行编译,进而制作出实际可用的安装文件。

下面就概要说明alluxio的整个编译过程和编译成果物的确认。


其他更多关于Alluxio的使用和交流,请加QQ群讨论:
Alluxio-China 452894882


一、准备工作:

1. 保证你的编译环境是Linux系列(Linux或者是Mac OS X),如果你是Windows系统,可以使用虚拟机解决方案。

2. 保证你的编译环境的OS是可以联网的(编译时候需要依赖包下载和其他网络通讯)

3. 安装Java7或者以上版本的JDK

4. 安装Maven

5. 安装Git(如果你是直接下载源码包的方式,此项可选)


二、编译开始:


1. 从github克隆(git clone)Alluxio源码(并切换到你想要编译的版本号)

git clone git://github.com/alluxio/alluxio.gitcd alluxiogit checkout v1.4.0


2. 执行编译

根据你的hadoop基础环境中hadoop的版本号,来设定Alluxio工程中的<hadoop.version>属性值,比如你的环境中部署的是Hadoop2.6.5,请将alluxio工程跟目录下的pom文件中的<hadoop.version>2.2.0</hadoop.version>修改为<hadoop.version>2.6.5</hadoop.version>,保存后执行如下命令:

mvn clean package -DskipTests


另一种方式,不需要修改上述pom文件,可直接执行如下命令:

mvn -Dhadoop.version=2.6.5 clean package -DskipTests


编译成功后,你会看到如下信息:

[INFO] Installing /home/admin/alluxio/integration/fuse/target/alluxio-integration-fuse-1.4.0-javadoc.jar to /data/maven/repository/org/alluxio/alluxio-integration-fuse/1.4.0/alluxio-integration-fuse-1.4.0-javadoc.jar[INFO] ------------------------------------------------------------------------[INFO] Reactor Summary:[INFO] [INFO] Alluxio Parent ..................................... SUCCESS [  4.600 s][INFO] Alluxio Core ....................................... SUCCESS [  1.055 s][INFO] Alluxio Core - Common Utilities .................... SUCCESS [ 47.298 s][INFO] Alluxio Under File System .......................... SUCCESS [  0.541 s][INFO] Alluxio Under File System - Local FS ............... SUCCESS [  5.021 s][INFO] Alluxio Under File System - HDFS ................... SUCCESS [  5.221 s][INFO] Alluxio Under File System - Gluster FS ............. SUCCESS [  4.898 s][INFO] Alluxio Under File System - Aliyun OSS ............. SUCCESS [  4.583 s][INFO] Alluxio Under File System - Swift .................. SUCCESS [  5.133 s][INFO] Alluxio Under File System - S3 ..................... SUCCESS [  5.829 s][INFO] Alluxio Under File System - S3A .................... SUCCESS [  5.709 s][INFO] Alluxio Under File System - GCS .................... SUCCESS [  5.355 s][INFO] Alluxio Core - Client .............................. SUCCESS [ 24.055 s][INFO] Alluxio Core - Server .............................. SUCCESS [ 36.202 s][INFO] Alluxio Key Value .................................. SUCCESS [  0.497 s][INFO] Alluxio Key Value - Common Utilities ............... SUCCESS [ 10.604 s][INFO] Alluxio Key Value - Client ......................... SUCCESS [  7.401 s][INFO] Alluxio Key Value - Server ......................... SUCCESS [  6.708 s][INFO] Alluxio Shell ...................................... SUCCESS [  7.800 s][INFO] Alluxio Examples ................................... SUCCESS [  7.095 s][INFO] Alluxio MiniCluster ................................ SUCCESS [  5.587 s][INFO] Alluxio Tests ...................................... SUCCESS [  1.636 s][INFO] Alluxio Integration ................................ SUCCESS [  0.493 s][INFO] Alluxio Assemblies ................................. SUCCESS [  6.896 s][INFO] Alluxio Integration - FUSE ......................... SUCCESS [ 10.288 s][INFO] ------------------------------------------------------------------------[INFO] BUILD SUCCESS[INFO] ------------------------------------------------------------------------[INFO] Total time: 03:40 min[INFO] Finished at: 2017-01-16T17:05:16+08:00[INFO] Final Memory: 148M/776M[INFO] ------------------------------------------------------------------------



3. 查看编译成果物

编译成功后,你会在assembly/target目录下看到alluxio-assemblies-1.4.0-jar-with-dependencies.jar,core/client/target目录下看到 alluxio-core-client-1.4.0-jar-with-dependencies.jar

assembly/├── pom.xml├── README.md├── src│   └── main│       └── assembly│           └── alluxio-dist.xml└── target    ├── alluxio-assemblies-1.4.0.jar    ├── alluxio-assemblies-1.4.0-jar-with-dependencies.jar    ├── checkstyle-cachefile    ├── checkstyle-checker.xml    ├── checkstyle-result.xml    ├── checkstyle-suppressions.xml    ├── javadoc-bundle-options    │   └── javadoc-options-javadoc-resources.xml    └── maven-archiver        └── pom.properties


core/client/├── pom.xml├── src│   ├── main│   │   ├── java│   │   │   └── alluxio│   │   └── resources│   │       └── META-INF│   └── test│       ├── java│       │   └── alluxio│       └── resources│           └── log4j.properties└── target    ├── alluxio-core-client-1.4.0.jar    ├── alluxio-core-client-1.4.0-jar-with-dependencies.jar    ├── alluxio-core-client-1.4.0-javadoc.jar    ├── alluxio-core-client-1.4.0-sources.jar    ├── alluxio-core-client-1.4.0-tests.jar    ├── apidocs    │   ├── allclasses-frame.html    │   ├── allclasses-noframe.html    │   ├── alluxio    │   │   ├── client    │   │   └── hadoop    │   ├── constant-values.html    │   ├── deprecated-list.html    │   ├── help-doc.html    │   ├── index-all.html    │   ├── index.html    │   ├── overview-frame.html    │   ├── overview-summary.html    │   ├── overview-tree.html    │   ├── package-list    │   ├── script.js    │   └── stylesheet.css    ├── checkstyle-cachefile    ├── checkstyle-checker.xml    ├── checkstyle-result.xml    ├── checkstyle-suppressions.xml    ├── classes    │   ├── alluxio    │   │   ├── client    │   │   └── hadoop    │   └── META-INF    │       └── services    ├── findbugs-exclude.xml    ├── findbugs.xml    ├── findbugsXml.xml    ├── generated-sources    │   └── annotations    ├── generated-test-sources    │   └── test-annotations    ├── javadoc-bundle-options    │   ├── javadoc-options-javadoc-resources.xml    │   └── package-list    ├── maven-archiver    │   └── pom.properties    ├── maven-status    │   └── maven-compiler-plugin    │       ├── compile    │       └── testCompile    └── test-classes        ├── alluxio        │   ├── client        │   └── hadoop        └── log4j.propertie


至此,你已经完成了Alluxio的源码编译,接下来就可以执行安装配置和启动过程。

0 0