Alluxio编译
来源:互联网 发布:mac添加pdf虚拟打印机 编辑:程序博客网 时间:2024/06/11 05:41
Alluxio的二进制发布包,是依赖于具体的hadoop版本的,截至本文撰写时,直接下载的alluxio二进制安装包是对应于hadoop 2.2.0的,如果你的hadoop基础环境不是这个版本,那就需要根据实际情况,下载alluxio源码,执行编译,进而制作出实际可用的安装文件。
下面就概要说明alluxio的整个编译过程和编译成果物的确认。
一、准备工作:
1. 保证你的编译环境是Linux系列(Linux或者是Mac OS X),如果你是Windows系统,可以使用虚拟机解决方案。
2. 保证你的编译环境的OS是可以联网的(编译时候需要依赖包下载和其他网络通讯)
3. 安装Java7或者以上版本的JDK
4. 安装Maven
5. 安装Git(如果你是直接下载源码包的方式,此项可选)
二、编译开始:
1. 从github克隆(git clone)Alluxio源码(并切换到你想要编译的版本号)
git clone git://github.com/alluxio/alluxio.gitcd alluxiogit checkout v1.4.0
2. 执行编译
根据你的hadoop基础环境中hadoop的版本号,来设定Alluxio工程中的<hadoop.version>属性值,比如你的环境中部署的是Hadoop2.6.5,请将alluxio工程跟目录下的pom文件中的<hadoop.version>2.2.0</hadoop.version>修改为<hadoop.version>2.6.5</hadoop.version>,保存后执行如下命令:
mvn clean package -DskipTests
另一种方式,不需要修改上述pom文件,可直接执行如下命令:
mvn -Dhadoop.version=2.6.5 clean package -DskipTests
编译成功后,你会看到如下信息:
[INFO] Installing /home/admin/alluxio/integration/fuse/target/alluxio-integration-fuse-1.4.0-javadoc.jar to /data/maven/repository/org/alluxio/alluxio-integration-fuse/1.4.0/alluxio-integration-fuse-1.4.0-javadoc.jar[INFO] ------------------------------------------------------------------------[INFO] Reactor Summary:[INFO] [INFO] Alluxio Parent ..................................... SUCCESS [ 4.600 s][INFO] Alluxio Core ....................................... SUCCESS [ 1.055 s][INFO] Alluxio Core - Common Utilities .................... SUCCESS [ 47.298 s][INFO] Alluxio Under File System .......................... SUCCESS [ 0.541 s][INFO] Alluxio Under File System - Local FS ............... SUCCESS [ 5.021 s][INFO] Alluxio Under File System - HDFS ................... SUCCESS [ 5.221 s][INFO] Alluxio Under File System - Gluster FS ............. SUCCESS [ 4.898 s][INFO] Alluxio Under File System - Aliyun OSS ............. SUCCESS [ 4.583 s][INFO] Alluxio Under File System - Swift .................. SUCCESS [ 5.133 s][INFO] Alluxio Under File System - S3 ..................... SUCCESS [ 5.829 s][INFO] Alluxio Under File System - S3A .................... SUCCESS [ 5.709 s][INFO] Alluxio Under File System - GCS .................... SUCCESS [ 5.355 s][INFO] Alluxio Core - Client .............................. SUCCESS [ 24.055 s][INFO] Alluxio Core - Server .............................. SUCCESS [ 36.202 s][INFO] Alluxio Key Value .................................. SUCCESS [ 0.497 s][INFO] Alluxio Key Value - Common Utilities ............... SUCCESS [ 10.604 s][INFO] Alluxio Key Value - Client ......................... SUCCESS [ 7.401 s][INFO] Alluxio Key Value - Server ......................... SUCCESS [ 6.708 s][INFO] Alluxio Shell ...................................... SUCCESS [ 7.800 s][INFO] Alluxio Examples ................................... SUCCESS [ 7.095 s][INFO] Alluxio MiniCluster ................................ SUCCESS [ 5.587 s][INFO] Alluxio Tests ...................................... SUCCESS [ 1.636 s][INFO] Alluxio Integration ................................ SUCCESS [ 0.493 s][INFO] Alluxio Assemblies ................................. SUCCESS [ 6.896 s][INFO] Alluxio Integration - FUSE ......................... SUCCESS [ 10.288 s][INFO] ------------------------------------------------------------------------[INFO] BUILD SUCCESS[INFO] ------------------------------------------------------------------------[INFO] Total time: 03:40 min[INFO] Finished at: 2017-01-16T17:05:16+08:00[INFO] Final Memory: 148M/776M[INFO] ------------------------------------------------------------------------
3. 查看编译成果物
编译成功后,你会在assembly/target目录下看到alluxio-assemblies-1.4.0-jar-with-dependencies.jar,在core/client/target目录下看到 alluxio-core-client-1.4.0-jar-with-dependencies.jar
assembly/├── pom.xml├── README.md├── src│ └── main│ └── assembly│ └── alluxio-dist.xml└── target ├── alluxio-assemblies-1.4.0.jar ├── alluxio-assemblies-1.4.0-jar-with-dependencies.jar ├── checkstyle-cachefile ├── checkstyle-checker.xml ├── checkstyle-result.xml ├── checkstyle-suppressions.xml ├── javadoc-bundle-options │ └── javadoc-options-javadoc-resources.xml └── maven-archiver └── pom.properties
core/client/├── pom.xml├── src│ ├── main│ │ ├── java│ │ │ └── alluxio│ │ └── resources│ │ └── META-INF│ └── test│ ├── java│ │ └── alluxio│ └── resources│ └── log4j.properties└── target ├── alluxio-core-client-1.4.0.jar ├── alluxio-core-client-1.4.0-jar-with-dependencies.jar ├── alluxio-core-client-1.4.0-javadoc.jar ├── alluxio-core-client-1.4.0-sources.jar ├── alluxio-core-client-1.4.0-tests.jar ├── apidocs │ ├── allclasses-frame.html │ ├── allclasses-noframe.html │ ├── alluxio │ │ ├── client │ │ └── hadoop │ ├── constant-values.html │ ├── deprecated-list.html │ ├── help-doc.html │ ├── index-all.html │ ├── index.html │ ├── overview-frame.html │ ├── overview-summary.html │ ├── overview-tree.html │ ├── package-list │ ├── script.js │ └── stylesheet.css ├── checkstyle-cachefile ├── checkstyle-checker.xml ├── checkstyle-result.xml ├── checkstyle-suppressions.xml ├── classes │ ├── alluxio │ │ ├── client │ │ └── hadoop │ └── META-INF │ └── services ├── findbugs-exclude.xml ├── findbugs.xml ├── findbugsXml.xml ├── generated-sources │ └── annotations ├── generated-test-sources │ └── test-annotations ├── javadoc-bundle-options │ ├── javadoc-options-javadoc-resources.xml │ └── package-list ├── maven-archiver │ └── pom.properties ├── maven-status │ └── maven-compiler-plugin │ ├── compile │ └── testCompile └── test-classes ├── alluxio │ ├── client │ └── hadoop └── log4j.propertie
至此,你已经完成了Alluxio的源码编译,接下来就可以执行安装配置和启动过程。
- Alluxio编译
- alluxio
- Alluxio
- Alluxio简介
- Spark & Alluxio
- Alluxio简介
- spark&&alluxio
- Alluxio初探
- Alluxio Paper
- Alluxio学习笔记(一):Alluxio介绍
- Alluxio之定位策略
- Alluxio环境搭建
- Alluxio之定位策略
- Alluxio架构图-总
- Alluxio架构图-Master
- Alluxio架构图-Worker
- Alluxio Master - BlockMaster
- alluxio的适用场景
- JZOJ 3870. 【NOIP2014八校联考第4场第1试10.19】单词检索(search)
- 浅谈BI领域的数据模型设计(一)
- Poj 3764 The xor-longest Path(Trie树+xor+贪心)
- 回文检测 [USACO Training Section 1.3]
- 4-Openwrt main Makefile
- Alluxio编译
- xposed multidex dex
- 微信小程序开发基础篇(四)之请求、上传、下载
- CS231n课程笔记翻译系列之目录汇总
- HTML入门学习笔记--CSS过渡模块(9)
- javaScript 入门基础知识(二)
- 数据库三范式
- 【leetcode】【Easy】【412. Fizz Buzz】
- Java WebRestApp后台(一):第一个java web项目(从创建到返回第一个json字符串)