You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by cm...@apache.org on 2015/03/19 03:14:49 UTC
hadoop git commit: HADOOP-9329. document native build dependencies in
BUILDING.txt (Vijay Bhat via Colin P. McCabe)
Repository: hadoop
Updated Branches:
refs/heads/trunk c7c71cdba -> bf6295bed
HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bf6295be
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/bf6295be
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/bf6295be
Branch: refs/heads/trunk
Commit: bf6295bed8b58432ede44e074fa7998d55c4b821
Parents: c7c71cd
Author: Colin Patrick Mccabe <cm...@cloudera.com>
Authored: Wed Mar 18 19:14:21 2015 -0700
Committer: Colin Patrick Mccabe <cm...@cloudera.com>
Committed: Wed Mar 18 19:14:21 2015 -0700
----------------------------------------------------------------------
BUILDING.txt | 50 ++++++++++++++++----
hadoop-common-project/hadoop-common/CHANGES.txt | 3 ++
2 files changed, 45 insertions(+), 8 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf6295be/BUILDING.txt
----------------------------------------------------------------------
diff --git a/BUILDING.txt b/BUILDING.txt
index b60da6c..c126c5e 100644
--- a/BUILDING.txt
+++ b/BUILDING.txt
@@ -10,10 +10,45 @@ Requirements:
* ProtocolBuffer 2.5.0
* CMake 2.6 or newer (if compiling native code), must be 3.0 or newer on Mac
* Zlib devel (if compiling native code)
-* openssl devel ( if compiling native hadoop-pipes )
+* openssl devel ( if compiling native hadoop-pipes and to get the best HDFS encryption performance )
+* Jansson C XML parsing library ( if compiling libwebhdfs )
+* Linux FUSE (Filesystem in Userspace) version 2.6 or above ( if compiling fuse_dfs )
* Internet connection for first build (to fetch all Maven and Hadoop dependencies)
----------------------------------------------------------------------------------
+Installing required packages for clean install of Ubuntu 14.04 LTS Desktop:
+
+* Oracle JDK 1.7 (preferred)
+ $ sudo apt-get purge openjdk*
+ $ sudo apt-get install software-properties-common
+ $ sudo add-apt-repository ppa:webupd8team/java
+ $ sudo apt-get update
+ $ sudo apt-get install oracle-java7-installer
+* Maven
+ $ sudo apt-get -y install maven
+* Native libraries
+ $ sudo apt-get -y install build-essential autoconf automake libtool cmake zlib1g-dev pkg-config libssl-dev
+* ProtocolBuffer 2.5.0
+ $ wget https://protobuf.googlecode.com/svn/rc/protobuf-2.5.0.tar.gz
+ $ tar -zxvf protobuf-2.5.0.tar.gz
+ $ cd protobuf-2.5.0.tar.gz
+ $ ./configure
+ $ make
+ $ sudo make install
+ $ sudo ldconfig
+
+Optional packages:
+
+* Snappy compression
+ $ sudo apt-get install snappy libsnappy-dev
+* Bzip2
+ $ sudo apt-get install bzip2 libbz2-dev
+* Jansson (C Library for JSON)
+ $ sudo apt-get install libjansson-dev
+* Linux FUSE
+ $ sudo apt-get install fuse libfuse-dev
+
+----------------------------------------------------------------------------------
Maven main modules:
hadoop (Main Hadoop project)
@@ -90,7 +125,7 @@ Maven build goals:
* Use -Drequire.openssl to fail the build if libcrypto.so is not found.
If this option is not specified and the openssl library is missing,
we silently build a version of libhadoop.so that cannot make use of
- openssl. This option is recommended if you plan on making use of openssl
+ openssl. This option is recommended if you plan on making use of openssl
and want to get more repeatable builds.
* Use -Dopenssl.prefix to specify a nonstandard location for the libcrypto
header files and library files. You do not need this option if you have
@@ -128,8 +163,8 @@ Protocol Buffer compiler
The version of Protocol Buffer compiler, protoc, must match the version of the
protobuf JAR.
-If you have multiple versions of protoc in your system, you can set in your
-build shell the HADOOP_PROTOC_PATH environment variable to point to the one you
+If you have multiple versions of protoc in your system, you can set in your
+build shell the HADOOP_PROTOC_PATH environment variable to point to the one you
want to use for the Hadoop build. If you don't define this environment variable,
protoc is looked up in the PATH.
----------------------------------------------------------------------------------
@@ -258,8 +293,8 @@ Several tests require that the user must have the Create Symbolic Links
privilege.
All Maven goals are the same as described above with the exception that
-native code is built by enabling the 'native-win' Maven profile. -Pnative-win
-is enabled by default when building on Windows since the native components
+native code is built by enabling the 'native-win' Maven profile. -Pnative-win
+is enabled by default when building on Windows since the native components
are required (not optional) on Windows.
If native code bindings for zlib are required, then the zlib headers must be
@@ -277,5 +312,4 @@ http://www.zlib.net/
----------------------------------------------------------------------------------
Building distributions:
- * Build distribution with native code : mvn package [-Pdist][-Pdocs][-Psrc][-Dtar]
-
+ * Build distribution with native code : mvn package [-Pdist][-Pdocs][-Psrc][-Dtar]
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf6295be/hadoop-common-project/hadoop-common/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt
index 37dea77..ab88d27 100644
--- a/hadoop-common-project/hadoop-common/CHANGES.txt
+++ b/hadoop-common-project/hadoop-common/CHANGES.txt
@@ -697,6 +697,9 @@ Release 2.7.0 - UNRELEASED
HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability.
(Brandon Li via suresh)
+ HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat
+ via Colin P. McCabe)
+
OPTIMIZATIONS
HADOOP-11323. WritableComparator#compare keeps reference to byte array.