You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@bigtop.apache.org by of...@apache.org on 2019/07/07 20:14:43 UTC
[bigtop] branch bigtop-alpha updated (dcb51a1 -> b8a1c79)
This is an automated email from the ASF dual-hosted git repository.
oflebbe pushed a change to branch bigtop-alpha
in repository https://gitbox.apache.org/repos/asf/bigtop.git.
discard dcb51a1 adapt to hadoop3
new b8a1c79 adapt to hadoop3
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (dcb51a1)
\
N -- N -- N refs/heads/bigtop-alpha (b8a1c79)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
bigtop-packages/src/deb/hadoop/control | 22 +++++++++++-----------
bigtop-packages/src/deb/hadoop/hadoop.install | 6 ++++++
2 files changed, 17 insertions(+), 11 deletions(-)
[bigtop] 01/01: adapt to hadoop3
Posted by of...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
oflebbe pushed a commit to branch bigtop-alpha
in repository https://gitbox.apache.org/repos/asf/bigtop.git
commit b8a1c799a229e9b8e21c005f954e3d9d56c38358
Author: Olaf Flebbe <of...@oflebbe.de>
AuthorDate: Tue Jul 2 22:31:42 2019 +0200
adapt to hadoop3
---
bigtop-packages/src/deb/hadoop/control | 24 ++++++++++++------------
bigtop-packages/src/deb/hadoop/hadoop.install | 7 +++++++
bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec | 3 ++-
3 files changed, 21 insertions(+), 13 deletions(-)
diff --git a/bigtop-packages/src/deb/hadoop/control b/bigtop-packages/src/deb/hadoop/control
index fc3f3c9..e80073b 100644
--- a/bigtop-packages/src/deb/hadoop/control
+++ b/bigtop-packages/src/deb/hadoop/control
@@ -47,7 +47,7 @@ Description: Hadoop is a software platform for processing vast amounts of data
Package: hadoop-hdfs
Architecture: any
-Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), bigtop-groovy, hadoop (= ${binary:Version}), bigtop-jsvc
+Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), bigtop-groovy, hadoop (= ${binary:Version})
Description: The Hadoop Distributed File System
Hadoop Distributed File System (HDFS) is the primary storage system used by
Hadoop applications. HDFS creates multiple replicas of data blocks and distributes
@@ -56,7 +56,7 @@ Description: The Hadoop Distributed File System
Package: hadoop-yarn
Architecture: any
-Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), hadoop (= ${binary:Version})
+Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), hadoop (= ${binary:Version}), lsb-base
Description: The Hadoop NextGen MapReduce (YARN)
YARN (Hadoop NextGen MapReduce) is a general purpose data-computation framework.
The fundamental idea of YARN is to split up the two major functionalities of the
@@ -106,13 +106,13 @@ Description: Pseudo-distributed Hadoop configuration
Package: hadoop-mapreduce-historyserver
Architecture: any
-Depends: hadoop-mapreduce (= ${binary:Version}), hadoop-hdfs (= ${binary:Version})
+Depends: hadoop-mapreduce (= ${binary:Version}), hadoop-hdfs (= ${binary:Version}), lsb-base
Description: MapReduce History Server
The History server keeps records of the different activities being performed on a Apache Hadoop cluster
Package: hadoop-yarn-nodemanager
Architecture: any
-Depends: hadoop-yarn (= ${binary:Version})
+Depends: hadoop-yarn (= ${binary:Version}), lsb-base
Description: YARN Node Manager
The NodeManager is the per-machine framework agent who is responsible for
containers, monitoring their resource usage (cpu, memory, disk, network) and
@@ -120,19 +120,19 @@ Description: YARN Node Manager
Package: hadoop-yarn-resourcemanager
Architecture: any
-Depends: hadoop-yarn (= ${binary:Version})
+Depends: hadoop-yarn (= ${binary:Version}), lsb-base
Description: YARN Resource Manager
The resource manager manages the global assignment of compute resources to applications
Package: hadoop-yarn-proxyserver
Architecture: any
-Depends: hadoop-yarn (= ${binary:Version})
+Depends: hadoop-yarn (= ${binary:Version}), lsb-base
Description: YARN Web Proxy
The web proxy server sits in front of the YARN application master web UI.
Package: hadoop-yarn-timelineserver
Architecture: any
-Depends: hadoop-yarn (= ${binary:Version})
+Depends: hadoop-yarn (= ${binary:Version}), lsb-base
Description: YARN Timeline Server
Storage and retrieval of applications' current as well as historic
information in a generic fashion is solved in YARN through the
@@ -140,14 +140,14 @@ Description: YARN Timeline Server
Package: hadoop-hdfs-namenode
Architecture: any
-Depends: hadoop-hdfs (= ${binary:Version})
+Depends: hadoop-hdfs (= ${binary:Version}), lsb-base
Description: The Hadoop namenode manages the block locations of HDFS files
The Hadoop Distributed Filesystem (HDFS) requires one unique server, the
namenode, which manages the block locations of files on the filesystem.
Package: hadoop-hdfs-secondarynamenode
Architecture: any
-Depends: hadoop-hdfs (= ${binary:Version})
+Depends: hadoop-hdfs (= ${binary:Version}), lsb-base
Description: Hadoop Secondary namenode
The Secondary Name Node periodically compacts the Name Node EditLog
into a checkpoint. This compaction ensures that Name Node restarts
@@ -155,7 +155,7 @@ Description: Hadoop Secondary namenode
Package: hadoop-hdfs-zkfc
Architecture: any
-Depends: hadoop-hdfs (= ${binary:Version})
+Depends: hadoop-hdfs (= ${binary:Version}), lsb-base
Description: Hadoop HDFS failover controller
The Hadoop HDFS failover controller is a ZooKeeper client which also
monitors and manages the state of the NameNode. Each of the machines
@@ -166,7 +166,7 @@ Description: Hadoop HDFS failover controller
Package: hadoop-hdfs-journalnode
Provides: hadoop-hdfs-journalnode
Architecture: any
-Depends: hadoop-hdfs (= ${binary:Version})
+Depends: hadoop-hdfs (= ${binary:Version}), lsb-base
Description: Hadoop HDFS JournalNode
The HDFS JournalNode is responsible for persisting NameNode edit logs.
In a typical deployment the JournalNode daemon runs on at least three
@@ -174,7 +174,7 @@ Description: Hadoop HDFS JournalNode
Package: hadoop-hdfs-datanode
Architecture: any
-Depends: hadoop-hdfs (= ${binary:Version})
+Depends: hadoop-hdfs (= ${binary:Version}), lsb-base
Description: Hadoop Data Node
The Data Nodes in the Hadoop Cluster are responsible for serving up
blocks of data over the network to Hadoop Distributed Filesystem
diff --git a/bigtop-packages/src/deb/hadoop/hadoop.install b/bigtop-packages/src/deb/hadoop/hadoop.install
index 7fd0f34..eb70b29 100644
--- a/bigtop-packages/src/deb/hadoop/hadoop.install
+++ b/bigtop-packages/src/deb/hadoop/hadoop.install
@@ -11,6 +11,13 @@
/usr/lib/hadoop/etc
/usr/lib/hadoop/libexec/hadoop-config.sh
/usr/lib/hadoop/libexec/hadoop-layout.sh
+/usr/lib/hadoop/libexec/hadoop-functions.sh
+/usr/lib/hadoop/libexec/hadoop-layout.sh
+/usr/lib/hadoop/libexec/hadoop-layout.sh.example
+/usr/lib/hadoop/libexec/shellprofile.d/
+/usr/lib/hadoop/libexec/shellprofile.d/*
+/usr/lib/hadoop/libexec/tools/
+/usr/lib/hadoop/libexec/tools/*
/usr/lib/hadoop/*.jar
/usr/lib/hadoop/lib
/usr/lib/hadoop/sbin
diff --git a/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec b/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec
index 262b2a6..2c72349 100644
--- a/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec
+++ b/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec
@@ -223,7 +223,7 @@ located.
%package hdfs
Summary: The Hadoop Distributed File System
Group: System/Daemons
-Requires: %{name} = %{version}-%{release}, bigtop-groovy, bigtop-jsvc
+Requires: %{name} = %{version}-%{release}, bigtop-groovy
%description hdfs
Hadoop Distributed File System (HDFS) is the primary storage system used by
@@ -666,6 +666,7 @@ fi
%{lib_hadoop}/etc
%{lib_hadoop}/libexec/hadoop-config.sh
%{lib_hadoop}/libexec/hadoop-layout.sh
+%{lib_hadoop}/libexec/hadoop-functions.sh
%{lib_hadoop}/libexec/kms-config.sh
%{bin_hadoop}/hadoop
%{man_hadoop}/man1/hadoop.1.*