You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@bigtop.apache.org by ev...@apache.org on 2017/10/10 16:54:03 UTC
[1/2] bigtop git commit: Bigtop 1.2.1 release
Repository: bigtop
Updated Branches:
refs/heads/branch-1.2 2365207dc -> 6c38d542a
Bigtop 1.2.1 release
Project: http://git-wip-us.apache.org/repos/asf/bigtop/repo
Commit: http://git-wip-us.apache.org/repos/asf/bigtop/commit/85be63f7
Tree: http://git-wip-us.apache.org/repos/asf/bigtop/tree/85be63f7
Diff: http://git-wip-us.apache.org/repos/asf/bigtop/diff/85be63f7
Branch: refs/heads/branch-1.2
Commit: 85be63f715f023f0a14458c3b13d8d7bc54bb415
Parents: 2365207
Author: Evans Ye <ev...@apache.org>
Authored: Wed Oct 11 00:47:00 2017 +0800
Committer: Evans Ye <ev...@apache.org>
Committed: Wed Oct 11 00:47:00 2017 +0800
----------------------------------------------------------------------
CHANGES.txt | 15 ++++++++++++++-
src/site/xdoc/release-notes.xml | 32 +++++++++++++++++++++++++++++---
2 files changed, 43 insertions(+), 4 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/bigtop/blob/85be63f7/CHANGES.txt
----------------------------------------------------------------------
diff --git a/CHANGES.txt b/CHANGES.txt
index d23ad84..b2dc674 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -35,6 +35,7 @@ Release Notes - Bigtop - Version 1.2.1
** Bug
* [BIGTOP-2295] - Docker tests should consume current builds
* [BIGTOP-2679] - Streamline CI Jobs
+ * [BIGTOP-2716] - Solr build failed when OpenJDK8u_121 is used
* [BIGTOP-2729] - AMBARI-20686: Add ID to allow compilation with recent maven
* [BIGTOP-2737] - Spark charm doesn't handle HA or examples well
* [BIGTOP-2738] - spark-worker fails to start
@@ -71,6 +72,18 @@ Release Notes - Bigtop - Version 1.2.1
* [BIGTOP-2805] - ycsb: turn of autodetection of dependencies by rpm
* [BIGTOP-2806] - hue is not installable on debian, ubuntu
* [BIGTOP-2808] - Handle deletion of symlinks: update gradle
+ * [BIGTOP-2826] - Zeppelin RPM is broken: "missing" osgi package deps
+ * [BIGTOP-2829] - [iTest] build failed during Maven integration test phase
+ * [BIGTOP-2832] - Toolchain failed to install on Debian 8
+ * [BIGTOP-2850] - Not able to build bigtop/slaves image for OpenSuSE 42.1
+ * [BIGTOP-2870] - testHCFS should be using USER_NAME for expected output
+ * [BIGTOP-2871] - Make run_itest report Standard Error from tests to stderr
+ * [BIGTOP-2873] - A few cosmetic changes to run_itest.sh output
+ * [BIGTOP-2879] - BIGTOP-2749 breaks deployments on Debian-8
+ * [BIGTOP-2890] - Download page must not link to snapshots / nightly builds
+ * [BIGTOP-2891] - Download page must link to ASF mirrors
+ * [BIGTOP-2900] - Crunch build failed because of OS OOM killer on OpenJDK 1.8.0-144
+ * [BIGTOP-2901] - disable GPDB because of build failure on OpenSuSE 42.1
** Improvement
* [BIGTOP-2355] - Update Mahout version to 0.13.0
@@ -85,7 +98,6 @@ Release Notes - Bigtop - Version 1.2.1
* [BIGTOP-2807] - Upgrade Spark to 2.1.1
* [BIGTOP-2812] - Upgrade Zeppelin version to 0.7.2
* [BIGTOP-2819] - Polish the README.md for 1.2.1 release
- * [BIGTOP-2820] - Polish the documentations on Bigtop Wiki for 1.2.1 release
* [BIGTOP-2821] - expose extra config options for spark
* [BIGTOP-2827] - juju bundle refresh (june 2017)
* [BIGTOP-2828] - Since BIGTOP-2775 JDK version has been specified by Bigtop Puppet
@@ -101,6 +113,7 @@ Release Notes - Bigtop - Version 1.2.1
* [BIGTOP-2776] - Bump Apache Apex version to 3.6.0
* [BIGTOP-2785] - Define Bigtop 1.2.1 release BOM
* [BIGTOP-2786] - Push Bigtop 1.2.1 Docker build slaves to Docker Hub
+ * [BIGTOP-2877] - Drop Kite packaging
* Release 1.2.0 (2017-04-04)
http://git-wip-us.apache.org/repos/asf/bigtop/blob/85be63f7/src/site/xdoc/release-notes.xml
----------------------------------------------------------------------
diff --git a/src/site/xdoc/release-notes.xml b/src/site/xdoc/release-notes.xml
index dd7f45e..d2925e8 100644
--- a/src/site/xdoc/release-notes.xml
+++ b/src/site/xdoc/release-notes.xml
@@ -53,6 +53,8 @@
</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2679'>BIGTOP-2679</a>] - Streamline CI Jobs
</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2716'>BIGTOP-2716</a>] - Solr build failed when OpenJDK8u_121 is used
+</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2729'>BIGTOP-2729</a>] - AMBARI-20686: Add ID to allow compilation with recent maven
</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2737'>BIGTOP-2737</a>] - Spark charm doesn't handle HA or examples well
@@ -125,8 +127,32 @@
</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2808'>BIGTOP-2808</a>] - Handle deletion of symlinks: update gradle
</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2826'>BIGTOP-2826</a>] - Zeppelin RPM is broken: "missing" osgi package deps
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2829'>BIGTOP-2829</a>] - [iTest] build failed during Maven integration test phase
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2832'>BIGTOP-2832</a>] - Toolchain failed to install on Debian 8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2850'>BIGTOP-2850</a>] - Not able to build bigtop/slaves image for OpenSuSE 42.1
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2870'>BIGTOP-2870</a>] - testHCFS should be using USER_NAME for expected output
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2871'>BIGTOP-2871</a>] - Make run_itest report Standard Error from tests to stderr
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2873'>BIGTOP-2873</a>] - A few cosmetic changes to run_itest.sh output
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2879'>BIGTOP-2879</a>] - BIGTOP-2749 breaks deployments on Debian-8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2890'>BIGTOP-2890</a>] - Download page must not link to snapshots / nightly builds
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2891'>BIGTOP-2891</a>] - Download page must link to ASF mirrors
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2900'>BIGTOP-2900</a>] - Crunch build failed because of OS OOM killer on OpenJDK 1.8.0-144
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2901'>BIGTOP-2901</a>] - disable GPDB because of build failure on OpenSuSE 42.1
+</li>
</ul>
-
+
<h2> Improvement
</h2>
<ul>
@@ -154,8 +180,6 @@
</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2819'>BIGTOP-2819</a>] - Polish the README.md for 1.2.1 release
</li>
-<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2820'>BIGTOP-2820</a>] - Polish the documentations on Bigtop Wiki for 1.2.1 release
-</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2821'>BIGTOP-2821</a>] - expose extra config options for spark
</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2827'>BIGTOP-2827</a>] - juju bundle refresh (june 2017)
@@ -188,6 +212,8 @@
</li>
<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2786'>BIGTOP-2786</a>] - Push Bigtop 1.2.1 Docker build slaves to Docker Hub
</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2877'>BIGTOP-2877</a>] - Drop Kite packaging
+</li>
</ul>
[2/2] bigtop git commit: Update repo URL to repos.bigtop.apache.org
Posted by ev...@apache.org.
Update repo URL to repos.bigtop.apache.org
Project: http://git-wip-us.apache.org/repos/asf/bigtop/repo
Commit: http://git-wip-us.apache.org/repos/asf/bigtop/commit/6c38d542
Tree: http://git-wip-us.apache.org/repos/asf/bigtop/tree/6c38d542
Diff: http://git-wip-us.apache.org/repos/asf/bigtop/diff/6c38d542
Branch: refs/heads/branch-1.2
Commit: 6c38d542a4699694cafa829f2cc139e71add0ca3
Parents: 85be63f
Author: Evans Ye <ev...@apache.org>
Authored: Wed Oct 11 00:53:34 2017 +0800
Committer: Evans Ye <ev...@apache.org>
Committed: Wed Oct 11 00:53:34 2017 +0800
----------------------------------------------------------------------
bigtop-deploy/puppet/README.md | 2 +-
bigtop-deploy/puppet/manifests/bigtop_repo.pp | 4 ++--
docker/pseudo-cluster/config/hieradata/site.yaml | 2 +-
docker/sandbox/build.sh | 2 +-
docker/sandbox/site.yaml.template.centos-6_hadoop | 2 +-
docker/sandbox/site.yaml.template.debian-8_hadoop | 2 +-
provisioner/docker/config_centos-6.yaml | 2 +-
provisioner/docker/config_centos-7.yaml | 2 +-
provisioner/docker/config_debian-8.yaml | 2 +-
provisioner/docker/config_ubuntu-16.04.yaml | 2 +-
provisioner/vagrant/vagrantconfig.yaml | 2 +-
11 files changed, 12 insertions(+), 12 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/bigtop-deploy/puppet/README.md
----------------------------------------------------------------------
diff --git a/bigtop-deploy/puppet/README.md b/bigtop-deploy/puppet/README.md
index ddb79a5..201e172 100644
--- a/bigtop-deploy/puppet/README.md
+++ b/bigtop-deploy/puppet/README.md
@@ -136,7 +136,7 @@ hadoop_cluster_node::cluster_components:
- spark
- yarn
- zookeeper
-bigtop::bigtop_repo_uri: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/ubuntu/16.04/x86_64"
+bigtop::bigtop_repo_uri: "http://repos.bigtop.apache.org/releases/1.2.1/ubuntu/16.04/x86_64"
```
And finally execute
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/bigtop-deploy/puppet/manifests/bigtop_repo.pp
----------------------------------------------------------------------
diff --git a/bigtop-deploy/puppet/manifests/bigtop_repo.pp b/bigtop-deploy/puppet/manifests/bigtop_repo.pp
index 48451cb..ce17858 100644
--- a/bigtop-deploy/puppet/manifests/bigtop_repo.pp
+++ b/bigtop-deploy/puppet/manifests/bigtop_repo.pp
@@ -16,7 +16,7 @@
class bigtop_repo {
case $::operatingsystem {
/(OracleLinux|Amazon|CentOS|Fedora|RedHat)/: {
- $default_repo = "http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/centos/7/x86_64"
+ $default_repo = "http://repos.bigtop.apache.org/releases/1.2.1/centos/7/x86_64"
$baseurls_array = any2array(hiera("bigtop::bigtop_repo_uri", $default_repo))
each ($baseurls_array) |$count, $baseurl| {
yumrepo { "Bigtop_$count":
@@ -36,7 +36,7 @@ class bigtop_repo {
$lower_os = downcase($operatingsystem)
# We use code name such as trusty for Ubuntu instead of release version in bigtop's binary convenience repos
if ($operatingsystem == "Ubuntu") { $release = $lsbdistcodename } else { $release = $operatingsystemmajrelease }
- $default_repo = "http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/${lower_os}/${release}/x86_64"
+ $default_repo = "http://repos.bigtop.apache.org/releases/1.2.1/${lower_os}/${release}/x86_64"
$baseurls_array = any2array(hiera("bigtop::bigtop_repo_uri", $default_repo))
# I couldn't enforce the sequence -> anymore because of this
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/docker/pseudo-cluster/config/hieradata/site.yaml
----------------------------------------------------------------------
diff --git a/docker/pseudo-cluster/config/hieradata/site.yaml b/docker/pseudo-cluster/config/hieradata/site.yaml
index 4c56bf5..45d6172 100644
--- a/docker/pseudo-cluster/config/hieradata/site.yaml
+++ b/docker/pseudo-cluster/config/hieradata/site.yaml
@@ -6,5 +6,5 @@ hadoop_cluster_node::cluster_components:
- hdfs
- yarn
- mapreduce
-bigtop::bigtop_repo_uri: http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/ubuntu/16.04/x86_64
+bigtop::bigtop_repo_uri: http://repos.bigtop.apache.org/releases/1.2.1/ubuntu/16.04/x86_64
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/docker/sandbox/build.sh
----------------------------------------------------------------------
diff --git a/docker/sandbox/build.sh b/docker/sandbox/build.sh
index 8910f93..dc67ca3 100755
--- a/docker/sandbox/build.sh
+++ b/docker/sandbox/build.sh
@@ -65,7 +65,7 @@ generate_tag() {
detect_repo() {
OS_SEP_BY_SLASH=${OS/-//}
- REPO=${REPO:-"http://bigtop-repos.s3.amazonaws.com/releases/${BIGTOP_VERSION}/${OS_SEP_BY_SLASH}/x86_64"}
+ REPO=${REPO:-"http://repos.bigtop.apache.org/releases/${BIGTOP_VERSION}/${OS_SEP_BY_SLASH}/x86_64"}
}
image_config_validator() {
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/docker/sandbox/site.yaml.template.centos-6_hadoop
----------------------------------------------------------------------
diff --git a/docker/sandbox/site.yaml.template.centos-6_hadoop b/docker/sandbox/site.yaml.template.centos-6_hadoop
index 1aa2951..6e8caf2 100644
--- a/docker/sandbox/site.yaml.template.centos-6_hadoop
+++ b/docker/sandbox/site.yaml.template.centos-6_hadoop
@@ -15,5 +15,5 @@
bigtop::hadoop_head_node: "head.node.fqdn"
hadoop::hadoop_storage_dirs: [/data/1, /data/2]
-bigtop::bigtop_repo_uri: http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/centos/6/x86_64
+bigtop::bigtop_repo_uri: http://repos.bigtop.apache.org/releases/1.2.1/centos/6/x86_64
hadoop_cluster_node::cluster_components: [hdfs, yarn, mapred-app]
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/docker/sandbox/site.yaml.template.debian-8_hadoop
----------------------------------------------------------------------
diff --git a/docker/sandbox/site.yaml.template.debian-8_hadoop b/docker/sandbox/site.yaml.template.debian-8_hadoop
index a8d7f15..3c32a69 100644
--- a/docker/sandbox/site.yaml.template.debian-8_hadoop
+++ b/docker/sandbox/site.yaml.template.debian-8_hadoop
@@ -15,5 +15,5 @@
bigtop::hadoop_head_node: "head.node.fqdn"
hadoop::hadoop_storage_dirs: [/data/1, /data/2]
-bigtop::bigtop_repo_uri: http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/debian/8/x86_64
+bigtop::bigtop_repo_uri: http://repos.bigtop.apache.org/releases/1.2.1/debian/8/x86_64
hadoop_cluster_node::cluster_components: [hdfs, yarn, mapred-app]
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/provisioner/docker/config_centos-6.yaml
----------------------------------------------------------------------
diff --git a/provisioner/docker/config_centos-6.yaml b/provisioner/docker/config_centos-6.yaml
index c56b4f2..5f78986 100644
--- a/provisioner/docker/config_centos-6.yaml
+++ b/provisioner/docker/config_centos-6.yaml
@@ -17,7 +17,7 @@ docker:
memory_limit: "4g"
image: "bigtop/puppet:centos-6"
-repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/centos/6/x86_64"
+repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/6/x86_64"
distro: centos
components: [hdfs, yarn, mapreduce]
enable_local_repo: false
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/provisioner/docker/config_centos-7.yaml
----------------------------------------------------------------------
diff --git a/provisioner/docker/config_centos-7.yaml b/provisioner/docker/config_centos-7.yaml
index 238080b..3b1b0e0 100644
--- a/provisioner/docker/config_centos-7.yaml
+++ b/provisioner/docker/config_centos-7.yaml
@@ -17,7 +17,7 @@ docker:
memory_limit: "4g"
image: "bigtop/puppet:centos-7"
-repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/centos/7/x86_64"
+repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/7/x86_64"
distro: centos
components: [hdfs, yarn, mapreduce]
enable_local_repo: false
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/provisioner/docker/config_debian-8.yaml
----------------------------------------------------------------------
diff --git a/provisioner/docker/config_debian-8.yaml b/provisioner/docker/config_debian-8.yaml
index 467dc77..41a6cbe 100644
--- a/provisioner/docker/config_debian-8.yaml
+++ b/provisioner/docker/config_debian-8.yaml
@@ -17,7 +17,7 @@ docker:
memory_limit: "4g"
image: "bigtop/puppet:debian-8"
-repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/debian/8/x86_64"
+repo: "http://repos.bigtop.apache.org/releases/1.2.1/debian/8/x86_64"
distro: debian
components: [hdfs, yarn, mapreduce]
enable_local_repo: false
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/provisioner/docker/config_ubuntu-16.04.yaml
----------------------------------------------------------------------
diff --git a/provisioner/docker/config_ubuntu-16.04.yaml b/provisioner/docker/config_ubuntu-16.04.yaml
index 5aab505..2568377 100644
--- a/provisioner/docker/config_ubuntu-16.04.yaml
+++ b/provisioner/docker/config_ubuntu-16.04.yaml
@@ -17,7 +17,7 @@ docker:
memory_limit: "4g"
image: "bigtop/puppet:ubuntu-16.04"
-repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/ubuntu/16.04/x86_64"
+repo: "http://repos.bigtop.apache.org/releases/1.2.1/ubuntu/16.04/x86_64"
distro: debian
components: [hdfs, yarn, mapreduce]
enable_local_repo: false
http://git-wip-us.apache.org/repos/asf/bigtop/blob/6c38d542/provisioner/vagrant/vagrantconfig.yaml
----------------------------------------------------------------------
diff --git a/provisioner/vagrant/vagrantconfig.yaml b/provisioner/vagrant/vagrantconfig.yaml
index b1db63c..c5dd644 100644
--- a/provisioner/vagrant/vagrantconfig.yaml
+++ b/provisioner/vagrant/vagrantconfig.yaml
@@ -16,7 +16,7 @@
memory_size: 4096
number_cpus: 1
box: "puppetlabs/centos-7.2-64-nocm"
-repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.1/centos/7/x86_64"
+repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/7/x86_64"
num_instances: 1
distro: centos
components: [hdfs, yarn, mapreduce]