You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by pw...@apache.org on 2014/09/11 23:07:00 UTC
svn commit: r1624392 [1/3] - in /spark: ./ _layouts/ js/ site/ site/graphx/
site/js/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/
site/streaming/
Author: pwendell
Date: Thu Sep 11 21:06:59 2014
New Revision: 1624392
URL: http://svn.apache.org/r1624392
Log:
New format for downloads page.
Added:
spark/js/downloads.js
spark/site/js/downloads.js
Modified:
spark/_layouts/global.html
spark/downloads.md
spark/site/community.html
spark/site/documentation.html
spark/site/downloads.html
spark/site/examples.html
spark/site/faq.html
spark/site/graphx/index.html
spark/site/index.html
spark/site/mailing-lists.html
spark/site/mllib/index.html
spark/site/news/amp-camp-2013-registration-ope.html
spark/site/news/announcing-the-first-spark-summit.html
spark/site/news/fourth-spark-screencast-published.html
spark/site/news/index.html
spark/site/news/nsdi-paper.html
spark/site/news/run-spark-and-shark-on-amazon-emr.html
spark/site/news/spark-0-6-1-and-0-5-2-released.html
spark/site/news/spark-0-6-2-released.html
spark/site/news/spark-0-7-0-released.html
spark/site/news/spark-0-7-2-released.html
spark/site/news/spark-0-7-3-released.html
spark/site/news/spark-0-8-0-released.html
spark/site/news/spark-0-8-1-released.html
spark/site/news/spark-0-9-0-released.html
spark/site/news/spark-0-9-1-released.html
spark/site/news/spark-0-9-2-released.html
spark/site/news/spark-1-0-0-released.html
spark/site/news/spark-1-0-1-released.html
spark/site/news/spark-1-0-2-released.html
spark/site/news/spark-accepted-into-apache-incubator.html
spark/site/news/spark-and-shark-in-the-news.html
spark/site/news/spark-becomes-tlp.html
spark/site/news/spark-featured-in-wired.html
spark/site/news/spark-mailing-lists-moving-to-apache.html
spark/site/news/spark-meetups.html
spark/site/news/spark-screencasts-published.html
spark/site/news/spark-summit-2013-is-a-wrap.html
spark/site/news/spark-summit-2014-videos-posted.html
spark/site/news/spark-summit-agenda-posted.html
spark/site/news/spark-tips-from-quantifind.html
spark/site/news/spark-user-survey-and-powered-by-page.html
spark/site/news/spark-version-0-6-0-released.html
spark/site/news/strata-exercises-now-available-online.html
spark/site/news/submit-talks-to-spark-summit-2014.html
spark/site/news/two-weeks-to-spark-summit-2014.html
spark/site/news/video-from-first-spark-development-meetup.html
spark/site/releases/spark-release-0-3.html
spark/site/releases/spark-release-0-5-0.html
spark/site/releases/spark-release-0-5-1.html
spark/site/releases/spark-release-0-5-2.html
spark/site/releases/spark-release-0-6-0.html
spark/site/releases/spark-release-0-6-1.html
spark/site/releases/spark-release-0-6-2.html
spark/site/releases/spark-release-0-7-0.html
spark/site/releases/spark-release-0-7-2.html
spark/site/releases/spark-release-0-7-3.html
spark/site/releases/spark-release-0-8-0.html
spark/site/releases/spark-release-0-8-1.html
spark/site/releases/spark-release-0-9-0.html
spark/site/releases/spark-release-0-9-1.html
spark/site/releases/spark-release-0-9-2.html
spark/site/releases/spark-release-1-0-0.html
spark/site/releases/spark-release-1-0-1.html
spark/site/releases/spark-release-1-0-2.html
spark/site/research.html
spark/site/screencasts/1-first-steps-with-spark.html
spark/site/screencasts/2-spark-documentation-overview.html
spark/site/screencasts/3-transformations-and-caching.html
spark/site/screencasts/4-a-standalone-job-in-spark.html
spark/site/screencasts/index.html
spark/site/sql/index.html
spark/site/streaming/index.html
Modified: spark/_layouts/global.html
URL: http://svn.apache.org/viewvc/spark/_layouts/global.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/_layouts/global.html (original)
+++ spark/_layouts/global.html Thu Sep 11 21:06:59 2014
@@ -52,6 +52,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="{{site.url}}js/lang-tabs.js"></script>
+<script src="{{site.url}}js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -181,9 +186,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="{{site.url}}js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/downloads.md
URL: http://svn.apache.org/viewvc/spark/downloads.md?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/downloads.md (original)
+++ spark/downloads.md Thu Sep 11 21:06:59 2014
@@ -7,30 +7,31 @@ navigation:
show: true
---
+<script type="text/javascript">
+$(document).ready(function() {
+ initDownloads();
+ initReleaseNotes();
+});
+</script>
+
## Download Spark
-The latest release is Spark 1.0.2, released August 5, 2014 [(release notes)]({{site.url}}releases/spark-release-1-0-2.html) [(git tag)](https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f)
-Pre-built packages:
+Select below to download a release of Spark.
+The latest release of Spark is Spark 1.0.2
+<a href="{{site.url}}releases/spark-release-1-0-2.html">(release notes)</a>:
+
+1. Chose a Spark release:
+ <select id="sparkVersionSelect" onChange="javascript:onVersionSelect();"></select><br>
+
+2. Chose a package type:
+ <select id="sparkPackageSelect" onChange="javascript:onPackageSelect();"></select><br>
-* For Hadoop 1 (HDP1, CDH3):
-<a href="http://www.apache.org/dyn/closer.cgi/spark/spark-1.0.2/spark-1.0.2-bin-hadoop1.tgz" onClick="trackOutboundLink(this, 'Release Download Links', 'apache_spark-1.0.1-bin-hadoop1.tgz'); return false;"> find an Apache mirror </a>
-or
-<a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop1.tgz" onClick="trackOutboundLink(this, 'Release Download Links', 'cloudfront_spark-1.0.2-bin-hadoop1.tgz'); return false;"> direct file download </a>
-* For CDH4:
-<a href="http://www.apache.org/dyn/closer.cgi/spark/spark-1.0.2/spark-1.0.2-bin-cdh4.tgz" onClick="trackOutboundLink(this, 'Release Download Links', 'apache_spark-1.0.1-bin-cdh4.tgz'); return false;"> find an Apache mirror </a>
-or
-<a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-cdh4.tgz" onClick="trackOutboundLink(this, 'Release Download Links', 'cloudfront_spark-1.0.2-bin-cdh4.tgz'); return false;"> direct file download </a>
-* For Hadoop 2 (HDP2, CDH5):
-<a href="http://www.apache.org/dyn/closer.cgi/spark/spark-1.0.2/spark-1.0.2-bin-hadoop2.tgz" onClick="trackOutboundLink(this, 'Release Download Links', 'apache_spark-1.0.2-bin-hadoop2.tgz'); return false;"> find an Apache mirror </a>
-or
-<a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop2.tgz" onClick="trackOutboundLink(this, 'Release Download Links', 'cloudfront_spark-1.0.2-bin-hadoop2.tgz'); return false;"> direct file download </a>
-
-Pre-built packages, third-party (NOTE: may include non ASF-compatible licenses):
-
-* For MapRv3: <a href="http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr3.tgz" onClick="trackOutboundLink(this, 'Release Downlaod Links', 'mapr-v3_spark-1.0.2.tgz'); return false;">direct file download (external)</a>
-* For MapRv4: <a href="http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr4.tgz" onClick="trackOutboundLink(this, 'Release Downlaod Links', 'mapr-v4_spark-1.0.2.tgz'); return false;">direct file download (external)</a>
+3. Chose a download type:
+ <select id="sparkDownloadSelect" onChange="javascript:onDownloadSelect()"></select><br>
-Verify your download: [signatures and checksums](http://www.apache.org/dist/spark/spark-1.0.2/)
+4. Download Spark: <span id="spanDownloadLink"></span>
+
+5. This release can be verfied using the <span id="sparkDownloadVerify"></span>.
### Link with Spark
Spark artifacts are [hosted in Maven Central](http://search.maven.org/#browse%7C1686516968). You can add a Maven dependency with the following coordinates:
@@ -39,31 +40,16 @@ Spark artifacts are [hosted in Maven Cen
artifactId: spark-core_2.10
version: 1.0.2
-### Development Version
-If you are interested in working with the newest under-development code or contributing to Spark development, you can also check out the master branch from Git: <tt>git clone git://github.com/apache/spark.git</tt>.
+### Development and Maintenance Branches
+If you are interested in working with the newest under-development code or contributing to Spark development, you can also check out the master branch from Git:
+
+ # Master development branch
+ git clone git://github.com/apache/spark.git
+
+ # 1.1 maintenance branch with stability fixes on top of Spark 1.1.0
+ git clone git://github.com/apache/spark.git -b branch-1.1
Once you've downloaded Spark, you can find instructions for installing and building it on the <a href="{{site.url}}documentation.html">documentation page</a>.
<h3 id="all-releases">All Releases</h3>
-* [Spark 1.0.2](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2.tgz) (August 5, 2014) [(release notes)]({{site.url}}releases/spark-release-1-0-2.html) (prebuilt: [Hadoop1 [HDP1, CDH3]](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop1.tgz), [CDH4](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-cdh4.tgz), [Hadoop2 [HDP2, CDH5]](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop2.tgz), third-party: [MapRv3](http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr3.tgz), [MapRv4](http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr4.tgz))
-* [Spark 1.0.1](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1.tgz) (July 11, 2014) [(release notes)]({{site.url}}releases/spark-release-1-0-1.html) (prebuilt: [Hadoop1 [HDP1, CDH3]](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1-bin-hadoop1.tgz), [CDH4](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1-bin-cdh4.tgz), [Hadoop2 [HDP2, CDH5]](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1-bin-hadoop2.tgz), third-party: [MapRv3](http://package.mapr.com/tools/apache-spark/1.0.1/spark-1.0.1-bin-mapr3.tgz), [MapRv4](http://package.mapr.com/tools/apache-spark/1.0.1/spark-1.0.1-bin-mapr3.tgz))
-* [Spark 1.0.0](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0.tgz) (May 30, 2014) [(release notes)]({{site.url}}releases/spark-release-1-0-0.html) (prebuilt: [Hadoop1 [HDP1, CDH3]](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-hadoop1.tgz), [CDH4](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-cdh4.tgz), [Hadoop2 [HDP2, CDH5]](http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-hadoop2.tgz))
-* [Spark 0.9.2](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2.tgz) (Jul 23, 2014) [(release notes)]({{site.url}}releases/spark-release-0-9-2.html) (prebuilt: [Hadoop1 [HDP1, CDH3]](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2-bin-hadoop1.tgz), [CDH4](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2-bin-cdh4.tgz), [Hadoop2 [HDP2, CDH5]](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2-bin-hadoop2.tgz))
-* [Spark 0.9.1](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1.tgz) (Apr 9, 2014) [(release notes)]({{site.url}}releases/spark-release-0-9-1.html) (prebuilt: [Hadoop1 [HDP1, CDH3]](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1-bin-hadoop1.tgz), [CDH4](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1-bin-cdh4.tgz), [Hadoop2 [HDP2, CDH5]](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1-bin-hadoop2.tgz))
-* [Spark 0.9.0](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating.tgz) (Feb 2, 2014) [(release notes)]({{site.url}}releases/spark-release-0-9-0.html) (prebuilt: [Hadoop1 [HDP1, CDH3]](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating-bin-hadoop1.tgz), [CDH4](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating-bin-cdh4.tgz), [Hadoop2 [HDP2, CDH5]](http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating-bin-hadoop2.tgz))
-* [Spark 0.8.1](http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating.tgz) (Dec 19, 2013) [(release notes)]({{site.url}}releases/spark-release-0-8-1.html) (prebuilt: [Hadoop1 [HDP1, CDH3]](http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating-bin-hadoop1.tgz), [CDH4](http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating-bin-cdh4.tgz), [Hadoop2 [HDP2, CDH5]](http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating-bin-hadoop2.tgz))
-* [Spark 0.8.0](http://d3kbcqa49mib13.cloudfront.net/spark-0.8.0-incubating.tgz) (Sept 25, 2013) [(release notes)]({{site.url}}releases/spark-release-0-8-0.html) (prebuilt: [Hadoop 1 / CDH3](http://spark-project.org/download/spark-0.8.0-incubating-bin-hadoop1.tgz), [CDH4](http://spark-project.org/download/spark-0.8.0-incubating-bin-cdh4.tgz))
-* [Spark 0.7.3](http://spark-project.org/download/spark-0.7.3-sources.tgz) (July 16, 2013) [(release notes)]({{site.url}}releases/spark-release-0-7-3.html) (prebuilt:
-[Hadoop1 / CDH3](http://spark-project.org/download/spark-0.7.3-prebuilt-hadoop1.tgz), [CDH4](http://spark-project.org/download/spark-0.7.3-prebuilt-cdh4.tgz))
-* [Spark 0.7.2](http://spark-project.org/download/spark-0.7.2-sources.tgz) (June 2, 2013) [(release notes)]({{site.url}}releases/spark-release-0-7-2.html) (prebuilt:
-[Hadoop1 / CDH3](http://spark-project.org/download/spark-0.7.2-prebuilt-hadoop1.tgz), [CDH4](http://spark-project.org/download/spark-0.7.2-prebuilt-cdh4.tgz))
-* [Spark 0.7.0](http://spark-project.org/download/spark-0.7.0-sources.tgz) (February 27, 2013) [(release notes)]({{site.url}}releases/spark-release-0-7-0.html)
-* [Spark 0.6.2](http://spark-project.org/download/spark-0.6.2-sources.tgz) (February 7, 2013) [(release notes)]({{site.url}}releases/spark-release-0-6-2.html)
-* [Spark 0.6.1](https://github.com/downloads/mesos/spark/spark-0.6.1-sources.tgz) (November 22, 2012) [(release notes)]({{site.url}}releases/spark-release-0-6-1.html)
-* [Spark 0.5.2](https://github.com/downloads/mesos/spark/spark-0.5.2-sources.tgz) (November 22, 2012) [(release notes)]({{site.url}}releases/spark-release-0-5-2.html)
-* [Spark 0.6.0](http://github.com/downloads/mesos/spark/spark-0.6.0-sources.tar.gz) (October 15, 2012) [(release notes)]({{site.url}}releases/spark-release-0-6-0.html)
-* [Spark 0.5.1](http://github.com/downloads/mesos/spark/spark-0.5.1.tgz) (October 11, 2012) [(release notes)]({{site.url}}releases/spark-release-0-5-1.html)
-* [Spark 0.5.0](https://github.com/mesos/spark/tarball/v0.5.0) (June 12, 2012) [(release notes)]({{site.url}}releases/spark-release-0-5-0.html)
-* [Spark 0.3 for Scala 2.9](https://github.com/mesos/spark/tarball/0.3-scala-2.9) (July 14, 2011) [(release notes)]({{site.url}}releases/spark-release-0-3.html)
-* [Spark 0.3 for Scala 2.8](https://github.com/mesos/spark/tarball/0.3-scala-2.8) (July 14, 2011) [(release notes)]({{site.url}}releases/spark-release-0-3.html)
-* [Spark 0.2](https://github.com/mesos/spark/tarball/alpha-0.2) (May 24, 2011)
+<ul id="sparkReleaseNotes">
Added: spark/js/downloads.js
URL: http://svn.apache.org/viewvc/spark/js/downloads.js?rev=1624392&view=auto
==============================================================================
--- spark/js/downloads.js (added)
+++ spark/js/downloads.js Thu Sep 11 21:06:59 2014
@@ -0,0 +1,148 @@
+// Script for generating Spark download links
+// No dependencies; pure javascript.
+
+releases = {};
+
+function addRelease(version, releaseDate, packages, downloadable) {
+ releases[version] = {released: releaseDate, packages: packages, downloadable: downloadable};
+}
+
+var sources = ["sources"];
+var packagesV1 = sources.concat(["hadoop1", "cdh4"]);
+var packagesV2 = packagesV1.concat(["hadoop2"]);
+var packagesV3 = packagesV2.concat(["mapr3", "mapr4"]);
+
+addRelease("1.0.2", new Date(2014, 8, 5), packagesV3, true);
+addRelease("1.0.1", new Date(2014, 7, 11), packagesV3);
+addRelease("1.0.0", new Date(2014, 5, 30), packagesV2);
+addRelease("0.9.2", new Date(2014, 7, 23), packagesV2, true);
+addRelease("0.9.1", new Date(2014, 4, 9), packagesV2);
+addRelease("0.9.0-incubating", new Date(2014, 2, 2), packagesV2);
+addRelease("0.8.1-incubating", new Date(2013, 12, 19), packagesV2, true);
+addRelease("0.8.0-incubating", new Date(2013, 9, 25), packagesV1, true);
+addRelease("0.7.3", new Date(2013, 7, 16), packagesV1, true);
+addRelease("0.7.2", new Date(2013, 6, 2), packagesV1);
+addRelease("0.7.0", new Date(2013, 2, 27), sources);
+
+function append(el, contents) {
+ el.innerHTML = el.innerHTML + contents;
+};
+
+function empty(el) {
+ el.innerHTML = "";
+}
+
+function getSelectedValue(selectEl) {
+ return selectEl.options[selectEl.selectedIndex].value;
+}
+
+function versionShort(version) { return version.replace(/-incubating/, ""); }
+
+function initDownloads() {
+ var versionSelect = document.getElementById("sparkVersionSelect");
+
+ // Populate versions
+ for (var version in releases) {
+ var releaseDate = releases[version].released;
+ var downloadable = releases[version].downloadable;
+
+ if (!downloadable) { continue; }
+
+ // Don't display incubation status here
+ var title = versionShort(version) + " (" + releaseDate.toDateString().slice(4) + ")";
+ append(versionSelect, "<option value=\"" + version + "\">" + title + "</option>");
+ }
+
+ // Populate packages and (transitively) releases
+ onVersionSelect();
+}
+
+function initReleaseNotes() {
+ var releaseNotes = document.getElementById("sparkReleaseNotes");
+ for (var version in releases) {
+ var releaseDate = releases[version].released;
+ var verShort = versionShort(version);
+ var contents = "<li><a href='releases/spark-release-$verUrl.html'>Spark $ver</a> ($date)</li>"
+ .replace(/\$verUrl/, verShort.replace(/\./g, "-"))
+ .replace(/\$ver/, verShort)
+ .replace(/\$date/, releaseDate.toDateString().slice(4))
+ append(releaseNotes, contents);
+ }
+}
+
+function onVersionSelect() {
+ var versionSelect = document.getElementById("sparkVersionSelect");
+ var packageSelect = document.getElementById("sparkPackageSelect");
+ var verifyLink = document.getElementById("sparkDownloadVerify");
+
+ empty(packageSelect);
+ empty(verifyLink);
+
+ var version = getSelectedValue(versionSelect);
+ var packages = releases[version]["packages"];
+ for (var idx in packages) {
+ append(packageSelect, "<option>" + packages[idx] + "</option>")
+ }
+
+ var href = "http://www.apache.org/dist/spark/spark-" + version + "/";
+ var link = "<a href=\"" + href + "\">" + versionShort(version) + " signatures and checksums</a>"
+ append(verifyLink, link);
+
+ // Populate releases
+ onPackageSelect();
+ updateDownloadLink();
+}
+
+function onPackageSelect() {
+ var downloadSelect = document.getElementById("sparkDownloadSelect");
+ var packageSelect = document.getElementById("sparkPackageSelect");
+
+ empty(downloadSelect);
+
+ var pkg = getSelectedValue(packageSelect);
+
+ if (pkg.toLowerCase().indexOf("mapr") > -1) {
+ var external = "External Download (MAY CONTAIN INCOMPATIBLE LICENSES)";
+ append(downloadSelect, "<option value='external'>" + external + "</option>");
+ } else {
+ append(downloadSelect, "<option value='direct'>Direct Download</option>")
+ append(downloadSelect, "<option value='apache'>Select Apache Mirror</option>")
+ }
+ updateDownloadLink();
+}
+
+function onDownloadSelect() {
+ updateDownloadLink();
+}
+
+function updateDownloadLink() {
+ var versionSelect = document.getElementById("sparkVersionSelect");
+ var packageSelect = document.getElementById("sparkPackageSelect");
+ var downloadSelect = document.getElementById("sparkDownloadSelect");
+ var downloadLink = document.getElementById("spanDownloadLink");
+
+ empty(downloadLink);
+
+ var version = getSelectedValue(versionSelect);
+ var pkg = getSelectedValue(packageSelect);
+ var download = getSelectedValue(downloadSelect);
+
+ var link = "http://d3kbcqa49mib13.cloudfront.net/spark-$ver-bin-$pkg.tgz";
+ if (version <= "0.7.3") {
+ link = "http://spark-project.org/download/spark-$ver-bin-$pkg.tgz";
+ }
+ if (pkg.toLowerCase().indexOf("mapr") > -1) {
+ link = "http://package.mapr.com/tools/apache-spark/$ver/spark-$ver-bin-$pkg.tgz"
+ } else if (download == "apache") {
+ link = "http://www.apache.org/dyn/closer.cgi/spark/spark-$ver/spark-$ver-bin-$pkg.tgz";
+ }
+ link = link.replace(/\$ver/g, version).replace(/\$pkg/g, pkg);
+
+ // Sources are handled as a special case here, since they don't follow the bin-[package] syntax
+ link = link.replace(/-bin-sources/, "");
+
+ var text = link.split("/").reverse()[0];
+
+ var contents = "<a href=\"" + link + "\">" + text + "</a>";
+ append(downloadLink, contents);
+}
Modified: spark/site/community.html
URL: http://svn.apache.org/viewvc/spark/site/community.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/community.html (original)
+++ spark/site/community.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -272,9 +277,5 @@ A wide range of contributors now develop
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/documentation.html
URL: http://svn.apache.org/viewvc/spark/site/documentation.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/documentation.html (original)
+++ spark/site/documentation.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -341,9 +346,5 @@ The following papers have been published
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/downloads.html
URL: http://svn.apache.org/viewvc/spark/site/downloads.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/downloads.html (original)
+++ spark/site/downloads.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -157,34 +162,39 @@
</div>
<div class="col-md-9 col-md-pull-3">
- <h2 id="download-spark">Download Spark</h2>
-<p>The latest release is Spark 1.0.2, released August 5, 2014 <a href="/releases/spark-release-1-0-2.html">(release notes)</a> <a href="https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f">(git tag)</a></p>
-
-<p>Pre-built packages:</p>
-
-<ul>
- <li>For Hadoop 1 (HDP1, CDH3):
-<a href="http://www.apache.org/dyn/closer.cgi/spark/spark-1.0.2/spark-1.0.2-bin-hadoop1.tgz" onclick="trackOutboundLink(this, 'Release Download Links', 'apache_spark-1.0.1-bin-hadoop1.tgz'); return false;"> find an Apache mirror </a>
-or
-<a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop1.tgz" onclick="trackOutboundLink(this, 'Release Download Links', 'cloudfront_spark-1.0.2-bin-hadoop1.tgz'); return false;"> direct file download </a></li>
- <li>For CDH4:
-<a href="http://www.apache.org/dyn/closer.cgi/spark/spark-1.0.2/spark-1.0.2-bin-cdh4.tgz" onclick="trackOutboundLink(this, 'Release Download Links', 'apache_spark-1.0.1-bin-cdh4.tgz'); return false;"> find an Apache mirror </a>
-or
-<a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-cdh4.tgz" onclick="trackOutboundLink(this, 'Release Download Links', 'cloudfront_spark-1.0.2-bin-cdh4.tgz'); return false;"> direct file download </a></li>
- <li>For Hadoop 2 (HDP2, CDH5):
-<a href="http://www.apache.org/dyn/closer.cgi/spark/spark-1.0.2/spark-1.0.2-bin-hadoop2.tgz" onclick="trackOutboundLink(this, 'Release Download Links', 'apache_spark-1.0.2-bin-hadoop2.tgz'); return false;"> find an Apache mirror </a>
-or
-<a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop2.tgz" onclick="trackOutboundLink(this, 'Release Download Links', 'cloudfront_spark-1.0.2-bin-hadoop2.tgz'); return false;"> direct file download </a></li>
-</ul>
-
-<p>Pre-built packages, third-party (NOTE: may include non ASF-compatible licenses):</p>
-
-<ul>
- <li>For MapRv3: <a href="http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr3.tgz" onclick="trackOutboundLink(this, 'Release Downlaod Links', 'mapr-v3_spark-1.0.2.tgz'); return false;">direct file download (external)</a></li>
- <li>For MapRv4: <a href="http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr4.tgz" onclick="trackOutboundLink(this, 'Release Downlaod Links', 'mapr-v4_spark-1.0.2.tgz'); return false;">direct file download (external)</a></li>
-</ul>
-
-<p>Verify your download: <a href="http://www.apache.org/dist/spark/spark-1.0.2/">signatures and checksums</a></p>
+ <script type="text/javascript">
+$(document).ready(function() {
+ initDownloads();
+ initReleaseNotes();
+});
+</script>
+
+<h2 id="download-spark">Download Spark</h2>
+
+<p>Select below to download a release of Spark.
+The latest release of Spark is Spark 1.0.2
+<a href="/releases/spark-release-1-0-2.html">(release notes)</a>:</p>
+
+<ol>
+ <li>
+ <p>Chose a Spark release:
+ <select id="sparkVersionSelect" onchange="javascript:onVersionSelect();"></select><br /></p>
+ </li>
+ <li>
+ <p>Chose a package type:
+ <select id="sparkPackageSelect" onchange="javascript:onPackageSelect();"></select><br /></p>
+ </li>
+ <li>
+ <p>Chose a download type:
+ <select id="sparkDownloadSelect" onchange="javascript:onDownloadSelect()"></select><br /></p>
+ </li>
+ <li>
+ <p>Download Spark: <span id="spanDownloadLink"></span></p>
+ </li>
+ <li>
+ <p>This release can be verfied using the <span id="sparkDownloadVerify"></span>.</p>
+ </li>
+</ol>
<h3 id="link-with-spark">Link with Spark</h3>
<p>Spark artifacts are <a href="http://search.maven.org/#browse%7C1686516968">hosted in Maven Central</a>. You can add a Maven dependency with the following coordinates:</p>
@@ -194,35 +204,20 @@ artifactId: spark-core_2.10
version: 1.0.2
</code></pre>
-<h3 id="development-version">Development Version</h3>
-<p>If you are interested in working with the newest under-development code or contributing to Spark development, you can also check out the master branch from Git: <tt>git clone git://github.com/apache/spark.git</tt>.</p>
+<h3 id="development-and-maintenance-branches">Development and Maintenance Branches</h3>
+<p>If you are interested in working with the newest under-development code or contributing to Spark development, you can also check out the master branch from Git:</p>
+
+<pre><code># Master development branch
+git clone git://github.com/apache/spark.git
+
+# 1.1 maintenance branch with stability fixes on top of Spark 1.1.0
+git clone git://github.com/apache/spark.git -b branch-1.1
+</code></pre>
-<p>Once youâve downloaded Spark, you can find instructions for installing and building it on the <a href="/documentation.html">documentation page</a>.</p>
+<p>Once you’ve downloaded Spark, you can find instructions for installing and building it on the <a href="/documentation.html">documentation page</a>.</p>
<h3 id="all-releases">All Releases</h3>
-<ul>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2.tgz">Spark 1.0.2</a> (August 5, 2014) <a href="/releases/spark-release-1-0-2.html">(release notes)</a> (prebuilt: <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop1.tgz">Hadoop1 [HDP1, CDH3]</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-cdh4.tgz">CDH4</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.2-bin-hadoop2.tgz">Hadoop2 [HDP2, CDH5]</a>, third-party: <a href="http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr3.tgz">MapRv3</a>, <a href="http://package.mapr.com/tools/apache-spark/1.0.2/spark-1.0.2-bin-mapr4.tgz">MapRv4</a>)</li>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1.tgz">Spark 1.0.1</a> (July 11, 2014) <a href="/releases/spark-release-1-0-1.html">(release notes)</a> (prebuilt: <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1-bin-hadoop1.tgz">Hadoop1 [HDP1, CDH3]</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1-bin-cdh4.tgz">CDH4</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.1-bin-hadoop2.tgz">Hadoop2 [HDP2, CDH5]</a>, third-party: <a href="http://package.mapr.com/tools/apache-spark/1.0.1/spark-1.0.1-bin-mapr3.tgz">MapRv3</a>, <a href="http://package.mapr.com/tools/apache-spark/1.0.1/spark-1.0.1-bin-mapr3.tgz">MapRv4</a>)</li>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0.tgz">Spark 1.0.0</a> (May 30, 2014) <a href="/releases/spark-release-1-0-0.html">(release notes)</a> (prebuilt: <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-hadoop1.tgz">Hadoop1 [HDP1, CDH3]</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-cdh4.tgz">CDH4</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-hadoop2.tgz">Hadoop2 [HDP2, CDH5]</a>)</li>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2.tgz">Spark 0.9.2</a> (Jul 23, 2014) <a href="/releases/spark-release-0-9-2.html">(release notes)</a> (prebuilt: <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2-bin-hadoop1.tgz">Hadoop1 [HDP1, CDH3]</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2-bin-cdh4.tgz">CDH4</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.2-bin-hadoop2.tgz">Hadoop2 [HDP2, CDH5]</a>) </li>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1.tgz">Spark 0.9.1</a> (Apr 9, 2014) <a href="/releases/spark-release-0-9-1.html">(release notes)</a> (prebuilt: <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1-bin-hadoop1.tgz">Hadoop1 [HDP1, CDH3]</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1-bin-cdh4.tgz">CDH4</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.1-bin-hadoop2.tgz">Hadoop2 [HDP2, CDH5]</a>)</li>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating.tgz">Spark 0.9.0</a> (Feb 2, 2014) <a href="/releases/spark-release-0-9-0.html">(release notes)</a> (prebuilt: <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating-bin-hadoop1.tgz">Hadoop1 [HDP1, CDH3]</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating-bin-cdh4.tgz">CDH4</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.9.0-incubating-bin-hadoop2.tgz">Hadoop2 [HDP2, CDH5]</a>)</li>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating.tgz">Spark 0.8.1</a> (Dec 19, 2013) <a href="/releases/spark-release-0-8-1.html">(release notes)</a> (prebuilt: <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating-bin-hadoop1.tgz">Hadoop1 [HDP1, CDH3]</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating-bin-cdh4.tgz">CDH4</a>, <a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.8.1-incubating-bin-hadoop2.tgz">Hadoop2 [HDP2, CDH5]</a>)</li>
- <li><a href="http://d3kbcqa49mib13.cloudfront.net/spark-0.8.0-incubating.tgz">Spark 0.8.0</a> (Sept 25, 2013) <a href="/releases/spark-release-0-8-0.html">(release notes)</a> (prebuilt: <a href="http://spark-project.org/download/spark-0.8.0-incubating-bin-hadoop1.tgz">Hadoop 1 / CDH3</a>, <a href="http://spark-project.org/download/spark-0.8.0-incubating-bin-cdh4.tgz">CDH4</a>)</li>
- <li><a href="http://spark-project.org/download/spark-0.7.3-sources.tgz">Spark 0.7.3</a> (July 16, 2013) <a href="/releases/spark-release-0-7-3.html">(release notes)</a> (prebuilt:
-<a href="http://spark-project.org/download/spark-0.7.3-prebuilt-hadoop1.tgz">Hadoop1 / CDH3</a>, <a href="http://spark-project.org/download/spark-0.7.3-prebuilt-cdh4.tgz">CDH4</a>)</li>
- <li><a href="http://spark-project.org/download/spark-0.7.2-sources.tgz">Spark 0.7.2</a> (June 2, 2013) <a href="/releases/spark-release-0-7-2.html">(release notes)</a> (prebuilt:
-<a href="http://spark-project.org/download/spark-0.7.2-prebuilt-hadoop1.tgz">Hadoop1 / CDH3</a>, <a href="http://spark-project.org/download/spark-0.7.2-prebuilt-cdh4.tgz">CDH4</a>)</li>
- <li><a href="http://spark-project.org/download/spark-0.7.0-sources.tgz">Spark 0.7.0</a> (February 27, 2013) <a href="/releases/spark-release-0-7-0.html">(release notes)</a></li>
- <li><a href="http://spark-project.org/download/spark-0.6.2-sources.tgz">Spark 0.6.2</a> (February 7, 2013) <a href="/releases/spark-release-0-6-2.html">(release notes)</a></li>
- <li><a href="https://github.com/downloads/mesos/spark/spark-0.6.1-sources.tgz">Spark 0.6.1</a> (November 22, 2012) <a href="/releases/spark-release-0-6-1.html">(release notes)</a></li>
- <li><a href="https://github.com/downloads/mesos/spark/spark-0.5.2-sources.tgz">Spark 0.5.2</a> (November 22, 2012) <a href="/releases/spark-release-0-5-2.html">(release notes)</a></li>
- <li><a href="http://github.com/downloads/mesos/spark/spark-0.6.0-sources.tar.gz">Spark 0.6.0</a> (October 15, 2012) <a href="/releases/spark-release-0-6-0.html">(release notes)</a></li>
- <li><a href="http://github.com/downloads/mesos/spark/spark-0.5.1.tgz">Spark 0.5.1</a> (October 11, 2012) <a href="/releases/spark-release-0-5-1.html">(release notes)</a></li>
- <li><a href="https://github.com/mesos/spark/tarball/v0.5.0">Spark 0.5.0</a> (June 12, 2012) <a href="/releases/spark-release-0-5-0.html">(release notes)</a></li>
- <li><a href="https://github.com/mesos/spark/tarball/0.3-scala-2.9">Spark 0.3 for Scala 2.9</a> (July 14, 2011) <a href="/releases/spark-release-0-3.html">(release notes)</a></li>
- <li><a href="https://github.com/mesos/spark/tarball/0.3-scala-2.8">Spark 0.3 for Scala 2.8</a> (July 14, 2011) <a href="/releases/spark-release-0-3.html">(release notes)</a></li>
- <li><a href="https://github.com/mesos/spark/tarball/alpha-0.2">Spark 0.2</a> (May 24, 2011)</li>
+<ul id="sparkReleaseNotes">
</ul>
</div>
@@ -238,9 +233,5 @@ version: 1.0.2
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/examples.html
URL: http://svn.apache.org/viewvc/spark/site/examples.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/examples.html (original)
+++ spark/site/examples.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -427,9 +432,5 @@ previous ones, and <em>actions</em>, whi
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/faq.html
URL: http://svn.apache.org/viewvc/spark/site/faq.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/faq.html (original)
+++ spark/site/faq.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -222,9 +227,5 @@ streaming, interactive queries, and mach
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/graphx/index.html
URL: http://svn.apache.org/viewvc/spark/site/graphx/index.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/graphx/index.html (original)
+++ spark/site/graphx/index.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -285,9 +290,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/index.html
URL: http://svn.apache.org/viewvc/spark/site/index.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/index.html (original)
+++ spark/site/index.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -351,9 +356,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Added: spark/site/js/downloads.js
URL: http://svn.apache.org/viewvc/spark/site/js/downloads.js?rev=1624392&view=auto
==============================================================================
--- spark/site/js/downloads.js (added)
+++ spark/site/js/downloads.js Thu Sep 11 21:06:59 2014
@@ -0,0 +1,148 @@
+// Script for generating Spark download links
+// No dependencies; pure javascript.
+
+releases = {};
+
+function addRelease(version, releaseDate, packages, downloadable) {
+ releases[version] = {released: releaseDate, packages: packages, downloadable: downloadable};
+}
+
+var sources = ["sources"];
+var packagesV1 = sources.concat(["hadoop1", "cdh4"]);
+var packagesV2 = packagesV1.concat(["hadoop2"]);
+var packagesV3 = packagesV2.concat(["mapr3", "mapr4"]);
+
+addRelease("1.0.2", new Date(2014, 8, 5), packagesV3, true);
+addRelease("1.0.1", new Date(2014, 7, 11), packagesV3);
+addRelease("1.0.0", new Date(2014, 5, 30), packagesV2);
+addRelease("0.9.2", new Date(2014, 7, 23), packagesV2, true);
+addRelease("0.9.1", new Date(2014, 4, 9), packagesV2);
+addRelease("0.9.0-incubating", new Date(2014, 2, 2), packagesV2);
+addRelease("0.8.1-incubating", new Date(2013, 12, 19), packagesV2, true);
+addRelease("0.8.0-incubating", new Date(2013, 9, 25), packagesV1, true);
+addRelease("0.7.3", new Date(2013, 7, 16), packagesV1, true);
+addRelease("0.7.2", new Date(2013, 6, 2), packagesV1);
+addRelease("0.7.0", new Date(2013, 2, 27), sources);
+
+function append(el, contents) {
+ el.innerHTML = el.innerHTML + contents;
+};
+
+function empty(el) {
+ el.innerHTML = "";
+}
+
+function getSelectedValue(selectEl) {
+ return selectEl.options[selectEl.selectedIndex].value;
+}
+
+function versionShort(version) { return version.replace(/-incubating/, ""); }
+
+function initDownloads() {
+ var versionSelect = document.getElementById("sparkVersionSelect");
+
+ // Populate versions
+ for (var version in releases) {
+ var releaseDate = releases[version].released;
+ var downloadable = releases[version].downloadable;
+
+ if (!downloadable) { continue; }
+
+ // Don't display incubation status here
+ var title = versionShort(version) + " (" + releaseDate.toDateString().slice(4) + ")";
+ append(versionSelect, "<option value=\"" + version + "\">" + title + "</option>");
+ }
+
+ // Populate packages and (transitively) releases
+ onVersionSelect();
+}
+
+function initReleaseNotes() {
+ var releaseNotes = document.getElementById("sparkReleaseNotes");
+ for (var version in releases) {
+ var releaseDate = releases[version].released;
+ var verShort = versionShort(version);
+ var contents = "<li><a href='releases/spark-release-$verUrl.html'>Spark $ver</a> ($date)</li>"
+ .replace(/\$verUrl/, verShort.replace(/\./g, "-"))
+ .replace(/\$ver/, verShort)
+ .replace(/\$date/, releaseDate.toDateString().slice(4))
+ append(releaseNotes, contents);
+ }
+}
+
+function onVersionSelect() {
+ var versionSelect = document.getElementById("sparkVersionSelect");
+ var packageSelect = document.getElementById("sparkPackageSelect");
+ var verifyLink = document.getElementById("sparkDownloadVerify");
+
+ empty(packageSelect);
+ empty(verifyLink);
+
+ var version = getSelectedValue(versionSelect);
+ var packages = releases[version]["packages"];
+ for (var idx in packages) {
+ append(packageSelect, "<option>" + packages[idx] + "</option>")
+ }
+
+ var href = "http://www.apache.org/dist/spark/spark-" + version + "/";
+ var link = "<a href=\"" + href + "\">" + versionShort(version) + " signatures and checksums</a>"
+ append(verifyLink, link);
+
+ // Populate releases
+ onPackageSelect();
+ updateDownloadLink();
+}
+
+function onPackageSelect() {
+ var downloadSelect = document.getElementById("sparkDownloadSelect");
+ var packageSelect = document.getElementById("sparkPackageSelect");
+
+ empty(downloadSelect);
+
+ var pkg = getSelectedValue(packageSelect);
+
+ if (pkg.toLowerCase().indexOf("mapr") > -1) {
+ var external = "External Download (MAY CONTAIN INCOMPATIBLE LICENSES)";
+ append(downloadSelect, "<option value='external'>" + external + "</option>");
+ } else {
+ append(downloadSelect, "<option value='direct'>Direct Download</option>")
+ append(downloadSelect, "<option value='apache'>Select Apache Mirror</option>")
+ }
+ updateDownloadLink();
+}
+
+function onDownloadSelect() {
+ updateDownloadLink();
+}
+
+function updateDownloadLink() {
+ var versionSelect = document.getElementById("sparkVersionSelect");
+ var packageSelect = document.getElementById("sparkPackageSelect");
+ var downloadSelect = document.getElementById("sparkDownloadSelect");
+ var downloadLink = document.getElementById("spanDownloadLink");
+
+ empty(downloadLink);
+
+ var version = getSelectedValue(versionSelect);
+ var pkg = getSelectedValue(packageSelect);
+ var download = getSelectedValue(downloadSelect);
+
+ var link = "http://d3kbcqa49mib13.cloudfront.net/spark-$ver-bin-$pkg.tgz";
+ if (version <= "0.7.3") {
+ link = "http://spark-project.org/download/spark-$ver-bin-$pkg.tgz";
+ }
+ if (pkg.toLowerCase().indexOf("mapr") > -1) {
+ link = "http://package.mapr.com/tools/apache-spark/$ver/spark-$ver-bin-$pkg.tgz"
+ } else if (download == "apache") {
+ link = "http://www.apache.org/dyn/closer.cgi/spark/spark-$ver/spark-$ver-bin-$pkg.tgz";
+ }
+ link = link.replace(/\$ver/g, version).replace(/\$pkg/g, pkg);
+
+ // Sources are handled as a special case here, since they don't follow the bin-[package] syntax
+ link = link.replace(/-bin-sources/, "");
+
+ var text = link.split("/").reverse()[0];
+
+ var contents = "<a href=\"" + link + "\">" + text + "</a>";
+ append(downloadLink, contents);
+}
Modified: spark/site/mailing-lists.html
URL: http://svn.apache.org/viewvc/spark/site/mailing-lists.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/mailing-lists.html (original)
+++ spark/site/mailing-lists.html Thu Sep 11 21:06:59 2014
@@ -51,6 +51,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -175,9 +180,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/mllib/index.html
URL: http://svn.apache.org/viewvc/spark/site/mllib/index.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/mllib/index.html (original)
+++ spark/site/mllib/index.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -186,9 +191,9 @@
points = spark.textFile(<span class="string">"hdfs://..."</span>)<br />
.<span class="sparkop">map</span>(<span class="closure">parsePoint</span>)<br />
<br />
- model = KMeans.<span class="sparkop">train</span>(points, k=10)
+ model = KMeans.<span class="sparkop">train</span>(points)
</div>
- <div class="caption">Calling MLlib in Python</div>
+ <div class="caption">Calling MLlib in Scala</div>
</div>
</div>
</div>
@@ -242,18 +247,16 @@
<div class="col-md-4 col-padded">
<h3>Algorithms</h3>
<p>
- MLlib 1.1 contains the following algorithms:
+ MLlib 0.9 contains the following algorithms:
</p>
<ul class="list-narrow">
- <li>linear SVM and logistic regression</li>
- <li>classification and regression tree</li>
- <li>k-means clustering</li>
- <li>recommendation via alternating least squares</li>
- <li>singular value decomposition</li>
- <li>linear regression with L<sub>1</sub>- and L<sub>2</sub>-regularization</li>
- <li>multinomial naive Bayes</li>
- <li>basic statistics</li>
- <li>feature transformations</li>
+ <li>K-means clustering with <a href="http://theory.stanford.edu/~sergei/papers/vldb12-kmpar.pdf">K-means|| initialization</a>.</li>
+ <li>L<sub>1</sub>- and L<sub>2</sub>-regularized <a href="http://en.wikipedia.org/wiki/Linear_regression">linear regression</a>.</li>
+ <li>L<sub>1</sub>- and L<sub>2</sub>-regularized <a href="http://en.wikipedia.org/wiki/Logistic_regression">logistic regression</a>.</li>
+ <li><a href="http://www.hpl.hp.com/personal/Robert_Schreiber/papers/2008%20AAIM%20Netflix/netflix_aaim08(submitted).pdf">Alternating least squares</a> collaborative filtering, with explicit
+ ratings or <a href="http://www2.research.att.com/~yifanhu/PUB/cf.pdf">implicit feedback</a>.</li>
+ <li><a href="http://en.wikipedia.org/wiki/Naive_Bayes_classifier">Naive Bayes</a> multinomial classification.</li>
+ <li>Stochastic gradient descent.</li>
</ul>
<p>Refer to the <a href="/docs/latest/mllib-guide.html">MLlib guide</a> for usage examples.</p>
</div>
@@ -311,9 +314,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/amp-camp-2013-registration-ope.html
URL: http://svn.apache.org/viewvc/spark/site/news/amp-camp-2013-registration-ope.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/amp-camp-2013-registration-ope.html (original)
+++ spark/site/news/amp-camp-2013-registration-ope.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -160,7 +165,7 @@
<h2>Registration open for AMP Camp training camp in Berkeley</h2>
-<p>Want to learn how to use Spark, Shark, GraphX, and related technologies in person? The AMP Lab is hosting a two-day training workshop for them on August 29th and 30th in Berkeley. The workshop will include tutorials, talks from users, and over four hours of hands-on exercises. <a href="http://ampcamp.berkeley.edu/amp-camp-three-berkeley-2013/">Registration is now open on the AMP Camp website</a>, for a price of $250 per person. We recommend signing up early because last yearâs workshop was sold out.</p>
+<p>Want to learn how to use Spark, Shark, GraphX, and related technologies in person? The AMP Lab is hosting a two-day training workshop for them on August 29th and 30th in Berkeley. The workshop will include tutorials, talks from users, and over four hours of hands-on exercises. <a href="http://ampcamp.berkeley.edu/amp-camp-three-berkeley-2013/">Registration is now open on the AMP Camp website</a>, for a price of $250 per person. We recommend signing up early because last year’s workshop was sold out.</p>
<p>
@@ -181,9 +186,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/announcing-the-first-spark-summit.html
URL: http://svn.apache.org/viewvc/spark/site/news/announcing-the-first-spark-summit.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/announcing-the-first-spark-summit.html (original)
+++ spark/site/news/announcing-the-first-spark-summit.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -185,9 +190,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/fourth-spark-screencast-published.html
URL: http://svn.apache.org/viewvc/spark/site/news/fourth-spark-screencast-published.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/fourth-spark-screencast-published.html (original)
+++ spark/site/news/fourth-spark-screencast-published.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -185,9 +190,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/index.html
URL: http://svn.apache.org/viewvc/spark/site/news/index.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/index.html (original)
+++ spark/site/news/index.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -196,7 +201,7 @@ Contributions to this release came from
<h3 class="entry-title"><a href="/news/spark-1-0-1-released.html">Spark 1.0.1 released</a></h3>
<div class="entry-date">July 11, 2014</div>
</header>
- <div class="entry-content"><p>We are happy to announce the availability of <a href="/releases/spark-release-1-0-1.html" title="Spark Release 1.0.1">Spark 1.0.1</a>! This release includes contributions from 70 developers. Spark 1.0.0 includes fixes across several areas of Spark, including the core API, PySpark, and MLlib. It also includes new features in Sparkâs (alpha) SQL library, including support for JSON data and performance and stability fixes.</p>
+ <div class="entry-content"><p>We are happy to announce the availability of <a href="/releases/spark-release-1-0-1.html" title="Spark Release 1.0.1">Spark 1.0.1</a>! This release includes contributions from 70 developers. Spark 1.0.0 includes fixes across several areas of Spark, including the core API, PySpark, and MLlib. It also includes new features in Spark’s (alpha) SQL library, including support for JSON data and performance and stability fixes.</p>
</div>
</article>
@@ -219,8 +224,8 @@ organizations using Spark, focused on us
<h3 class="entry-title"><a href="/news/spark-1-0-0-released.html">Spark 1.0.0 released</a></h3>
<div class="entry-date">May 30, 2014</div>
</header>
- <div class="entry-content"><p>We are happy to announce the availability of <a href="/releases/spark-release-1-0-0.html" title="Spark Release 1.0.0">Spark 1.0.0</a>! Spark 1.0.0 is the first in the 1.X line of releases, providing API stability for Sparkâs core interfaces. It is Sparkâs largest release ever, with contributions from 117 developers.
-This release expands Sparkâs standard libraries, introducing a new SQL package (Spark SQL) that lets users integrate SQL queries into existing Spark workflows. MLlib, Sparkâs machine learning library, is expanded with sparse vector support and several new algorithms. The GraphX and Streaming libraries also introduce new features and optimizations. Sparkâs core engine adds support for secured YARN clusters, a unified tool for submitting Spark applications, and several performance and stability improvements.</p>
+ <div class="entry-content"><p>We are happy to announce the availability of <a href="/releases/spark-release-1-0-0.html" title="Spark Release 1.0.0">Spark 1.0.0</a>! Spark 1.0.0 is the first in the 1.X line of releases, providing API stability for Spark’s core interfaces. It is Spark’s largest release ever, with contributions from 117 developers.
+This release expands Spark’s standard libraries, introducing a new SQL package (Spark SQL) that lets users integrate SQL queries into existing Spark workflows. MLlib, Spark’s machine learning library, is expanded with sparse vector support and several new algorithms. The GraphX and Streaming libraries also introduce new features and optimizations. Spark’s core engine adds support for secured YARN clusters, a unified tool for submitting Spark applications, and several performance and stability improvements.</p>
</div>
</article>
@@ -257,7 +262,7 @@ Contributions to this release came from
<h3 class="entry-title"><a href="/news/submit-talks-to-spark-summit-2014.html">Submissions and registration open for Spark Summit 2014</a></h3>
<div class="entry-date">March 20, 2014</div>
</header>
- <div class="entry-content"><p>After last yearâs successful <a href="http://spark-summit.org/2013">first Spark Summit</a>, registrations
+ <div class="entry-content"><p>After last year’s successful <a href="http://spark-summit.org/2013">first Spark Summit</a>, registrations
and talk submissions are now open for <a href="http://spark-summit.org/2014">Spark Summit 2014</a>.
This will be a 3-day event in San Francisco organized by multiple companies in the Spark community.
The event will run <strong>June 30th to July 2nd</strong> in San Francisco, CA.</p>
@@ -270,7 +275,7 @@ The event will run <strong>June 30th to
<h3 class="entry-title"><a href="/news/spark-becomes-tlp.html">Spark becomes top-level Apache project</a></h3>
<div class="entry-date">February 27, 2014</div>
</header>
- <div class="entry-content"><p>The Apache Software Foundation <a href="https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces50">announced</a> today that Spark has graduated from the Apache Incubator to become a top-level Apache project, signifying that the projectâs community and products have been well-governed under the ASFâs meritocratic process and principles. This is a major step for the community and we are very proud to share this news with users as we complete Sparkâs move to Apache. Read more about Sparkâs growth during the past year and from contributors and users in the ASFâs <a href="https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces50">press release</a>.</p>
+ <div class="entry-content"><p>The Apache Software Foundation <a href="https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces50">announced</a> today that Spark has graduated from the Apache Incubator to become a top-level Apache project, signifying that the project’s community and products have been well-governed under the ASF’s meritocratic process and principles. This is a major step for the community and we are very proud to share this news with users as we complete Spark’s move to Apache. Read more about Spark’s growth during the past year and from contributors and users in the ASF’s <a href="https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces50">press release</a>.</p>
</div>
</article>
@@ -281,8 +286,8 @@ The event will run <strong>June 30th to
<div class="entry-date">February 2, 2014</div>
</header>
<div class="entry-content"><p>We are happy to announce the availability of <a href="/releases/spark-release-0-9-0.html" title="Spark Release 0.9.0">
-Spark 0.9.0</a>! Spark 0.9.0 is a major release and Sparkâs largest release ever, with contributions from 83 developers.
-This release expands Sparkâs standard libraries, introducing a new graph computation package (GraphX) and adding several new features to the machine learning and stream-processing packages. It also makes major improvements to the core engine,
+Spark 0.9.0</a>! Spark 0.9.0 is a major release and Spark’s largest release ever, with contributions from 83 developers.
+This release expands Spark’s standard libraries, introducing a new graph computation package (GraphX) and adding several new features to the machine learning and stream-processing packages. It also makes major improvements to the core engine,
including external aggregations, a simplified H/A mode for long lived applications, and
hardened YARN support.</p>
@@ -294,7 +299,7 @@ hardened YARN support.</p>
<h3 class="entry-title"><a href="/news/spark-0-8-1-released.html">Spark 0.8.1 released</a></h3>
<div class="entry-date">December 19, 2013</div>
</header>
- <div class="entry-content"><p>Weâve just posted <a href="/releases/spark-release-0-8-1.html" title="Spark Release 0.8.1">Spark Release 0.8.1</a>, a maintenance and performance release for the Scala 2.9 version of Spark. 0.8.1 includes support for YARN 2.2, a high availability mode for the standalone scheduler, optimizations to the shuffle, and many other improvements. We recommend that all users update to this release. Visit the <a href="/releases/spark-release-0-8-1.html" title="Spark Release 0.8.1">release notes</a> to read about the new features, or <a href="/downloads.html">download</a> the release today.</p>
+ <div class="entry-content"><p>We’ve just posted <a href="/releases/spark-release-0-8-1.html" title="Spark Release 0.8.1">Spark Release 0.8.1</a>, a maintenance and performance release for the Scala 2.9 version of Spark. 0.8.1 includes support for YARN 2.2, a high availability mode for the standalone scheduler, optimizations to the shuffle, and many other improvements. We recommend that all users update to this release. Visit the <a href="/releases/spark-release-0-8-1.html" title="Spark Release 0.8.1">release notes</a> to read about the new features, or <a href="/downloads.html">download</a> the release today.</p>
</div>
</article>
@@ -325,7 +330,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-0-8-0-released.html">Spark 0.8.0 released</a></h3>
<div class="entry-date">September 25, 2013</div>
</header>
- <div class="entry-content"><p>Weâre proud to announce the release of <a href="/releases/spark-release-0-8-0.html" title="Spark Release 0.8.0">Apache Spark 0.8.0</a>. Spark 0.8.0 is a major release that includes many new capabilities and usability improvements. Itâs also our first release under the Apache incubator. It is the largest Spark release yet, with contributions from 67 developers and 24 companies. Major new features include an expanded monitoring framework and UI, a machine learning library, and support for running Spark inside of YARN.</p>
+ <div class="entry-content"><p>We’re proud to announce the release of <a href="/releases/spark-release-0-8-0.html" title="Spark Release 0.8.0">Apache Spark 0.8.0</a>. Spark 0.8.0 is a major release that includes many new capabilities and usability improvements. Itâs also our first release under the Apache incubator. It is the largest Spark release yet, with contributions from 67 developers and 24 companies. Major new features include an expanded monitoring framework and UI, a machine learning library, and support for running Spark inside of YARN.</p>
</div>
</article>
@@ -335,7 +340,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-user-survey-and-powered-by-page.html">Spark user survey and "Powered By" page</a></h3>
<div class="entry-date">September 5, 2013</div>
</header>
- <div class="entry-content"><p>As we continue developing Spark, we would love to get feedback from users and hear what youâd like us to work on next. Weâve decided that a good way to do that is a survey â we hope to run this at regular intervals. If you have a few minutes to participate, <a href="https://docs.google.com/forms/d/1eMXp4GjcIXglxJe5vYYBzXKVm-6AiYt1KThJwhCjJiY/viewform">fill in the survey here</a>. Your time is greatly appreciated.</p>
+ <div class="entry-content"><p>As we continue developing Spark, we would love to get feedback from users and hear what you’d like us to work on next. We’ve decided that a good way to do that is a survey – we hope to run this at regular intervals. If you have a few minutes to participate, <a href="https://docs.google.com/forms/d/1eMXp4GjcIXglxJe5vYYBzXKVm-6AiYt1KThJwhCjJiY/viewform">fill in the survey here</a>. Your time is greatly appreciated.</p>
</div>
</article>
@@ -355,7 +360,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/amp-camp-2013-registration-ope.html">Registration open for AMP Camp training camp in Berkeley</a></h3>
<div class="entry-date">July 23, 2013</div>
</header>
- <div class="entry-content"><p>Want to learn how to use Spark, Shark, GraphX, and related technologies in person? The AMP Lab is hosting a two-day training workshop for them on August 29th and 30th in Berkeley. The workshop will include tutorials, talks from users, and over four hours of hands-on exercises. <a href="http://ampcamp.berkeley.edu/amp-camp-three-berkeley-2013/">Registration is now open on the AMP Camp website</a>, for a price of $250 per person. We recommend signing up early because last yearâs workshop was sold out.</p>
+ <div class="entry-content"><p>Want to learn how to use Spark, Shark, GraphX, and related technologies in person? The AMP Lab is hosting a two-day training workshop for them on August 29th and 30th in Berkeley. The workshop will include tutorials, talks from users, and over four hours of hands-on exercises. <a href="http://ampcamp.berkeley.edu/amp-camp-three-berkeley-2013/">Registration is now open on the AMP Camp website</a>, for a price of $250 per person. We recommend signing up early because last year’s workshop was sold out.</p>
</div>
</article>
@@ -386,7 +391,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-0-7-3-released.html">Spark 0.7.3 released</a></h3>
<div class="entry-date">July 16, 2013</div>
</header>
- <div class="entry-content"><p>Weâve just posted <a href="/releases/spark-release-0-7-3.html" title="Spark Release 0.7.3">Spark Release 0.7.3</a>, a maintenance release that contains several fixes, including streaming API updates and new functionality for adding JARs to a <code>spark-shell</code> session. We recommend that all users update to this release. Visit the <a href="/releases/spark-release-0-7-3.html" title="Spark Release 0.7.3">release notes</a> to read about the new features, or <a href="/downloads.html">download</a> the release today.</p>
+ <div class="entry-content"><p>We’ve just posted <a href="/releases/spark-release-0-7-3.html" title="Spark Release 0.7.3">Spark Release 0.7.3</a>, a maintenance release that contains several fixes, including streaming API updates and new functionality for adding JARs to a <code>spark-shell</code> session. We recommend that all users update to this release. Visit the <a href="/releases/spark-release-0-7-3.html" title="Spark Release 0.7.3">release notes</a> to read about the new features, or <a href="/downloads.html">download</a> the release today.</p>
</div>
</article>
@@ -416,7 +421,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-0-7-2-released.html">Spark 0.7.2 released</a></h3>
<div class="entry-date">June 2, 2013</div>
</header>
- <div class="entry-content"><p>Weâre happy to announce the release of <a href="/releases/spark-release-0-7-2.html" title="Spark Release 0.7.2">Spark 0.7.2</a>, a new maintenance release that includes several bug fixes and improvements, as well as new code examples and API features. We recommend that all users update to this release. Head over to the <a href="/releases/spark-release-0-7-2.html" title="Spark Release 0.7.2">release notes</a> to read about the new features, or <a href="/downloads.html">download</a> the release today.</p>
+ <div class="entry-content"><p>We’re happy to announce the release of <a href="/releases/spark-release-0-7-2.html" title="Spark Release 0.7.2">Spark 0.7.2</a>, a new maintenance release that includes several bug fixes and improvements, as well as new code examples and API features. We recommend that all users update to this release. Head over to the <a href="/releases/spark-release-0-7-2.html" title="Spark Release 0.7.2">release notes</a> to read about the new features, or <a href="/downloads.html">download</a> the release today.</p>
</div>
</article>
@@ -442,7 +447,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/strata-exercises-now-available-online.html">Strata exercises now available online</a></h3>
<div class="entry-date">March 17, 2013</div>
</header>
- <div class="entry-content"><p>At this yearâs <a href="http://strataconf.com/strata2013">Strata</a> conference, the AMP Lab hosted a full day of tutorials on Spark, Shark, and Spark Streaming, including online exercises on Amazon EC2. Those exercises are now <a href="http://ampcamp.berkeley.edu/big-data-mini-course/">available online</a>, letting you learn Spark and Shark at your own pace on an EC2 cluster with real data. They are a great resource for learning the systems. You can also find <a href="http://ampcamp.berkeley.edu/amp-camp-two-strata-2013/">slides</a> from the Strata tutorials online, as well as <a href="http://ampcamp.berkeley.edu/amp-camp-one-berkeley-2012/">videos</a> from the AMP Camp workshop we held at Berkeley in August.</p>
+ <div class="entry-content"><p>At this year’s <a href="http://strataconf.com/strata2013">Strata</a> conference, the AMP Lab hosted a full day of tutorials on Spark, Shark, and Spark Streaming, including online exercises on Amazon EC2. Those exercises are now <a href="http://ampcamp.berkeley.edu/big-data-mini-course/">available online</a>, letting you learn Spark and Shark at your own pace on an EC2 cluster with real data. They are a great resource for learning the systems. You can also find <a href="http://ampcamp.berkeley.edu/amp-camp-two-strata-2013/">slides</a> from the Strata tutorials online, as well as <a href="http://ampcamp.berkeley.edu/amp-camp-one-berkeley-2012/">videos</a> from the AMP Camp workshop we held at Berkeley in August.</p>
</div>
</article>
@@ -452,7 +457,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-0-7-0-released.html">Spark 0.7.0 released</a></h3>
<div class="entry-date">February 27, 2013</div>
</header>
- <div class="entry-content"><p>Weâre proud to announce the release of <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">Spark 0.7.0</a>, a new major version of Spark that adds several key features, including a <a href="/docs/latest/python-programming-guide.html">Python API</a> for Spark and an <a href="/docs/latest/streaming-programming-guide.html">alpha of Spark Streaming</a>. This release is the result of the largest group of contributors yet behind a Spark release â 31 contributors from inside and outside Berkeley. Head over to the <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">release notes</a> to read more about the new features, or <a href="/downloads.html">download</a> the release today.</p>
+ <div class="entry-content"><p>We’re proud to announce the release of <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">Spark 0.7.0</a>, a new major version of Spark that adds several key features, including a <a href="/docs/latest/python-programming-guide.html">Python API</a> for Spark and an <a href="/docs/latest/streaming-programming-guide.html">alpha of Spark Streaming</a>. This release is the result of the largest group of contributors yet behind a Spark release – 31 contributors from inside and outside Berkeley. Head over to the <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">release notes</a> to read more about the new features, or <a href="/downloads.html">download</a> the release today.</p>
</div>
</article>
@@ -462,7 +467,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/run-spark-and-shark-on-amazon-emr.html">Spark/Shark Tutorial for Amazon EMR</a></h3>
<div class="entry-date">February 24, 2013</div>
</header>
- <div class="entry-content"><p>This weekend, Amazon posted an <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">article</a> and code that make it easy to launch Spark and Shark on Elastic MapReduce. The article includes examples of how to run both interactive Scala commands and SQL queries from Shark on data in S3. Head over to the <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">Amazon article</a> for details. Weâre very excited because, to our knowledge, this makes Spark the first non-Hadoop engine that you can launch with EMR.</p>
+ <div class="entry-content"><p>This weekend, Amazon posted an <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">article</a> and code that make it easy to launch Spark and Shark on Elastic MapReduce. The article includes examples of how to run both interactive Scala commands and SQL queries from Shark on data in S3. Head over to the <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">Amazon article</a> for details. We’re very excited because, to our knowledge, this makes Spark the first non-Hadoop engine that you can launch with EMR.</p>
</div>
</article>
@@ -497,7 +502,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/video-from-first-spark-development-meetup.html">Video up from first Spark development meetup</a></h3>
<div class="entry-date">December 21, 2012</div>
</header>
- <div class="entry-content"><p>On December 18th, we held the first of a series of Spark development meetups, for people interested in learning the Spark codebase and contributing to the project. There was quite a bit more demand than we anticipated, with over 80 people signing up and 64 attending. The first meetup was an <a href="http://www.meetup.com/spark-users/events/94101942/">introduction to Spark internals</a>. Thanks to one of the attendees, thereâs now a <a href="http://www.youtube.com/watch?v=49Hr5xZyTEA">video of the meetup</a> on YouTube. Weâve also posted the <a href="http://files.meetup.com/3138542/dev-meetup-dec-2012.pptx">slides</a>. Look to see more development meetups on Spark and Shark in the future.</p>
+ <div class="entry-content"><p>On December 18th, we held the first of a series of Spark development meetups, for people interested in learning the Spark codebase and contributing to the project. There was quite a bit more demand than we anticipated, with over 80 people signing up and 64 attending. The first meetup was an <a href="http://www.meetup.com/spark-users/events/94101942/">introduction to Spark internals</a>. Thanks to one of the attendees, there’s now a <a href="http://www.youtube.com/watch?v=49Hr5xZyTEA">video of the meetup</a> on YouTube. We’ve also posted the <a href="http://files.meetup.com/3138542/dev-meetup-dec-2012.pptx">slides</a>. Look to see more development meetups on Spark and Shark in the future.</p>
</div>
</article>
@@ -507,7 +512,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-and-shark-in-the-news.html">Spark in the news</a></h3>
<div class="entry-date">December 21, 2012</div>
</header>
- <div class="entry-content"><p>Recently, weâve seen quite a bit of coverage of Spark in the news. I wanted to list some of the more recent articles, for readers interested in learning more.</p>
+ <div class="entry-content"><p>Recently, we’ve seen quite a bit of coverage of Spark in the news. I wanted to list some of the more recent articles, for readers interested in learning more.</p>
<ul>
<li>Curt Monash, editor of the popular DBMS2 blog, wrote a great <a href="http://www.dbms2.com/2012/12/13/introduction-to-spark-shark-bdas-and-amplab/">introduction to Spark and Shark</a>, as well as a more detailed <a href="http://www.dbms2.com/2012/12/13/spark-shark-and-rdds-technology-notes/">technical overview</a>.</li>
@@ -517,7 +522,7 @@ Over 450 Spark developers and enthusiast
<li><a href="http://data-informed.com/spark-an-open-source-engine-for-iterative-data-mining/">DataInformed</a> interviewed two Spark users and wrote about their applications in anomaly detection, predictive analytics and data mining.</li>
</ul>
-<p>In other news, there will be a full day of tutorials on Spark and Shark at the <a href="http://strataconf.com/strata2013">OâReilly Strata conference</a> in February. They include a three-hour <a href="http://strataconf.com/strata2013/public/schedule/detail/27438">introduction to Spark, Shark and BDAS</a> Tuesday morning, and a three-hour <a href="http://strataconf.com/strata2013/public/schedule/detail/27440">hands-on exercise session</a>. </p>
+<p>In other news, there will be a full day of tutorials on Spark and Shark at the <a href="http://strataconf.com/strata2013">O’Reilly Strata conference</a> in February. They include a three-hour <a href="http://strataconf.com/strata2013/public/schedule/detail/27438">introduction to Spark, Shark and BDAS</a> Tuesday morning, and a three-hour <a href="http://strataconf.com/strata2013/public/schedule/detail/27440">hands-on exercise session</a>. </p>
</div>
</article>
@@ -527,7 +532,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-0-6-1-and-0-5-2-released.html">Spark 0.6.1 and 0.5.2 out</a></h3>
<div class="entry-date">November 22, 2012</div>
</header>
- <div class="entry-content"><p>Today weâve made available two maintenance releases for Spark: <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a> and <a href="/releases/spark-release-0-5-2.html" title="Spark Release 0.5.2">0.5.2</a>. They both contain important bug fixes as well as some new features, such as the ability to build against Hadoop 2 distributions. We recommend that users update to the latest version for their branch; for new users, we recommend <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a>.</p>
+ <div class="entry-content"><p>Today we’ve made available two maintenance releases for Spark: <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a> and <a href="/releases/spark-release-0-5-2.html" title="Spark Release 0.5.2">0.5.2</a>. They both contain important bug fixes as well as some new features, such as the ability to build against Hadoop 2 distributions. We recommend that users update to the latest version for their branch; for new users, we recommend <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a>.</p>
</div>
</article>
@@ -557,7 +562,7 @@ Over 450 Spark developers and enthusiast
<h3 class="entry-title"><a href="/news/spark-meetups.html">We've started hosting a Bay Area Spark User Meetup</a></h3>
<div class="entry-date">January 10, 2012</div>
</header>
- <div class="entry-content"><p>Weâve started hosting a regular <a href="http://www.meetup.com/spark-users/">Bay Area Spark User Meetup</a>. Sign up on the meetup.com page to be notified about events and meet other Spark developers and users.</p>
+ <div class="entry-content"><p>We’ve started hosting a regular <a href="http://www.meetup.com/spark-users/">Bay Area Spark User Meetup</a>. Sign up on the meetup.com page to be notified about events and meet other Spark developers and users.</p>
</div>
</article>
@@ -576,9 +581,5 @@ Over 450 Spark developers and enthusiast
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/nsdi-paper.html
URL: http://svn.apache.org/viewvc/spark/site/news/nsdi-paper.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/nsdi-paper.html (original)
+++ spark/site/news/nsdi-paper.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -181,9 +186,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/run-spark-and-shark-on-amazon-emr.html
URL: http://svn.apache.org/viewvc/spark/site/news/run-spark-and-shark-on-amazon-emr.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/run-spark-and-shark-on-amazon-emr.html (original)
+++ spark/site/news/run-spark-and-shark-on-amazon-emr.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -160,7 +165,7 @@
<h2>Spark/Shark Tutorial for Amazon EMR</h2>
-<p>This weekend, Amazon posted an <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">article</a> and code that make it easy to launch Spark and Shark on Elastic MapReduce. The article includes examples of how to run both interactive Scala commands and SQL queries from Shark on data in S3. Head over to the <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">Amazon article</a> for details. Weâre very excited because, to our knowledge, this makes Spark the first non-Hadoop engine that you can launch with EMR.</p>
+<p>This weekend, Amazon posted an <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">article</a> and code that make it easy to launch Spark and Shark on Elastic MapReduce. The article includes examples of how to run both interactive Scala commands and SQL queries from Shark on data in S3. Head over to the <a href="http://aws.amazon.com/articles/Elastic-MapReduce/4926593393724923">Amazon article</a> for details. We’re very excited because, to our knowledge, this makes Spark the first non-Hadoop engine that you can launch with EMR.</p>
<p>
@@ -181,9 +186,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/spark-0-6-1-and-0-5-2-released.html
URL: http://svn.apache.org/viewvc/spark/site/news/spark-0-6-1-and-0-5-2-released.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/spark-0-6-1-and-0-5-2-released.html (original)
+++ spark/site/news/spark-0-6-1-and-0-5-2-released.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -160,7 +165,7 @@
<h2>Spark 0.6.1 and 0.5.2 out</h2>
-<p>Today weâve made available two maintenance releases for Spark: <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a> and <a href="/releases/spark-release-0-5-2.html" title="Spark Release 0.5.2">0.5.2</a>. They both contain important bug fixes as well as some new features, such as the ability to build against Hadoop 2 distributions. We recommend that users update to the latest version for their branch; for new users, we recommend <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a>.</p>
+<p>Today we’ve made available two maintenance releases for Spark: <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a> and <a href="/releases/spark-release-0-5-2.html" title="Spark Release 0.5.2">0.5.2</a>. They both contain important bug fixes as well as some new features, such as the ability to build against Hadoop 2 distributions. We recommend that users update to the latest version for their branch; for new users, we recommend <a href="/releases/spark-release-0-6-1.html" title="Spark Release 0.6.1">0.6.1</a>.</p>
<p>
@@ -181,9 +186,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/spark-0-6-2-released.html
URL: http://svn.apache.org/viewvc/spark/site/news/spark-0-6-2-released.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/spark-0-6-2-released.html (original)
+++ spark/site/news/spark-0-6-2-released.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -181,9 +186,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
Modified: spark/site/news/spark-0-7-0-released.html
URL: http://svn.apache.org/viewvc/spark/site/news/spark-0-7-0-released.html?rev=1624392&r1=1624391&r2=1624392&view=diff
==============================================================================
--- spark/site/news/spark-0-7-0-released.html (original)
+++ spark/site/news/spark-0-7-0-released.html Thu Sep 11 21:06:59 2014
@@ -48,6 +48,11 @@
<body>
+<script src="https://code.jquery.com/jquery.js"></script>
+<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
+<script src="/js/lang-tabs.js"></script>
+<script src="/js/downloads.js"></script>
+
<div class="container" style="max-width: 1200px;">
<div class="masthead">
@@ -160,7 +165,7 @@
<h2>Spark 0.7.0 released</h2>
-<p>Weâre proud to announce the release of <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">Spark 0.7.0</a>, a new major version of Spark that adds several key features, including a <a href="/docs/latest/python-programming-guide.html">Python API</a> for Spark and an <a href="/docs/latest/streaming-programming-guide.html">alpha of Spark Streaming</a>. This release is the result of the largest group of contributors yet behind a Spark release â 31 contributors from inside and outside Berkeley. Head over to the <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">release notes</a> to read more about the new features, or <a href="/downloads.html">download</a> the release today.</p>
+<p>We’re proud to announce the release of <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">Spark 0.7.0</a>, a new major version of Spark that adds several key features, including a <a href="/docs/latest/python-programming-guide.html">Python API</a> for Spark and an <a href="/docs/latest/streaming-programming-guide.html">alpha of Spark Streaming</a>. This release is the result of the largest group of contributors yet behind a Spark release – 31 contributors from inside and outside Berkeley. Head over to the <a href="/releases/spark-release-0-7-0.html" title="Spark Release 0.7.0">release notes</a> to read more about the new features, or <a href="/downloads.html">download</a> the release today.</p>
<p>
@@ -181,9 +186,5 @@
</div>
-<script src="https://code.jquery.com/jquery.js"></script>
-<script src="//netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js"></script>
-<script src="/js/lang-tabs.js"></script>
-
</body>
</html>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org