You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2016/11/06 07:19:34 UTC
[05/51] [partial] spark-website git commit: Add 1.6.3 doc.
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html
new file mode 100644
index 0000000..7256968
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html
@@ -0,0 +1,381 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:20 PDT 2016 -->
+<title>Broadcast (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<script type="text/javascript"><!--
+ if (location.href.indexOf('is-external=true') == -1) {
+ parent.document.title="Broadcast (Spark 1.6.3 JavaDoc)";
+ }
+//-->
+</script>
+<noscript>
+<div>JavaScript is disabled on your browser.</div>
+</noscript>
+<!-- ========= START OF TOP NAVBAR ======= -->
+<div class="topNav"><a name="navbar_top">
+<!-- -->
+</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li>Prev Class</li>
+<li><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/Broadcast.html" target="_top">Frames</a></li>
+<li><a href="Broadcast.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_top">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_top");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_top">
+<!-- -->
+</a></div>
+<!-- ========= END OF TOP NAVBAR ========= -->
+<!-- ======== START OF CLASS DATA ======== -->
+<div class="header">
+<div class="subTitle">org.apache.spark.broadcast</div>
+<h2 title="Class Broadcast" class="title">Class Broadcast<T></h2>
+</div>
+<div class="contentContainer">
+<ul class="inheritance">
+<li>Object</li>
+<li>
+<ul class="inheritance">
+<li>org.apache.spark.broadcast.Broadcast<T></li>
+</ul>
+</li>
+</ul>
+<div class="description">
+<ul class="blockList">
+<li class="blockList">
+<dl>
+<dt>All Implemented Interfaces:</dt>
+<dd>java.io.Serializable, <a href="../../../../org/apache/spark/Logging.html" title="interface in org.apache.spark">Logging</a></dd>
+</dl>
+<hr>
+<br>
+<pre>public abstract class <span class="strong">Broadcast<T></span>
+extends Object
+implements java.io.Serializable, <a href="../../../../org/apache/spark/Logging.html" title="interface in org.apache.spark">Logging</a></pre>
+<div class="block">A broadcast variable. Broadcast variables allow the programmer to keep a read-only variable
+ cached on each machine rather than shipping a copy of it with tasks. They can be used, for
+ example, to give every node a copy of a large input dataset in an efficient manner. Spark also
+ attempts to distribute broadcast variables using efficient broadcast algorithms to reduce
+ communication cost.
+ <p>
+ Broadcast variables are created from a variable <code>v</code> by calling
+ <a href="../../../../org/apache/spark/SparkContext.html#broadcast(T,%20scala.reflect.ClassTag)"><code>SparkContext.broadcast(T, scala.reflect.ClassTag<T>)</code></a>.
+ The broadcast variable is a wrapper around <code>v</code>, and its value can be accessed by calling the
+ <code>value</code> method. The interpreter session below shows this:
+ <p>
+ <pre><code>
+ scala> val broadcastVar = sc.broadcast(Array(1, 2, 3))
+ broadcastVar: org.apache.spark.broadcast.Broadcast[Array[Int} = Broadcast(0)
+
+ scala> broadcastVar.value
+ res0: Array[Int] = Array(1, 2, 3)
+ </code></pre>
+ <p>
+ After the broadcast variable is created, it should be used instead of the value <code>v</code> in any
+ functions run on the cluster so that <code>v</code> is not shipped to the nodes more than once.
+ In addition, the object <code>v</code> should not be modified after it is broadcast in order to ensure
+ that all nodes get the same value of the broadcast variable (e.g. if the variable is shipped
+ to a new node later).
+ <p>
+ param: id A unique identifier for the broadcast variable.</div>
+<dl><dt><span class="strong">See Also:</span></dt><dd><a href="../../../../serialized-form.html#org.apache.spark.broadcast.Broadcast">Serialized Form</a></dd></dl>
+</li>
+</ul>
+</div>
+<div class="summary">
+<ul class="blockList">
+<li class="blockList">
+<!-- ======== CONSTRUCTOR SUMMARY ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_summary">
+<!-- -->
+</a>
+<h3>Constructor Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Constructor Summary table, listing constructors, and an explanation">
+<caption><span>Constructors</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colOne" scope="col">Constructor and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colOne"><code><strong><a href="../../../../org/apache/spark/broadcast/Broadcast.html#Broadcast(long,%20scala.reflect.ClassTag)">Broadcast</a></strong>(long id,
+ scala.reflect.ClassTag<<a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="type parameter in Broadcast">T</a>> evidence$1)</code> </td>
+</tr>
+</table>
+</li>
+</ul>
+<!-- ========== METHOD SUMMARY =========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_summary">
+<!-- -->
+</a>
+<h3>Method Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Method Summary table, listing methods, and an explanation">
+<caption><span>Methods</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colFirst" scope="col">Modifier and Type</th>
+<th class="colLast" scope="col">Method and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/Broadcast.html#destroy()">destroy</a></strong>()</code>
+<div class="block">Destroy all data and metadata related to this broadcast variable.</div>
+</td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code>long</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/Broadcast.html#id()">id</a></strong>()</code> </td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>String</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/Broadcast.html#toString()">toString</a></strong>()</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/Broadcast.html#unpersist()">unpersist</a></strong>()</code>
+<div class="block">Asynchronously delete cached copies of this broadcast on the executors.</div>
+</td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/Broadcast.html#unpersist(boolean)">unpersist</a></strong>(boolean blocking)</code>
+<div class="block">Delete cached copies of this broadcast on the executors.</div>
+</td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code><a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="type parameter in Broadcast">T</a></code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/Broadcast.html#value()">value</a></strong>()</code>
+<div class="block">Get the broadcasted value.</div>
+</td>
+</tr>
+</table>
+<ul class="blockList">
+<li class="blockList"><a name="methods_inherited_from_class_Object">
+<!-- -->
+</a>
+<h3>Methods inherited from class Object</h3>
+<code>equals, getClass, hashCode, notify, notifyAll, wait, wait, wait</code></li>
+</ul>
+<ul class="blockList">
+<li class="blockList"><a name="methods_inherited_from_class_org.apache.spark.Logging">
+<!-- -->
+</a>
+<h3>Methods inherited from interface org.apache.spark.<a href="../../../../org/apache/spark/Logging.html" title="interface in org.apache.spark">Logging</a></h3>
+<code><a href="../../../../org/apache/spark/Logging.html#initializeIfNecessary()">initializeIfNecessary</a>, <a href="../../../../org/apache/spark/Logging.html#initializeLogging()">initializeLogging</a>, <a href="../../../../org/apache/spark/Logging.html#isTraceEnabled()">isTraceEnabled</a>, <a href="../../../../org/apache/spark/Logging.html#log_()">log_</a>, <a href="../../../../org/apache/spark/Logging.html#log()">log</a>, <a href="../../../../org/apache/spark/Logging.html#logDebug(scala.Function0)">logDebug</a>, <a href="../../../../org/apache/spark/Logging.html#logDebug(scala.Function0,%20java.lang.Throwable)">logDebug</a>, <a href="../../../../org/apache/spark/Logging.html#logError(scala.Function0)">logError</a>, <a href="../../../../org/apache/spark/Logging.html#logError(scala.Function0,%20java.lang.Throwable)">logError</a>, <a href="../../../../org/apache/spark/Logging.html#logInfo(scala.Function0)">logInfo</a>, <a href="../../../../org/apache/spark/Logging.html#logInfo(scala
.Function0,%20java.lang.Throwable)">logInfo</a>, <a href="../../../../org/apache/spark/Logging.html#logName()">logName</a>, <a href="../../../../org/apache/spark/Logging.html#logTrace(scala.Function0)">logTrace</a>, <a href="../../../../org/apache/spark/Logging.html#logTrace(scala.Function0,%20java.lang.Throwable)">logTrace</a>, <a href="../../../../org/apache/spark/Logging.html#logWarning(scala.Function0)">logWarning</a>, <a href="../../../../org/apache/spark/Logging.html#logWarning(scala.Function0,%20java.lang.Throwable)">logWarning</a></code></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+<div class="details">
+<ul class="blockList">
+<li class="blockList">
+<!-- ========= CONSTRUCTOR DETAIL ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_detail">
+<!-- -->
+</a>
+<h3>Constructor Detail</h3>
+<a name="Broadcast(long, scala.reflect.ClassTag)">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>Broadcast</h4>
+<pre>public Broadcast(long id,
+ scala.reflect.ClassTag<<a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="type parameter in Broadcast">T</a>> evidence$1)</pre>
+</li>
+</ul>
+</li>
+</ul>
+<!-- ============ METHOD DETAIL ========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_detail">
+<!-- -->
+</a>
+<h3>Method Detail</h3>
+<a name="id()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>id</h4>
+<pre>public long id()</pre>
+</li>
+</ul>
+<a name="value()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>value</h4>
+<pre>public <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="type parameter in Broadcast">T</a> value()</pre>
+<div class="block">Get the broadcasted value.</div>
+</li>
+</ul>
+<a name="unpersist()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>unpersist</h4>
+<pre>public void unpersist()</pre>
+<div class="block">Asynchronously delete cached copies of this broadcast on the executors.
+ If the broadcast is used after this is called, it will need to be re-sent to each executor.</div>
+</li>
+</ul>
+<a name="unpersist(boolean)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>unpersist</h4>
+<pre>public void unpersist(boolean blocking)</pre>
+<div class="block">Delete cached copies of this broadcast on the executors. If the broadcast is used after
+ this is called, it will need to be re-sent to each executor.</div>
+<dl><dt><span class="strong">Parameters:</span></dt><dd><code>blocking</code> - Whether to block until unpersisting has completed</dd></dl>
+</li>
+</ul>
+<a name="destroy()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>destroy</h4>
+<pre>public void destroy()</pre>
+<div class="block">Destroy all data and metadata related to this broadcast variable. Use this with caution;
+ once a broadcast variable has been destroyed, it cannot be used again.
+ This method blocks until destroy has completed</div>
+</li>
+</ul>
+<a name="toString()">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>toString</h4>
+<pre>public String toString()</pre>
+<dl>
+<dt><strong>Overrides:</strong></dt>
+<dd><code>toString</code> in class <code>Object</code></dd>
+</dl>
+</li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+</div>
+<!-- ========= END OF CLASS DATA ========= -->
+<!-- ======= START OF BOTTOM NAVBAR ====== -->
+<div class="bottomNav"><a name="navbar_bottom">
+<!-- -->
+</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li>Prev Class</li>
+<li><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/Broadcast.html" target="_top">Frames</a></li>
+<li><a href="Broadcast.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_bottom">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_bottom");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_bottom">
+<!-- -->
+</a></div>
+<!-- ======== END OF BOTTOM NAVBAR ======= -->
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/BroadcastFactory.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/BroadcastFactory.html b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/BroadcastFactory.html
new file mode 100644
index 0000000..f865013
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/BroadcastFactory.html
@@ -0,0 +1,274 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:20 PDT 2016 -->
+<title>BroadcastFactory (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<script type="text/javascript"><!--
+ if (location.href.indexOf('is-external=true') == -1) {
+ parent.document.title="BroadcastFactory (Spark 1.6.3 JavaDoc)";
+ }
+//-->
+</script>
+<noscript>
+<div>JavaScript is disabled on your browser.</div>
+</noscript>
+<!-- ========= START OF TOP NAVBAR ======= -->
+<div class="topNav"><a name="navbar_top">
+<!-- -->
+</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast"><span class="strong">Prev Class</span></a></li>
+<li><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/BroadcastFactory.html" target="_top">Frames</a></li>
+<li><a href="BroadcastFactory.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_top">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_top");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li>Constr | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li>Constr | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_top">
+<!-- -->
+</a></div>
+<!-- ========= END OF TOP NAVBAR ========= -->
+<!-- ======== START OF CLASS DATA ======== -->
+<div class="header">
+<div class="subTitle">org.apache.spark.broadcast</div>
+<h2 title="Interface BroadcastFactory" class="title">Interface BroadcastFactory</h2>
+</div>
+<div class="contentContainer">
+<div class="description">
+<ul class="blockList">
+<li class="blockList">
+<dl>
+<dt>All Known Implementing Classes:</dt>
+<dd><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast">HttpBroadcastFactory</a>, <a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html" title="class in org.apache.spark.broadcast">TorrentBroadcastFactory</a></dd>
+</dl>
+<hr>
+<br>
+<pre>public interface <span class="strong">BroadcastFactory</span></pre>
+<div class="block">:: DeveloperApi ::
+ An interface for all the broadcast implementations in Spark (to allow
+ multiple broadcast implementations). SparkContext uses a user-specified
+ BroadcastFactory implementation to instantiate a particular broadcast for the
+ entire Spark job.</div>
+</li>
+</ul>
+</div>
+<div class="summary">
+<ul class="blockList">
+<li class="blockList">
+<!-- ========== METHOD SUMMARY =========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_summary">
+<!-- -->
+</a>
+<h3>Method Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Method Summary table, listing methods, and an explanation">
+<caption><span>Methods</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colFirst" scope="col">Modifier and Type</th>
+<th class="colLast" scope="col">Method and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#initialize(boolean,%20org.apache.spark.SparkConf,%20org.apache.spark.SecurityManager)">initialize</a></strong>(boolean isDriver,
+ <a href="../../../../org/apache/spark/SparkConf.html" title="class in org.apache.spark">SparkConf</a> conf,
+ org.apache.spark.SecurityManager securityMgr)</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code><T> <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast">Broadcast</a><T></code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#newBroadcast(T,%20boolean,%20long,%20scala.reflect.ClassTag)">newBroadcast</a></strong>(T value,
+ boolean isLocal,
+ long id,
+ scala.reflect.ClassTag<T> evidence$1)</code>
+<div class="block">Creates a new broadcast variable.</div>
+</td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#stop()">stop</a></strong>()</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#unbroadcast(long,%20boolean,%20boolean)">unbroadcast</a></strong>(long id,
+ boolean removeFromDriver,
+ boolean blocking)</code> </td>
+</tr>
+</table>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+<div class="details">
+<ul class="blockList">
+<li class="blockList">
+<!-- ============ METHOD DETAIL ========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_detail">
+<!-- -->
+</a>
+<h3>Method Detail</h3>
+<a name="initialize(boolean, org.apache.spark.SparkConf, org.apache.spark.SecurityManager)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>initialize</h4>
+<pre>void initialize(boolean isDriver,
+ <a href="../../../../org/apache/spark/SparkConf.html" title="class in org.apache.spark">SparkConf</a> conf,
+ org.apache.spark.SecurityManager securityMgr)</pre>
+</li>
+</ul>
+<a name="newBroadcast(java.lang.Object,boolean,long,scala.reflect.ClassTag)">
+<!-- -->
+</a><a name="newBroadcast(T, boolean, long, scala.reflect.ClassTag)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>newBroadcast</h4>
+<pre><T> <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast">Broadcast</a><T> newBroadcast(T value,
+ boolean isLocal,
+ long id,
+ scala.reflect.ClassTag<T> evidence$1)</pre>
+<div class="block">Creates a new broadcast variable.
+ <p></div>
+<dl><dt><span class="strong">Parameters:</span></dt><dd><code>value</code> - value to broadcast</dd><dd><code>isLocal</code> - whether we are in local mode (single JVM process)</dd><dd><code>id</code> - unique id representing this broadcast variable</dd><dd><code>evidence$1</code> - (undocumented)</dd>
+<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
+</li>
+</ul>
+<a name="unbroadcast(long, boolean, boolean)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>unbroadcast</h4>
+<pre>void unbroadcast(long id,
+ boolean removeFromDriver,
+ boolean blocking)</pre>
+</li>
+</ul>
+<a name="stop()">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>stop</h4>
+<pre>void stop()</pre>
+</li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+</div>
+<!-- ========= END OF CLASS DATA ========= -->
+<!-- ======= START OF BOTTOM NAVBAR ====== -->
+<div class="bottomNav"><a name="navbar_bottom">
+<!-- -->
+</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast"><span class="strong">Prev Class</span></a></li>
+<li><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/BroadcastFactory.html" target="_top">Frames</a></li>
+<li><a href="BroadcastFactory.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_bottom">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_bottom");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li>Constr | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li>Constr | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_bottom">
+<!-- -->
+</a></div>
+<!-- ======== END OF BOTTOM NAVBAR ======= -->
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/HttpBroadcastFactory.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/HttpBroadcastFactory.html b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/HttpBroadcastFactory.html
new file mode 100644
index 0000000..23ac4ec
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/HttpBroadcastFactory.html
@@ -0,0 +1,342 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:20 PDT 2016 -->
+<title>HttpBroadcastFactory (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<script type="text/javascript"><!--
+ if (location.href.indexOf('is-external=true') == -1) {
+ parent.document.title="HttpBroadcastFactory (Spark 1.6.3 JavaDoc)";
+ }
+//-->
+</script>
+<noscript>
+<div>JavaScript is disabled on your browser.</div>
+</noscript>
+<!-- ========= START OF TOP NAVBAR ======= -->
+<div class="topNav"><a name="navbar_top">
+<!-- -->
+</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast"><span class="strong">Prev Class</span></a></li>
+<li><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/HttpBroadcastFactory.html" target="_top">Frames</a></li>
+<li><a href="HttpBroadcastFactory.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_top">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_top");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_top">
+<!-- -->
+</a></div>
+<!-- ========= END OF TOP NAVBAR ========= -->
+<!-- ======== START OF CLASS DATA ======== -->
+<div class="header">
+<div class="subTitle">org.apache.spark.broadcast</div>
+<h2 title="Class HttpBroadcastFactory" class="title">Class HttpBroadcastFactory</h2>
+</div>
+<div class="contentContainer">
+<ul class="inheritance">
+<li>Object</li>
+<li>
+<ul class="inheritance">
+<li>org.apache.spark.broadcast.HttpBroadcastFactory</li>
+</ul>
+</li>
+</ul>
+<div class="description">
+<ul class="blockList">
+<li class="blockList">
+<dl>
+<dt>All Implemented Interfaces:</dt>
+<dd><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></dd>
+</dl>
+<hr>
+<br>
+<pre>public class <span class="strong">HttpBroadcastFactory</span>
+extends Object
+implements <a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></pre>
+<div class="block">A <a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast"><code>BroadcastFactory</code></a> implementation that uses a
+ HTTP server as the broadcast mechanism. Refer to
+ <code>HttpBroadcast</code> for more details about this mechanism.</div>
+</li>
+</ul>
+</div>
+<div class="summary">
+<ul class="blockList">
+<li class="blockList">
+<!-- ======== CONSTRUCTOR SUMMARY ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_summary">
+<!-- -->
+</a>
+<h3>Constructor Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Constructor Summary table, listing constructors, and an explanation">
+<caption><span>Constructors</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colOne" scope="col">Constructor and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colOne"><code><strong><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html#HttpBroadcastFactory()">HttpBroadcastFactory</a></strong>()</code> </td>
+</tr>
+</table>
+</li>
+</ul>
+<!-- ========== METHOD SUMMARY =========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_summary">
+<!-- -->
+</a>
+<h3>Method Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Method Summary table, listing methods, and an explanation">
+<caption><span>Methods</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colFirst" scope="col">Modifier and Type</th>
+<th class="colLast" scope="col">Method and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html#initialize(boolean,%20org.apache.spark.SparkConf,%20org.apache.spark.SecurityManager)">initialize</a></strong>(boolean isDriver,
+ <a href="../../../../org/apache/spark/SparkConf.html" title="class in org.apache.spark">SparkConf</a> conf,
+ org.apache.spark.SecurityManager securityMgr)</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code><T> <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast">Broadcast</a><T></code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html#newBroadcast(T,%20boolean,%20long,%20scala.reflect.ClassTag)">newBroadcast</a></strong>(T value_,
+ boolean isLocal,
+ long id,
+ scala.reflect.ClassTag<T> evidence$1)</code>
+<div class="block">Creates a new broadcast variable.</div>
+</td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html#stop()">stop</a></strong>()</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html#unbroadcast(long,%20boolean,%20boolean)">unbroadcast</a></strong>(long id,
+ boolean removeFromDriver,
+ boolean blocking)</code>
+<div class="block">Remove all persisted state associated with the HTTP broadcast with the given ID.</div>
+</td>
+</tr>
+</table>
+<ul class="blockList">
+<li class="blockList"><a name="methods_inherited_from_class_Object">
+<!-- -->
+</a>
+<h3>Methods inherited from class Object</h3>
+<code>equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait</code></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+<div class="details">
+<ul class="blockList">
+<li class="blockList">
+<!-- ========= CONSTRUCTOR DETAIL ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_detail">
+<!-- -->
+</a>
+<h3>Constructor Detail</h3>
+<a name="HttpBroadcastFactory()">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>HttpBroadcastFactory</h4>
+<pre>public HttpBroadcastFactory()</pre>
+</li>
+</ul>
+</li>
+</ul>
+<!-- ============ METHOD DETAIL ========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_detail">
+<!-- -->
+</a>
+<h3>Method Detail</h3>
+<a name="initialize(boolean, org.apache.spark.SparkConf, org.apache.spark.SecurityManager)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>initialize</h4>
+<pre>public void initialize(boolean isDriver,
+ <a href="../../../../org/apache/spark/SparkConf.html" title="class in org.apache.spark">SparkConf</a> conf,
+ org.apache.spark.SecurityManager securityMgr)</pre>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#initialize(boolean,%20org.apache.spark.SparkConf,%20org.apache.spark.SecurityManager)">initialize</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+</dl>
+</li>
+</ul>
+<a name="newBroadcast(java.lang.Object,boolean,long,scala.reflect.ClassTag)">
+<!-- -->
+</a><a name="newBroadcast(T, boolean, long, scala.reflect.ClassTag)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>newBroadcast</h4>
+<pre>public <T> <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast">Broadcast</a><T> newBroadcast(T value_,
+ boolean isLocal,
+ long id,
+ scala.reflect.ClassTag<T> evidence$1)</pre>
+<div class="block"><strong>Description copied from interface: <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#newBroadcast(T,%20boolean,%20long,%20scala.reflect.ClassTag)">BroadcastFactory</a></code></strong></div>
+<div class="block">Creates a new broadcast variable.
+ <p></div>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#newBroadcast(T,%20boolean,%20long,%20scala.reflect.ClassTag)">newBroadcast</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+<dt><span class="strong">Parameters:</span></dt><dd><code>value_</code> - value to broadcast</dd><dd><code>isLocal</code> - whether we are in local mode (single JVM process)</dd><dd><code>id</code> - unique id representing this broadcast variable</dd><dd><code>evidence$1</code> - (undocumented)</dd>
+<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
+</li>
+</ul>
+<a name="stop()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>stop</h4>
+<pre>public void stop()</pre>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#stop()">stop</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+</dl>
+</li>
+</ul>
+<a name="unbroadcast(long, boolean, boolean)">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>unbroadcast</h4>
+<pre>public void unbroadcast(long id,
+ boolean removeFromDriver,
+ boolean blocking)</pre>
+<div class="block">Remove all persisted state associated with the HTTP broadcast with the given ID.</div>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#unbroadcast(long,%20boolean,%20boolean)">unbroadcast</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+<dt><span class="strong">Parameters:</span></dt><dd><code>removeFromDriver</code> - Whether to remove state from the driver</dd><dd><code>blocking</code> - Whether to block until unbroadcasted</dd><dd><code>id</code> - (undocumented)</dd></dl>
+</li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+</div>
+<!-- ========= END OF CLASS DATA ========= -->
+<!-- ======= START OF BOTTOM NAVBAR ====== -->
+<div class="bottomNav"><a name="navbar_bottom">
+<!-- -->
+</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast"><span class="strong">Prev Class</span></a></li>
+<li><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/HttpBroadcastFactory.html" target="_top">Frames</a></li>
+<li><a href="HttpBroadcastFactory.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_bottom">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_bottom");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_bottom">
+<!-- -->
+</a></div>
+<!-- ======== END OF BOTTOM NAVBAR ======= -->
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/TorrentBroadcastFactory.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/TorrentBroadcastFactory.html b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/TorrentBroadcastFactory.html
new file mode 100644
index 0000000..0d9a362
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/TorrentBroadcastFactory.html
@@ -0,0 +1,342 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:20 PDT 2016 -->
+<title>TorrentBroadcastFactory (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<script type="text/javascript"><!--
+ if (location.href.indexOf('is-external=true') == -1) {
+ parent.document.title="TorrentBroadcastFactory (Spark 1.6.3 JavaDoc)";
+ }
+//-->
+</script>
+<noscript>
+<div>JavaScript is disabled on your browser.</div>
+</noscript>
+<!-- ========= START OF TOP NAVBAR ======= -->
+<div class="topNav"><a name="navbar_top">
+<!-- -->
+</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">Prev Class</span></a></li>
+<li>Next Class</li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/TorrentBroadcastFactory.html" target="_top">Frames</a></li>
+<li><a href="TorrentBroadcastFactory.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_top">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_top");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_top">
+<!-- -->
+</a></div>
+<!-- ========= END OF TOP NAVBAR ========= -->
+<!-- ======== START OF CLASS DATA ======== -->
+<div class="header">
+<div class="subTitle">org.apache.spark.broadcast</div>
+<h2 title="Class TorrentBroadcastFactory" class="title">Class TorrentBroadcastFactory</h2>
+</div>
+<div class="contentContainer">
+<ul class="inheritance">
+<li>Object</li>
+<li>
+<ul class="inheritance">
+<li>org.apache.spark.broadcast.TorrentBroadcastFactory</li>
+</ul>
+</li>
+</ul>
+<div class="description">
+<ul class="blockList">
+<li class="blockList">
+<dl>
+<dt>All Implemented Interfaces:</dt>
+<dd><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></dd>
+</dl>
+<hr>
+<br>
+<pre>public class <span class="strong">TorrentBroadcastFactory</span>
+extends Object
+implements <a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></pre>
+<div class="block">A <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast"><code>Broadcast</code></a> implementation that uses a BitTorrent-like
+ protocol to do a distributed transfer of the broadcasted data to the executors. Refer to
+ <code>TorrentBroadcast</code> for more details.</div>
+</li>
+</ul>
+</div>
+<div class="summary">
+<ul class="blockList">
+<li class="blockList">
+<!-- ======== CONSTRUCTOR SUMMARY ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_summary">
+<!-- -->
+</a>
+<h3>Constructor Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Constructor Summary table, listing constructors, and an explanation">
+<caption><span>Constructors</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colOne" scope="col">Constructor and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colOne"><code><strong><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html#TorrentBroadcastFactory()">TorrentBroadcastFactory</a></strong>()</code> </td>
+</tr>
+</table>
+</li>
+</ul>
+<!-- ========== METHOD SUMMARY =========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_summary">
+<!-- -->
+</a>
+<h3>Method Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Method Summary table, listing methods, and an explanation">
+<caption><span>Methods</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colFirst" scope="col">Modifier and Type</th>
+<th class="colLast" scope="col">Method and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html#initialize(boolean,%20org.apache.spark.SparkConf,%20org.apache.spark.SecurityManager)">initialize</a></strong>(boolean isDriver,
+ <a href="../../../../org/apache/spark/SparkConf.html" title="class in org.apache.spark">SparkConf</a> conf,
+ org.apache.spark.SecurityManager securityMgr)</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code><T> <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast">Broadcast</a><T></code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html#newBroadcast(T,%20boolean,%20long,%20scala.reflect.ClassTag)">newBroadcast</a></strong>(T value_,
+ boolean isLocal,
+ long id,
+ scala.reflect.ClassTag<T> evidence$1)</code>
+<div class="block">Creates a new broadcast variable.</div>
+</td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html#stop()">stop</a></strong>()</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code>void</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html#unbroadcast(long,%20boolean,%20boolean)">unbroadcast</a></strong>(long id,
+ boolean removeFromDriver,
+ boolean blocking)</code>
+<div class="block">Remove all persisted state associated with the torrent broadcast with the given ID.</div>
+</td>
+</tr>
+</table>
+<ul class="blockList">
+<li class="blockList"><a name="methods_inherited_from_class_Object">
+<!-- -->
+</a>
+<h3>Methods inherited from class Object</h3>
+<code>equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait</code></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+<div class="details">
+<ul class="blockList">
+<li class="blockList">
+<!-- ========= CONSTRUCTOR DETAIL ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_detail">
+<!-- -->
+</a>
+<h3>Constructor Detail</h3>
+<a name="TorrentBroadcastFactory()">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>TorrentBroadcastFactory</h4>
+<pre>public TorrentBroadcastFactory()</pre>
+</li>
+</ul>
+</li>
+</ul>
+<!-- ============ METHOD DETAIL ========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_detail">
+<!-- -->
+</a>
+<h3>Method Detail</h3>
+<a name="initialize(boolean, org.apache.spark.SparkConf, org.apache.spark.SecurityManager)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>initialize</h4>
+<pre>public void initialize(boolean isDriver,
+ <a href="../../../../org/apache/spark/SparkConf.html" title="class in org.apache.spark">SparkConf</a> conf,
+ org.apache.spark.SecurityManager securityMgr)</pre>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#initialize(boolean,%20org.apache.spark.SparkConf,%20org.apache.spark.SecurityManager)">initialize</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+</dl>
+</li>
+</ul>
+<a name="newBroadcast(java.lang.Object,boolean,long,scala.reflect.ClassTag)">
+<!-- -->
+</a><a name="newBroadcast(T, boolean, long, scala.reflect.ClassTag)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>newBroadcast</h4>
+<pre>public <T> <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast">Broadcast</a><T> newBroadcast(T value_,
+ boolean isLocal,
+ long id,
+ scala.reflect.ClassTag<T> evidence$1)</pre>
+<div class="block"><strong>Description copied from interface: <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#newBroadcast(T,%20boolean,%20long,%20scala.reflect.ClassTag)">BroadcastFactory</a></code></strong></div>
+<div class="block">Creates a new broadcast variable.
+ <p></div>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#newBroadcast(T,%20boolean,%20long,%20scala.reflect.ClassTag)">newBroadcast</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+<dt><span class="strong">Parameters:</span></dt><dd><code>value_</code> - value to broadcast</dd><dd><code>isLocal</code> - whether we are in local mode (single JVM process)</dd><dd><code>id</code> - unique id representing this broadcast variable</dd><dd><code>evidence$1</code> - (undocumented)</dd>
+<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
+</li>
+</ul>
+<a name="stop()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>stop</h4>
+<pre>public void stop()</pre>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#stop()">stop</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+</dl>
+</li>
+</ul>
+<a name="unbroadcast(long, boolean, boolean)">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>unbroadcast</h4>
+<pre>public void unbroadcast(long id,
+ boolean removeFromDriver,
+ boolean blocking)</pre>
+<div class="block">Remove all persisted state associated with the torrent broadcast with the given ID.</div>
+<dl>
+<dt><strong>Specified by:</strong></dt>
+<dd><code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html#unbroadcast(long,%20boolean,%20boolean)">unbroadcast</a></code> in interface <code><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></code></dd>
+<dt><span class="strong">Parameters:</span></dt><dd><code>removeFromDriver</code> - Whether to remove state from the driver.</dd><dd><code>blocking</code> - Whether to block until unbroadcasted</dd><dd><code>id</code> - (undocumented)</dd></dl>
+</li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+</div>
+<!-- ========= END OF CLASS DATA ========= -->
+<!-- ======= START OF BOTTOM NAVBAR ====== -->
+<div class="bottomNav"><a name="navbar_bottom">
+<!-- -->
+</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">Prev Class</span></a></li>
+<li>Next Class</li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/TorrentBroadcastFactory.html" target="_top">Frames</a></li>
+<li><a href="TorrentBroadcastFactory.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_bottom">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_bottom");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_bottom">
+<!-- -->
+</a></div>
+<!-- ======== END OF BOTTOM NAVBAR ======= -->
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-frame.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-frame.html b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-frame.html
new file mode 100644
index 0000000..1a2e98f
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-frame.html
@@ -0,0 +1,25 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:21 PDT 2016 -->
+<title>org.apache.spark.broadcast (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<h1 class="bar"><a href="../../../../org/apache/spark/broadcast/package-summary.html" target="classFrame">org.apache.spark.broadcast</a></h1>
+<div class="indexContainer">
+<h2 title="Interfaces">Interfaces</h2>
+<ul title="Interfaces">
+<li><a href="BroadcastFactory.html" title="interface in org.apache.spark.broadcast" target="classFrame"><i>BroadcastFactory</i></a></li>
+</ul>
+<h2 title="Classes">Classes</h2>
+<ul title="Classes">
+<li><a href="Broadcast.html" title="class in org.apache.spark.broadcast" target="classFrame">Broadcast</a></li>
+<li><a href="HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast" target="classFrame">HttpBroadcastFactory</a></li>
+<li><a href="TorrentBroadcastFactory.html" title="class in org.apache.spark.broadcast" target="classFrame">TorrentBroadcastFactory</a></li>
+</ul>
+</div>
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-summary.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-summary.html b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-summary.html
new file mode 100644
index 0000000..4743d64
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-summary.html
@@ -0,0 +1,175 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:21 PDT 2016 -->
+<title>org.apache.spark.broadcast (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<script type="text/javascript"><!--
+ if (location.href.indexOf('is-external=true') == -1) {
+ parent.document.title="org.apache.spark.broadcast (Spark 1.6.3 JavaDoc)";
+ }
+//-->
+</script>
+<noscript>
+<div>JavaScript is disabled on your browser.</div>
+</noscript>
+<!-- ========= START OF TOP NAVBAR ======= -->
+<div class="topNav"><a name="navbar_top">
+<!-- -->
+</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li class="navBarCell1Rev">Package</li>
+<li>Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/api/r/package-summary.html">Prev Package</a></li>
+<li><a href="../../../../org/apache/spark/graphx/package-summary.html">Next Package</a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/package-summary.html" target="_top">Frames</a></li>
+<li><a href="package-summary.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_top">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_top");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<a name="skip-navbar_top">
+<!-- -->
+</a></div>
+<!-- ========= END OF TOP NAVBAR ========= -->
+<div class="header">
+<h1 title="Package" class="title">Package org.apache.spark.broadcast</h1>
+<div class="docSummary">
+<div class="block">Spark's broadcast variables, used to broadcast immutable datasets to all nodes.</div>
+</div>
+<p>See: <a href="#package_description">Description</a></p>
+</div>
+<div class="contentContainer">
+<ul class="blockList">
+<li class="blockList">
+<table class="packageSummary" border="0" cellpadding="3" cellspacing="0" summary="Interface Summary table, listing interfaces, and an explanation">
+<caption><span>Interface Summary</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colFirst" scope="col">Interface</th>
+<th class="colLast" scope="col">Description</th>
+</tr>
+<tbody>
+<tr class="altColor">
+<td class="colFirst"><a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a></td>
+<td class="colLast">
+<div class="block">:: DeveloperApi ::
+ An interface for all the broadcast implementations in Spark (to allow
+ multiple broadcast implementations).</div>
+</td>
+</tr>
+</tbody>
+</table>
+</li>
+<li class="blockList">
+<table class="packageSummary" border="0" cellpadding="3" cellspacing="0" summary="Class Summary table, listing classes, and an explanation">
+<caption><span>Class Summary</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colFirst" scope="col">Class</th>
+<th class="colLast" scope="col">Description</th>
+</tr>
+<tbody>
+<tr class="altColor">
+<td class="colFirst"><a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast">Broadcast</a><T></td>
+<td class="colLast">
+<div class="block">A broadcast variable.</div>
+</td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast">HttpBroadcastFactory</a></td>
+<td class="colLast">
+<div class="block">A <a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast"><code>BroadcastFactory</code></a> implementation that uses a
+ HTTP server as the broadcast mechanism.</div>
+</td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html" title="class in org.apache.spark.broadcast">TorrentBroadcastFactory</a></td>
+<td class="colLast">
+<div class="block">A <a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast"><code>Broadcast</code></a> implementation that uses a BitTorrent-like
+ protocol to do a distributed transfer of the broadcasted data to the executors.</div>
+</td>
+</tr>
+</tbody>
+</table>
+</li>
+</ul>
+<a name="package_description">
+<!-- -->
+</a>
+<h2 title="Package org.apache.spark.broadcast Description">Package org.apache.spark.broadcast Description</h2>
+<div class="block">Spark's broadcast variables, used to broadcast immutable datasets to all nodes.</div>
+</div>
+<!-- ======= START OF BOTTOM NAVBAR ====== -->
+<div class="bottomNav"><a name="navbar_bottom">
+<!-- -->
+</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li class="navBarCell1Rev">Package</li>
+<li>Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/api/r/package-summary.html">Prev Package</a></li>
+<li><a href="../../../../org/apache/spark/graphx/package-summary.html">Next Package</a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/package-summary.html" target="_top">Frames</a></li>
+<li><a href="package-summary.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_bottom">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_bottom");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<a name="skip-navbar_bottom">
+<!-- -->
+</a></div>
+<!-- ======== END OF BOTTOM NAVBAR ======= -->
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-tree.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-tree.html b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-tree.html
new file mode 100644
index 0000000..6937a08
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/broadcast/package-tree.html
@@ -0,0 +1,132 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:21 PDT 2016 -->
+<title>org.apache.spark.broadcast Class Hierarchy (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<script type="text/javascript"><!--
+ if (location.href.indexOf('is-external=true') == -1) {
+ parent.document.title="org.apache.spark.broadcast Class Hierarchy (Spark 1.6.3 JavaDoc)";
+ }
+//-->
+</script>
+<noscript>
+<div>JavaScript is disabled on your browser.</div>
+</noscript>
+<!-- ========= START OF TOP NAVBAR ======= -->
+<div class="topNav"><a name="navbar_top">
+<!-- -->
+</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li>Class</li>
+<li class="navBarCell1Rev">Tree</li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/api/r/package-tree.html">Prev</a></li>
+<li><a href="../../../../org/apache/spark/graphx/package-tree.html">Next</a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/package-tree.html" target="_top">Frames</a></li>
+<li><a href="package-tree.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_top">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_top");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<a name="skip-navbar_top">
+<!-- -->
+</a></div>
+<!-- ========= END OF TOP NAVBAR ========= -->
+<div class="header">
+<h1 class="title">Hierarchy For Package org.apache.spark.broadcast</h1>
+<span class="strong">Package Hierarchies:</span>
+<ul class="horizontal">
+<li><a href="../../../../overview-tree.html">All Packages</a></li>
+</ul>
+</div>
+<div class="contentContainer">
+<h2 title="Class Hierarchy">Class Hierarchy</h2>
+<ul>
+<li type="circle">Object
+<ul>
+<li type="circle">org.apache.spark.broadcast.<a href="../../../../org/apache/spark/broadcast/Broadcast.html" title="class in org.apache.spark.broadcast"><span class="strong">Broadcast</span></a><T> (implements org.apache.spark.<a href="../../../../org/apache/spark/Logging.html" title="interface in org.apache.spark">Logging</a>, java.io.Serializable)</li>
+<li type="circle">org.apache.spark.broadcast.<a href="../../../../org/apache/spark/broadcast/HttpBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">HttpBroadcastFactory</span></a> (implements org.apache.spark.broadcast.<a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a>)</li>
+<li type="circle">org.apache.spark.broadcast.<a href="../../../../org/apache/spark/broadcast/TorrentBroadcastFactory.html" title="class in org.apache.spark.broadcast"><span class="strong">TorrentBroadcastFactory</span></a> (implements org.apache.spark.broadcast.<a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast">BroadcastFactory</a>)</li>
+</ul>
+</li>
+</ul>
+<h2 title="Interface Hierarchy">Interface Hierarchy</h2>
+<ul>
+<li type="circle">org.apache.spark.broadcast.<a href="../../../../org/apache/spark/broadcast/BroadcastFactory.html" title="interface in org.apache.spark.broadcast"><span class="strong">BroadcastFactory</span></a></li>
+</ul>
+</div>
+<!-- ======= START OF BOTTOM NAVBAR ====== -->
+<div class="bottomNav"><a name="navbar_bottom">
+<!-- -->
+</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li>Class</li>
+<li class="navBarCell1Rev">Tree</li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li><a href="../../../../org/apache/spark/api/r/package-tree.html">Prev</a></li>
+<li><a href="../../../../org/apache/spark/graphx/package-tree.html">Next</a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/broadcast/package-tree.html" target="_top">Frames</a></li>
+<li><a href="package-tree.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_bottom">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_bottom");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<a name="skip-navbar_bottom">
+<!-- -->
+</a></div>
+<!-- ======== END OF BOTTOM NAVBAR ======= -->
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/graphx/Edge.html
----------------------------------------------------------------------
diff --git a/site/docs/1.6.3/api/java/org/apache/spark/graphx/Edge.html b/site/docs/1.6.3/api/java/org/apache/spark/graphx/Edge.html
new file mode 100644
index 0000000..2eef131
--- /dev/null
+++ b/site/docs/1.6.3/api/java/org/apache/spark/graphx/Edge.html
@@ -0,0 +1,354 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<!-- NewPage -->
+<html lang="en">
+<head>
+<!-- Generated by javadoc (version 1.7.0_79) on Wed Nov 02 15:16:13 PDT 2016 -->
+<title>Edge (Spark 1.6.3 JavaDoc)</title>
+<meta name="date" content="2016-11-02">
+<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
+</head>
+<body>
+<script type="text/javascript"><!--
+ if (location.href.indexOf('is-external=true') == -1) {
+ parent.document.title="Edge (Spark 1.6.3 JavaDoc)";
+ }
+//-->
+</script>
+<noscript>
+<div>JavaScript is disabled on your browser.</div>
+</noscript>
+<!-- ========= START OF TOP NAVBAR ======= -->
+<div class="topNav"><a name="navbar_top">
+<!-- -->
+</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li>Prev Class</li>
+<li><a href="../../../../org/apache/spark/graphx/EdgeContext.html" title="class in org.apache.spark.graphx"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/graphx/Edge.html" target="_top">Frames</a></li>
+<li><a href="Edge.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_top">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_top");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_top">
+<!-- -->
+</a></div>
+<!-- ========= END OF TOP NAVBAR ========= -->
+<!-- ======== START OF CLASS DATA ======== -->
+<div class="header">
+<div class="subTitle">org.apache.spark.graphx</div>
+<h2 title="Class Edge" class="title">Class Edge<ED></h2>
+</div>
+<div class="contentContainer">
+<ul class="inheritance">
+<li>Object</li>
+<li>
+<ul class="inheritance">
+<li>org.apache.spark.graphx.Edge<ED></li>
+</ul>
+</li>
+</ul>
+<div class="description">
+<ul class="blockList">
+<li class="blockList">
+<dl>
+<dt>All Implemented Interfaces:</dt>
+<dd>java.io.Serializable, scala.Equals, scala.Product</dd>
+</dl>
+<dl>
+<dt>Direct Known Subclasses:</dt>
+<dd><a href="../../../../org/apache/spark/graphx/EdgeTriplet.html" title="class in org.apache.spark.graphx">EdgeTriplet</a></dd>
+</dl>
+<hr>
+<br>
+<pre>public class <span class="strong">Edge<ED></span>
+extends Object
+implements scala.Serializable, scala.Product</pre>
+<div class="block">A single directed edge consisting of a source id, target id,
+ and the data associated with the edge.
+ <p></div>
+<dl><dt><span class="strong">See Also:</span></dt><dd><a href="../../../../serialized-form.html#org.apache.spark.graphx.Edge">Serialized Form</a></dd></dl>
+</li>
+</ul>
+</div>
+<div class="summary">
+<ul class="blockList">
+<li class="blockList">
+<!-- ======== CONSTRUCTOR SUMMARY ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_summary">
+<!-- -->
+</a>
+<h3>Constructor Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Constructor Summary table, listing constructors, and an explanation">
+<caption><span>Constructors</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colOne" scope="col">Constructor and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colOne"><code><strong><a href="../../../../org/apache/spark/graphx/Edge.html#Edge(long,%20long,%20ED)">Edge</a></strong>(long srcId,
+ long dstId,
+ <a href="../../../../org/apache/spark/graphx/Edge.html" title="type parameter in Edge">ED</a> attr)</code> </td>
+</tr>
+</table>
+</li>
+</ul>
+<!-- ========== METHOD SUMMARY =========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_summary">
+<!-- -->
+</a>
+<h3>Method Summary</h3>
+<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Method Summary table, listing methods, and an explanation">
+<caption><span>Methods</span><span class="tabEnd"> </span></caption>
+<tr>
+<th class="colFirst" scope="col">Modifier and Type</th>
+<th class="colLast" scope="col">Method and Description</th>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code><a href="../../../../org/apache/spark/graphx/Edge.html" title="type parameter in Edge">ED</a></code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/graphx/Edge.html#attr()">attr</a></strong>()</code> </td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code>long</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/graphx/Edge.html#dstId()">dstId</a></strong>()</code> </td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>long</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/graphx/Edge.html#otherVertexId(long)">otherVertexId</a></strong>(long vid)</code>
+<div class="block">Given one vertex in the edge return the other vertex.</div>
+</td>
+</tr>
+<tr class="rowColor">
+<td class="colFirst"><code><a href="../../../../org/apache/spark/graphx/EdgeDirection.html" title="class in org.apache.spark.graphx">EdgeDirection</a></code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/graphx/Edge.html#relativeDirection(long)">relativeDirection</a></strong>(long vid)</code>
+<div class="block">Return the relative direction of the edge to the corresponding
+ vertex.</div>
+</td>
+</tr>
+<tr class="altColor">
+<td class="colFirst"><code>long</code></td>
+<td class="colLast"><code><strong><a href="../../../../org/apache/spark/graphx/Edge.html#srcId()">srcId</a></strong>()</code> </td>
+</tr>
+</table>
+<ul class="blockList">
+<li class="blockList"><a name="methods_inherited_from_class_Object">
+<!-- -->
+</a>
+<h3>Methods inherited from class Object</h3>
+<code>equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait</code></li>
+</ul>
+<ul class="blockList">
+<li class="blockList"><a name="methods_inherited_from_class_scala.Product">
+<!-- -->
+</a>
+<h3>Methods inherited from interface scala.Product</h3>
+<code>productArity, productElement, productIterator, productPrefix</code></li>
+</ul>
+<ul class="blockList">
+<li class="blockList"><a name="methods_inherited_from_class_scala.Equals">
+<!-- -->
+</a>
+<h3>Methods inherited from interface scala.Equals</h3>
+<code>canEqual, equals</code></li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+<div class="details">
+<ul class="blockList">
+<li class="blockList">
+<!-- ========= CONSTRUCTOR DETAIL ======== -->
+<ul class="blockList">
+<li class="blockList"><a name="constructor_detail">
+<!-- -->
+</a>
+<h3>Constructor Detail</h3>
+<a name="Edge(long,long,java.lang.Object)">
+<!-- -->
+</a><a name="Edge(long, long, ED)">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>Edge</h4>
+<pre>public Edge(long srcId,
+ long dstId,
+ <a href="../../../../org/apache/spark/graphx/Edge.html" title="type parameter in Edge">ED</a> attr)</pre>
+</li>
+</ul>
+</li>
+</ul>
+<!-- ============ METHOD DETAIL ========== -->
+<ul class="blockList">
+<li class="blockList"><a name="method_detail">
+<!-- -->
+</a>
+<h3>Method Detail</h3>
+<a name="srcId()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>srcId</h4>
+<pre>public long srcId()</pre>
+</li>
+</ul>
+<a name="dstId()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>dstId</h4>
+<pre>public long dstId()</pre>
+</li>
+</ul>
+<a name="attr()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>attr</h4>
+<pre>public <a href="../../../../org/apache/spark/graphx/Edge.html" title="type parameter in Edge">ED</a> attr()</pre>
+</li>
+</ul>
+<a name="otherVertexId(long)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>otherVertexId</h4>
+<pre>public long otherVertexId(long vid)</pre>
+<div class="block">Given one vertex in the edge return the other vertex.
+ <p></div>
+<dl><dt><span class="strong">Parameters:</span></dt><dd><code>vid</code> - the id one of the two vertices on the edge.</dd>
+<dt><span class="strong">Returns:</span></dt><dd>the id of the other vertex on the edge.</dd></dl>
+</li>
+</ul>
+<a name="relativeDirection(long)">
+<!-- -->
+</a>
+<ul class="blockListLast">
+<li class="blockList">
+<h4>relativeDirection</h4>
+<pre>public <a href="../../../../org/apache/spark/graphx/EdgeDirection.html" title="class in org.apache.spark.graphx">EdgeDirection</a> relativeDirection(long vid)</pre>
+<div class="block">Return the relative direction of the edge to the corresponding
+ vertex.
+ <p></div>
+<dl><dt><span class="strong">Parameters:</span></dt><dd><code>vid</code> - the id of one of the two vertices in the edge.</dd>
+<dt><span class="strong">Returns:</span></dt><dd>the relative direction of the edge to the corresponding
+ vertex.</dd></dl>
+</li>
+</ul>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+</div>
+<!-- ========= END OF CLASS DATA ========= -->
+<!-- ======= START OF BOTTOM NAVBAR ====== -->
+<div class="bottomNav"><a name="navbar_bottom">
+<!-- -->
+</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
+<!-- -->
+</a>
+<ul class="navList" title="Navigation">
+<li><a href="../../../../overview-summary.html">Overview</a></li>
+<li><a href="package-summary.html">Package</a></li>
+<li class="navBarCell1Rev">Class</li>
+<li><a href="package-tree.html">Tree</a></li>
+<li><a href="../../../../deprecated-list.html">Deprecated</a></li>
+<li><a href="../../../../index-all.html">Index</a></li>
+<li><a href="../../../../help-doc.html">Help</a></li>
+</ul>
+</div>
+<div class="subNav">
+<ul class="navList">
+<li>Prev Class</li>
+<li><a href="../../../../org/apache/spark/graphx/EdgeContext.html" title="class in org.apache.spark.graphx"><span class="strong">Next Class</span></a></li>
+</ul>
+<ul class="navList">
+<li><a href="../../../../index.html?org/apache/spark/graphx/Edge.html" target="_top">Frames</a></li>
+<li><a href="Edge.html" target="_top">No Frames</a></li>
+</ul>
+<ul class="navList" id="allclasses_navbar_bottom">
+<li><a href="../../../../allclasses-noframe.html">All Classes</a></li>
+</ul>
+<div>
+<script type="text/javascript"><!--
+ allClassesLink = document.getElementById("allclasses_navbar_bottom");
+ if(window==top) {
+ allClassesLink.style.display = "block";
+ }
+ else {
+ allClassesLink.style.display = "none";
+ }
+ //-->
+</script>
+</div>
+<div>
+<ul class="subNavList">
+<li>Summary: </li>
+<li>Nested | </li>
+<li>Field | </li>
+<li><a href="#constructor_summary">Constr</a> | </li>
+<li><a href="#method_summary">Method</a></li>
+</ul>
+<ul class="subNavList">
+<li>Detail: </li>
+<li>Field | </li>
+<li><a href="#constructor_detail">Constr</a> | </li>
+<li><a href="#method_detail">Method</a></li>
+</ul>
+</div>
+<a name="skip-navbar_bottom">
+<!-- -->
+</a></div>
+<!-- ======== END OF BOTTOM NAVBAR ======= -->
+<script defer="defer" type="text/javascript" src="../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../lib/api-javadocs.js"></script></body>
+</html>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org