You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafu.apache.org by ey...@apache.org on 2023/01/25 20:48:41 UTC
svn commit: r1906998 [13/19] - in /datafu/site: ./ blog/ blog/2012/01/10/ blog/2013/01/24/ blog/2013/09/04/ blog/2013/10/03/ blog/2014/04/27/ blog/2015/11/17/ blog/2016/08/10/ blog/2017/03/10/ blog/2018/01/26/ blog/2018/03/22/ blog/2019/01/07/ blog/201...
Added: datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/SparkPythonRunner.html
URL: http://svn.apache.org/viewvc/datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/SparkPythonRunner.html?rev=1906998&view=auto
==============================================================================
--- datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/SparkPythonRunner.html (added)
+++ datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/SparkPythonRunner.html Wed Jan 25 20:48:40 2023
@@ -0,0 +1,585 @@
+<!DOCTYPE html >
+<html>
+ <head>
+ <title>SparkPythonRunner - datafu-spark 1.8.0-SNAPSHOT-SNAPSHOT API - org.apache.spark.datafu.deploy.SparkPythonRunner</title>
+ <meta name="description" content="SparkPythonRunner - datafu - spark 1.8.0 - SNAPSHOT - SNAPSHOT API - org.apache.spark.datafu.deploy.SparkPythonRunner" />
+ <meta name="keywords" content="SparkPythonRunner datafu spark 1.8.0 SNAPSHOT SNAPSHOT API org.apache.spark.datafu.deploy.SparkPythonRunner" />
+ <meta http-equiv="content-type" content="text/html; charset=UTF-8" />
+
+ <link href="../../../../../lib/template.css" media="screen" type="text/css" rel="stylesheet" />
+ <link href="../../../../../lib/diagrams.css" media="screen" type="text/css" rel="stylesheet" id="diagrams-css" />
+ <script type="text/javascript" src="../../../../../lib/jquery.js" id="jquery-js"></script>
+ <script type="text/javascript" src="../../../../../lib/jquery-ui.js"></script>
+ <script type="text/javascript" src="../../../../../lib/template.js"></script>
+ <script type="text/javascript" src="../../../../../lib/tools.tooltip.js"></script>
+
+ <script type="text/javascript">
+ if(top === self) {
+ var url = '../../../../../index.html';
+ var hash = 'org.apache.spark.datafu.deploy.SparkPythonRunner';
+ var anchor = window.location.hash;
+ var anchor_opt = '';
+ if (anchor.length >= 1)
+ anchor_opt = '@' + anchor.substring(1);
+ window.location.href = url + '#' + hash + anchor_opt;
+ }
+ </script>
+
+ </head>
+ <body class="type">
+ <div id="definition">
+ <img alt="Class" src="../../../../../lib/class_big.png" />
+ <p id="owner"><a href="../../../../package.html" class="extype" name="org">org</a>.<a href="../../../package.html" class="extype" name="org.apache">apache</a>.<a href="../../package.html" class="extype" name="org.apache.spark">spark</a>.<a href="../package.html" class="extype" name="org.apache.spark.datafu">datafu</a>.<a href="package.html" class="extype" name="org.apache.spark.datafu.deploy">deploy</a></p>
+ <h1>SparkPythonRunner</h1><h3><span class="morelinks"><div>Related Doc:
+ <a href="package.html" class="extype" name="org.apache.spark.datafu.deploy">package deploy</a>
+ </div></span></h3><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ </div>
+
+ <h4 id="signature" class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">case class</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SparkPythonRunner</span><span class="params">(<span name="pyPaths">pyPaths: <span class="extype" name="scala.Predef.String">String</span></span>, <span name="otherArgs">otherArgs: <span class="extype" name="scala.Array">Array</span>[<span class="extype" name="scala.Predef.String">String</span>] = <span class="symbol">Array()</span></span>)</span><span class="result"> extends <span class="extype" name="scala.Product">Product</span> with <span class="extype" name="scala.Serializable">Serializable</span></span>
+ </span>
+ </h4>
+
+ <div id="comment" class="fullcommenttop"><div class="comment cmt"><p>Internal class - should not be used by user</p><p>background:
+We had to "override" Spark's PythonRunner because we failed on premature python process closing.
+In PythonRunner the python process exits immediately when finished to read the file,
+this caused us to Accumulators Exceptions when the driver tries to get accumulation data
+from the python gateway.
+Instead, like in Zeppelin, we create an "interactive" python process, feed it the python
+script and not closing the gateway.
+</p></div><div class="toggleContainer block">
+ <span class="toggle">Linear Supertypes</span>
+ <div class="superTypes hiddenContent"><span class="extype" name="scala.Serializable">Serializable</span>, <span class="extype" name="java.io.Serializable">Serializable</span>, <span class="extype" name="scala.Product">Product</span>, <span class="extype" name="scala.Equals">Equals</span>, <span class="extype" name="scala.AnyRef">AnyRef</span>, <span class="extype" name="scala.Any">Any</span></div>
+ </div></div>
+
+
+ <div id="mbrsel">
+ <div id="textfilter"><span class="pre"></span><span class="input"><input id="mbrsel-input" type="text" accesskey="/" /></span><span class="post"></span></div>
+ <div id="order">
+ <span class="filtertype">Ordering</span>
+ <ol>
+
+ <li class="alpha in"><span>Alphabetic</span></li>
+ <li class="inherit out"><span>By Inheritance</span></li>
+ </ol>
+ </div>
+ <div id="ancestors">
+ <span class="filtertype">Inherited<br />
+ </span>
+ <ol id="linearization">
+ <li class="in" name="org.apache.spark.datafu.deploy.SparkPythonRunner"><span>SparkPythonRunner</span></li><li class="in" name="scala.Serializable"><span>Serializable</span></li><li class="in" name="java.io.Serializable"><span>Serializable</span></li><li class="in" name="scala.Product"><span>Product</span></li><li class="in" name="scala.Equals"><span>Equals</span></li><li class="in" name="scala.AnyRef"><span>AnyRef</span></li><li class="in" name="scala.Any"><span>Any</span></li>
+ </ol>
+ </div><div id="ancestors">
+ <span class="filtertype"></span>
+ <ol>
+ <li class="hideall out"><span>Hide All</span></li>
+ <li class="showall in"><span>Show All</span></li>
+ </ol>
+ </div>
+ <div id="visbl">
+ <span class="filtertype">Visibility</span>
+ <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol>
+ </div>
+ </div>
+
+ <div id="template">
+ <div id="allMembers">
+ <div id="constructors" class="members">
+ <h3>Instance Constructors</h3>
+ <ol><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#<init>" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="<init>(pyPaths:String,otherArgs:Array[String]):org.apache.spark.datafu.deploy.SparkPythonRunner"></a>
+ <a id="<init>:SparkPythonRunner"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">new</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SparkPythonRunner</span><span class="params">(<span name="pyPaths">pyPaths: <span class="extype" name="scala.Predef.String">String</span></span>, <span name="otherArgs">otherArgs: <span class="extype" name="scala.Array">Array</span>[<span class="extype" name="scala.Predef.String">String</span>] = <span class="symbol">Array()</span></span>)</span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@<init>(pyPaths:String,otherArgs:Array[String]):org.apache.spark.datafu.deploy.SparkPythonRunner" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li></ol>
+ </div>
+
+
+
+
+
+ <div id="values" class="values members">
+ <h3>Value Members</h3>
+ <ol><li name="scala.AnyRef#!=" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="!=(x$1:Any):Boolean"></a>
+ <a id="!=(Any):Boolean"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span title="gt4s: $bang$eq" class="name">!=</span><span class="params">(<span name="arg0">arg0: <span class="extype" name="scala.Any">Any</span></span>)</span><span class="result">: <span class="extype" name="scala.Boolean">Boolean</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@!=(x$1:Any):Boolean" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef â Any</dd></dl></div>
+ </li><li name="scala.AnyRef###" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="##():Int"></a>
+ <a id="##():Int"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span title="gt4s: $hash$hash" class="name">##</span><span class="params">()</span><span class="result">: <span class="extype" name="scala.Int">Int</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@##():Int" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef â Any</dd></dl></div>
+ </li><li name="scala.AnyRef#==" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="==(x$1:Any):Boolean"></a>
+ <a id="==(Any):Boolean"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span title="gt4s: $eq$eq" class="name">==</span><span class="params">(<span name="arg0">arg0: <span class="extype" name="scala.Any">Any</span></span>)</span><span class="result">: <span class="extype" name="scala.Boolean">Boolean</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@==(x$1:Any):Boolean" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef â Any</dd></dl></div>
+ </li><li name="scala.Any#asInstanceOf" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="asInstanceOf[T0]:T0"></a>
+ <a id="asInstanceOf[T0]:T0"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span class="extype" name="scala.Any.asInstanceOf.T0">T0</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@asInstanceOf[T0]:T0" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div>
+ </li><li name="scala.AnyRef#clone" visbl="prt" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="clone():Object"></a>
+ <a id="clone():AnyRef"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">clone</span><span class="params">()</span><span class="result">: <span class="extype" name="scala.AnyRef">AnyRef</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@clone():Object" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a href="../../../../../java$lang.html" class="extype" name="java.lang">java.lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd>
+ <span class="name">@throws</span><span class="args">(<span>
+
+ <span class="defval" name="classOf[java.lang.CloneNotSupportedException]">...</span>
+ </span>)</span>
+
+ </dd></dl></div>
+ </li><li name="scala.AnyRef#eq" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="eq(x$1:AnyRef):Boolean"></a>
+ <a id="eq(AnyRef):Boolean"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">eq</span><span class="params">(<span name="arg0">arg0: <span class="extype" name="scala.AnyRef">AnyRef</span></span>)</span><span class="result">: <span class="extype" name="scala.Boolean">Boolean</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@eq(x$1:AnyRef):Boolean" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div>
+ </li><li name="scala.AnyRef#finalize" visbl="prt" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="finalize():Unit"></a>
+ <a id="finalize():Unit"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">finalize</span><span class="params">()</span><span class="result">: <span class="extype" name="scala.Unit">Unit</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@finalize():Unit" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a href="../../../../../java$lang.html" class="extype" name="java.lang">java.lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd>
+ <span class="name">@throws</span><span class="args">(<span>
+
+ <span class="symbol">classOf[java.lang.Throwable]</span>
+ </span>)</span>
+
+ </dd></dl></div>
+ </li><li name="scala.AnyRef#getClass" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="getClass():Class[_]"></a>
+ <a id="getClass():Class[_]"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">getClass</span><span class="params">()</span><span class="result">: <span class="extype" name="java.lang.Class">Class</span>[_]</span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@getClass():Class[_]" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef â Any</dd></dl></div>
+ </li><li name="scala.Any#isInstanceOf" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="isInstanceOf[T0]:Boolean"></a>
+ <a id="isInstanceOf[T0]:Boolean"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span class="extype" name="scala.Boolean">Boolean</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@isInstanceOf[T0]:Boolean" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div>
+ </li><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#logger" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="logger:org.apache.logging.log4j.Logger"></a>
+ <a id="logger:Logger"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">logger</span><span class="result">: <span class="extype" name="org.apache.logging.log4j.Logger">Logger</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@logger:org.apache.logging.log4j.Logger" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="scala.AnyRef#ne" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="ne(x$1:AnyRef):Boolean"></a>
+ <a id="ne(AnyRef):Boolean"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">ne</span><span class="params">(<span name="arg0">arg0: <span class="extype" name="scala.AnyRef">AnyRef</span></span>)</span><span class="result">: <span class="extype" name="scala.Boolean">Boolean</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@ne(x$1:AnyRef):Boolean" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div>
+ </li><li name="scala.AnyRef#notify" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="notify():Unit"></a>
+ <a id="notify():Unit"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">notify</span><span class="params">()</span><span class="result">: <span class="extype" name="scala.Unit">Unit</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@notify():Unit" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div>
+ </li><li name="scala.AnyRef#notifyAll" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="notifyAll():Unit"></a>
+ <a id="notifyAll():Unit"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span class="extype" name="scala.Unit">Unit</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@notifyAll():Unit" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div>
+ </li><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#otherArgs" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="otherArgs:Array[String]"></a>
+ <a id="otherArgs:Array[String]"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">otherArgs</span><span class="result">: <span class="extype" name="scala.Array">Array</span>[<span class="extype" name="scala.Predef.String">String</span>]</span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@otherArgs:Array[String]" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#process" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="process:Process"></a>
+ <a id="process:Process"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">process</span><span class="result">: <span class="extype" name="java.lang.Process">Process</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@process:Process" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#pyPaths" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="pyPaths:String"></a>
+ <a id="pyPaths:String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">pyPaths</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@pyPaths:String" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#reader" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="reader:java.io.BufferedReader"></a>
+ <a id="reader:BufferedReader"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">reader</span><span class="result">: <span class="extype" name="java.io.BufferedReader">BufferedReader</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@reader:java.io.BufferedReader" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#runPyFile" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="runPyFile(pythonFile:String):String"></a>
+ <a id="runPyFile(String):String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">runPyFile</span><span class="params">(<span name="pythonFile">pythonFile: <span class="extype" name="scala.Predef.String">String</span></span>)</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@runPyFile(pythonFile:String):String" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="scala.AnyRef#synchronized" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="synchronized[T0](x$1:=>T0):T0"></a>
+ <a id="synchronized[T0](âT0):T0"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: â <span class="extype" name="java.lang.AnyRef.synchronized.T0">T0</span></span>)</span><span class="result">: <span class="extype" name="java.lang.AnyRef.synchronized.T0">T0</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@synchronized[T0](x$1:=>T0):T0" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div>
+ </li><li name="scala.AnyRef#wait" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="wait():Unit"></a>
+ <a id="wait():Unit"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">wait</span><span class="params">()</span><span class="result">: <span class="extype" name="scala.Unit">Unit</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@wait():Unit" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd>
+ <span class="name">@throws</span><span class="args">(<span>
+
+ <span class="defval" name="classOf[java.lang.InterruptedException]">...</span>
+ </span>)</span>
+
+ </dd></dl></div>
+ </li><li name="scala.AnyRef#wait" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="wait(x$1:Long,x$2:Int):Unit"></a>
+ <a id="wait(Long,Int):Unit"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span class="extype" name="scala.Long">Long</span></span>, <span name="arg1">arg1: <span class="extype" name="scala.Int">Int</span></span>)</span><span class="result">: <span class="extype" name="scala.Unit">Unit</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@wait(x$1:Long,x$2:Int):Unit" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd>
+ <span class="name">@throws</span><span class="args">(<span>
+
+ <span class="defval" name="classOf[java.lang.InterruptedException]">...</span>
+ </span>)</span>
+
+ </dd></dl></div>
+ </li><li name="scala.AnyRef#wait" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="wait(x$1:Long):Unit"></a>
+ <a id="wait(Long):Unit"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier">final </span>
+ <span class="kind">def</span>
+ </span>
+ <span class="symbol">
+ <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span class="extype" name="scala.Long">Long</span></span>)</span><span class="result">: <span class="extype" name="scala.Unit">Unit</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@wait(x$1:Long):Unit" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd>
+ <span class="name">@throws</span><span class="args">(<span>
+
+ <span class="defval" name="classOf[java.lang.InterruptedException]">...</span>
+ </span>)</span>
+
+ </dd></dl></div>
+ </li><li name="org.apache.spark.datafu.deploy.SparkPythonRunner#writer" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="writer:java.io.BufferedWriter"></a>
+ <a id="writer:BufferedWriter"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">writer</span><span class="result">: <span class="extype" name="java.io.BufferedWriter">BufferedWriter</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.SparkPythonRunner@writer:java.io.BufferedWriter" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li></ol>
+ </div>
+
+
+
+
+ </div>
+
+ <div id="inheritedMembers">
+ <div class="parent" name="scala.Serializable">
+ <h3>Inherited from <span class="extype" name="scala.Serializable">Serializable</span></h3>
+ </div><div class="parent" name="java.io.Serializable">
+ <h3>Inherited from <span class="extype" name="java.io.Serializable">Serializable</span></h3>
+ </div><div class="parent" name="scala.Product">
+ <h3>Inherited from <span class="extype" name="scala.Product">Product</span></h3>
+ </div><div class="parent" name="scala.Equals">
+ <h3>Inherited from <span class="extype" name="scala.Equals">Equals</span></h3>
+ </div><div class="parent" name="scala.AnyRef">
+ <h3>Inherited from <span class="extype" name="scala.AnyRef">AnyRef</span></h3>
+ </div><div class="parent" name="scala.Any">
+ <h3>Inherited from <span class="extype" name="scala.Any">Any</span></h3>
+ </div>
+
+ </div>
+
+ <div id="groupedMembers">
+ <div class="group" name="Ungrouped">
+ <h3>Ungrouped</h3>
+
+ </div>
+ </div>
+
+ </div>
+
+ <div id="tooltip"></div>
+
+ <div id="footer"> </div>
+
+
+ </body>
+ </html>
Added: datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/package.html
URL: http://svn.apache.org/viewvc/datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/package.html?rev=1906998&view=auto
==============================================================================
--- datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/package.html (added)
+++ datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/deploy/package.html Wed Jan 25 20:48:40 2023
@@ -0,0 +1,125 @@
+<!DOCTYPE html >
+<html>
+ <head>
+ <title>deploy - datafu-spark 1.8.0-SNAPSHOT-SNAPSHOT API - org.apache.spark.datafu.deploy</title>
+ <meta name="description" content="deploy - datafu - spark 1.8.0 - SNAPSHOT - SNAPSHOT API - org.apache.spark.datafu.deploy" />
+ <meta name="keywords" content="deploy datafu spark 1.8.0 SNAPSHOT SNAPSHOT API org.apache.spark.datafu.deploy" />
+ <meta http-equiv="content-type" content="text/html; charset=UTF-8" />
+
+ <link href="../../../../../lib/template.css" media="screen" type="text/css" rel="stylesheet" />
+ <link href="../../../../../lib/diagrams.css" media="screen" type="text/css" rel="stylesheet" id="diagrams-css" />
+ <script type="text/javascript" src="../../../../../lib/jquery.js" id="jquery-js"></script>
+ <script type="text/javascript" src="../../../../../lib/jquery-ui.js"></script>
+ <script type="text/javascript" src="../../../../../lib/template.js"></script>
+ <script type="text/javascript" src="../../../../../lib/tools.tooltip.js"></script>
+
+ <script type="text/javascript">
+ if(top === self) {
+ var url = '../../../../../index.html';
+ var hash = 'org.apache.spark.datafu.deploy.package';
+ var anchor = window.location.hash;
+ var anchor_opt = '';
+ if (anchor.length >= 1)
+ anchor_opt = '@' + anchor.substring(1);
+ window.location.href = url + '#' + hash + anchor_opt;
+ }
+ </script>
+
+ </head>
+ <body class="value">
+ <div id="definition">
+ <img alt="Package" src="../../../../../lib/package_big.png" />
+ <p id="owner"><a href="../../../../package.html" class="extype" name="org">org</a>.<a href="../../../package.html" class="extype" name="org.apache">apache</a>.<a href="../../package.html" class="extype" name="org.apache.spark">spark</a>.<a href="../package.html" class="extype" name="org.apache.spark.datafu">datafu</a></p>
+ <h1>deploy</h1><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.package" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ </div>
+
+ <h4 id="signature" class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <span class="name">deploy</span>
+ </span>
+ </h4>
+
+ <div id="comment" class="fullcommenttop"></div>
+
+
+ <div id="mbrsel">
+ <div id="textfilter"><span class="pre"></span><span class="input"><input id="mbrsel-input" type="text" accesskey="/" /></span><span class="post"></span></div>
+
+
+ <div id="visbl">
+ <span class="filtertype">Visibility</span>
+ <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol>
+ </div>
+ </div>
+
+ <div id="template">
+ <div id="allMembers">
+
+
+ <div id="types" class="types members">
+ <h3>Type Members</h3>
+ <ol><li name="org.apache.spark.datafu.deploy.SparkPythonRunner" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped">
+ <a id="SparkPythonRunnerextendsProductwithSerializable"></a>
+ <a id="SparkPythonRunner:SparkPythonRunner"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">case class</span>
+ </span>
+ <span class="symbol">
+ <a href="SparkPythonRunner.html"><span class="name">SparkPythonRunner</span></a><span class="params">(<span name="pyPaths">pyPaths: <span class="extype" name="scala.Predef.String">String</span></span>, <span name="otherArgs">otherArgs: <span class="extype" name="scala.Array">Array</span>[<span class="extype" name="scala.Predef.String">String</span>] = <span class="symbol">Array()</span></span>)</span><span class="result"> extends <span class="extype" name="scala.Product">Product</span> with <span class="extype" name="scala.Serializable">Serializable</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.datafu.deploy.package@SparkPythonRunnerextendsProductwithSerializable" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ <p class="shortcomment cmt">Internal class - should not be used by user</p><div class="fullcomment"><div class="comment cmt"><p>Internal class - should not be used by user</p><p>background:
+We had to "override" Spark's PythonRunner because we failed on premature python process closing.
+In PythonRunner the python process exits immediately when finished to read the file,
+this caused us to Accumulators Exceptions when the driver tries to get accumulation data
+from the python gateway.
+Instead, like in Zeppelin, we create an "interactive" python process, feed it the python
+script and not closing the gateway.
+</p></div></div>
+ </li></ol>
+ </div>
+
+
+
+
+
+
+
+
+ </div>
+
+ <div id="inheritedMembers">
+
+
+ </div>
+
+ <div id="groupedMembers">
+ <div class="group" name="Ungrouped">
+ <h3>Ungrouped</h3>
+
+ </div>
+ </div>
+
+ </div>
+
+ <div id="tooltip"></div>
+
+ <div id="footer"> </div>
+
+
+ </body>
+ </html>
Added: datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/package.html
URL: http://svn.apache.org/viewvc/datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/package.html?rev=1906998&view=auto
==============================================================================
--- datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/package.html (added)
+++ datafu/site/docs/spark/1.7.0/org/apache/spark/datafu/package.html Wed Jan 25 20:48:40 2023
@@ -0,0 +1,118 @@
+<!DOCTYPE html >
+<html>
+ <head>
+ <title>datafu - datafu-spark 1.8.0-SNAPSHOT-SNAPSHOT API - org.apache.spark.datafu</title>
+ <meta name="description" content="datafu - datafu - spark 1.8.0 - SNAPSHOT - SNAPSHOT API - org.apache.spark.datafu" />
+ <meta name="keywords" content="datafu datafu spark 1.8.0 SNAPSHOT SNAPSHOT API org.apache.spark.datafu" />
+ <meta http-equiv="content-type" content="text/html; charset=UTF-8" />
+
+ <link href="../../../../lib/template.css" media="screen" type="text/css" rel="stylesheet" />
+ <link href="../../../../lib/diagrams.css" media="screen" type="text/css" rel="stylesheet" id="diagrams-css" />
+ <script type="text/javascript" src="../../../../lib/jquery.js" id="jquery-js"></script>
+ <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script>
+ <script type="text/javascript" src="../../../../lib/template.js"></script>
+ <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script>
+
+ <script type="text/javascript">
+ if(top === self) {
+ var url = '../../../../index.html';
+ var hash = 'org.apache.spark.datafu.package';
+ var anchor = window.location.hash;
+ var anchor_opt = '';
+ if (anchor.length >= 1)
+ anchor_opt = '@' + anchor.substring(1);
+ window.location.href = url + '#' + hash + anchor_opt;
+ }
+ </script>
+
+ </head>
+ <body class="value">
+ <div id="definition">
+ <img alt="Package" src="../../../../lib/package_big.png" />
+ <p id="owner"><a href="../../../package.html" class="extype" name="org">org</a>.<a href="../../package.html" class="extype" name="org.apache">apache</a>.<a href="../package.html" class="extype" name="org.apache.spark">spark</a></p>
+ <h1>datafu</h1><span class="permalink">
+ <a href="../../../../index.html#org.apache.spark.datafu.package" title="Permalink" target="_top">
+ <img src="../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ </div>
+
+ <h4 id="signature" class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <span class="name">datafu</span>
+ </span>
+ </h4>
+
+ <div id="comment" class="fullcommenttop"></div>
+
+
+ <div id="mbrsel">
+ <div id="textfilter"><span class="pre"></span><span class="input"><input id="mbrsel-input" type="text" accesskey="/" /></span><span class="post"></span></div>
+
+
+ <div id="visbl">
+ <span class="filtertype">Visibility</span>
+ <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol>
+ </div>
+ </div>
+
+ <div id="template">
+ <div id="allMembers">
+
+
+
+
+
+
+ <div id="values" class="values members">
+ <h3>Value Members</h3>
+ <ol><li name="org.apache.spark.datafu.deploy" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="deploy"></a>
+ <a id="deploy:deploy"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <a href="deploy/package.html"><span class="name">deploy</span></a>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../index.html#org.apache.spark.datafu.package@deploy" title="Permalink" target="_top">
+ <img src="../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li></ol>
+ </div>
+
+
+
+
+ </div>
+
+ <div id="inheritedMembers">
+
+
+ </div>
+
+ <div id="groupedMembers">
+ <div class="group" name="Ungrouped">
+ <h3>Ungrouped</h3>
+
+ </div>
+ </div>
+
+ </div>
+
+ <div id="tooltip"></div>
+
+ <div id="footer"> </div>
+
+
+ </body>
+ </html>
Added: datafu/site/docs/spark/1.7.0/org/apache/spark/package.html
URL: http://svn.apache.org/viewvc/datafu/site/docs/spark/1.7.0/org/apache/spark/package.html?rev=1906998&view=auto
==============================================================================
--- datafu/site/docs/spark/1.7.0/org/apache/spark/package.html (added)
+++ datafu/site/docs/spark/1.7.0/org/apache/spark/package.html Wed Jan 25 20:48:40 2023
@@ -0,0 +1,263 @@
+<!DOCTYPE html >
+<html>
+ <head>
+ <title>spark - datafu-spark 1.8.0-SNAPSHOT-SNAPSHOT API - org.apache.spark</title>
+ <meta name="description" content="spark - datafu - spark 1.8.0 - SNAPSHOT - SNAPSHOT API - org.apache.spark" />
+ <meta name="keywords" content="spark datafu spark 1.8.0 SNAPSHOT SNAPSHOT API org.apache.spark" />
+ <meta http-equiv="content-type" content="text/html; charset=UTF-8" />
+
+ <link href="../../../lib/template.css" media="screen" type="text/css" rel="stylesheet" />
+ <link href="../../../lib/diagrams.css" media="screen" type="text/css" rel="stylesheet" id="diagrams-css" />
+ <script type="text/javascript" src="../../../lib/jquery.js" id="jquery-js"></script>
+ <script type="text/javascript" src="../../../lib/jquery-ui.js"></script>
+ <script type="text/javascript" src="../../../lib/template.js"></script>
+ <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script>
+
+ <script type="text/javascript">
+ if(top === self) {
+ var url = '../../../index.html';
+ var hash = 'org.apache.spark.package';
+ var anchor = window.location.hash;
+ var anchor_opt = '';
+ if (anchor.length >= 1)
+ anchor_opt = '@' + anchor.substring(1);
+ window.location.href = url + '#' + hash + anchor_opt;
+ }
+ </script>
+
+ </head>
+ <body class="value">
+ <div id="definition">
+ <img alt="Package" src="../../../lib/package_big.png" />
+ <p id="owner"><a href="../../package.html" class="extype" name="org">org</a>.<a href="../package.html" class="extype" name="org.apache">apache</a></p>
+ <h1>spark</h1><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ </div>
+
+ <h4 id="signature" class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <span class="name">spark</span>
+ </span>
+ </h4>
+
+ <div id="comment" class="fullcommenttop"><div class="toggleContainer block">
+ <span class="toggle">Linear Supertypes</span>
+ <div class="superTypes hiddenContent"><span class="extype" name="scala.AnyRef">AnyRef</span>, <span class="extype" name="scala.Any">Any</span></div>
+ </div></div>
+
+
+ <div id="mbrsel">
+ <div id="textfilter"><span class="pre"></span><span class="input"><input id="mbrsel-input" type="text" accesskey="/" /></span><span class="post"></span></div>
+ <div id="order">
+ <span class="filtertype">Ordering</span>
+ <ol>
+
+ <li class="alpha in"><span>Alphabetic</span></li>
+ <li class="inherit out"><span>By Inheritance</span></li>
+ </ol>
+ </div>
+ <div id="ancestors">
+ <span class="filtertype">Inherited<br />
+ </span>
+ <ol id="linearization">
+ <li class="in" name="org.apache.spark"><span>spark</span></li><li class="in" name="scala.AnyRef"><span>AnyRef</span></li><li class="in" name="scala.Any"><span>Any</span></li>
+ </ol>
+ </div><div id="ancestors">
+ <span class="filtertype"></span>
+ <ol>
+ <li class="hideall out"><span>Hide All</span></li>
+ <li class="showall in"><span>Show All</span></li>
+ </ol>
+ </div>
+ <div id="visbl">
+ <span class="filtertype">Visibility</span>
+ <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol>
+ </div>
+ </div>
+
+ <div id="template">
+ <div id="allMembers">
+
+
+
+
+
+
+ <div id="values" class="values members">
+ <h3>Value Members</h3>
+ <ol><li name="org.apache.spark#SPARK_BRANCH" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="SPARK_BRANCH:String"></a>
+ <a id="SPARK_BRANCH:String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SPARK_BRANCH</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@SPARK_BRANCH:String" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark#SPARK_BUILD_DATE" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="SPARK_BUILD_DATE:String"></a>
+ <a id="SPARK_BUILD_DATE:String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SPARK_BUILD_DATE</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@SPARK_BUILD_DATE:String" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark#SPARK_BUILD_USER" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="SPARK_BUILD_USER:String"></a>
+ <a id="SPARK_BUILD_USER:String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SPARK_BUILD_USER</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@SPARK_BUILD_USER:String" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark#SPARK_REPO_URL" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="SPARK_REPO_URL:String"></a>
+ <a id="SPARK_REPO_URL:String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SPARK_REPO_URL</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@SPARK_REPO_URL:String" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark#SPARK_REVISION" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="SPARK_REVISION:String"></a>
+ <a id="SPARK_REVISION:String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SPARK_REVISION</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@SPARK_REVISION:String" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark#SPARK_VERSION" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="SPARK_VERSION:String"></a>
+ <a id="SPARK_VERSION:String"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">val</span>
+ </span>
+ <span class="symbol">
+ <span class="name">SPARK_VERSION</span><span class="result">: <span class="extype" name="scala.Predef.String">String</span></span>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@SPARK_VERSION:String" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark.datafu" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="datafu"></a>
+ <a id="datafu:datafu"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <a href="datafu/package.html"><span class="name">datafu</span></a>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@datafu" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li><li name="org.apache.spark.sql" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="sql"></a>
+ <a id="sql:sql"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <a href="sql/package.html"><span class="name">sql</span></a>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../index.html#org.apache.spark.package@sql" title="Permalink" target="_top">
+ <img src="../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li></ol>
+ </div>
+
+
+
+
+ </div>
+
+ <div id="inheritedMembers">
+ <div class="parent" name="scala.AnyRef">
+ <h3>Inherited from <span class="extype" name="scala.AnyRef">AnyRef</span></h3>
+ </div><div class="parent" name="scala.Any">
+ <h3>Inherited from <span class="extype" name="scala.Any">Any</span></h3>
+ </div>
+
+ </div>
+
+ <div id="groupedMembers">
+ <div class="group" name="Ungrouped">
+ <h3>Ungrouped</h3>
+
+ </div>
+ </div>
+
+ </div>
+
+ <div id="tooltip"></div>
+
+ <div id="footer"> </div>
+
+
+ </body>
+ </html>
Added: datafu/site/docs/spark/1.7.0/org/apache/spark/sql/datafu/package.html
URL: http://svn.apache.org/viewvc/datafu/site/docs/spark/1.7.0/org/apache/spark/sql/datafu/package.html?rev=1906998&view=auto
==============================================================================
--- datafu/site/docs/spark/1.7.0/org/apache/spark/sql/datafu/package.html (added)
+++ datafu/site/docs/spark/1.7.0/org/apache/spark/sql/datafu/package.html Wed Jan 25 20:48:40 2023
@@ -0,0 +1,118 @@
+<!DOCTYPE html >
+<html>
+ <head>
+ <title>datafu - datafu-spark 1.8.0-SNAPSHOT-SNAPSHOT API - org.apache.spark.sql.datafu</title>
+ <meta name="description" content="datafu - datafu - spark 1.8.0 - SNAPSHOT - SNAPSHOT API - org.apache.spark.sql.datafu" />
+ <meta name="keywords" content="datafu datafu spark 1.8.0 SNAPSHOT SNAPSHOT API org.apache.spark.sql.datafu" />
+ <meta http-equiv="content-type" content="text/html; charset=UTF-8" />
+
+ <link href="../../../../../lib/template.css" media="screen" type="text/css" rel="stylesheet" />
+ <link href="../../../../../lib/diagrams.css" media="screen" type="text/css" rel="stylesheet" id="diagrams-css" />
+ <script type="text/javascript" src="../../../../../lib/jquery.js" id="jquery-js"></script>
+ <script type="text/javascript" src="../../../../../lib/jquery-ui.js"></script>
+ <script type="text/javascript" src="../../../../../lib/template.js"></script>
+ <script type="text/javascript" src="../../../../../lib/tools.tooltip.js"></script>
+
+ <script type="text/javascript">
+ if(top === self) {
+ var url = '../../../../../index.html';
+ var hash = 'org.apache.spark.sql.datafu.package';
+ var anchor = window.location.hash;
+ var anchor_opt = '';
+ if (anchor.length >= 1)
+ anchor_opt = '@' + anchor.substring(1);
+ window.location.href = url + '#' + hash + anchor_opt;
+ }
+ </script>
+
+ </head>
+ <body class="value">
+ <div id="definition">
+ <img alt="Package" src="../../../../../lib/package_big.png" />
+ <p id="owner"><a href="../../../../package.html" class="extype" name="org">org</a>.<a href="../../../package.html" class="extype" name="org.apache">apache</a>.<a href="../../package.html" class="extype" name="org.apache.spark">spark</a>.<a href="../package.html" class="extype" name="org.apache.spark.sql">sql</a></p>
+ <h1>datafu</h1><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.sql.datafu.package" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+ </div>
+
+ <h4 id="signature" class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <span class="name">datafu</span>
+ </span>
+ </h4>
+
+ <div id="comment" class="fullcommenttop"></div>
+
+
+ <div id="mbrsel">
+ <div id="textfilter"><span class="pre"></span><span class="input"><input id="mbrsel-input" type="text" accesskey="/" /></span><span class="post"></span></div>
+
+
+ <div id="visbl">
+ <span class="filtertype">Visibility</span>
+ <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol>
+ </div>
+ </div>
+
+ <div id="template">
+ <div id="allMembers">
+
+
+
+
+
+
+ <div id="values" class="values members">
+ <h3>Value Members</h3>
+ <ol><li name="org.apache.spark.sql.datafu.types" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped">
+ <a id="types"></a>
+ <a id="types:types"></a>
+ <h4 class="signature">
+ <span class="modifier_kind">
+ <span class="modifier"></span>
+ <span class="kind">package</span>
+ </span>
+ <span class="symbol">
+ <a href="types/package.html"><span class="name">types</span></a>
+ </span>
+ </h4><span class="permalink">
+ <a href="../../../../../index.html#org.apache.spark.sql.datafu.package@types" title="Permalink" target="_top">
+ <img src="../../../../../lib/permalink.png" alt="Permalink" />
+ </a>
+ </span>
+
+ </li></ol>
+ </div>
+
+
+
+
+ </div>
+
+ <div id="inheritedMembers">
+
+
+ </div>
+
+ <div id="groupedMembers">
+ <div class="group" name="Ungrouped">
+ <h3>Ungrouped</h3>
+
+ </div>
+ </div>
+
+ </div>
+
+ <div id="tooltip"></div>
+
+ <div id="footer"> </div>
+
+
+ </body>
+ </html>