You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2017/12/17 14:12:04 UTC

Re: [01/51] [partial] spark-website git commit: 2.2.1 generated doc

Hi,

I saw the following commit, but I can't seem to see 2.2.1 as the version in
the header of the documentation pages under
http://spark.apache.org/docs/latest/ (that is still 2.2.0). Is this being
worked on?

http://spark.apache.org/docs/2.2.1 is available and shows the proper
version, but not http://spark.apache.org/docs/latest :(

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

On Thu, Dec 14, 2017 at 1:51 PM, <sr...@apache.org> wrote:

> Repository: spark-website
> Updated Branches:
>   refs/heads/asf-site c312ef84e -> 49992614f
>
>
> http://git-wip-us.apache.org/repos/asf/spark-website/blob/49
> 992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/
> function/ForeachFunction.html
> ----------------------------------------------------------------------
> diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/function/ForeachFunction.html
> b/site/docs/2.2.1/api/java/org/apache/spark/api/java/functio
> n/ForeachFunction.html
> new file mode 100644
> index 0000000..81efb81
> --- /dev/null
> +++ b/site/docs/2.2.1/api/java/org/apache/spark/api/java/functio
> n/ForeachFunction.html
> @@ -0,0 +1,239 @@
> +<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "
> http://www.w3.org/TR/html4/loose.dtd">
> +<!-- NewPage -->
> +<html lang="en">
> +<head>
> +<!-- Generated by javadoc (1.8.0_131) on Sat Nov 25 01:45:57 UTC 2017 -->
> +<title>ForeachFunction (Spark 2.2.1 JavaDoc)</title>
> +<meta name="date" content="2017-11-25">
> +<link rel="stylesheet" type="text/css" href="../../../../../../stylesheet.css"
> title="Style">
> +<script type="text/javascript" src="../../../../../../script.
> js"></script>
> +</head>
> +<body>
> +<script type="text/javascript"><!--
> +    try {
> +        if (location.href.indexOf('is-external=true') == -1) {
> +            parent.document.title="ForeachFunction (Spark 2.2.1
> JavaDoc)";
> +        }
> +    }
> +    catch(err) {
> +    }
> +//-->
> +var methods = {"i0":6};
> +var tabs = {65535:["t0","All Methods"],2:["t2","Instance
> Methods"],4:["t3","Abstract Methods"]};
> +var altColor = "altColor";
> +var rowColor = "rowColor";
> +var tableTab = "tableTab";
> +var activeTableTab = "activeTableTab";
> +</script>
> +<noscript>
> +<div>JavaScript is disabled on your browser.</div>
> +</noscript>
> +<!-- ========= START OF TOP NAVBAR ======= -->
> +<div class="topNav"><a name="navbar.top">
> +<!--   -->
> +</a>
> +<div class="skipNav"><a href="#skip.navbar.top" title="Skip navigation
> links">Skip navigation links</a></div>
> +<a name="navbar.top.firstrow">
> +<!--   -->
> +</a>
> +<ul class="navList" title="Navigation">
> +<li><a href="../../../../../../overview-summary.html">Overview</a></li>
> +<li><a href="package-summary.html">Package</a></li>
> +<li class="navBarCell1Rev">Class</li>
> +<li><a href="package-tree.html">Tree</a></li>
> +<li><a href="../../../../../../deprecated-list.html">Deprecated</a></li>
> +<li><a href="../../../../../../index-all.html">Index</a></li>
> +<li><a href="../../../../../../help-doc.html">Help</a></li>
> +</ul>
> +</div>
> +<div class="subNav">
> +<ul class="navList">
> +<li><a href="../../../../../../org/apache/spark/api/java/function/F
> latMapGroupsWithStateFunction.html" title="interface in
> org.apache.spark.api.java.function"><span class="typeNameLink">Prev&nbsp
> ;Class</span></a></li>
> +<li><a href="../../../../../../org/apache/spark/api/java/function/ForeachPartitionFunction.html"
> title="interface in org.apache.spark.api.java.function"><span
> class="typeNameLink">Next&nbsp;Class</span></a></li>
> +</ul>
> +<ul class="navList">
> +<li><a href="../../../../../../index.html?org/apache/spark/api/java
> /function/ForeachFunction.html" target="_top">Frames</a></li>
> +<li><a href="ForeachFunction.html" target="_top">No&nbsp;Frames</a></li>
> +</ul>
> +<ul class="navList" id="allclasses_navbar_top">
> +<li><a href="../../../../../../allclasses-noframe.html">All&nbsp;
> Classes</a></li>
> +</ul>
> +<div>
> +<script type="text/javascript"><!--
> +  allClassesLink = document.getElementById("allclasses_navbar_top");
> +  if(window==top) {
> +    allClassesLink.style.display = "block";
> +  }
> +  else {
> +    allClassesLink.style.display = "none";
> +  }
> +  //-->
> +</script>
> +</div>
> +<div>
> +<ul class="subNavList">
> +<li>Summary:&nbsp;</li>
> +<li>Nested&nbsp;|&nbsp;</li>
> +<li>Field&nbsp;|&nbsp;</li>
> +<li>Constr&nbsp;|&nbsp;</li>
> +<li><a href="#method.summary">Method</a></li>
> +</ul>
> +<ul class="subNavList">
> +<li>Detail:&nbsp;</li>
> +<li>Field&nbsp;|&nbsp;</li>
> +<li>Constr&nbsp;|&nbsp;</li>
> +<li><a href="#method.detail">Method</a></li>
> +</ul>
> +</div>
> +<a name="skip.navbar.top">
> +<!--   -->
> +</a></div>
> +<!-- ========= END OF TOP NAVBAR ========= -->
> +<!-- ======== START OF CLASS DATA ======== -->
> +<div class="header">
> +<div class="subTitle">org.apache.spark.api.java.function</div>
> +<h2 title="Interface ForeachFunction" class="title">Interface
> ForeachFunction&lt;T&gt;</h2>
> +</div>
> +<div class="contentContainer">
> +<div class="description">
> +<ul class="blockList">
> +<li class="blockList">
> +<dl>
> +<dt>All Superinterfaces:</dt>
> +<dd>java.io.Serializable</dd>
> +</dl>
> +<dl>
> +<dt>Functional Interface:</dt>
> +<dd>This is a functional interface and can therefore be used as the
> assignment target for a lambda expression or method reference.</dd>
> +</dl>
> +<hr>
> +<br>
> +<pre>@FunctionalInterface
> +public interface <span class="typeNameLabel">ForeachF
> unction&lt;T&gt;</span>
> +extends java.io.Serializable</pre>
> +<div class="block">Base interface for a function used in Dataset's
> foreach function.
> +
> + Spark will invoke the call function on each element in the input
> Dataset.</div>
> +</li>
> +</ul>
> +</div>
> +<div class="summary">
> +<ul class="blockList">
> +<li class="blockList">
> +<!-- ========== METHOD SUMMARY =========== -->
> +<ul class="blockList">
> +<li class="blockList"><a name="method.summary">
> +<!--   -->
> +</a>
> +<h3>Method Summary</h3>
> +<table class="memberSummary" border="0" cellpadding="3" cellspacing="0"
> summary="Method Summary table, listing methods, and an explanation">
> +<caption><span id="t0" class="activeTableTab"><span>All
> Methods</span><span class="tabEnd">&nbsp;</span></span><span id="t2"
> class="tableTab"><span><a href="javascript:show(2);">Instance
> Methods</a></span><span class="tabEnd">&nbsp;</span></span><span id="t3"
> class="tableTab"><span><a href="javascript:show(4);">Abstract
> Methods</a></span><span class="tabEnd">&nbsp;</span></span></caption>
> +<tr>
> +<th class="colFirst" scope="col">Modifier and Type</th>
> +<th class="colLast" scope="col">Method and Description</th>
> +</tr>
> +<tr id="i0" class="altColor">
> +<td class="colFirst"><code>void</code></td>
> +<td class="colLast"><code><span class="memberNameLink"><a
> href="../../../../../../org/apache/spark/api/java/function/
> ForeachFunction.html#call-T-">call</a></span>(<a
> href="../../../../../../org/apache/spark/api/java/function/ForeachFunction.html"
> title="type parameter in ForeachFunction">T</a>&nbsp;t)</code>&nbsp;</td>
> +</tr>
> +</table>
> +</li>
> +</ul>
> +</li>
> +</ul>
> +</div>
> +<div class="details">
> +<ul class="blockList">
> +<li class="blockList">
> +<!-- ============ METHOD DETAIL ========== -->
> +<ul class="blockList">
> +<li class="blockList"><a name="method.detail">
> +<!--   -->
> +</a>
> +<h3>Method Detail</h3>
> +<a name="call-java.lang.Object-">
> +<!--   -->
> +</a><a name="call-T-">
> +<!--   -->
> +</a>
> +<ul class="blockListLast">
> +<li class="blockList">
> +<h4>call</h4>
> +<pre>void&nbsp;call(<a href="../../../../../../org/ap
> ache/spark/api/java/function/ForeachFunction.html" title="type parameter
> in ForeachFunction">T</a>&nbsp;t)
> +   throws Exception</pre>
> +<dl>
> +<dt><span class="throwsLabel">Throws:</span></dt>
> +<dd><code>Exception</code></dd>
> +</dl>
> +</li>
> +</ul>
> +</li>
> +</ul>
> +</li>
> +</ul>
> +</div>
> +</div>
> +<!-- ========= END OF CLASS DATA ========= -->
> +<!-- ======= START OF BOTTOM NAVBAR ====== -->
> +<div class="bottomNav"><a name="navbar.bottom">
> +<!--   -->
> +</a>
> +<div class="skipNav"><a href="#skip.navbar.bottom" title="Skip navigation
> links">Skip navigation links</a></div>
> +<a name="navbar.bottom.firstrow">
> +<!--   -->
> +</a>
> +<ul class="navList" title="Navigation">
> +<li><a href="../../../../../../overview-summary.html">Overview</a></li>
> +<li><a href="package-summary.html">Package</a></li>
> +<li class="navBarCell1Rev">Class</li>
> +<li><a href="package-tree.html">Tree</a></li>
> +<li><a href="../../../../../../deprecated-list.html">Deprecated</a></li>
> +<li><a href="../../../../../../index-all.html">Index</a></li>
> +<li><a href="../../../../../../help-doc.html">Help</a></li>
> +</ul>
> +</div>
> +<div class="subNav">
> +<ul class="navList">
> +<li><a href="../../../../../../org/apache/spark/api/java/function/F
> latMapGroupsWithStateFunction.html" title="interface in
> org.apache.spark.api.java.function"><span class="typeNameLink">Prev&nbsp
> ;Class</span></a></li>
> +<li><a href="../../../../../../org/apache/spark/api/java/function/ForeachPartitionFunction.html"
> title="interface in org.apache.spark.api.java.function"><span
> class="typeNameLink">Next&nbsp;Class</span></a></li>
> +</ul>
> +<ul class="navList">
> +<li><a href="../../../../../../index.html?org/apache/spark/api/java
> /function/ForeachFunction.html" target="_top">Frames</a></li>
> +<li><a href="ForeachFunction.html" target="_top">No&nbsp;Frames</a></li>
> +</ul>
> +<ul class="navList" id="allclasses_navbar_bottom">
> +<li><a href="../../../../../../allclasses-noframe.html">All&nbsp;
> Classes</a></li>
> +</ul>
> +<div>
> +<script type="text/javascript"><!--
> +  allClassesLink = document.getElementById("allclasses_navbar_bottom");
> +  if(window==top) {
> +    allClassesLink.style.display = "block";
> +  }
> +  else {
> +    allClassesLink.style.display = "none";
> +  }
> +  //-->
> +</script>
> +</div>
> +<div>
> +<ul class="subNavList">
> +<li>Summary:&nbsp;</li>
> +<li>Nested&nbsp;|&nbsp;</li>
> +<li>Field&nbsp;|&nbsp;</li>
> +<li>Constr&nbsp;|&nbsp;</li>
> +<li><a href="#method.summary">Method</a></li>
> +</ul>
> +<ul class="subNavList">
> +<li>Detail:&nbsp;</li>
> +<li>Field&nbsp;|&nbsp;</li>
> +<li>Constr&nbsp;|&nbsp;</li>
> +<li><a href="#method.detail">Method</a></li>
> +</ul>
> +</div>
> +<a name="skip.navbar.bottom">
> +<!--   -->
> +</a></div>
> +<!-- ======== END OF BOTTOM NAVBAR ======= -->
> +<script defer="defer" type="text/javascript"
> src="../../../../../../lib/jquery.js"></script><script defer="defer"
> type="text/javascript" src="../../../../../../lib/api
> -javadocs.js"></script></body>
> +</html>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
> For additional commands, e-mail: commits-help@spark.apache.org
>
>

Re: [01/51] [partial] spark-website git commit: 2.2.1 generated doc

Posted by Reynold Xin <rx...@databricks.com>.
There is an additional step that's needed to update the symlink, and that
step hasn't been done yet.


On Sun, Dec 17, 2017 at 12:32 PM, Jacek Laskowski <ja...@japila.pl> wrote:

> Hi Sean,
>
> What does "Not all the pieces are released yet" mean if you don't mind me
> asking? 2.2.1 has already been announced, hasn't it? [1]
>
> [1] http://spark.apache.org/news/spark-2-2-1-released.html
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://about.me/JacekLaskowski
> Spark Structured Streaming https://bit.ly/spark-structured-streaming
> Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
> Follow me at https://twitter.com/jaceklaskowski
>
> On Sun, Dec 17, 2017 at 4:19 PM, Sean Owen <sr...@apache.org> wrote:
>
>> /latest does not point to 2.2.1 yet. Not all the pieces are released yet,
>> as I understand?
>>
>> On Sun, Dec 17, 2017 at 8:12 AM Jacek Laskowski <ja...@japila.pl> wrote:
>>
>>> Hi,
>>>
>>> I saw the following commit, but I can't seem to see 2.2.1 as the version
>>> in the header of the documentation pages under http://spark.apache.org/
>>> docs/latest/ (that is still 2.2.0). Is this being worked on?
>>>
>>> http://spark.apache.org/docs/2.2.1 is available and shows the proper
>>> version, but not http://spark.apache.org/docs/latest :(
>>>
>>> Pozdrawiam,
>>> Jacek Laskowski
>>> ----
>>>
>>>
>

Re: [01/51] [partial] spark-website git commit: 2.2.1 generated doc

Posted by Jacek Laskowski <ja...@japila.pl>.
Hi Sean,

What does "Not all the pieces are released yet" mean if you don't mind me
asking? 2.2.1 has already been announced, hasn't it? [1]

[1] http://spark.apache.org/news/spark-2-2-1-released.html

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

On Sun, Dec 17, 2017 at 4:19 PM, Sean Owen <sr...@apache.org> wrote:

> /latest does not point to 2.2.1 yet. Not all the pieces are released yet,
> as I understand?
>
> On Sun, Dec 17, 2017 at 8:12 AM Jacek Laskowski <ja...@japila.pl> wrote:
>
>> Hi,
>>
>> I saw the following commit, but I can't seem to see 2.2.1 as the version
>> in the header of the documentation pages under http://spark.apache.org/
>> docs/latest/ (that is still 2.2.0). Is this being worked on?
>>
>> http://spark.apache.org/docs/2.2.1 is available and shows the proper
>> version, but not http://spark.apache.org/docs/latest :(
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> ----
>>
>>

Re: [01/51] [partial] spark-website git commit: 2.2.1 generated doc

Posted by Sean Owen <sr...@apache.org>.
/latest does not point to 2.2.1 yet. Not all the pieces are released yet,
as I understand?

On Sun, Dec 17, 2017 at 8:12 AM Jacek Laskowski <ja...@japila.pl> wrote:

> Hi,
>
> I saw the following commit, but I can't seem to see 2.2.1 as the version
> in the header of the documentation pages under
> http://spark.apache.org/docs/latest/ (that is still 2.2.0). Is this being
> worked on?
>
> http://spark.apache.org/docs/2.2.1 is available and shows the proper
> version, but not http://spark.apache.org/docs/latest :(
>
> Pozdrawiam,
> Jacek Laskowski
> ----
>
>