You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/08/04 02:39:20 UTC
[jira] [Commented] (SPARK-16886) StructuredNetworkWordCount code
comment incorrectly refers to DataFrame instead of Dataset
[ https://issues.apache.org/jira/browse/SPARK-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407032#comment-15407032 ]
Apache Spark commented on SPARK-16886:
--------------------------------------
User 'ganeshchand' has created a pull request for this issue:
https://github.com/apache/spark/pull/14491
> StructuredNetworkWordCount code comment incorrectly refers to DataFrame instead of Dataset
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-16886
> URL: https://issues.apache.org/jira/browse/SPARK-16886
> Project: Spark
> Issue Type: Bug
> Components: Examples
> Affects Versions: 2.0.0
> Reporter: Ganesh Chand
> Priority: Trivial
> Labels: comment, examples
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Both StructuredNetworkWordCount.scala and StructuredNetworkWordCount.java has the following code comment:
> {code}
> // Create DataFrame representing the stream of input lines from connection to host:port
> val lines = spark.readStream
> .format("socket")
> .option("host", host)
> .option("port", port)
> .load().as[String]
> {code}
> The above comment should be
> {code}
> // Create Dataset representing the stream of input lines from connection to host:port
> val lines = spark.readStream
> .format("socket")
> .option("host", host)
> .option("port", port)
> .load().as[String]
> {code}
> because .as[String] returns a Dataset.
> Affects:
> * examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCount.scala
> * examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredNetworkWordCount.java
> * examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCountWindowed.scala
> * examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredNetworkWordCountWindowed.java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org