You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ganesh Chand (JIRA)" <ji...@apache.org> on 2016/08/04 01:49:20 UTC
[jira] [Updated] (SPARK-16886) StructuredNetworkWordCount code
comment incorrectly refers to DataFrame instead of Dataset
[ https://issues.apache.org/jira/browse/SPARK-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ganesh Chand updated SPARK-16886:
---------------------------------
Description:
Both StructuredNetworkWordCount.scala and StructuredNetworkWordCount.java has the following code comment:
{code}
// Create DataFrame representing the stream of input lines from connection to host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
The above comment should be
{code}
// Create Dataset representing the stream of input lines from connection to host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
because .as[String] returns a Dataset.
Files affected are:
* examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCount.scala
was:
Both StructuredNetworkWordCount.scala and StructuredNetworkWordCount.java has the following code comment:
{code}
// Create DataFrame representing the stream of input lines from connection to host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
The above comment should be
{code}
// Create Dataset representing the stream of input lines from connection to host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
because .as[String] returns a Dataset.
> StructuredNetworkWordCount code comment incorrectly refers to DataFrame instead of Dataset
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-16886
> URL: https://issues.apache.org/jira/browse/SPARK-16886
> Project: Spark
> Issue Type: Bug
> Components: Examples
> Affects Versions: 2.0.0
> Reporter: Ganesh Chand
> Priority: Trivial
> Labels: comment, examples
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Both StructuredNetworkWordCount.scala and StructuredNetworkWordCount.java has the following code comment:
> {code}
> // Create DataFrame representing the stream of input lines from connection to host:port
> val lines = spark.readStream
> .format("socket")
> .option("host", host)
> .option("port", port)
> .load().as[String]
> {code}
> The above comment should be
> {code}
> // Create Dataset representing the stream of input lines from connection to host:port
> val lines = spark.readStream
> .format("socket")
> .option("host", host)
> .option("port", port)
> .load().as[String]
> {code}
> because .as[String] returns a Dataset.
> Files affected are:
> * examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCount.scala
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org