You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2017/02/22 13:54:44 UTC

[jira] [Resolved] (SPARK-19696) Wrong Documentation for Java Word Count Example

     [ https://issues.apache.org/jira/browse/SPARK-19696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-19696.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 2.1.0

> Wrong Documentation for Java Word Count Example
> -----------------------------------------------
>
>                 Key: SPARK-19696
>                 URL: https://issues.apache.org/jira/browse/SPARK-19696
>             Project: Spark
>          Issue Type: Bug
>          Components: Documentation
>    Affects Versions: 2.1.0
>            Reporter: gaurav gupta
>            Assignee: Sean Owen
>            Priority: Minor
>             Fix For: 2.1.0
>
>
> Java Word Count example of http://spark.apache.org/examples.html page is defined incorrectly 
> '''
> JavaRDD<String> textFile = sc.textFile("hdfs://...");
> JavaRDD<String> words = textFile.flatMap(s -> Arrays.asList(s.split(" ")).iterator())
>                             .mapToPair(word -> new Tuple2<>(word, 1))
>                             .reduceByKey((a, b) -> a + b);
> counts.saveAsTextFile("hdfs://...");
> ''
> It should be 
> '''
> JavaRDD<String> textFile = sc.textFile("hdfs://...");
> JavaPairRDD<String, Integer> counts = textFile.flatMap(s -> Arrays.asList(s.split(" ")).iterator())
>                             .mapToPair(word -> new Tuple2<>(word, 1))
>                             .reduceByKey((a, b) -> a + b);
> counts.saveAsTextFile("hdfs://...");
> ''''



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org