You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Amit Sela (JIRA)" <ji...@apache.org> on 2016/06/27 18:19:52 UTC

[jira] [Updated] (BEAM-329) Fix Spark runner README to use it's own WordCount examlpe

     [ https://issues.apache.org/jira/browse/BEAM-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amit Sela updated BEAM-329:
---------------------------
             Assignee: Amit Sela
    Affects Version/s:     (was: 0.1.0-incubating)
                       0.2.0-incubating
          Description: The Spark runner should use its own WordCount because it can't support TextIO.Read without ignoring validation.  (was: In the Spark runner README - https://github.com/apache/incubator-beam/tree/master/runners/spark 
The "Running On Cluster" example doesn't work because it looks for the input on the local FS instead of HDFS.
Need to check what's up with TextIO there.. If this behaviour is wanted we should fix the README, otherwise it should read from HDFS. )
              Summary: Fix Spark runner README to use it's own WordCount examlpe   (was: README cluster example not working with HDFS input)

> Fix Spark runner README to use it's own WordCount examlpe 
> ----------------------------------------------------------
>
>                 Key: BEAM-329
>                 URL: https://issues.apache.org/jira/browse/BEAM-329
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>    Affects Versions: 0.2.0-incubating
>            Reporter: Amit Sela
>            Assignee: Amit Sela
>            Priority: Minor
>
> The Spark runner should use its own WordCount because it can't support TextIO.Read without ignoring validation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)