You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Amit Sela (JIRA)" <ji...@apache.org> on 2016/06/27 18:19:52 UTC
[jira] [Updated] (BEAM-329) Fix Spark runner README to use it's own
WordCount examlpe
[ https://issues.apache.org/jira/browse/BEAM-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amit Sela updated BEAM-329:
---------------------------
Assignee: Amit Sela
Affects Version/s: (was: 0.1.0-incubating)
0.2.0-incubating
Description: The Spark runner should use its own WordCount because it can't support TextIO.Read without ignoring validation. (was: In the Spark runner README - https://github.com/apache/incubator-beam/tree/master/runners/spark
The "Running On Cluster" example doesn't work because it looks for the input on the local FS instead of HDFS.
Need to check what's up with TextIO there.. If this behaviour is wanted we should fix the README, otherwise it should read from HDFS. )
Summary: Fix Spark runner README to use it's own WordCount examlpe (was: README cluster example not working with HDFS input)
> Fix Spark runner README to use it's own WordCount examlpe
> ----------------------------------------------------------
>
> Key: BEAM-329
> URL: https://issues.apache.org/jira/browse/BEAM-329
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Affects Versions: 0.2.0-incubating
> Reporter: Amit Sela
> Assignee: Amit Sela
> Priority: Minor
>
> The Spark runner should use its own WordCount because it can't support TextIO.Read without ignoring validation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)