You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/10/10 18:11:00 UTC

[jira] [Work logged] (BEAM-3587) User reports TextIO failure in FlinkRunner on master

     [ https://issues.apache.org/jira/browse/BEAM-3587?focusedWorklogId=153233&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-153233 ]

ASF GitHub Bot logged work on BEAM-3587:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 10/Oct/18 18:10
            Start Date: 10/Oct/18 18:10
    Worklog Time Spent: 10m 
      Work Description: swegner commented on issue #384: [BEAM-3587] Add a note to Gradle shadowJar for merge service files
URL: https://github.com/apache/beam-site/pull/384#issuecomment-428674409
 
 
   FYI, Beam Website source code is being migrated to [apache/beam](https://github.com/apache/beam), and we will retire the beam-site repository after all in-progress pull requests have been completed.
   
   Is this PR still relevant? If so, do you have an ETA of when it can be merged?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 153233)
    Time Spent: 1h  (was: 50m)

> User reports TextIO failure in FlinkRunner on master
> ----------------------------------------------------
>
>                 Key: BEAM-3587
>                 URL: https://issues.apache.org/jira/browse/BEAM-3587
>             Project: Beam
>          Issue Type: Bug
>          Components: website
>            Reporter: Kenneth Knowles
>            Assignee: Jean-Baptiste Onofré
>            Priority: Minor
>             Fix For: Not applicable
>
>         Attachments: screen1.png, screen2.png
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> Reported here: [https://lists.apache.org/thread.html/47b16c94032392782505415e010970fd2a9480891c55c2f7b5de92bd@%3Cuser.beam.apache.org%3E]
> "I'm trying to run a pipeline containing just a TextIO.read() step on a Flink cluster, using the latest Beam git revision (ff37337). The job fails to start with the Exception:
>   {{java.lang.UnsupportedOperationException: The transform  is currently not supported.}}
> It does work with Beam 2.2.0 though. All code, logs, and reproduction steps  [https://github.com/pelletier/beam-flink-example]"
> My initial thoughts: I have a guess that this has to do with switching to running from a portable pipeline representation, and it looks like there's a non-composite transform with an empty URN and it threw a bad error message. We can try to root cause but may also mitigate short-term by removing the round-trip through pipeline proto for now.
> What is curious is that the ValidatesRunner and WordCountIT are working - they only run on a local Flink, yet this seems to be a translation issue that would occur for local or distributed runs.
> We need to certainly run this repro on the RC if we don't totally get to the bottom of it quickly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)