You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/03/08 23:40:00 UTC

[jira] [Work logged] (BEAM-6049) Support Job / Graph upload to GCS in Dataflow Runner

     [ https://issues.apache.org/jira/browse/BEAM-6049?focusedWorklogId=210399&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-210399 ]

ASF GitHub Bot logged work on BEAM-6049:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 08/Mar/19 23:39
            Start Date: 08/Mar/19 23:39
    Worklog Time Spent: 10m 
      Work Description: Jdban commented on issue #7047: [BEAM-6049] Add option to load job to GCS in Dataflow Runner
URL: https://github.com/apache/beam/pull/7047#issuecomment-471114935
 
 
   @bbhoss I'm getting the same error with `2.10.0` and `2.11.0`
   ```Runnable workflow has no steps specified.```
   
   We enabled it via:
   ```java
   DataflowPipelineOptions options = PipelineOptionsFactory.as(DataflowPipelineOptions.class);
   options.setExperiments(Arrays.asList("upload_graph"));
   ```
   
   @swegner/@foegler
   How do we get this working with GCP dataflow? Has the feature been enabled in the service yet?
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 210399)
    Time Spent: 3h 10m  (was: 3h)

> Support Job / Graph upload to GCS in Dataflow Runner
> ----------------------------------------------------
>
>                 Key: BEAM-6049
>                 URL: https://issues.apache.org/jira/browse/BEAM-6049
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-dataflow
>            Reporter: Andrea Foegler
>            Assignee: Andrea Foegler
>            Priority: Major
>              Labels: triaged
>          Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> Add uploadGraph flag to support uploading the job / graph to GCS instead of embedding in the request.  This change allows the API to support much larger graphs than the embedded format of CreateJob.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)