You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "wusf233 (via GitHub)" <gi...@apache.org> on 2023/08/02 09:35:58 UTC

[I] [Bug]: I use hop to run Pipeline in flink, can I get the JobID of Flink? (hop)

wusf233 opened a new issue, #3131:
URL: https://github.com/apache/hop/issues/3131

   ### Apache Hop version?
   
   2.4
   
   ### Java version?
   
   11
   
   ### Operating system
   
   Windows
   
   ### What happened?
   
   I used the following to create IPipelineEngine<PipelineMeta>
   `IPipelineEngine<PipelineMeta> pipeline = PipelineEngineFactory.createPipelineEngine(
                       variables,
                       executionConfiguration.getRunConfiguration(),
                       pipelineMeta.getMetadataProvider(),
                       pipelineMeta);`
   
   Then start executing
   
   ` pipeline.prepareExecution();
    pipeline.startThreads();
   `
   I will submit the Pipeline to the Flink environment to run, so can I get the JobID of this Pipeline in Flink through code?
   Something like
   ![image](https://github.com/apache/hop/assets/58242269/280effd2-0ff5-4436-b054-ee4424ed6af3)
   
   
   
   ### Issue Priority
   
   Priority: 3
   
   ### Issue Component
   
   Component: Beam


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: I use hop to run Pipeline in flink, can I get the JobID of Flink? (hop)

Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters commented on issue #3131:
URL: https://github.com/apache/hop/issues/3131#issuecomment-1813194107

   For DataFlow we solved it by saving the specific details like Job ID, project ID, region, as details in the execution information location.
   
   So the `pipeline` object above is a `HopBeamPipelineEngine` object of which you can ask `getBeamPipelineResults()`.  That will have the details for DataFlow by casting to `DataflowPipelineJob`.  Perhaps we can cast to `FlinkRunnerResult` to get similar results.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org