You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 16:24:29 UTC

[GitHub] [beam] kennknowles opened a new issue, #18148: DataflowRunner support for Class-Path jars

kennknowles opened a new issue, #18148:
URL: https://github.com/apache/beam/issues/18148

   See https://github.com/GoogleCloudPlatform/DataflowJavaSDK/issues/538
   
   The code that infers `--filesToStage` from the classpath does not seem to support a classpath jar. which uses a `Class-Path` manifest to indicate which other jars are needed at runtime. This is apparently a standard, approved way to pass the classpath.
   
   We need to add this support to `DataflowRunner#detectClasspathResourcesToStage`, but correctly representing the user's classpath continues to be challenging.
   
   (As `FlinkRunner` has copied this code, we should probably either pull the common utility somewhere public or update the FlinkRunner too?)
   
   Imported from Jira [BEAM-1325](https://issues.apache.org/jira/browse/BEAM-1325). Original Jira may contain additional context.
   Reported by: dhalperi.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org