You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/12/04 23:27:24 UTC

[GitHub] [beam] max-lepikhin commented on issue #24367: [Bug]: workflow.tar.gz cannot be passed to flink runner

max-lepikhin commented on issue #24367:
URL: https://github.com/apache/beam/issues/24367#issuecomment-1336548839

   @phoerious AzureBlobStoreFileSystemRegistrar is not included in beam-runners-flink-1.14-job-server-2.43.0.jar, so [this line](https://github.com/apache/beam/blob/b5a0f4895ccf7bd2f8b03217d866e8d0c67f6f52/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkJobServerDriver.java#L76) doesn't register the filesystem causing the exception when "azfs://" is used with [artifacts_dir](https://github.com/apache/beam/blob/883a362c930aca4298551697d7aaacbe7b6602f1/sdks/python/apache_beam/options/pipeline_options.py#L1428) pipeline option.
   
   It seems we need to add "runtimeOnly project(":sdks:java:io:azure")" in here:
   https://github.com/apache/beam/blob/master/runners/flink/job-server/flink_job_server.gradle#L96
   Is it possible for someone with contributor permissions to make the one line change to be included in the next release?
   
   I confirmed that the shadow jar built locally with "./gradlew -p runners/flink/1.14/job-server build" contains AzureBlobStoreFileSystemRegistrar.class.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org