You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Aitozi (Jira)" <ji...@apache.org> on 2022/04/14 09:32:00 UTC

[jira] [Commented] (FLINK-27203) Add supports for uploading jars from object storage (s3, gcs, oss)

    [ https://issues.apache.org/jira/browse/FLINK-27203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17522186#comment-17522186 ] 

Aitozi commented on FLINK-27203:
--------------------------------

Hi [~haoxin] , do you mean for uploading the session jobs jars ? There is a ticket tracking this 

> Add supports for uploading jars from object storage (s3, gcs, oss)
> ------------------------------------------------------------------
>
>                 Key: FLINK-27203
>                 URL: https://issues.apache.org/jira/browse/FLINK-27203
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kubernetes Operator
>            Reporter: Xin Hao
>            Priority: Major
>
> I think it will be efficient if we can read jars from object storage.
>  
>  *  We can detect the object storage provider by path scheme. (Such as: `gs://` for GCS)
>  * Because the most cloud providers' SDK support native permission integration with K8s, for example, the GCP, the user can bind the permission by service accounts, and the code running in the K8s cluster will be simple `{{{}storage = StorageOptions.getDefaultInstance().service{}}}`
>  * In this way, the users only need to bind the service accounts permissions and don't need to handle volumes mount and jars initialize (download jars from object storage into the volumes by themselves).
> I think we can define the interface first and let the community help contribute to the implementation for the different cloud providers.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)