[jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN

["Weiwei Yang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642697#comment-16642697 ] 

Weiwei Yang commented on YARN-8811:
-----------------------------------

Thanks [~eyang] for the feedback. The idea behind this is to create an abstract layer standing between YARN and various of storage systems, and that layer is built upon CSI spec. This allows us to support various of storage systems without changing a lot of YARN internals. Given there is already eco-system around CSI, I think this is a good direction for us too. And technically, the CSI driver should be CO independent, this was listed as the first goal to address per CSI spec
{quote}Enable SP authors to write one CSI compliant Plugin that “just works” across all COs that implement CSI.
{quote}
Hope that clarifies the motivation.

I agree with your suggestion about making the user interface more easier to use, e.g use unified source path as URI form to make this more consistent for user to consume. Lets get the infra stuff built first and see if that can be done on top of that. Hope that makes sense.

Thanks

> Support Container Storage Interface (CSI) in YARN
> -------------------------------------------------
>
>                 Key: YARN-8811
>                 URL: https://issues.apache.org/jira/browse/YARN-8811
>             Project: Hadoop YARN
>          Issue Type: New Feature
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>            Priority: Major
>         Attachments: Support Container Storage Interface(CSI) in YARN_design doc_20180921.pdf, Support Container Storage Interface(CSI) in YARN_design doc_20180928.pdf
>
>
> The Container Storage Interface (CSI) is a vendor neutral interface to bridge Container Orchestrators and Storage Providers. With the adoption of CSI in YARN, it will be easier to integrate 3rd party storage systems, and provide the ability to attach persistent volumes for stateful applications.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org