[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

["Eric Badger (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875283#comment-16875283 ] 

Eric Badger commented on YARN-9562:
-----------------------------------

Attaching patch 001 as an initial patch to give everyone a sense of how the patch will look for the most part. Currently, the {{RuncContainerRuntime}} is using Docker configs, but we have decided to split the config into docker and runc separately. So this will need to change in future versions of the patch. Additionally, there are currently no unit tests. An entire suite of new tests will need to be written before this can be committed. Because of this, I'm not going to submit the patch until a later revision.

Other than that, I'm happy to hear feedback from others while I fix up the patch, add unit tests, and etc. 

To try this out (along with the C code changes from YARN-9561), you will need to create squashfs layers from all of the layers of a docker image and upload them to the layers directory specified by the configs. The image config will go in the config directory, and the the manifest in the manifests directory. There is also some magic that needs to be done in relation to whiteout and opaque files in the docker image, but you can probably get your image to run without dealing with those. I have a tool that does the whole conversion, but that isn't yet ready to put up for review because there are some bits of code that rely on internal changes that haven't been made to the apache codebase. If you'd like, I could try and put that up before focusing on the unit tests for this JIRA as well as YARN-9561.

> Add Java changes for the new RuncContainerRuntime
> -------------------------------------------------
>
>                 Key: YARN-9562
>                 URL: https://issues.apache.org/jira/browse/YARN-9562
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>            Priority: Major
>         Attachments: YARN-9562.001.patch
>
>
> This JIRA will be used to add the Java changes for the new RuncContainerRuntime. This will work off of YARN-9560 to use much of the existing DockerLinuxContainerRuntime code once it is moved up into an abstract class that can be extended. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org