You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Szilard Nemeth (Jira)" <ji...@apache.org> on 2019/09/27 09:24:00 UTC

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config

    [ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939248#comment-16939248 ] 

Szilard Nemeth commented on YARN-9699:
--------------------------------------

Hi [~sunilg] / [~Prabhu Joseph]! / [~pbacsko]!

We have been thinking about the ways we could connect the converter to the existing code so I'm trying to collect all the pros and cons of these approaches.
Right now, we can think of a new RM admin CLI command or a completely new, standalone tool to invoke the converter.

*RMAdminCLI*
Advantages: 
1. Classpath is already set so the converter itself is available
2. No need to setup yet another standalone tool
3. yarn-site.xml and fair-scheduler.xml don't need to be specified on CLI as they are given at RM startup. Optionally, these input configs should be 

Disadvantages:
1. RM needs to be run to be able to convert

*Standalone tool* 
Advantages:
1. Conversion can be started even if RM does not run so offline conversion is available

Disadvantages
1. Users need to accustomed to the new standalone tool
2. The new standalone tool should have Yarn RM library on its classpath, this makes things more difficult to set up on clusters

Please feel free to add your thoughts as this decision has to be made as early as possible!

Thanks!

> Migration tool that help to generate CS config based on FS config
> -----------------------------------------------------------------
>
>                 Key: YARN-9699
>                 URL: https://issues.apache.org/jira/browse/YARN-9699
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Wanqiang Ji
>            Assignee: Gergely Pollak
>            Priority: Major
>         Attachments: FS_to_CS_migration_POC.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org