You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Erkin Alp Güney (JIRA)" <ji...@apache.org> on 2019/07/19 09:16:00 UTC
[jira] [Commented] (YARN-6522) Make SLS JSON input file format
simple and scalable
[ https://issues.apache.org/jira/browse/YARN-6522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888728#comment-16888728 ]
Erkin Alp Güney commented on YARN-6522:
---------------------------------------
I tried the new format JSON with Hadoop Trunk, but getting "no node" errors.
> Make SLS JSON input file format simple and scalable
> ---------------------------------------------------
>
> Key: YARN-6522
> URL: https://issues.apache.org/jira/browse/YARN-6522
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: scheduler-load-simulator
> Affects Versions: 3.0.0-alpha2
> Reporter: Yufei Gu
> Assignee: Yufei Gu
> Priority: Major
> Fix For: 3.0.0-alpha4
>
> Attachments: YARN-6522.001.patch, YARN-6522.002.patch, YARN-6522.003.patch, YARN-6522.004.patch
>
>
> SLS input format is verbose, and it doesn't scale out. We can improve it in these ways:
> # We need to configure tasks one by one if there are more than one task in a job, which means the job configuration usually includes lots of redundant items. To specify the number of task for task configuration will solve this issue.
> # Container host is useful for locality testing. It is obnoxious to specify container host for each task for tests unrelated to locality. We would like to make it optional.
> # For most tests, we don't care about job.id. Make it optional and generated automatically by default.
> # job.finish.ms doesn't make sense, just remove it.
> # container type and container priority should be optional as well.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org