You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Badger (JIRA)" <ji...@apache.org> on 2018/05/02 22:35:12 UTC
[jira] [Updated] (YARN-6988) container-executor fails for docker
when command length > 4096 B
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Badger updated YARN-6988:
------------------------------
Labels: Docker (was: )
> container-executor fails for docker when command length > 4096 B
> ----------------------------------------------------------------
>
> Key: YARN-6988
> URL: https://issues.apache.org/jira/browse/YARN-6988
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Eric Badger
> Assignee: Eric Badger
> Priority: Major
> Labels: Docker
> Fix For: 2.9.0, 3.0.0-beta1, 2.8.2
>
> Attachments: YARN-6988-branch-2.002.patch, YARN-6988-branch-2.8.002.patch, YARN-6988.001.patch, YARN-6988.002.patch
>
>
> {{run_docker}} and {{launch_docker_container_as_user}} allocate their command arrays using EXECUTOR_PATH_MAX, which is hardcoded to 4096 in configuration.h. Because of this, the full docker command can only be 4096 characters. If it is longer, it will be truncated and the command will fail with a parsing error. Because of the bind-mounting of volumes, the arguments to the docker command can quickly get large. For example, I passed the 4096 limit with an 11 disk node.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org