You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Mao Geng (JIRA)" <ji...@apache.org> on 2017/06/18 17:48:02 UTC

[jira] [Comment Edited] (MESOS-7692) Default environment variables defined in docker image are not available in mesos containerizer

    [ https://issues.apache.org/jira/browse/MESOS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053269#comment-16053269 ] 

Mao Geng edited comment on MESOS-7692 at 6/18/17 5:47 PM:
----------------------------------------------------------

Tested on a host with following command:
{code}
/usr/bin/mesos-execute --master=<master_url> --name=java8 --docker_image=java:8 --command="env"
{code}

Output of the task:
{code}Executing pre-exec command '{"arguments":["mesos-containerizer","mount","--help=false","--operation=make-rslave","--path=\/"],"shell":false,"value":"\/usr\/libexec\/mesos\/mesos-containerizer"}'
Executing pre-exec command '{"arguments":["mount","-n","--rbind","\/mnt\/mesos\/slaves\/f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S3\/frameworks\/609ef166-7000-4c8d-a6ed-909e4d504eaa-0005\/executors\/java8\/runs\/4a381932-6bc2-4e52-a044-697491694d76","\/mnt\/mesos\/provisioner\/containers\/4a381932-6bc2-4e52-a044-697491694d76\/backends\/overlay\/rootfses\/4d202d5d-42f9-4904-b67f-b995c7dfab46\/mnt\/mesos\/sandbox"],"shell":false,"value":"mount"}'
Received SUBSCRIBED event
Subscribed executor on <slave hostname>
Received LAUNCH event
Starting task java8
Running '/usr/libexec/mesos/mesos-containerizer launch <POSSIBLY-SENSITIVE-DATA>'
Forked command at 122347
Changing root to /mnt/mesos/provisioner/containers/4a381932-6bc2-4e52-a044-697491694d76/backends/overlay/rootfses/4d202d5d-42f9-4904-b67f-b995c7dfab46
MESOS_EXECUTOR_ID=java8
MESOS_CHECKPOINT=0
MESOS_HTTP_COMMAND_EXECUTOR=0
MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD=5secs
LIBPROCESS_PORT=0
MESOS_AGENT_ENDPOINT=10.1.100.89:5051
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
MESOS_SANDBOX=/mnt/mesos/sandbox
MESOS_NATIVE_JAVA_LIBRARY=/usr/lib/libmesos-1.3.0.so
MESOS_FRAMEWORK_ID=609ef166-7000-4c8d-a6ed-909e4d504eaa-0005
MESOS_NATIVE_LIBRARY=/usr/lib/libmesos-1.3.0.so
MESOS_SLAVE_ID=f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S3
MESOS_DIRECTORY=/mnt/mesos/slaves/f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S3/frameworks/609ef166-7000-4c8d-a6ed-909e4d504eaa-0005/executors/java8/runs/4a381932-6bc2-4e52-a044-697491694d76
PWD=/mnt/mesos/sandbox
MESOS_SLAVE_PID=slave(1)@10.1.100.89:5051
Command exited with status 0 (pid: 122347)
Received SHUTDOWN event
Shutting down{code}

Package version:
{quote}apt-cache policy mesos
mesos:
  Installed: 1.3.0-2.0.3
  Candidate: 1.3.0-2.0.3
  Version table:
 *** 1.3.0-2.0.3 0
        500 http://repos.mesosphere.io/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status{quote}


was (Author: gengmao):
Tested on a host with following command:
{code}
/usr/bin/mesos-execute --master=<master_url> --name=java8 --docker_image=java:8 --command="env"
{code}

Output of the task:
{quote}Executing pre-exec command '{"arguments":["mesos-containerizer","mount","--help=false","--operation=make-rslave","--path=\/"],"shell":false,"value":"\/usr\/libexec\/mesos\/mesos-containerizer"}'
Executing pre-exec command '{"arguments":["mount","-n","--rbind","\/mnt\/mesos\/slaves\/f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S3\/frameworks\/609ef166-7000-4c8d-a6ed-909e4d504eaa-0005\/executors\/java8\/runs\/4a381932-6bc2-4e52-a044-697491694d76","\/mnt\/mesos\/provisioner\/containers\/4a381932-6bc2-4e52-a044-697491694d76\/backends\/overlay\/rootfses\/4d202d5d-42f9-4904-b67f-b995c7dfab46\/mnt\/mesos\/sandbox"],"shell":false,"value":"mount"}'
Received SUBSCRIBED event
Subscribed executor on <slave hostname>
Received LAUNCH event
Starting task java8
Running '/usr/libexec/mesos/mesos-containerizer launch <POSSIBLY-SENSITIVE-DATA>'
Forked command at 122347
Changing root to /mnt/mesos/provisioner/containers/4a381932-6bc2-4e52-a044-697491694d76/backends/overlay/rootfses/4d202d5d-42f9-4904-b67f-b995c7dfab46
MESOS_EXECUTOR_ID=java8
MESOS_CHECKPOINT=0
MESOS_HTTP_COMMAND_EXECUTOR=0
MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD=5secs
LIBPROCESS_PORT=0
MESOS_AGENT_ENDPOINT=10.1.100.89:5051
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
MESOS_SANDBOX=/mnt/mesos/sandbox
MESOS_NATIVE_JAVA_LIBRARY=/usr/lib/libmesos-1.3.0.so
MESOS_FRAMEWORK_ID=609ef166-7000-4c8d-a6ed-909e4d504eaa-0005
MESOS_NATIVE_LIBRARY=/usr/lib/libmesos-1.3.0.so
MESOS_SLAVE_ID=f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S3
MESOS_DIRECTORY=/mnt/mesos/slaves/f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S3/frameworks/609ef166-7000-4c8d-a6ed-909e4d504eaa-0005/executors/java8/runs/4a381932-6bc2-4e52-a044-697491694d76
PWD=/mnt/mesos/sandbox
MESOS_SLAVE_PID=slave(1)@10.1.100.89:5051
Command exited with status 0 (pid: 122347)
Received SHUTDOWN event
Shutting down{quote}

Package version:
{quote}apt-cache policy mesos
mesos:
  Installed: 1.3.0-2.0.3
  Candidate: 1.3.0-2.0.3
  Version table:
 *** 1.3.0-2.0.3 0
        500 http://repos.mesosphere.io/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status{quote}

> Default environment variables defined in docker image are not available in mesos containerizer
> ----------------------------------------------------------------------------------------------
>
>                 Key: MESOS-7692
>                 URL: https://issues.apache.org/jira/browse/MESOS-7692
>             Project: Mesos
>          Issue Type: Bug
>          Components: containerization
>    Affects Versions: 1.3.0
>            Reporter: Mao Geng
>            Priority: Blocker
>
> Found an unexpected change in 1.3.0-2.0.3 - the environment variables defined by ENV statements in dockerfile are not available in mesos containerizer any more. For example LD_LIBRARY_PATH of tensorflow/tensorflow:latest-gpu image, JAVA_HOME of java:8 image, etc. 
> The env vars are available in mesos containerizer in 1.2.0. Looks like a regression to me, isn't it? 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)