[jira] [Resolved] (SPARK-15271) Allow force pulling executor docker images

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-15271.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 2.1.0

Issue resolved by pull request 13051
[https://github.com/apache/spark/pull/13051]

> Allow force pulling executor docker images
> ------------------------------------------
>
>                 Key: SPARK-15271
>                 URL: https://issues.apache.org/jira/browse/SPARK-15271
>             Project: Spark
>          Issue Type: New Feature
>          Components: Mesos
>    Affects Versions: 1.6.1
>            Reporter: Philipp Hoffmann
>             Fix For: 2.1.0
>
>
> Mesos agents by default will not pull docker images which are cached locally already.
> Because of this, in order to run a mutable tag (like {{...:latest}}) from the current version on the docker repository you have to explicitly tell the Mesos agent to pull the image (force pull). Otherwise the Mesos agent will run an old (cached version).
> The feature for force pulling the image was introduced in Mesos 0.22:
> https://github.com/apache/mesos/commit/8682569df528717ff5efb64da26b1b49c39c4efd
> This ticket is about making use of this feature in Spark in order to force Mesos agents to pull the executors docker image.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org