You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/08/10 21:32:00 UTC

[jira] [Commented] (AIRFLOW-2868) Mesos Executor should use executor_config to specify CPU, Memory and Docker image on the task level

    [ https://issues.apache.org/jira/browse/AIRFLOW-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576881#comment-16576881 ] 

ASF GitHub Bot commented on AIRFLOW-2868:
-----------------------------------------

amir656 opened a new pull request #3739: [AIRFLOW-2868] Extend mesos_executor
URL: https://github.com/apache/incubator-airflow/pull/3739
 
 
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [ ] My PR addresses the following [AIRFLOW-2868](https://issues.apache.org/jira/browse/AIRFLOW-2868) issue and references it in the PR title. 
   
   
   ### Description
   
   - [ ] I extended the mesos_executor to be able to execute different tasks with different CPU and Memory requirements, as well as different docker images. By providing an executor_config dictionary, users can specify these tasks in their operators. This builds off of the executor config created for the kubernetes_executor.
   
   ### Tests
   
   - [ ] My PR added to tests/contrib/executors/test_mesos_executor.py
   
   ### Commits
   
   - [ ] My commits all reference Jira issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "[How to write a good git commit message](http://chris.beams.io/posts/git-commit/)"
   
   ### Documentation
   
   - [ ] In case of new functionality, my PR adds documentation that describes how to use it.
   
   ### Code Quality
   
   - [ ] Passes `git diff upstream/master -u -- "*.py" | flake8 --diff`

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Mesos Executor should use executor_config to specify CPU, Memory and Docker image on the task level
> ---------------------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-2868
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2868
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib
>    Affects Versions: 1.10, 1.10.1
>            Reporter: Amir Shahatit
>            Assignee: Amir Shahatit
>            Priority: Major
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> Executor_config was added as a part of [AIRFLOW-1314|https://github.com/apache/incubator-airflow/commit/c0920efc012468681cff3d3c9cfe25c7381dc976]. This task extends the mesosExecutor to make use of specified executor configs to pass on resource requirements (CPU/Memory) as well as docker images on the task level. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)