You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "George Miller (JIRA)" <ji...@apache.org> on 2019/06/05 18:00:04 UTC
[jira] [Updated] (AIRFLOW-4739) Kubernetes Executor: Allow per
task labels on task pods
[ https://issues.apache.org/jira/browse/AIRFLOW-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
George Miller updated AIRFLOW-4739:
-----------------------------------
Description:
I want to be able to add arbitrary labels to an airflow worker pod. For example, I want to specify this in the task definition:
```
run_this = PythonOperator(
task_id='print_the_context',
provide_context=True,
python_callable=my_sleeping_function,
executor_config={"KubernetesExecutor": {"labels":
{"test": "label"}
}},
dag=dag,
)
```
And have my worker pod have the label `test:label`.
My main use case for this is for auditing. We audit our kubernetes cluster by tags, attributing cost based on how much resources the pod uses.
I will make a PR.
was:
I want to be able to add arbitrary labels to an airflow worker pod. For example, I want to specify this in the task definition:
```
run_this = PythonOperator(
task_id='print_the_context',
provide_context=True,
python_callable=my_sleeping_function,
executor_config=\{"KubernetesExecutor": {"labels": {"test": "label"}}},
dag=dag,
)
```
And have my worker pod have the label `test:label`. My main use case for this is for auditing. We audit our kubernetes cluster by tags, attributing cost based on how much resources the pod uses.
> Kubernetes Executor: Allow per task labels on task pods
> --------------------------------------------------------
>
> Key: AIRFLOW-4739
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4739
> Project: Apache Airflow
> Issue Type: New Feature
> Components: executors
> Affects Versions: 1.10.4
> Reporter: George Miller
> Assignee: George Miller
> Priority: Major
> Labels: pull-request-available
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> I want to be able to add arbitrary labels to an airflow worker pod. For example, I want to specify this in the task definition:
> ```
> run_this = PythonOperator(
> task_id='print_the_context',
> provide_context=True,
> python_callable=my_sleeping_function,
> executor_config={"KubernetesExecutor": {"labels":
> {"test": "label"}
> }},
> dag=dag,
> )
> ```
> And have my worker pod have the label `test:label`.
>
> My main use case for this is for auditing. We audit our kubernetes cluster by tags, attributing cost based on how much resources the pod uses.
>
> I will make a PR.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)