You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/08/03 11:11:07 UTC
[GitHub] [airflow] alittlesliceoftom commented on issue #13888: Kubernetes Launchers Log Check in Time is Not Configurable - Excess Logs Slow Airflow
alittlesliceoftom commented on issue #13888:
URL: https://github.com/apache/airflow/issues/13888#issuecomment-891757648
Hey @kdunee a very crude one for #14259, I just replace the command I use with one that runs an echo every 30 secs in addition to the main task.
So I prepend this boilerplate to my kube pod calls...
`cmd_boilerplate = "while true; do echo heartbeat; sleep 30; done &"`
Then my KubePodCalls look like:
```
kubernetes_pod.KubernetesPodOperator(
name="name",
# ? The ID specified for the task.
task_id="task_id",
cmds=bash,
arguments=[
"-c",
f"{cmd_boilerplate} do your thing here",
],
get_logs=True,
**default_kube_args,
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org