You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jonathonbattista (via GitHub)" <gi...@apache.org> on 2024/04/30 21:17:07 UTC

Re: [PR] Modify KPO to log container log periodically [airflow]

jonathonbattista commented on PR #37279:
URL: https://github.com/apache/airflow/pull/37279#issuecomment-2087353608

   Should this already be compatible with the `GKEStartPodOperator` out of the box or does it also need updated?
   
   I am on `apache-airflow-providers-cncf-kubernetes v8.1.1` and `apache-airflow-providers-google v10.17.0`
   
   I have `logging_internval` set, but its not polling the logs when the task is deferred:
   https://github.com/apache/airflow/blob/main/airflow/providers/google/cloud/operators/kubernetes_engine.py#L792
   
   ```
   with DAG(
       "gke_start_pod_test",
       schedule_interval=None,
       start_date=days_ago(1),
       tags=["test"],
   ) as dag:
     gke_start_pod_test = GKEStartPodOperator(
         task_id="sleep",
         project_id="xxxxx",
         location="xxx",
         cluster_name="xxxxx",
         do_xcom_push=True,
         namespace="default",
         image="ubuntu:jammy",
         cmds=["sh", "-c", "timeout 300 bash -c 'while true; do echo \"meow\"; sleep 3; done'"],
         name="test-sleep",
         in_cluster=False,
         on_finish_action="delete_pod",
         deferrable=True,
         get_logs=True,
         logging_interval=10
     )
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org