You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "pykenny (via GitHub)" <gi...@apache.org> on 2024/06/15 03:31:55 UTC

[I] Support logs pulling in `KubernetesJobOperator` [airflow]

pykenny opened a new issue, #40252:
URL: https://github.com/apache/airflow/issues/40252

   ### Description
   
   `KubernetesPodOperator` provides `get_logs` and `log_containers` arguments to support pulling logs generated from created Kubernetes pod, and these arguments are also available in `KubernetesJobOperator` from class inheritance.
   
   However, `KubernetesJobOperator` does not implement logs pulling mechanism, so user has no way to obtain pod logs from the created job with this operator.
   
   ### Use case/motivation
   
   Supports `get_logs` and `log_containers` settings in `KubernetesJobOperator` when `wait_until_job_complete` is enabled.
   
   We can take similar approach used in `KubernetesPodOperator` to regularly fetch pod logs under the created job.
   
   ### Related issues
   
    - https://github.com/apache/airflow/issues/17490
    - https://github.com/apache/airflow/pull/36847
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Support logs pulling in `KubernetesJobOperator` [airflow]

Posted by "pykenny (via GitHub)" <gi...@apache.org>.
pykenny closed issue #40252: Support logs pulling in `KubernetesJobOperator`
URL: https://github.com/apache/airflow/issues/40252


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Support logs pulling in `KubernetesJobOperator` [airflow]

Posted by "pykenny (via GitHub)" <gi...@apache.org>.
pykenny commented on issue #40252:
URL: https://github.com/apache/airflow/issues/40252#issuecomment-2908342370

   Went back to the topic today and found that it was solved just a month later:
    - https://github.com/apache/airflow/pull/40814/files
   
   Much appreciate @MaksYermak's support on this issue!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org