You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "adamgorkaextbi (via GitHub)" <gi...@apache.org> on 2025/10/10 06:33:57 UTC

[I] GlueJobOperatorin verbose mode do not pull logs correctly [airflow]

adamgorkaextbi opened a new issue, #56535:
URL: https://github.com/apache/airflow/issues/56535

   ### Apache Airflow Provider(s)
   
   amazon
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-amazon==9.10.0 up to newest at current time 9.15.0
   
   ### Apache Airflow version
   
   2.11.0
   
   ### Operating System
   
   Debian GNU/Linux 12
   
   ### Deployment
   
   Official Apache Airflow Helm Chart
   
   ### Deployment details
   
   official helm chart
   
   ### What happened
   
   GlueJobOperator in dereferable mode, wait_for_completion=true, verbose=true mode is not pulling logs
   newly introduced 
   waiter_with_logging is not working correctly
   [2025-10-09, 22:25:23 UTC] {waiter_with_logging.py:158} INFO - Status of AWS Glue job is: RUNNING
   
   
   ### What you think should happen instead
   
   I should see glue logs in airflow UI i task details log section
   
   ### How to reproduce
   
   run GlueJobOperator  in dereferable mode,
   wait_for_completion=true, verbose=true
   
   ### Anything else
   
   all the time
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] GlueJobOperator in verbose mode do not pull logs correctly [airflow]

Posted by "justinpakzad (via GitHub)" <gi...@apache.org>.
justinpakzad commented on issue #56535:
URL: https://github.com/apache/airflow/issues/56535#issuecomment-4017731197

   Going to look into this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] GlueJobOperator in verbose mode do not pull logs correctly [airflow]

Posted by "shivaam (via GitHub)" <gi...@apache.org>.
shivaam commented on issue #56535:
URL: https://github.com/apache/airflow/issues/56535#issuecomment-4018090535

   Created a draft PR for initial review. Gonna publish in a couple of hours.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] GlueJobOperator in verbose mode do not pull logs correctly [airflow]

Posted by "shivaam (via GitHub)" <gi...@apache.org>.
shivaam commented on issue #56535:
URL: https://github.com/apache/airflow/issues/56535#issuecomment-4017885781

   @justinpakzad Heads up. I am almost done with the fix for this. Was able to replicate the issue on my side and testing the fix right now. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] GlueJobOperator in verbose mode do not pull logs correctly [airflow]

Posted by "felixpitterling (via GitHub)" <gi...@apache.org>.
felixpitterling commented on issue #56535:
URL: https://github.com/apache/airflow/issues/56535#issuecomment-3985305753

   Facing the same issue. Are there any updates? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] GlueJobOperator in verbose mode do not pull logs correctly [airflow]

Posted by "justinpakzad (via GitHub)" <gi...@apache.org>.
justinpakzad commented on issue #56535:
URL: https://github.com/apache/airflow/issues/56535#issuecomment-4017924036

   @shivaam Thanks for letting me know! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] GlueJobOperator in verbose mode do not pull logs correctly [airflow]

Posted by "o-nikolas (via GitHub)" <gi...@apache.org>.
o-nikolas closed issue #56535: GlueJobOperator in verbose mode do not pull logs correctly
URL: https://github.com/apache/airflow/issues/56535


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org