You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "skestle (via GitHub)" <gi...@apache.org> on 2025/03/05 06:36:14 UTC

Re: [PR] Fix bug in LivyOperator when its trigger times out [airflow]

skestle commented on PR #38916:
URL: https://github.com/apache/airflow/pull/38916#issuecomment-2700006625

   I came across this, trying to figure out why the livy trigger had it's own timeout mechanism.
   I understand that the error in the bug can be caused by un-initialised `_batch_id`, but I can't figure out how it would become uninitialised while using the deferred trigger.
   
   ```
   def execute(self, context: Context) -> Any:
           self._batch_id = self.hook.post_batch(**self.spark_params)
   ```
   initialised the batch id, which is passed to the trigger - why was batch id not still set when `on_kill` is called later (after general airflow timeout)?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org