You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/06/21 03:16:54 UTC

[GitHub] [airflow] sivankumar86 opened a new issue, #24574: There is no cancel job option in hook

sivankumar86 opened a new issue, #24574:
URL: https://github.com/apache/airflow/issues/24574

   ### Apache Airflow Provider(s)
   
   airbyte
   
   ### Versions of Apache Airflow Providers
   
   I want to cancel the job if it running more than specific time . Task is getting timeout however, airbyte job was not cancelled. it seems, on kill feature has not implemented 
   
   Workaround:
     Create a custom operator and implement cancel hook and call it in on kill function. 
   
      def on_kill(self):
           if (self.job_id):
               self.log.error('on_kill: stopping airbyte Job %s',self.job_id)
               self.hook.cancel_job(self.job_id)
   
   ### Apache Airflow version
   
   2.0.2
   
   ### Operating System
   
   Linux
   
   ### Deployment
   
   MWAA
   
   ### Deployment details
   
   Airflow 2.0.2
   
   ### What happened
   
   airbyte job was not cancelled upon timeout 
   
   ### What you think should happen instead
   
   it should cancel the job
   
   ### How to reproduce
   
   Make sure job runs more than timeout
   
   sync_source_destination = AirbyteTriggerSyncOperator(
                       task_id=f'airbyte_{key}',
                       airbyte_conn_id='airbyte_con',
                       connection_id=key,
                       asynchronous=False,
                       execution_timeout=timedelta(minutes=2)
               )
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #24574: There is no cancel job option in hook

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #24574:
URL: https://github.com/apache/airflow/issues/24574#issuecomment-1161186234

   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] sivankumar86 commented on issue #24574: There is no cancel job option in hook

Posted by GitBox <gi...@apache.org>.
sivankumar86 commented on issue #24574:
URL: https://github.com/apache/airflow/issues/24574#issuecomment-1162571915

   Could you please review the change ? 
   
   https://github.com/apache/airflow/pull/24593


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #24574: There is no cancel job option in hook

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #24574:
URL: https://github.com/apache/airflow/issues/24574#issuecomment-1161367476

   Feel free to add it! assigned you!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk closed issue #24574: `AirbyteHook` add cancel job option

Posted by GitBox <gi...@apache.org>.
potiuk closed issue #24574: `AirbyteHook` add cancel job option
URL: https://github.com/apache/airflow/issues/24574


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org