You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "frantoja (via GitHub)" <gi...@apache.org> on 2024/06/12 21:15:49 UTC

[I] Parameter invalid (cluster) in amazon-> operator -> EcsRunTaskOperator when using deferrable [airflow]

frantoja opened a new issue, #40207:
URL: https://github.com/apache/airflow/issues/40207

   ### Apache Airflow Provider(s)
   
   amazon
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Apache Airflow version
   
   2.8.1
   
   ### Operating System
   
   AWS MWAA
   
   ### Deployment
   
   Amazon (AWS) MWAA
   
   ### Deployment details
   
   _No response_
   
   ### What happened
   
   I have a custom class inheritance from EcsRunTaskOperator.
   When I set deferrable = True, the Airflow task runs and changes to the deferred state successfully and also the ECS task runs successfully. However, when it returns (TaskDoneTrigger - task finished), the method execute_completes -> self._after_execution() -> self._check_success_task() -> response = self.client.describe_tasks(cluster=self.cluster, task=[self. arn]) shows an error:
   
   botocore.exceptions.ParamValidationError: Parameter validation failed
   Invalid type for parameter cluster, value: None, type: <class 'NoneType'>, valid types: <class 'str'>
   
   ### What you think should happen instead
   
   I believe (and tested) that the variable self.cluster (approximately line 696 in the file airflow/providers/amazon/aws/operators/ecs.py) "looses the value"
   
   ### How to reproduce
   
   Set the parameter deferrable to true in EcsRunTaskOperator
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Parameter invalid (cluster) in amazon-> operator -> EcsRunTaskOperator when using deferrable [airflow]

Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #40207:
URL: https://github.com/apache/airflow/issues/40207#issuecomment-2163915539

   Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org