[GitHub] [airflow] shlomiken edited a comment on issue #16299: SageMakerTrainingOperator gets ThrottlingException when listing training jobs

[GitBox <gi...@apache.org>]

shlomiken edited a comment on issue #16299:
URL: https://github.com/apache/airflow/issues/16299#issuecomment-988012736


   @olivermeyer - you described precisely the way we work and the problem we are now facing trying to migrate to airflow 2.0
   not sure how this didn't resonate more - probably not many use airflow with sagemaker.
   regarding the single responsibility of the operator - i could not agree more , and in fact we are working like this for 3 years now, creating our own semi-random job names, and its fine - this definitely should not be implemented within the operator.
   (specially not by checking existing jobs...)
   
   we are facing the same for other operators as well - like processing jobs and transform jobs.
   do you know if there any plans improving them as well ?
   
   regards 
   Shlomi
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org