You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "sumitdas66 (via GitHub)" <gi...@apache.org> on 2023/06/05 09:35:11 UTC
[GitHub] [airflow] sumitdas66 opened a new issue, #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
sumitdas66 opened a new issue, #31711:
URL: https://github.com/apache/airflow/issues/31711
### Description
We have a use case where we would like to start job runs in EMR Serverless where the job name is derived from the output from a previous task.
Since the job name is passed via the 'config' argument to the EmrServerlessStartJobOperator, this request is to add 'config' to the list of 'template_fields' in that operator (https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/operators/emr.py#L966), if at all possible.
Thanks in advance,
Sumit Das
### Use case/motivation
_No response_
### Related issues
Something similar is already implemented on the aws-samples project.
Link to the related issue: https://github.com/aws-samples/emr-serverless-samples/issues/36
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] sumitdas66 commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "sumitdas66 (via GitHub)" <gi...@apache.org>.
sumitdas66 commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1581916682
Which versions of the provider and airflow can we expect these changes to reflect?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1576460981
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] o-nikolas commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "o-nikolas (via GitHub)" <gi...@apache.org>.
o-nikolas commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1577308614
Assigned to you @mahammi :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
URL: https://github.com/apache/airflow/issues/31711
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1582585920
Observe release notes and announcement on users@ when it will be released. Checking release notes is the easiest way to verify if the PR fixes it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] o-nikolas closed issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "o-nikolas (via GitHub)" <gi...@apache.org>.
o-nikolas closed issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
URL: https://github.com/apache/airflow/issues/31711
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] phanikumv commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "phanikumv (via GitHub)" <gi...@apache.org>.
phanikumv commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1582819319
Hi @potiuk , I believe a PR needs to be created for the issue, hence lets keep the issue open.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] o-nikolas commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "o-nikolas (via GitHub)" <gi...@apache.org>.
o-nikolas commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1583170982
> Hi @potiuk , I believe a PR needs to be created for the issue, hence lets keep the issue open.
@phanikumv you can see the PR from Maham above has been merged (it is #31746), so I think this is safe to close
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] phanikumv commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "phanikumv (via GitHub)" <gi...@apache.org>.
phanikumv commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1576648878
This should definitely be feasible! Let me know if you would like to open a PR on it ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mahammi commented on issue #31711: Would it be possible to add 'config' to the list of template fields for EmrServerlessStartJobOperator?
Posted by "mahammi (via GitHub)" <gi...@apache.org>.
mahammi commented on issue #31711:
URL: https://github.com/apache/airflow/issues/31711#issuecomment-1577304439
Hello! I would like to pick up this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org