You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/10/21 01:47:34 UTC

[GitHub] [airflow] mik-laj opened a new issue #11707: Manage connections, variables, pools in Helm Chart

mik-laj opened a new issue #11707:
URL: https://github.com/apache/airflow/issues/11707


   Hello,
   
   Many users need to implement Airlfow and initialize instances with basic resources. It would be helpful if Helm Chart would facilitate this task.
   
   For connections and variables, all we need to do is add documentation that describes the use of [environment variables](https://airflow.readthedocs.io/en/latest/cli-and-env-variables-ref.html#environment-variables).
   
   For connections, we will have to add a new script that initializes the database using the CLI. 
   https://airflow.readthedocs.io/en/latest/cli-and-env-variables-ref.html#pools
   
   Similar tasks can be done with [Terraform provider](https://github.com/apache/airflow/issues/10550) as well, but it's still wIP and not everyone uses Terraform. We still need better support for this use case in the Helm Chart.
   
   Best regards,
   Kamil BreguĊ‚a


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-757348640






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] OmairK commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
OmairK commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-757347997


   Hello @FloChehab, I wont be able to work on this issue right now due to some academic commitments. So please go ahead and unassign me from this issue.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] OmairK commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
OmairK commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-757347997


   Hello @FloChehab, I wont be able to work on this issue right now due to some academic commitments. So please go ahead and unassign me from this issue.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] OmairK commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
OmairK commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-717929679


   Hey @mik-laj is this issue up for taking?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] FloChehab commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
FloChehab commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-756868873






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-717938850


   @OmairK Assigned.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] thesuperzapper commented on issue #11707: Manage pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
thesuperzapper commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-901531822


   I want to highlight that the ["user-community" chart](https://github.com/airflow-helm/charts/tree/main/charts/airflow) (this is separate from the "official") supports this.
   
   See ["How to create airflow pools?"](https://github.com/airflow-helm/charts/tree/main/charts/airflow#how-to-create-airflow-pools) for documentation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] FloChehab commented on issue #11707: Manage pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
FloChehab commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-784482916


   Hello, just wanted to let you now that I should have time to work on this issue in couple of weeks.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] OmairK edited a comment on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
OmairK edited a comment on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-717929679


   Hi @mik-laj, is this issue up for taking?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] FloChehab edited a comment on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
FloChehab edited a comment on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-715511476


   Hello, giving this issue a big :+1:
   
   This feature (creating pools) is already available in another chart, so if someone needs inspirations for this: https://github.com/helm/charts/blob/master/stable/airflow/templates/scheduler/scheduler-deployment.yaml#L250
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] FloChehab commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
FloChehab commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-715511476


   Hello, giving this issue a big :+1:
   
   This feature is already available in another chart, so if someone needs inspirations for this: https://github.com/helm/charts/blob/master/stable/airflow/templates/scheduler/scheduler-deployment.yaml#L250
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-757348640


   @FloChehab Assigned. ;-) 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] FloChehab commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
FloChehab commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-756868873


   Hello @OmairK did you have time to start looking at this issue or would you need an extra hand ?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] FloChehab commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
FloChehab commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-757354665


   > Hello @FloChehab, I wont be able to work on this issue right now due to some academic commitments. So please go ahead and unassign me from this issue.
   
   No worries @OmairK , good luck with your commitments !
   
   > For connections and variables, all we need to do is add documentation that describes the use of environment variables.
   
   @mik-laj Just to make sure, for now we stick with the Readme in the chart folder? Or is something else expected ?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-757358456


   in my opinion it is enough to describe the creation of environment variables.  Do you have a different idea for a solution?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] FloChehab commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
FloChehab commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-757359555


   > in my opinion it is enough to describe the creation of environment variables. Do you have a different idea for a solution?
   
   No, that what's I was thinking. Just wanted to double check.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] ashb commented on issue #11707: Manage connections, variables, pools in Helm Chart

Posted by GitBox <gi...@apache.org>.
ashb commented on issue #11707:
URL: https://github.com/apache/airflow/issues/11707#issuecomment-777761027


   Connections and Variables can now come form secrets manager, which is better placed to handle this than baking them in to the chart.
   
   Pools make sense.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org