[I] Support different plugins_folder setting in helm chart when airflow version > 2.0.0 [airflow]

["tankim (via GitHub)" <gi...@apache.org>]

tankim opened a new issue, #39562:
URL: https://github.com/apache/airflow/issues/39562

   ### Description
   
   When configuring Airflow using a Helm chart, the `core` section allows you to set the `plugins_folder`. This setting is applied equally across all web servers and schedulers. Many users utilize git-sync, and it's common for the plugins' path to be located within a git-synced repository.
   
   With Airflow version 2.0.0 and above, Dag Serialization is enabled by default, which means that the web server cannot use a git-sync sidecar. This is generally not an issue when developing custom operators, but it can cause confusion if you want to customize the web UI and the plugins folder on the web server is not synced through git-sync.
   
   Therefore, it would be beneficial to guide the explicit setting of the `plugins_folder` in the Helm chart, allowing separate configurations for the web server and scheduler. This approach would enable more flexible management of each component's settings, allowing finer adjustments to meet specific requirements.
   
   ### Use case/motivation
   
   When attempting to customize the Airflow Web UI based on AirflowPlugin, I followed the guidance to write scripts in the plugins directory. However, with Airflow version 2.0.0 and above, there was confusion in using the webserver plugins because git-sync does not operate as a sidecar for the webserver.
   
   As documented at [Airflow's Helm Chart Guide](https://airflow.apache.org/docs/helm-chart/stable/manage-dags-files.html#notes-for-combining-git-sync-and-persistence), it is generally not recommended to use git-sync with persistence together. This recommendation has significantly limited the possible workarounds to address this issue.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Support different plugins_folder setting in helm chart when airflow version > 2.0.0 [airflow]

["shahar1 (via GitHub)" <gi...@apache.org>]

shahar1 commented on issue #39562:
URL: https://github.com/apache/airflow/issues/39562#issuecomment-2226809579

   @tankim Would you still like to work on this issue?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Support different plugins_folder setting in helm chart when airflow version > 2.0.0 [airflow]

["boring-cyborg[bot] (via GitHub)" <gi...@apache.org>]

boring-cyborg[bot] commented on issue #39562:
URL: https://github.com/apache/airflow/issues/39562#issuecomment-2105683617

   Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org