[GitHub] [airflow] pvaling opened a new issue, #25987: Connection test feature have to run within Executor (instead of Webserver)

[GitBox <gi...@apache.org>]

pvaling opened a new issue, #25987:
URL: https://github.com/apache/airflow/issues/25987

   ### Description
   
   There is a _connection test_ feature in Airflow UI. It behaves incorrect because real user tasks executed in Executor network environment and it may be different from Webserver process environment. For example In my deployment Webserver and Scheduler runs in a different k8s clusters with different network access policies. Webserver doesn`t have any access to datasources.
   
   ### Use case/motivation
   
   Make connection test routines execute as real Executor jobs.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk closed issue #25987: Connection test feature have to run within Executor (instead of Webserver)

[GitBox <gi...@apache.org>]

potiuk closed issue #25987: Connection test feature have to run within Executor (instead of Webserver)
URL: https://github.com/apache/airflow/issues/25987


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #25987: Connection test feature have to run within Executor (instead of Webserver)

[GitBox <gi...@apache.org>]

potiuk commented on issue #25987:
URL: https://github.com/apache/airflow/issues/25987#issuecomment-1228637133

   See discussion here: https://github.com/apache/airflow/pull/15795 - we raised concern about this case and we decided that going with webserver-only is "good enough". And we knew there will be cases it won't work. 
   
   I am not sure we are going to implement it as it is much more complex and the return of such investment is not worth it. I would also personally like to get it done "right", but I also know that it involves complexities that are simply not worth for the "edge case" you have.
   
   Let me convert it into discussion and maybe others who participated @msumit @kaxil changed their mind since. Also I encourage you @pvaling to take a look at the discuscion in #15795 and see what you get from it, and whether it changes your POV.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org