You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/11/20 16:58:27 UTC
[GitHub] [airflow] potiuk edited a comment on pull request #12512: Implement reading provider information from packages/sources
potiuk edited a comment on pull request #12512:
URL: https://github.com/apache/airflow/pull/12512#issuecomment-731278698
Hey @ashb @mik-laj -> this is the "base" version of the ProvidersManager - updated to include both options:
* running directly from the sources (in which case provider information is read directly from provider.yaml file) - dev
* run-time version that reads the information from package entry_points - production
It also includes CLI that you can query the providers installed.
Reading from packages is much slower than from file, but it is bearable (~2-3 seconds on my machine). most of it is resolving and checking package dependencies, not reading the content. Also - currently - two packages (snowflake and amazon) fail to register because they have "ContextualVersionConflict" which I hope we will eventually resolve (#10854, #10854)
You can also try it out yourself - there is a new 'providers' cli command displaying the installed providers:
Works both - in dev env (with local sources) and prod env (with packages)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org