[GitHub] [airflow] mik-laj commented on issue #5335: [AIRFLOW-4588] Add GoogleDiscoveryApiHook and GoogleApiToS3Transfer

[GitBox <gi...@apache.org>]

mik-laj commented on issue #5335: [AIRFLOW-4588] Add GoogleDiscoveryApiHook and GoogleApiToS3Transfer
URL: https://github.com/apache/airflow/pull/5335#issuecomment-518651385
 
 
   Google provides two types of API libraries:
   * The Google APIs Python Client is a client library that are compatibilble with all Google APIs.
   * The google-cloud-* libraries are built specifically for the Google Cloud Platform and provide the recommended way to integrate Google Cloud APIs. This provides much better experience for programmers.
   
   It is worth noting that the Discovery library supports all Google services also those less popular among our clients. The google-cloud-* libraries support *only* Google Cloud Platform services. I do not know other libraries that integrate with Google API. Both libraries have identical authorization mechanisms, but they differ in implementation e.g. The Google APIs Python Client  use HTTPS only. In most cases the google-cloud-* libraries use protobuf. In rare cases, they also use HTTPs.
   
   In my opinion, it is worth introducing a separate hooks for both types of libraries to improve developer experience. Currently, it is necessary to create long descriptions to warn users that a given function can be used only with a given type of library. Despite warnings, even experienced developers face these problems and try to use functions designed for another type of library with the second type of library. 
   An example from the last 6 hours (CC: @potiuk)
   https://github.com/apache/airflow/pull/5335#discussion_r310900260
   
   CC: @nuclearpinguin 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services