[GitHub] [flink] jayadeep-jayaraman commented on pull request #22281: [FLINK-31631][FileSystems] Upgrade GCS connector to 2.2.11.

["jayadeep-jayaraman (via GitHub)" <gi...@apache.org>]

jayadeep-jayaraman commented on PR #22281:
URL: https://github.com/apache/flink/pull/22281#issuecomment-1732361470

   Hi @cnauroth - There are multiple code paths and API's in Flink which uses different google libraries and we should make them consistent.
   
   For instance 
   - Writes that use `saveAsText`, `saveAsCSV` etc go via the [hadoop-gcs](https://github.com/GoogleCloudDataproc/hadoop-connectors) connector.
   - Checkpoints also go via the [hadoop-gcs](https://github.com/GoogleCloudDataproc/hadoop-connectors) connector.
   - FileSink API which is used to write the final files to GCS uses the java storage library.
   
   The ideal scenario will be that everything goes via the [hadoop-gcs](https://github.com/GoogleCloudDataproc/hadoop-connectors) connector.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org