You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Xintong Song (Jira)" <ji...@apache.org> on 2022/01/28 02:49:00 UTC

[jira] [Closed] (FLINK-25577) Update GCS documentation

     [ https://issues.apache.org/jira/browse/FLINK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xintong Song closed FLINK-25577.
--------------------------------
    Release Note: 
The `flink-gs-fs-hadoop` FileSystem plugin for Google Cloud Storage (GCS) has been introduced. This allows Flink to read data from and write data to GCS via paths with the `gs://' scheme, and it provides similar functionality for GCS as, for example, the `flink-s3-fs-hadoop` provides for Amazon S3.

In particular, this plugin supports the `RecoverableWriter` interface, which allows it to be used with file sinks.

Under the hood, the `flink-gs-fs-hadoop` uses Google's `gcs-connector` Hadoop library for basic read/write operations, and it uses Google's `google-cloud-storage` library to implement `RecoverableWriter` functionality.
      Resolution: Done

Done via
- master (1.15): 00b519dff4279b38a1d9500dd5e7937944966b33

> Update GCS documentation
> ------------------------
>
>                 Key: FLINK-25577
>                 URL: https://issues.apache.org/jira/browse/FLINK-25577
>             Project: Flink
>          Issue Type: Technical Debt
>          Components: Connectors / FileSystem, Documentation
>            Reporter: David Morávek
>            Assignee: Galen Warren
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 1.15.0
>
>
> Update GCS documentation with respect to:
> - flink-shaded-hadoop artifacts and hadoop version 2.8.3 that are no longer supported as of 1.15
> - The recoverable writer new feature
> https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/gcs/



--
This message was sent by Atlassian Jira
(v8.20.1#820001)