You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2022/01/25 14:47:37 UTC

[GitHub] [flink] MartijnVisser commented on a change in pull request #18430: [FLINK-25577][docs] Update GCS documentation

MartijnVisser commented on a change in pull request #18430:
URL: https://github.com/apache/flink/pull/18430#discussion_r791784252



##########
File path: docs/content/docs/deployment/filesystems/gcs.md
##########
@@ -50,57 +48,66 @@ env.getCheckpointConfig().setCheckpointStorage("gs://<bucket>/<endpoint>");
 
 ```
 
-### Libraries
+Note that these examples are *not* exhaustive and you can use GCS in other places as well, including your [high availability setup]({{< ref "docs/deployment/ha/overview" >}}) or the [EmbeddedRocksDBStateBackend]({{< ref "docs/ops/state/state_backends" >}}#the-rocksdbstatebackend); everywhere that Flink expects a FileSystem URI.
+
+### GCS File System plugin
+
+Flink provides the `flink-gs-fs-hadoop` file system to write to GCS.
+This implementation is self-contained with no dependency footprint, so there is no need to add Hadoop to the classpath to use it.
 
-You must include the following jars in Flink's `lib` directory to connect Flink with gcs:
+`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the *gs://* scheme. It uses Google's [gcs-connector](https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector) Hadoop library to access GCS. It also uses Google's [google-cloud-storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage) library to provide `RecoverableWriter` support. 
 
-```xml
-<dependency>
-  <groupId>org.apache.flink</groupId>
-  <artifactId>flink-shaded-hadoop2-uber</artifactId>
-  <version>${flink.shared_hadoop_latest_version}</version>
-</dependency>
+This file system supports being used in [file sinks]({{< ref "docs/content/docs/connectors/datastream/filesystem.md" >}}).

Review comment:
       We've recently renamed the File Sink to FileSystem. 
   
   ```suggestion
   This file system can be used with the [FileSystem connector]({{< ref "docs/content/docs/connectors/datastream/filesystem.md" >}}).
   ```




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org