You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/02/08 11:56:00 UTC
[jira] [Commented] (HADOOP-18116) GCS connector in core-default.xml file missing
[ https://issues.apache.org/jira/browse/HADOOP-18116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488799#comment-17488799 ]
Steve Loughran commented on HADOOP-18116:
-----------------------------------------
fixed in HADOOP-17402 in hadoop 3.3.2 which is up for review right now
> GCS connector in core-default.xml file missing
> ----------------------------------------------
>
> Key: HADOOP-18116
> URL: https://issues.apache.org/jira/browse/HADOOP-18116
> Project: Hadoop Common
> Issue Type: Bug
> Components: common, contrib/cloud
> Affects Versions: 3.2.2
> Environment: google cloud dataproc
> Reporter: Ashish S Burkule
> Priority: Minor
> Original Estimate: 1h
> Remaining Estimate: 1h
>
>
> {{<property>
> <name>fs.gs.impl</name>
> <value>com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem</value>
> <description>The FileSystem for gs: (GCS) uris.</description>
> </property>
> <property>
> <name>fs.AbstractFileSystem.gs.impl</name>
> <value>com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS</value>
> <description>
> The AbstractFileSystem for gs: (GCS) uris. Only necessary for use with Hadoop 2.
> </description>
> </property>}}
> {{}}
> {{these config are missing from core-default.xml which is present inside hadoop-common-3.2.2.jar file, which is causing the ssl enabled solr to not communicate with GCS.}}
> {{}}
> {{By adding these class in the jar file , we will be able to access the gcs directory as the connection between the connector and HDFS will be established.}}
> {{}}
> {{}}
> {{}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org