You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/02/08 11:55:00 UTC

[jira] [Updated] (HADOOP-18116) GCS connector in core-default.xml file missing

     [ https://issues.apache.org/jira/browse/HADOOP-18116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran updated HADOOP-18116:
------------------------------------
    Priority: Minor  (was: Major)

> GCS connector in core-default.xml file missing
> ----------------------------------------------
>
>                 Key: HADOOP-18116
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18116
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: common, contrib/cloud
>    Affects Versions: 3.2.2
>         Environment: google cloud dataproc
>            Reporter: Ashish S Burkule
>            Priority: Minor
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
>  
> {{<property>
>     <name>fs.gs.impl</name>
>     <value>com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem</value>
>     <description>The FileSystem for gs: (GCS) uris.</description>
> </property>
> <property>
>     <name>fs.AbstractFileSystem.gs.impl</name>
>     <value>com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS</value>
>     <description>
>      The AbstractFileSystem for gs: (GCS) uris. Only necessary for use with Hadoop 2.
>     </description>
> </property>}}
> {{}}
> {{these config are missing from core-default.xml which is present inside hadoop-common-3.2.2.jar file, which is causing the ssl enabled solr to not communicate with GCS.}}
> {{}}
> {{By adding these class in the jar file , we will be able to access the gcs directory as the connection between the connector and HDFS will be established.}}
> {{}}
> {{}}
> {{}}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org