You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Vineet Mishra <cl...@gmail.com> on 2014/12/05 16:26:31 UTC

Fwd: No FileSystem for scheme: hdfs

+user@hadoop.apache.org

---------- Forwarded message ----------
From: Vineet Mishra <cl...@gmail.com>
Date: Fri, Dec 5, 2014 at 8:51 PM
Subject: No FileSystem for scheme: hdfs
To: cdh-user@cloudera.org


Hi All,

I am trying to invoke hadoop FileUtil.copyMerge from a piece of java code
but its comes up with error saying

java.io.IOException: No FileSystem for scheme: hdfs

I am stuck at this weird issue, Stack trace mentioned below, Hadoop 2.0 cdh
4.7 10 node cluster.

Looking out for the quickest response.


DEBUG MutableMetricsFactory - field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess
with annotation
@org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=,
value=[Rate of successful kerberos logins and latency (milliseconds)],
always=false, type=DEFAULT, sampleName=Ops)
2014-12-05 20:45:10 DEBUG MutableMetricsFactory - field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure
with annotation
@org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=,
value=[Rate of failed kerberos logins and latency (milliseconds)],
always=false, type=DEFAULT, sampleName=Ops)
2014-12-05 20:45:10 DEBUG MutableMetricsFactory - field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with
annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time,
about=, value=[GetGroups], always=false, type=DEFAULT, sampleName=Ops)
2014-12-05 20:45:10 DEBUG MetricsSystemImpl - UgiMetrics, User and group
related metrics
2014-12-05 20:45:10 DEBUG Groups -  Creating new Groups object
2014-12-05 20:45:10 DEBUG NativeCodeLoader - Trying to load the
custom-built native-hadoop library...
2014-12-05 20:45:10 DEBUG NativeCodeLoader - Failed to load native-hadoop
with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
2014-12-05 20:45:10 DEBUG NativeCodeLoader -
java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2014-12-05 20:45:10 WARN  NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2014-12-05 20:45:10 DEBUG JniBasedUnixGroupsMappingWithFallback - Falling
back to shell based
2014-12-05 20:45:10 DEBUG JniBasedUnixGroupsMappingWithFallback - Group
mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
2014-12-05 20:45:11 DEBUG Groups - Group mapping
impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback;
cacheTimeout=300000; warningDeltaMs=5000
2014-12-05 20:45:11 DEBUG UserGroupInformation - hadoop login
2014-12-05 20:45:11 DEBUG UserGroupInformation - hadoop login commit
2014-12-05 20:45:11 DEBUG UserGroupInformation - using local
user:UnixPrincipal: biops
2014-12-05 20:45:11 DEBUG UserGroupInformation - UGI loginUser:biops
(auth:SIMPLE)
2014-12-05 20:45:11 ERROR CommonFunction -
CommonFunctionmergeFromHDFSToLocaljava.io.IOException: No FileSystem for
scheme: hdfs