You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jake Thompson <ja...@jakethompson.com> on 2008/03/31 03:23:37 UTC
S3 Support in 16.1
So I am new to hadoop, but everything is working well so far.
Except.....
I can use S3 fs in 15.3 without a problem.
However, if I try the same in 16.1 I get:
Exception in thread "main" java.lang.IllegalArgumentException: Hook
previously registered
at
java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:45)
at java.lang.Runtime.addShutdownHook(Runtime.java:192)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1194)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
at
org.apache.hadoop.fs.s3.S3FileSystem.initialize(S3FileSystem.java:81)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1180)
at org.apache.hadoop.fs.FileSystem.access$400(FileSystem.java:53)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1197)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94)
at org.apache.hadoop.fs.FsShell.init(FsShell.java:79)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1567)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1704)
Same config both place, any thoughts on this? I checked out Jira and could
not find a related bug report.
-Jake
Re: S3 Support in 16.1
Posted by Jake Thompson <ja...@jakethompson.com>.
Sweet, did not see that in Jira/did not relate the errors. Now time to wait
until 0.16.2
On Mon, Mar 31, 2008 at 7:33 AM, Tom White <to...@gmail.com> wrote:
> Hi Jake,
>
> Yes, this is a known issue that is fixed in 0.16.2 - see
> https://issues.apache.org/jira/browse/HADOOP-3027.
>
> Tom
>
> On 31/03/2008, Jake Thompson <ja...@jakethompson.com> wrote:
> > So I am new to hadoop, but everything is working well so far.
> > Except.....
> > I can use S3 fs in 15.3 without a problem.
> >
> > However, if I try the same in 16.1 I get:
> > Exception in thread "main" java.lang.IllegalArgumentException: Hook
> > previously registered
> > at
> >
> java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:45)
> > at java.lang.Runtime.addShutdownHook(Runtime.java:192)
> > at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1194)
> > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
> > at
> > org.apache.hadoop.fs.s3.S3FileSystem.initialize(S3FileSystem.java:81)
> > at
> > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1180)
> > at
> org.apache.hadoop.fs.FileSystem.access$400(FileSystem.java:53)
> > at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1197)
> > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
> > at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122)
> > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94)
> > at org.apache.hadoop.fs.FsShell.init(FsShell.java:79)
> > at org.apache.hadoop.fs.FsShell.run(FsShell.java:1567)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> > at org.apache.hadoop.fs.FsShell.main(FsShell.java:1704)
> >
> >
> > Same config both place, any thoughts on this? I checked out Jira and
> could
> > not find a related bug report.
> >
> >
> > -Jake
> >
>
>
> --
> Blog: http://www.lexemetech.com/
>
Re: S3 Support in 16.1
Posted by Tom White <to...@gmail.com>.
Hi Jake,
Yes, this is a known issue that is fixed in 0.16.2 - see
https://issues.apache.org/jira/browse/HADOOP-3027.
Tom
On 31/03/2008, Jake Thompson <ja...@jakethompson.com> wrote:
> So I am new to hadoop, but everything is working well so far.
> Except.....
> I can use S3 fs in 15.3 without a problem.
>
> However, if I try the same in 16.1 I get:
> Exception in thread "main" java.lang.IllegalArgumentException: Hook
> previously registered
> at
> java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:45)
> at java.lang.Runtime.addShutdownHook(Runtime.java:192)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1194)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
> at
> org.apache.hadoop.fs.s3.S3FileSystem.initialize(S3FileSystem.java:81)
> at
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1180)
> at org.apache.hadoop.fs.FileSystem.access$400(FileSystem.java:53)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1197)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
> at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94)
> at org.apache.hadoop.fs.FsShell.init(FsShell.java:79)
> at org.apache.hadoop.fs.FsShell.run(FsShell.java:1567)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.fs.FsShell.main(FsShell.java:1704)
>
>
> Same config both place, any thoughts on this? I checked out Jira and could
> not find a related bug report.
>
>
> -Jake
>
--
Blog: http://www.lexemetech.com/