You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jake Thompson <ja...@jakethompson.com> on 2008/03/31 03:23:37 UTC

S3 Support in 16.1

So I am new to hadoop, but everything is working well so far.
Except.....
I can use S3 fs in 15.3 without a problem.

However, if I try the same in 16.1 I get:
Exception in thread "main" java.lang.IllegalArgumentException: Hook
previously registered
        at
java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:45)
        at java.lang.Runtime.addShutdownHook(Runtime.java:192)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1194)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
        at
org.apache.hadoop.fs.s3.S3FileSystem.initialize(S3FileSystem.java:81)
        at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1180)
        at org.apache.hadoop.fs.FileSystem.access$400(FileSystem.java:53)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1197)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
        at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94)
        at org.apache.hadoop.fs.FsShell.init(FsShell.java:79)
        at org.apache.hadoop.fs.FsShell.run(FsShell.java:1567)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.fs.FsShell.main(FsShell.java:1704)


Same config both place, any thoughts on this?  I checked out Jira and could
not find a related bug report.

-Jake

Re: S3 Support in 16.1

Posted by Jake Thompson <ja...@jakethompson.com>.
Sweet, did not see that in Jira/did not relate the errors.  Now time to wait
until 0.16.2

On Mon, Mar 31, 2008 at 7:33 AM, Tom White <to...@gmail.com> wrote:

> Hi Jake,
>
> Yes, this is a known issue that is fixed in 0.16.2 - see
> https://issues.apache.org/jira/browse/HADOOP-3027.
>
> Tom
>
> On 31/03/2008, Jake Thompson <ja...@jakethompson.com> wrote:
> > So I am new to hadoop, but everything is working well so far.
> >  Except.....
> >  I can use S3 fs in 15.3 without a problem.
> >
> >  However, if I try the same in 16.1 I get:
> >  Exception in thread "main" java.lang.IllegalArgumentException: Hook
> >  previously registered
> >         at
> >
>  java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:45)
> >         at java.lang.Runtime.addShutdownHook(Runtime.java:192)
> >         at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1194)
> >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
> >         at
> >  org.apache.hadoop.fs.s3.S3FileSystem.initialize(S3FileSystem.java:81)
> >         at
> >  org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1180)
> >         at
> org.apache.hadoop.fs.FileSystem.access$400(FileSystem.java:53)
> >         at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1197)
> >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
> >         at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122)
> >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94)
> >         at org.apache.hadoop.fs.FsShell.init(FsShell.java:79)
> >         at org.apache.hadoop.fs.FsShell.run(FsShell.java:1567)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >         at org.apache.hadoop.fs.FsShell.main(FsShell.java:1704)
> >
> >
> >  Same config both place, any thoughts on this?  I checked out Jira and
> could
> >  not find a related bug report.
> >
> >
> >  -Jake
> >
>
>
> --
> Blog: http://www.lexemetech.com/
>

Re: S3 Support in 16.1

Posted by Tom White <to...@gmail.com>.
Hi Jake,

Yes, this is a known issue that is fixed in 0.16.2 - see
https://issues.apache.org/jira/browse/HADOOP-3027.

Tom

On 31/03/2008, Jake Thompson <ja...@jakethompson.com> wrote:
> So I am new to hadoop, but everything is working well so far.
>  Except.....
>  I can use S3 fs in 15.3 without a problem.
>
>  However, if I try the same in 16.1 I get:
>  Exception in thread "main" java.lang.IllegalArgumentException: Hook
>  previously registered
>         at
>  java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:45)
>         at java.lang.Runtime.addShutdownHook(Runtime.java:192)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1194)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
>         at
>  org.apache.hadoop.fs.s3.S3FileSystem.initialize(S3FileSystem.java:81)
>         at
>  org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1180)
>         at org.apache.hadoop.fs.FileSystem.access$400(FileSystem.java:53)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1197)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
>         at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94)
>         at org.apache.hadoop.fs.FsShell.init(FsShell.java:79)
>         at org.apache.hadoop.fs.FsShell.run(FsShell.java:1567)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.fs.FsShell.main(FsShell.java:1704)
>
>
>  Same config both place, any thoughts on this?  I checked out Jira and could
>  not find a related bug report.
>
>
>  -Jake
>


-- 
Blog: http://www.lexemetech.com/