You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ignite.apache.org by pawanpawar <pa...@gmail.com> on 2016/03/31 12:07:26 UTC
hive not working with ignite igfs
Hi all, when I try to run the hive cmd I got this error.
pawanpawar@cloud:~$ hive
Exception in thread "main" java.lang.RuntimeException: java.io.IOException:
Failed to get file status [path=/tmp/hive]
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.io.IOException: Failed to get file status [path=/tmp/hive]
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info(HadoopIgfsWrapper.java:120)
at
org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
at
org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
at
org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
... 8 more
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
file status [path=/tmp/hive]
at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info(HadoopIgfsOutProc.java:209)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
... 14 more
Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get file
status [path=/tmp/hive]
at
org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
at
org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
at
org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
at
org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
at
org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
--
View this message in context: http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
Sent from the Apache Ignite Developers mailing list archive at Nabble.com.
Re: hive not working with ignite igfs
Posted by Vladimir Ozerov <vo...@gridgain.com>.
Pawan,
I think it makes sense to try reverting "fs.defaultFS" property back to
original value:
<property>
<name>fs.defaultFS</name>
<value>hdfs://192.168.1.5:9000</value>
</property>
Hadoop ecosystem is know to be pretty sensitive to the value of this
property and often cannot work when the value is somehing ither than HDFS
URI. Once you revert it, you should access IGFS using fully-qualified names
- "igfs://igfs@192.168.1.5/path/to/your/file" instead of
"/path/to/your/file".
I think that at first it makes sense to ensure that IGFS is able to
communicate with HDFS. E.g. through "hadoop fs" command line. And once it
works fine, go further with Hive.
Vladimir
On Fri, Apr 1, 2016 at 3:58 PM, Pawan Pawar <pa...@gmail.com> wrote:
> Hi Thanks, I am sending my ignite server log and also sending hadoop logs.
>
> On Fri, Apr 1, 2016 at 5:34 PM, Vladimir Ozerov <vo...@gridgain.com>
> wrote:
>
>> Hi,
>>
>> I do not see any apparent errors in configs. Could you please provide logs
>> from Ignite server?
>>
>> Vladimir.
>>
>> On Fri, Apr 1, 2016 at 10:03 AM, Pawan Pawar <pa...@gmail.com>
>> wrote:
>>
>> > Thanks for your reply I am sending my all conf files, please check
>> > attachment, I am using igfs://igfs@192.168.1.5:10500
>> >
>> > On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <vo...@gridgain.com>
>> > wrote:
>> >
>> >> Hi,
>> >>
>> >> Please provide your XML configuration and IGFS URI you use.
>> >>
>> >> Vladimir.
>> >>
>> >> On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <pa...@gmail.com>
>> wrote:
>> >>
>> >> > Hi all, when I try to run the hive cmd I got this error.
>> >> >
>> >> > pawanpawar@cloud:~$ hive
>> >> > Exception in thread "main" java.lang.RuntimeException:
>> >> java.io.IOException:
>> >> > Failed to get file status [path=/tmp/hive]
>> >> > at
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
>> >> > at
>> org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
>> >> > at
>> org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>> >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>> >> > at
>> >> >
>> >> >
>> >>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >> > at
>> >> >
>> >> >
>> >>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >> > at java.lang.reflect.Method.invoke(Method.java:497)
>> >> > at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> >> > at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>> >> > Caused by: java.io.IOException: Failed to get file status
>> >> [path=/tmp/hive]
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
>> >> > at
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
>> >> > (HadoopIgfsWrapper.java:120)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
>> >> > at
>> org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
>> >> > at
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
>> >> > ... 8 more
>> >> > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to
>> get
>> >> > file status [path=/tmp/hive]
>> >> > at
>> >> >
>> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
>> >> > at
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
>> >> > (HadoopIgfsOutProc.java:209)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
>> >> > ... 14 more
>> >> > Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get
>> >> file
>> >> > status [path=/tmp/hive]
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
>> >> > at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > View this message in context:
>> >> >
>> >>
>> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
>> >> > Sent from the Apache Ignite Developers mailing list archive at
>> >> Nabble.com.
>> >> >
>> >>
>> >
>> >
>> >
>> > --
>> > *Thanks & Regards*
>> > *Pawan Pawar*
>> > *Mobile: +91 9993585256*
>> > *Email: pawaremail@gmail.com <pa...@gmail.com>*
>> > *Skype: pawarskype*
>> >
>>
>
>
>
> --
> *Thanks & Regards*
> *Pawan Pawar*
> *Mobile: +91 9993585256*
> *Email: pawaremail@gmail.com <pa...@gmail.com>*
> *Skype: pawarskype*
>
Re: hive not working with ignite igfs
Posted by Pawan Pawar <pa...@gmail.com>.
Hi Thanks, I am sending my ignite server log and also sending hadoop logs.
On Fri, Apr 1, 2016 at 5:34 PM, Vladimir Ozerov <vo...@gridgain.com>
wrote:
> Hi,
>
> I do not see any apparent errors in configs. Could you please provide logs
> from Ignite server?
>
> Vladimir.
>
> On Fri, Apr 1, 2016 at 10:03 AM, Pawan Pawar <pa...@gmail.com> wrote:
>
> > Thanks for your reply I am sending my all conf files, please check
> > attachment, I am using igfs://igfs@192.168.1.5:10500
> >
> > On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <vo...@gridgain.com>
> > wrote:
> >
> >> Hi,
> >>
> >> Please provide your XML configuration and IGFS URI you use.
> >>
> >> Vladimir.
> >>
> >> On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <pa...@gmail.com>
> wrote:
> >>
> >> > Hi all, when I try to run the hive cmd I got this error.
> >> >
> >> > pawanpawar@cloud:~$ hive
> >> > Exception in thread "main" java.lang.RuntimeException:
> >> java.io.IOException:
> >> > Failed to get file status [path=/tmp/hive]
> >> > at
> >> >
> >>
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
> >> > at
> org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
> >> > at
> org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
> >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> > at
> >> >
> >> >
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >> > at
> >> >
> >> >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> > at java.lang.reflect.Method.invoke(Method.java:497)
> >> > at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> >> > at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> >> > Caused by: java.io.IOException: Failed to get file status
> >> [path=/tmp/hive]
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
> >> > at
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
> >> > (HadoopIgfsWrapper.java:120)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
> >> > at
> org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
> >> > at
> >> >
> >> >
> >>
> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
> >> > at
> >> >
> >> >
> >>
> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
> >> > at
> >> >
> >>
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
> >> > ... 8 more
> >> > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to
> get
> >> > file status [path=/tmp/hive]
> >> > at
> >> >
> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
> >> > at
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
> >> > (HadoopIgfsOutProc.java:209)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
> >> > ... 14 more
> >> > Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get
> >> file
> >> > status [path=/tmp/hive]
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
> >> > at
> >> >
> >> >
> >>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
> >> >
> >> >
> >> >
> >> >
> >> > --
> >> > View this message in context:
> >> >
> >>
> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
> >> > Sent from the Apache Ignite Developers mailing list archive at
> >> Nabble.com.
> >> >
> >>
> >
> >
> >
> > --
> > *Thanks & Regards*
> > *Pawan Pawar*
> > *Mobile: +91 9993585256*
> > *Email: pawaremail@gmail.com <pa...@gmail.com>*
> > *Skype: pawarskype*
> >
>
--
*Thanks & Regards*
*Pawan Pawar*
*Mobile: +91 9993585256*
*Email: pawaremail@gmail.com <pa...@gmail.com>*
*Skype: pawarskype*
Re: hive not working with ignite igfs
Posted by Vladimir Ozerov <vo...@gridgain.com>.
Hi,
I do not see any apparent errors in configs. Could you please provide logs
from Ignite server?
Vladimir.
On Fri, Apr 1, 2016 at 10:03 AM, Pawan Pawar <pa...@gmail.com> wrote:
> Thanks for your reply I am sending my all conf files, please check
> attachment, I am using igfs://igfs@192.168.1.5:10500
>
> On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <vo...@gridgain.com>
> wrote:
>
>> Hi,
>>
>> Please provide your XML configuration and IGFS URI you use.
>>
>> Vladimir.
>>
>> On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <pa...@gmail.com> wrote:
>>
>> > Hi all, when I try to run the hive cmd I got this error.
>> >
>> > pawanpawar@cloud:~$ hive
>> > Exception in thread "main" java.lang.RuntimeException:
>> java.io.IOException:
>> > Failed to get file status [path=/tmp/hive]
>> > at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
>> > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
>> > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>> >
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> > at
>> >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > at java.lang.reflect.Method.invoke(Method.java:497)
>> > at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> > at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>> > Caused by: java.io.IOException: Failed to get file status
>> [path=/tmp/hive]
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
>> > at
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
>> > (HadoopIgfsWrapper.java:120)
>> > at
>> >
>> >
>> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
>> > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>> > at
>> >
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
>> > at
>> >
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
>> > at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
>> > ... 8 more
>> > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
>> > file status [path=/tmp/hive]
>> > at
>> > org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
>> > at
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
>> > (HadoopIgfsOutProc.java:209)
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
>> > ... 14 more
>> > Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get
>> file
>> > status [path=/tmp/hive]
>> > at
>> >
>> >
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
>> > at
>> >
>> >
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
>> > at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
>> > at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>> >
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> >
>> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
>> > Sent from the Apache Ignite Developers mailing list archive at
>> Nabble.com.
>> >
>>
>
>
>
> --
> *Thanks & Regards*
> *Pawan Pawar*
> *Mobile: +91 9993585256*
> *Email: pawaremail@gmail.com <pa...@gmail.com>*
> *Skype: pawarskype*
>
Re: hive not working with ignite igfs
Posted by Pawan Pawar <pa...@gmail.com>.
Thanks for your reply I am sending my all conf files, please check
attachment, I am using igfs://igfs@192.168.1.5:10500
On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <vo...@gridgain.com>
wrote:
> Hi,
>
> Please provide your XML configuration and IGFS URI you use.
>
> Vladimir.
>
> On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <pa...@gmail.com> wrote:
>
> > Hi all, when I try to run the hive cmd I got this error.
> >
> > pawanpawar@cloud:~$ hive
> > Exception in thread "main" java.lang.RuntimeException:
> java.io.IOException:
> > Failed to get file status [path=/tmp/hive]
> > at
> >
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
> > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
> > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:497)
> > at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> > at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> > Caused by: java.io.IOException: Failed to get file status
> [path=/tmp/hive]
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
> > at
> > org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
> > (HadoopIgfsWrapper.java:120)
> > at
> >
> >
> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
> > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
> > at
> >
> >
> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
> > at
> >
> >
> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
> > at
> >
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
> > ... 8 more
> > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
> > file status [path=/tmp/hive]
> > at
> > org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
> > at
> > org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
> > (HadoopIgfsOutProc.java:209)
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
> > ... 14 more
> > Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get file
> > status [path=/tmp/hive]
> > at
> >
> >
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
> > at
> >
> >
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
> > at
> >
> >
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
> > at
> >
> >
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
> > Sent from the Apache Ignite Developers mailing list archive at
> Nabble.com.
> >
>
--
*Thanks & Regards*
*Pawan Pawar*
*Mobile: +91 9993585256*
*Email: pawaremail@gmail.com <pa...@gmail.com>*
*Skype: pawarskype*
Re: hive not working with ignite igfs
Posted by Vladimir Ozerov <vo...@gridgain.com>.
Hi,
Please provide your XML configuration and IGFS URI you use.
Vladimir.
On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <pa...@gmail.com> wrote:
> Hi all, when I try to run the hive cmd I got this error.
>
> pawanpawar@cloud:~$ hive
> Exception in thread "main" java.lang.RuntimeException: java.io.IOException:
> Failed to get file status [path=/tmp/hive]
> at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.io.IOException: Failed to get file status [path=/tmp/hive]
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
> at
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
> (HadoopIgfsWrapper.java:120)
> at
>
> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
> at
>
> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
> at
>
> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
> at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
> ... 8 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
> file status [path=/tmp/hive]
> at
> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
> at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
> at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
> at
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
> (HadoopIgfsOutProc.java:209)
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
> ... 14 more
> Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get file
> status [path=/tmp/hive]
> at
>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
> at
>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
> at
>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
> at
>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
> at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
> at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
> at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
> at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
> at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
> at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>
>
>
>
> --
> View this message in context:
> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
> Sent from the Apache Ignite Developers mailing list archive at Nabble.com.
>