You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by mao guo <gl...@gmail.com> on 2016/07/22 03:38:10 UTC

Problem about Ignite Hadoop Accelerator MRv2 with CDH5.5.2 and kerberos

Hi,all

In my env  CDH5.5.2 and kerberos,I configure ignite to Accelerator
mapreduce 2 as the office docs,but I got a problem when submit a MR job
like this:
16/07/22 11:16:42 WARN security.UserGroupInformation:
PriviledgedActionException as:****@XXXXXX.COM (auth:KERBEROS)
cause:java.io.IOException: Failed to submit job (null status obtained):
job_666baa91-cf92-49d9-a2ab-4cdc702019aa_0003
java.io.IOException: Failed to submit job (null status obtained):
job_666baa91-cf92-49d9-a2ab-4cdc702019aa_0003
        at
org.apache.ignite.internal.processors.hadoop.proto.HadoopClientProtocol.submitJob(HadoopClientProtocol.java:123)
        at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:243)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1325)
        at
org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:306)
        at
org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at
org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
        at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
        at
org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

did I configured something wrong or ignite not support MRv2 with kerberos

Re: Problem about Ignite Hadoop Accelerator MRv2 with CDH5.5.2 and kerberos

Posted by Vladimir Ozerov <vo...@gridgain.com>.
Hi Mao,

Ignite has special file system factory for Kerberized environments -
*org.apache.ignite.hadoop.fs.KerberosHadoopFileSystemFactory*. Please try
using it to resolve your problem.
Should you have any questions please provide your current XML configuration
and we will try to help you.

Vladimir.

On Fri, Jul 22, 2016 at 6:38 AM, mao guo <gl...@gmail.com> wrote:

> Hi,all
>
> In my env  CDH5.5.2 and kerberos,I configure ignite to Accelerator
> mapreduce 2 as the office docs,but I got a problem when submit a MR job
> like this:
> 16/07/22 11:16:42 WARN security.UserGroupInformation:
> PriviledgedActionException as:****@XXXXXX.COM (auth:KERBEROS)
> cause:java.io.IOException: Failed to submit job (null status obtained):
> job_666baa91-cf92-49d9-a2ab-4cdc702019aa_0003
> java.io.IOException: Failed to submit job (null status obtained):
> job_666baa91-cf92-49d9-a2ab-4cdc702019aa_0003
>         at
> org.apache.ignite.internal.processors.hadoop.proto.HadoopClientProtocol.submitJob(HadoopClientProtocol.java:123)
>         at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:243)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
>         at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1325)
>         at
> org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:306)
>         at
> org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at
> org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
>         at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
>         at
> org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
> did I configured something wrong or ignite not support MRv2 with kerberos
>
>