You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Neeraj Chaplot <ge...@gmail.com> on 2013/05/28 15:06:47 UTC
issue launching mapreduce job with kerberos secured hadoop
Hi All,
When hadoop started with Kerberos authentication hadoop fs commands work
well but MR job fails.
Simple wordcount program fails at reducer stage giving follwoing exception :
013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
attempt_201305281729_0003_m_000000_0 from 192.168.49.51
2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
at sun.net.www.http.HttpClient.New(HttpClient.java:306)
at sun.net.www.http.HttpClient.New(HttpClient.java:323)
at
sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
at
sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
at
sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
Please provide some inputs to fix the issue.
Thanks
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Robert Molina <rm...@hortonworks.com>.
Hi Neeraj,
This error doesn't look to be kerberos related initially. Can you
verify if 192.168.49.51
has the tasktracker process running?
Regards,
Robert
On Tue, May 28, 2013 at 7:58 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> The error looks a little low level , network level . The http server for
> some reason couldn't bind to the port.
> Might have nothing to do with Kerborose.
>
> Thanks,
> Rahul
>
>
> On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
>
>> Hi All,
>>
>> When hadoop started with Kerberos authentication hadoop fs commands work
>> well but MR job fails.
>>
>> Simple wordcount program fails at reducer stage giving follwoing
>> exception :
>> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
>> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
>> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
>> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
>> java.net.ConnectException: Connection refused
>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>> at java.net.Socket.connect(Socket.java:529)
>> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>>
>> Please provide some inputs to fix the issue.
>>
>> Thanks
>>
>>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Robert Molina <rm...@hortonworks.com>.
Hi Neeraj,
This error doesn't look to be kerberos related initially. Can you
verify if 192.168.49.51
has the tasktracker process running?
Regards,
Robert
On Tue, May 28, 2013 at 7:58 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> The error looks a little low level , network level . The http server for
> some reason couldn't bind to the port.
> Might have nothing to do with Kerborose.
>
> Thanks,
> Rahul
>
>
> On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
>
>> Hi All,
>>
>> When hadoop started with Kerberos authentication hadoop fs commands work
>> well but MR job fails.
>>
>> Simple wordcount program fails at reducer stage giving follwoing
>> exception :
>> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
>> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
>> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
>> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
>> java.net.ConnectException: Connection refused
>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>> at java.net.Socket.connect(Socket.java:529)
>> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>>
>> Please provide some inputs to fix the issue.
>>
>> Thanks
>>
>>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Robert Molina <rm...@hortonworks.com>.
Hi Neeraj,
This error doesn't look to be kerberos related initially. Can you
verify if 192.168.49.51
has the tasktracker process running?
Regards,
Robert
On Tue, May 28, 2013 at 7:58 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> The error looks a little low level , network level . The http server for
> some reason couldn't bind to the port.
> Might have nothing to do with Kerborose.
>
> Thanks,
> Rahul
>
>
> On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
>
>> Hi All,
>>
>> When hadoop started with Kerberos authentication hadoop fs commands work
>> well but MR job fails.
>>
>> Simple wordcount program fails at reducer stage giving follwoing
>> exception :
>> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
>> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
>> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
>> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
>> java.net.ConnectException: Connection refused
>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>> at java.net.Socket.connect(Socket.java:529)
>> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>>
>> Please provide some inputs to fix the issue.
>>
>> Thanks
>>
>>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Robert Molina <rm...@hortonworks.com>.
Hi Neeraj,
This error doesn't look to be kerberos related initially. Can you
verify if 192.168.49.51
has the tasktracker process running?
Regards,
Robert
On Tue, May 28, 2013 at 7:58 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> The error looks a little low level , network level . The http server for
> some reason couldn't bind to the port.
> Might have nothing to do with Kerborose.
>
> Thanks,
> Rahul
>
>
> On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
>
>> Hi All,
>>
>> When hadoop started with Kerberos authentication hadoop fs commands work
>> well but MR job fails.
>>
>> Simple wordcount program fails at reducer stage giving follwoing
>> exception :
>> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
>> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
>> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
>> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
>> java.net.ConnectException: Connection refused
>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>> at java.net.Socket.connect(Socket.java:529)
>> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>> at
>> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
>> at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>>
>> Please provide some inputs to fix the issue.
>>
>> Thanks
>>
>>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
The error looks a little low level , network level . The http server for
some reason couldn't bind to the port.
Might have nothing to do with Kerborose.
Thanks,
Rahul
On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
The error looks a little low level , network level . The http server for
some reason couldn't bind to the port.
Might have nothing to do with Kerborose.
Thanks,
Rahul
On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
The error looks a little low level , network level . The http server for
some reason couldn't bind to the port.
Might have nothing to do with Kerborose.
Thanks,
Rahul
On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Shahab Yunus <sh...@gmail.com>.
Have you verified that the kerberos settings are configured properly in
mapred-site.xml too just as in hdfs-site.xml (assuming you are using MRv1)?
-Shahab
On Tue, May 28, 2013 at 9:06 AM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
The error looks a little low level , network level . The http server for
some reason couldn't bind to the port.
Might have nothing to do with Kerborose.
Thanks,
Rahul
On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Shahab Yunus <sh...@gmail.com>.
Have you verified that the kerberos settings are configured properly in
mapred-site.xml too just as in hdfs-site.xml (assuming you are using MRv1)?
-Shahab
On Tue, May 28, 2013 at 9:06 AM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Shahab Yunus <sh...@gmail.com>.
Have you verified that the kerberos settings are configured properly in
mapred-site.xml too just as in hdfs-site.xml (assuming you are using MRv1)?
-Shahab
On Tue, May 28, 2013 at 9:06 AM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
Re: issue launching mapreduce job with kerberos secured hadoop
Posted by Shahab Yunus <sh...@gmail.com>.
Have you verified that the kerberos settings are configured properly in
mapred-site.xml too just as in hdfs-site.xml (assuming you are using MRv1)?
-Shahab
On Tue, May 28, 2013 at 9:06 AM, Neeraj Chaplot <ge...@gmail.com> wrote:
> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>