You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mesos.apache.org by 王国栋 <wa...@gmail.com> on 2013/03/28 09:01:18 UTC
Running hadoop on mesos 0.10.0, jobtracker can not get tasktracker info
Hi ,
I am trying to running hadoop on mesos0.10.0, but I get the following
errors. I use the latest hadoop patch in 0.10.0 release package. And I can
run jobtracker on localmode successfully. When I deploy hadoop on the
cluster, the following error happens.
*On jobtracker:*
2013-03-28 15:57:07,209 ERROR
org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
as:hadoop (auth:SIMPLE) cause:java.io.IOException:
java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
2013-03-28 15:57:07,209 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 9001, call
heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@52d18636, true, true,
true, -1) from 10.47.6.20:60457: error: java.io.IOException:
java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
java.io.IOException: java.lang.RuntimeException: Expecting TaskTrackerInfo
for host 10.47.6.20
at
org.apache.hadoop.mapred.FrameworkScheduler.assignTasks(FrameworkScheduler.java:513)
at
org.apache.hadoop.mapred.MesosScheduler.assignTasks(MesosScheduler.java:76)
at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2913)
at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1439)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1435)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1433)
2013-03-28 15:57:07,209 INFO org.apache.hadoop.mapred.JobTracker: Lost
tracker 'tracker_10.47.6.18:localhost.localdomain/127.0.0.1:51382'
*On tasktracker:*
2013-03-28 15:57:25,433 INFO org.apache.hadoop.mapred.TaskTracker:
Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
2013-03-28 15:57:25,437 INFO org.apache.hadoop.mapred.TaskTracker:
Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
2013-03-28 15:57:25,442 INFO org.apache.hadoop.mapred.TaskTracker:
Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
Guodong
Re: Running hadoop on mesos 0.10.0, jobtracker can not get
tasktracker info
Posted by 王国栋 <wa...@gmail.com>.
Hi Ben,
Thanks for your reply, I will check the patch in the trunk. And update the
info with you later.
Guodong
On Fri, Mar 29, 2013 at 7:59 AM, Benjamin Mahler
<be...@gmail.com>wrote:
> Guodong, we recently re-wrote our Hadoop patch. If you're looking to
> experiment with Hadoop, I'd advise using trunk, until we release 0.12.0.
>
>
> On Thu, Mar 28, 2013 at 4:54 PM, Vinod Kone <vi...@twitter.com> wrote:
>
> > i don't think so. i believe its in 0.12.
> >
> >
> > @vinodkone
> >
> >
> > On Thu, Mar 28, 2013 at 4:46 PM, Benjamin Mahler <
> > benjamin.mahler@gmail.com> wrote:
> >
> >> Vinod, is our new Hadoop patch in 0.10.0?
> >>
> >> On Thu, Mar 28, 2013 at 1:01 AM, 王国栋 <wa...@gmail.com> wrote:
> >>
> >>> Hi ,
> >>>
> >>> I am trying to running hadoop on mesos0.10.0, but I get the following
> >>> errors. I use the latest hadoop patch in 0.10.0 release package. And I
> >>> can
> >>> run jobtracker on localmode successfully. When I deploy hadoop on the
> >>> cluster, the following error happens.
> >>>
> >>> *On jobtracker:*
> >>> 2013-03-28 15:57:07,209 ERROR
> >>> org.apache.hadoop.security.UserGroupInformation:
> >>> PriviledgedActionException
> >>> as:hadoop (auth:SIMPLE) cause:java.io.IOException:
> >>> java.lang.RuntimeException: Expecting TaskTrackerInfo for host
> 10.47.6.20
> >>> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.ipc.Server: IPC Server
> >>> handler 8 on 9001, call
> >>> heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@52d18636, true,
> >>> true,
> >>> true, -1) from 10.47.6.20:60457: error: java.io.IOException:
> >>> java.lang.RuntimeException: Expecting TaskTrackerInfo for host
> 10.47.6.20
> >>> java.io.IOException: java.lang.RuntimeException: Expecting
> >>> TaskTrackerInfo
> >>> for host 10.47.6.20
> >>> at
> >>>
> >>>
> org.apache.hadoop.mapred.FrameworkScheduler.assignTasks(FrameworkScheduler.java:513)
> >>> at
> >>>
> >>>
> org.apache.hadoop.mapred.MesosScheduler.assignTasks(MesosScheduler.java:76)
> >>> at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2913)
> >>> at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
> >>> at
> >>>
> >>>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>> at java.lang.reflect.Method.invoke(Method.java:597)
> >>> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
> >>> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1439)
> >>> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1435)
> >>> at java.security.AccessController.doPrivileged(Native Method)
> >>> at javax.security.auth.Subject.doAs(Subject.java:396)
> >>> at
> >>>
> >>>
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> >>> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1433)
> >>> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.mapred.JobTracker: Lost
> >>> tracker 'tracker_10.47.6.18:localhost.localdomain/127.0.0.1:51382'
> >>>
> >>>
> >>> *On tasktracker:*
> >>> 2013-03-28 15:57:25,433 INFO org.apache.hadoop.mapred.TaskTracker:
> >>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
> >>> 2013-03-28 15:57:25,437 INFO org.apache.hadoop.mapred.TaskTracker:
> >>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
> >>> 2013-03-28 15:57:25,442 INFO org.apache.hadoop.mapred.TaskTracker:
> >>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
> >>>
> >>>
> >>>
> >>> Guodong
> >>>
> >>
> >>
> >
>
Re: Running hadoop on mesos 0.10.0, jobtracker can not get
tasktracker info
Posted by Benjamin Mahler <be...@gmail.com>.
Guodong, we recently re-wrote our Hadoop patch. If you're looking to
experiment with Hadoop, I'd advise using trunk, until we release 0.12.0.
On Thu, Mar 28, 2013 at 4:54 PM, Vinod Kone <vi...@twitter.com> wrote:
> i don't think so. i believe its in 0.12.
>
>
> @vinodkone
>
>
> On Thu, Mar 28, 2013 at 4:46 PM, Benjamin Mahler <
> benjamin.mahler@gmail.com> wrote:
>
>> Vinod, is our new Hadoop patch in 0.10.0?
>>
>> On Thu, Mar 28, 2013 at 1:01 AM, 王国栋 <wa...@gmail.com> wrote:
>>
>>> Hi ,
>>>
>>> I am trying to running hadoop on mesos0.10.0, but I get the following
>>> errors. I use the latest hadoop patch in 0.10.0 release package. And I
>>> can
>>> run jobtracker on localmode successfully. When I deploy hadoop on the
>>> cluster, the following error happens.
>>>
>>> *On jobtracker:*
>>> 2013-03-28 15:57:07,209 ERROR
>>> org.apache.hadoop.security.UserGroupInformation:
>>> PriviledgedActionException
>>> as:hadoop (auth:SIMPLE) cause:java.io.IOException:
>>> java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
>>> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.ipc.Server: IPC Server
>>> handler 8 on 9001, call
>>> heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@52d18636, true,
>>> true,
>>> true, -1) from 10.47.6.20:60457: error: java.io.IOException:
>>> java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
>>> java.io.IOException: java.lang.RuntimeException: Expecting
>>> TaskTrackerInfo
>>> for host 10.47.6.20
>>> at
>>>
>>> org.apache.hadoop.mapred.FrameworkScheduler.assignTasks(FrameworkScheduler.java:513)
>>> at
>>>
>>> org.apache.hadoop.mapred.MesosScheduler.assignTasks(MesosScheduler.java:76)
>>> at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2913)
>>> at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>>> at
>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
>>> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1439)
>>> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1435)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at javax.security.auth.Subject.doAs(Subject.java:396)
>>> at
>>>
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>>> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1433)
>>> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.mapred.JobTracker: Lost
>>> tracker 'tracker_10.47.6.18:localhost.localdomain/127.0.0.1:51382'
>>>
>>>
>>> *On tasktracker:*
>>> 2013-03-28 15:57:25,433 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
>>> 2013-03-28 15:57:25,437 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
>>> 2013-03-28 15:57:25,442 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
>>>
>>>
>>>
>>> Guodong
>>>
>>
>>
>
Re: Running hadoop on mesos 0.10.0, jobtracker can not get
tasktracker info
Posted by Vinod Kone <vi...@twitter.com>.
i don't think so. i believe its in 0.12.
@vinodkone
On Thu, Mar 28, 2013 at 4:46 PM, Benjamin Mahler
<be...@gmail.com>wrote:
> Vinod, is our new Hadoop patch in 0.10.0?
>
> On Thu, Mar 28, 2013 at 1:01 AM, 王国栋 <wa...@gmail.com> wrote:
>
>> Hi ,
>>
>> I am trying to running hadoop on mesos0.10.0, but I get the following
>> errors. I use the latest hadoop patch in 0.10.0 release package. And I can
>> run jobtracker on localmode successfully. When I deploy hadoop on the
>> cluster, the following error happens.
>>
>> *On jobtracker:*
>> 2013-03-28 15:57:07,209 ERROR
>> org.apache.hadoop.security.UserGroupInformation:
>> PriviledgedActionException
>> as:hadoop (auth:SIMPLE) cause:java.io.IOException:
>> java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
>> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 8 on 9001, call
>> heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@52d18636, true,
>> true,
>> true, -1) from 10.47.6.20:60457: error: java.io.IOException:
>> java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
>> java.io.IOException: java.lang.RuntimeException: Expecting TaskTrackerInfo
>> for host 10.47.6.20
>> at
>>
>> org.apache.hadoop.mapred.FrameworkScheduler.assignTasks(FrameworkScheduler.java:513)
>> at
>>
>> org.apache.hadoop.mapred.MesosScheduler.assignTasks(MesosScheduler.java:76)
>> at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2913)
>> at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>> at
>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
>> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1439)
>> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1435)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>>
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1433)
>> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.mapred.JobTracker: Lost
>> tracker 'tracker_10.47.6.18:localhost.localdomain/127.0.0.1:51382'
>>
>>
>> *On tasktracker:*
>> 2013-03-28 15:57:25,433 INFO org.apache.hadoop.mapred.TaskTracker:
>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
>> 2013-03-28 15:57:25,437 INFO org.apache.hadoop.mapred.TaskTracker:
>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
>> 2013-03-28 15:57:25,442 INFO org.apache.hadoop.mapred.TaskTracker:
>> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
>>
>>
>>
>> Guodong
>>
>
>
Re: Running hadoop on mesos 0.10.0, jobtracker can not get
tasktracker info
Posted by Benjamin Mahler <be...@gmail.com>.
Vinod, is our new Hadoop patch in 0.10.0?
On Thu, Mar 28, 2013 at 1:01 AM, 王国栋 <wa...@gmail.com> wrote:
> Hi ,
>
> I am trying to running hadoop on mesos0.10.0, but I get the following
> errors. I use the latest hadoop patch in 0.10.0 release package. And I can
> run jobtracker on localmode successfully. When I deploy hadoop on the
> cluster, the following error happens.
>
> *On jobtracker:*
> 2013-03-28 15:57:07,209 ERROR
> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
> as:hadoop (auth:SIMPLE) cause:java.io.IOException:
> java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.ipc.Server: IPC Server
> handler 8 on 9001, call
> heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@52d18636, true, true,
> true, -1) from 10.47.6.20:60457: error: java.io.IOException:
> java.lang.RuntimeException: Expecting TaskTrackerInfo for host 10.47.6.20
> java.io.IOException: java.lang.RuntimeException: Expecting TaskTrackerInfo
> for host 10.47.6.20
> at
>
> org.apache.hadoop.mapred.FrameworkScheduler.assignTasks(FrameworkScheduler.java:513)
> at
> org.apache.hadoop.mapred.MesosScheduler.assignTasks(MesosScheduler.java:76)
> at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2913)
> at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1439)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1435)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
>
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1433)
> 2013-03-28 15:57:07,209 INFO org.apache.hadoop.mapred.JobTracker: Lost
> tracker 'tracker_10.47.6.18:localhost.localdomain/127.0.0.1:51382'
>
>
> *On tasktracker:*
> 2013-03-28 15:57:25,433 INFO org.apache.hadoop.mapred.TaskTracker:
> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
> 2013-03-28 15:57:25,437 INFO org.apache.hadoop.mapred.TaskTracker:
> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
> 2013-03-28 15:57:25,442 INFO org.apache.hadoop.mapred.TaskTracker:
> Resending 'status' to 'hd2dz.prod.mediav.com' with reponseId '-1
>
>
>
> Guodong
>