You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Viswanathan J <ja...@gmail.com> on 2013/12/16 11:17:07 UTC

Getting following error in JT logs while running MR jobs

Hi,

I'm getting the following error frequently while running MR jobs.

ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
task attempt_201312040159_126927_m_000000_0 when no start time is set,
stackTrace is : java.lang.Exception
        at
org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
        at
org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
        at
org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
        at
org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
        at
org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
        at
org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
        at
org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
        at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)

Please help.

-- 
Regards,
Viswa.J

Re: Getting following error in JT logs while running MR jobs

Posted by Viswanathan J <ja...@gmail.com>.
Hadoop 1.2.1, also I gave permissions to job users.
On Dec 16, 2013 8:54 PM, "Mohammad Tariq" <do...@gmail.com> wrote:

> Which version??
>
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Does your job fails? check for the error in log or in the jobtracker web
>> ui by clicked on failed task you will get a closer error message
>>
>>
>>
>> *Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
>> dwivedishashwat@gmail.com> wrote:
>>
>>> Check if you are having correct permission for the user through which
>>> you are running the job.
>>>
>>>
>>>
>>> * Warm Regards_**∞_*
>>> *Shashwat Shriparv*
>>> Big-Data Engineer(HPC)
>>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>>
>>>
>>>
>>>
>>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>>> jayamviswanathan@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm getting the following error frequently while running MR jobs.
>>>>
>>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time
>>>> for task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>>> stackTrace is : java.lang.Exception
>>>>         at
>>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>>         at
>>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>>         at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>>         at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>>
>>>> Please help.
>>>>
>>>> --
>>>> Regards,
>>>> Viswa.J
>>>>
>>>
>>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by Viswanathan J <ja...@gmail.com>.
Hadoop 1.2.1, also I gave permissions to job users.
On Dec 16, 2013 8:54 PM, "Mohammad Tariq" <do...@gmail.com> wrote:

> Which version??
>
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Does your job fails? check for the error in log or in the jobtracker web
>> ui by clicked on failed task you will get a closer error message
>>
>>
>>
>> *Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
>> dwivedishashwat@gmail.com> wrote:
>>
>>> Check if you are having correct permission for the user through which
>>> you are running the job.
>>>
>>>
>>>
>>> * Warm Regards_**∞_*
>>> *Shashwat Shriparv*
>>> Big-Data Engineer(HPC)
>>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>>
>>>
>>>
>>>
>>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>>> jayamviswanathan@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm getting the following error frequently while running MR jobs.
>>>>
>>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time
>>>> for task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>>> stackTrace is : java.lang.Exception
>>>>         at
>>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>>         at
>>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>>         at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>>         at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>>
>>>> Please help.
>>>>
>>>> --
>>>> Regards,
>>>> Viswa.J
>>>>
>>>
>>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by Viswanathan J <ja...@gmail.com>.
Hadoop 1.2.1, also I gave permissions to job users.
On Dec 16, 2013 8:54 PM, "Mohammad Tariq" <do...@gmail.com> wrote:

> Which version??
>
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Does your job fails? check for the error in log or in the jobtracker web
>> ui by clicked on failed task you will get a closer error message
>>
>>
>>
>> *Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
>> dwivedishashwat@gmail.com> wrote:
>>
>>> Check if you are having correct permission for the user through which
>>> you are running the job.
>>>
>>>
>>>
>>> * Warm Regards_**∞_*
>>> *Shashwat Shriparv*
>>> Big-Data Engineer(HPC)
>>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>>
>>>
>>>
>>>
>>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>>> jayamviswanathan@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm getting the following error frequently while running MR jobs.
>>>>
>>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time
>>>> for task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>>> stackTrace is : java.lang.Exception
>>>>         at
>>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>>         at
>>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>>         at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>>         at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>>
>>>> Please help.
>>>>
>>>> --
>>>> Regards,
>>>> Viswa.J
>>>>
>>>
>>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by Viswanathan J <ja...@gmail.com>.
Hadoop 1.2.1, also I gave permissions to job users.
On Dec 16, 2013 8:54 PM, "Mohammad Tariq" <do...@gmail.com> wrote:

> Which version??
>
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Does your job fails? check for the error in log or in the jobtracker web
>> ui by clicked on failed task you will get a closer error message
>>
>>
>>
>> *Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
>> dwivedishashwat@gmail.com> wrote:
>>
>>> Check if you are having correct permission for the user through which
>>> you are running the job.
>>>
>>>
>>>
>>> * Warm Regards_**∞_*
>>> *Shashwat Shriparv*
>>> Big-Data Engineer(HPC)
>>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>>
>>>
>>>
>>>
>>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>>> jayamviswanathan@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm getting the following error frequently while running MR jobs.
>>>>
>>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time
>>>> for task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>>> stackTrace is : java.lang.Exception
>>>>         at
>>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>>         at
>>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>>         at
>>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>>         at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>>         at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>>
>>>> Please help.
>>>>
>>>> --
>>>> Regards,
>>>> Viswa.J
>>>>
>>>
>>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by Mohammad Tariq <do...@gmail.com>.
Which version??

Warm Regards,
Tariq
cloudfront.blogspot.com


On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Does your job fails? check for the error in log or in the jobtracker web
> ui by clicked on failed task you will get a closer error message
>
>
>
> *Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Check if you are having correct permission for the user through which you
>> are running the job.
>>
>>
>>
>> * Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>> jayamviswanathan@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm getting the following error frequently while running MR jobs.
>>>
>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>> stackTrace is : java.lang.Exception
>>>         at
>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>         at
>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>         at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>         at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>
>>> Please help.
>>>
>>> --
>>> Regards,
>>> Viswa.J
>>>
>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by Mohammad Tariq <do...@gmail.com>.
Which version??

Warm Regards,
Tariq
cloudfront.blogspot.com


On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Does your job fails? check for the error in log or in the jobtracker web
> ui by clicked on failed task you will get a closer error message
>
>
>
> *Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Check if you are having correct permission for the user through which you
>> are running the job.
>>
>>
>>
>> * Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>> jayamviswanathan@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm getting the following error frequently while running MR jobs.
>>>
>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>> stackTrace is : java.lang.Exception
>>>         at
>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>         at
>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>         at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>         at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>
>>> Please help.
>>>
>>> --
>>> Regards,
>>> Viswa.J
>>>
>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by Mohammad Tariq <do...@gmail.com>.
Which version??

Warm Regards,
Tariq
cloudfront.blogspot.com


On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Does your job fails? check for the error in log or in the jobtracker web
> ui by clicked on failed task you will get a closer error message
>
>
>
> *Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Check if you are having correct permission for the user through which you
>> are running the job.
>>
>>
>>
>> * Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>> jayamviswanathan@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm getting the following error frequently while running MR jobs.
>>>
>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>> stackTrace is : java.lang.Exception
>>>         at
>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>         at
>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>         at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>         at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>
>>> Please help.
>>>
>>> --
>>> Regards,
>>> Viswa.J
>>>
>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by Mohammad Tariq <do...@gmail.com>.
Which version??

Warm Regards,
Tariq
cloudfront.blogspot.com


On Mon, Dec 16, 2013 at 4:26 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Does your job fails? check for the error in log or in the jobtracker web
> ui by clicked on failed task you will get a closer error message
>
>
>
> *Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
> [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Check if you are having correct permission for the user through which you
>> are running the job.
>>
>>
>>
>> * Warm Regards_**∞_*
>> *Shashwat Shriparv*
>> Big-Data Engineer(HPC)
>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<sh...@yahoo.com>
>>
>>
>>
>>
>> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <
>> jayamviswanathan@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm getting the following error frequently while running MR jobs.
>>>
>>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>>> stackTrace is : java.lang.Exception
>>>         at
>>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>>         at
>>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>>         at
>>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>>         at
>>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>>         at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>>         at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>>
>>> Please help.
>>>
>>> --
>>> Regards,
>>> Viswa.J
>>>
>>
>>
>

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Does your job fails? check for the error in log or in the jobtracker web ui
by clicked on failed task you will get a closer error message



*Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Check if you are having correct permission for the user through which you
> are running the job.
>
>
>
> * Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <jayamviswanathan@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm getting the following error frequently while running MR jobs.
>>
>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>> stackTrace is : java.lang.Exception
>>         at
>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>         at
>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>         at
>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>         at
>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>         at
>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>
>> Please help.
>>
>> --
>> Regards,
>> Viswa.J
>>
>
>

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Does your job fails? check for the error in log or in the jobtracker web ui
by clicked on failed task you will get a closer error message



*Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Check if you are having correct permission for the user through which you
> are running the job.
>
>
>
> * Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <jayamviswanathan@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm getting the following error frequently while running MR jobs.
>>
>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>> stackTrace is : java.lang.Exception
>>         at
>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>         at
>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>         at
>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>         at
>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>         at
>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>
>> Please help.
>>
>> --
>> Regards,
>> Viswa.J
>>
>
>

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Does your job fails? check for the error in log or in the jobtracker web ui
by clicked on failed task you will get a closer error message



*Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Check if you are having correct permission for the user through which you
> are running the job.
>
>
>
> * Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <jayamviswanathan@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm getting the following error frequently while running MR jobs.
>>
>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>> stackTrace is : java.lang.Exception
>>         at
>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>         at
>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>         at
>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>         at
>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>         at
>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>
>> Please help.
>>
>> --
>> Regards,
>> Viswa.J
>>
>
>

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Does your job fails? check for the error in log or in the jobtracker web ui
by clicked on failed task you will get a closer error message



*Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 4:25 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:

> Check if you are having correct permission for the user through which you
> are running the job.
>
>
>
> * Warm Regards_**∞_*
> *Shashwat Shriparv*
> Big-Data Engineer(HPC)
>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
> http://google.com/+ShashwatShriparv] <http://google.com/+ShashwatShriparv>[image:
> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>
>
>
>
>
> On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J <jayamviswanathan@gmail.com
> > wrote:
>
>> Hi,
>>
>> I'm getting the following error frequently while running MR jobs.
>>
>> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
>> task attempt_201312040159_126927_m_000000_0 when no start time is set,
>> stackTrace is : java.lang.Exception
>>         at
>> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>>         at
>> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>>         at
>> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>>         at
>> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>>         at
>> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>>         at
>> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>>
>> Please help.
>>
>> --
>> Regards,
>> Viswa.J
>>
>
>

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Check if you are having correct permission for the user through which you
are running the job.



* Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J
<ja...@gmail.com>wrote:

> Hi,
>
> I'm getting the following error frequently while running MR jobs.
>
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
> task attempt_201312040159_126927_m_000000_0 when no start time is set,
> stackTrace is : java.lang.Exception
>         at
> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at
> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at
> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at
> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at
> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at
> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at
> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>
> Please help.
>
> --
> Regards,
> Viswa.J
>

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Check if you are having correct permission for the user through which you
are running the job.



* Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J
<ja...@gmail.com>wrote:

> Hi,
>
> I'm getting the following error frequently while running MR jobs.
>
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
> task attempt_201312040159_126927_m_000000_0 when no start time is set,
> stackTrace is : java.lang.Exception
>         at
> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at
> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at
> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at
> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at
> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at
> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at
> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>
> Please help.
>
> --
> Regards,
> Viswa.J
>

Re: Getting following error in JT logs while running MR jobs

Posted by rtejac <rt...@gmail.com>.
Looks like thats task tracker issue.  Its not able to update JT in time. From Job tracker UI, go to logs and check on that particular failed task in that particular task tracker and check logs. 


On Dec 16, 2013, at 2:17 AM, Viswanathan J <ja...@gmail.com> wrote:

> Hi,
> 
> I'm getting the following error frequently while running MR jobs.
> 
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for task attempt_201312040159_126927_m_000000_0 when no start time is set, stackTrace is : java.lang.Exception
>         at org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
> 
> Please help.
> 
> -- 
> Regards,
> Viswa.J

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Check if you are having correct permission for the user through which you
are running the job.



* Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J
<ja...@gmail.com>wrote:

> Hi,
>
> I'm getting the following error frequently while running MR jobs.
>
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
> task attempt_201312040159_126927_m_000000_0 when no start time is set,
> stackTrace is : java.lang.Exception
>         at
> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at
> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at
> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at
> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at
> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at
> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at
> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>
> Please help.
>
> --
> Regards,
> Viswa.J
>

Re: Getting following error in JT logs while running MR jobs

Posted by rtejac <rt...@gmail.com>.
Looks like thats task tracker issue.  Its not able to update JT in time. From Job tracker UI, go to logs and check on that particular failed task in that particular task tracker and check logs. 


On Dec 16, 2013, at 2:17 AM, Viswanathan J <ja...@gmail.com> wrote:

> Hi,
> 
> I'm getting the following error frequently while running MR jobs.
> 
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for task attempt_201312040159_126927_m_000000_0 when no start time is set, stackTrace is : java.lang.Exception
>         at org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
> 
> Please help.
> 
> -- 
> Regards,
> Viswa.J

Re: Getting following error in JT logs while running MR jobs

Posted by rtejac <rt...@gmail.com>.
Looks like thats task tracker issue.  Its not able to update JT in time. From Job tracker UI, go to logs and check on that particular failed task in that particular task tracker and check logs. 


On Dec 16, 2013, at 2:17 AM, Viswanathan J <ja...@gmail.com> wrote:

> Hi,
> 
> I'm getting the following error frequently while running MR jobs.
> 
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for task attempt_201312040159_126927_m_000000_0 when no start time is set, stackTrace is : java.lang.Exception
>         at org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
> 
> Please help.
> 
> -- 
> Regards,
> Viswa.J

Re: Getting following error in JT logs while running MR jobs

Posted by shashwat shriparv <dw...@gmail.com>.
Check if you are having correct permission for the user through which you
are running the job.



* Warm Regards_**∞_*
*Shashwat Shriparv*
Big-Data Engineer(HPC)
[image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <sh...@yahoo.com>




On Mon, Dec 16, 2013 at 3:47 PM, Viswanathan J
<ja...@gmail.com>wrote:

> Hi,
>
> I'm getting the following error frequently while running MR jobs.
>
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for
> task attempt_201312040159_126927_m_000000_0 when no start time is set,
> stackTrace is : java.lang.Exception
>         at
> org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at
> org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at
> org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at
> org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at
> org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at
> org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at
> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
>
> Please help.
>
> --
> Regards,
> Viswa.J
>

Re: Getting following error in JT logs while running MR jobs

Posted by rtejac <rt...@gmail.com>.
Looks like thats task tracker issue.  Its not able to update JT in time. From Job tracker UI, go to logs and check on that particular failed task in that particular task tracker and check logs. 


On Dec 16, 2013, at 2:17 AM, Viswanathan J <ja...@gmail.com> wrote:

> Hi,
> 
> I'm getting the following error frequently while running MR jobs.
> 
> ERROR org.apache.hadoop.mapred.TaskStatus: Trying to set finish time for task attempt_201312040159_126927_m_000000_0 when no start time is set, stackTrace is : java.lang.Exception
>         at org.apache.hadoop.mapred.TaskStatus.setFinishTime(TaskStatus.java:145)
>         at org.apache.hadoop.mapred.TaskInProgress.incompleteSubTask(TaskInProgress.java:700)
>         at org.apache.hadoop.mapred.JobInProgress.failedTask(JobInProgress.java:3004)
>         at org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1185)
>         at org.apache.hadoop.mapred.JobTracker.updateTaskStatuses(JobTracker.java:4471)
>         at org.apache.hadoop.mapred.JobTracker.processHeartbeat(JobTracker.java:3306)
>         at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:3001)
>         at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
> 
> Please help.
> 
> -- 
> Regards,
> Viswa.J