Re: MapReduce Job fails due to corrupted mapreduce.tar.gz

[Prabhu Josephraj <pj...@cloudera.com.INVALID>]

Hi Kunal,

     This issue will happen if the mapreduce.tar.gz present in hdfs
path (mapreduce.application.framework.path)
is corrupted due to some Hdfs issue.
Below steps will help to fix the issue

   1. Remove all cached and corrupted mapreduce.tar.gz under the NM local
   directories.
   2. Replace the corrupted copy in HDFS path
   (mapreduce.application.framework.path) with the good local copy:

   hdfs dfs -rm /hdp/apps/<hdp.version>/mapreduce/mapreduce.tar.gz

   hdfs dfs -put /usr/hdp/<hdp.version>/hadoop/mapreduce.tar.gz
/hdp/apps/<hdp.version>/mapreduce/mapreduce.tar.gz



On Wed, Mar 27, 2019 at 10:16 AM Kunal Patil <ku...@gslab.com> wrote:

> Hi,
> I am running mapreduce job on hortonwork data platform (hdp 2.6) cluster
> but it is showing following error.
>
> Diagnostics: ExitCodeException exitCode=2:
>
> gzip: /hadoop/yarn/local/filecache/17_tmp/tmp_mapreduce.tar.gz: unexpected
> end of file
>
> tar: Unexpected EOF in archive
>
> tar: Unexpected EOF in archive
>
> tar: Error is not recoverable: exiting now
>
>
>
> Failing this attempt. Failing the application.
>
>
>
> I have tested the jar locally and its working fine but on hdp there is some
> problem.
>
> mapreduce.tar.gz seems to be getting cahed and is corrupted. Also checked
> parallel execution on ambari agent which is disabled.
>
> Whats the solution for this ? Please help !
>
>
>
> Thanks & Regards,
>
> Kunal Patil
>
> Software Engineer
>
> GS Lab, Pune
>
> --
> Confidentiality Notice and Disclaimer: This email (including any
> attachments) contains information that may be confidential, privileged
> and/or copyrighted. If you are not the intended recipient, please notify
> the sender immediately and destroy this email. Any unauthorized use of the
> contents of this email in any manner whatsoever, is strictly prohibited.
> If
> improper activity is suspected, all available information may be used by
> the sender for possible disciplinary action, prosecution, civil claim or
> any remedy or lawful purpose. Email transmission cannot be guaranteed to
> be
> secure or error-free, as information could be intercepted, lost, arrive
> late, or contain viruses. The sender is not liable whatsoever for damage
> resulting from the opening of this message and/or the use of the
> information contained in this message and/or attachments. Expressions in
> this email cannot be treated as opined by the sender company management –
> they are solely expressed by the sender unless authorized.
>