You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by mahender bigdata <Ma...@outlook.com> on 2016/03/24 19:27:53 UTC
Hadoop 2.6 version https://issues.apache.org/jira/browse/YARN-2624
Hi,
Has any one is holding work around for this bug, Looks like this problem
still persists in hadoop 2.6. Templeton Job get failed as soon as job is
submitted. Please let us know as early as possible
Application application_1458842675930_0002 failed 2 times due to AM
Container for appattempt_1458842675930_0002_000002 exited with exitCode:
-1000
For more detailed output, check application tracking
page:http://headnodehost:9014/cluster/app/application_1458842675930_0002Then,
click on links to logs of each attempt.
Diagnostics: Rename cannot overwrite non empty destination directory
c:/apps/temp/hdfs/nm-local-dir/usercache/XXX/filecache/18
java.io.IOException: Rename cannot overwrite non empty destination
directory c:/apps/temp/hdfs/nm-local-dir/usercache/XXXX/filecache/18
at
org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:735)
at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:236)
at
org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:678)
at org.apache.hadoop.fs.FileContext.rename(FileContext.java:958)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:366)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Failing this attempt. Failing the application.
/Mahender
Re: Reopen https://issues.apache.org/jira/browse/YARN-2624
Posted by Lefty Leverenz <le...@gmail.com>.
Have you asked this question on one of the YARN mailing lists
<https://hadoop.apache.org/mailing_lists.html> (yarn-dev@hadoop.apache.org
or yarn-issues@hadoop.apache.org)?
-- Lefty
On Tue, Mar 29, 2016 at 3:56 PM, mahender bigdata <
Mahender.BigData@outlook.com> wrote:
> Ping..
>
>
> On 3/26/2016 7:23 AM, mahender bigdata wrote:
>
> Can we reopen this Jira.. Looks like this issue can be reproed though in
> Apache site it says resolved.
>
> -Mahender
>
> On 3/25/2016 2:06 AM, Mahender Sarangam wrote:
>
> any update on this..
>
> > Subject: Re: Hadoop 2.6 version
> <https://issues.apache.org/jira/browse/YARN-2624>
> https://issues.apache.org/jira/browse/YARN-2624
> > To: user@hive.apache.org
> > From: Mahender.BigData@outlook.com
> > Date: Thu, 24 Mar 2016 12:20:57 -0700
> >
> >
> > Is there any other way to do NM Node Cache directory, I'm using Windows
> > Cluster Hortan Works HDP System.
> >
> > /mahender
> > On 3/24/2016 11:27 AM, mahender bigdata wrote:
> > > Hi,
> > >
> > > Has any one is holding work around for this bug, Looks like this
> > > problem still persists in hadoop 2.6. Templeton Job get failed as soon
> > > as job is submitted. Please let us know as early as possible
> > >
> > > Application application_1458842675930_0002 failed 2 times due to AM
> > > Container for appattempt_1458842675930_0002_000002 exited with
> > > exitCode: -1000
> > > For more detailed output, check application tracking
> > > page:
> http://headnodehost:9014/cluster/app/application_1458842675930_0002Then,
> > > click on links to logs of each attempt.
> > > Diagnostics: Rename cannot overwrite non empty destination directory
> > > c:/apps/temp/hdfs/nm-local-dir/usercache/XXX/filecache/18
> > > java.io.IOException: Rename cannot overwrite non empty destination
> > > directory c:/apps/temp/hdfs/nm-local-dir/usercache/XXXX/filecache/18
> > > at
> > >
> org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:735)
>
> > >
> > > at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:236)
> > > at
> > >
> org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:678)
> > > at org.apache.hadoop.fs.FileContext.rename(FileContext.java:958)
> > > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:366)
> > > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > > at
> > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > > at
> > >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> > >
> > > at
> > >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> > >
> > > at java.lang.Thread.run(Thread.java:745)
> > > Failing this attempt. Failing the application.
> > >
> > >
> > > /Mahender
> > >
> > >
> > >
> > >
> >
>
>
>
>
Re: Reopen https://issues.apache.org/jira/browse/YARN-2624
Posted by mahender bigdata <Ma...@outlook.com>.
Ping..
On 3/26/2016 7:23 AM, mahender bigdata wrote:
> Can we reopen this Jira.. Looks like this issue can be reproed though
> in Apache site it says resolved.
>
> -Mahender
>
> On 3/25/2016 2:06 AM, Mahender Sarangam wrote:
>> any update on this..
>>
>> > Subject: Re: Hadoop 2.6 version
>> https://issues.apache.org/jira/browse/YARN-2624
>> > To: user@hive.apache.org
>> > From: Mahender.BigData@outlook.com
>> > Date: Thu, 24 Mar 2016 12:20:57 -0700
>> >
>> >
>> > Is there any other way to do NM Node Cache directory, I'm using
>> Windows
>> > Cluster Hortan Works HDP System.
>> >
>> > /mahender
>> > On 3/24/2016 11:27 AM, mahender bigdata wrote:
>> > > Hi,
>> > >
>> > > Has any one is holding work around for this bug, Looks like this
>> > > problem still persists in hadoop 2.6. Templeton Job get failed as
>> soon
>> > > as job is submitted. Please let us know as early as possible
>> > >
>> > > Application application_1458842675930_0002 failed 2 times due to AM
>> > > Container for appattempt_1458842675930_0002_000002 exited with
>> > > exitCode: -1000
>> > > For more detailed output, check application tracking
>> > >
>> page:http://headnodehost:9014/cluster/app/application_1458842675930_0002Then,
>>
>> > > click on links to logs of each attempt.
>> > > Diagnostics: Rename cannot overwrite non empty destination directory
>> > > c:/apps/temp/hdfs/nm-local-dir/usercache/XXX/filecache/18
>> > > java.io.IOException: Rename cannot overwrite non empty destination
>> > > directory c:/apps/temp/hdfs/nm-local-dir/usercache/XXXX/filecache/18
>> > > at
>> > >
>> org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:735)
>>
>> > >
>> > > at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:236)
>> > > at
>> > >
>> org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:678)
>> > > at org.apache.hadoop.fs.FileContext.rename(FileContext.java:958)
>> > > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:366)
>> > > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> > > at
>> > >
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> > > at
>> > >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>
>> > >
>> > > at
>> > >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>
>> > >
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > Failing this attempt. Failing the application.
>> > >
>> > >
>> > > /Mahender
>> > >
>> > >
>> > >
>> > >
>> >
>
Re: Reopen https://issues.apache.org/jira/browse/YARN-2624
Posted by mahender bigdata <Ma...@outlook.com>.
Can we reopen this Jira.. Looks like this issue can be reproed though
in Apache site it says resolved.
-Mahender
On 3/25/2016 2:06 AM, Mahender Sarangam wrote:
> any update on this..
>
> > Subject: Re: Hadoop 2.6 version
> https://issues.apache.org/jira/browse/YARN-2624
> > To: user@hive.apache.org
> > From: Mahender.BigData@outlook.com
> > Date: Thu, 24 Mar 2016 12:20:57 -0700
> >
> >
> > Is there any other way to do NM Node Cache directory, I'm using Windows
> > Cluster Hortan Works HDP System.
> >
> > /mahender
> > On 3/24/2016 11:27 AM, mahender bigdata wrote:
> > > Hi,
> > >
> > > Has any one is holding work around for this bug, Looks like this
> > > problem still persists in hadoop 2.6. Templeton Job get failed as
> soon
> > > as job is submitted. Please let us know as early as possible
> > >
> > > Application application_1458842675930_0002 failed 2 times due to AM
> > > Container for appattempt_1458842675930_0002_000002 exited with
> > > exitCode: -1000
> > > For more detailed output, check application tracking
> > >
> page:http://headnodehost:9014/cluster/app/application_1458842675930_0002Then,
>
> > > click on links to logs of each attempt.
> > > Diagnostics: Rename cannot overwrite non empty destination directory
> > > c:/apps/temp/hdfs/nm-local-dir/usercache/XXX/filecache/18
> > > java.io.IOException: Rename cannot overwrite non empty destination
> > > directory c:/apps/temp/hdfs/nm-local-dir/usercache/XXXX/filecache/18
> > > at
> > >
> org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:735)
>
> > >
> > > at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:236)
> > > at
> > >
> org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:678)
> > > at org.apache.hadoop.fs.FileContext.rename(FileContext.java:958)
> > > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:366)
> > > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > > at
> > >
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > > at
> > >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> > >
> > > at
> > >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> > >
> > > at java.lang.Thread.run(Thread.java:745)
> > > Failing this attempt. Failing the application.
> > >
> > >
> > > /Mahender
> > >
> > >
> > >
> > >
> >
RE: Hadoop 2.6 version
https://issues.apache.org/jira/browse/YARN-2624
Posted by Mahender Sarangam <ma...@outlook.com>.
any update on this..
> Subject: Re: Hadoop 2.6 version https://issues.apache.org/jira/browse/YARN-2624
> To: user@hive.apache.org
> From: Mahender.BigData@outlook.com
> Date: Thu, 24 Mar 2016 12:20:57 -0700
>
>
> Is there any other way to do NM Node Cache directory, I'm using Windows
> Cluster Hortan Works HDP System.
>
> /mahender
> On 3/24/2016 11:27 AM, mahender bigdata wrote:
> > Hi,
> >
> > Has any one is holding work around for this bug, Looks like this
> > problem still persists in hadoop 2.6. Templeton Job get failed as soon
> > as job is submitted. Please let us know as early as possible
> >
> > Application application_1458842675930_0002 failed 2 times due to AM
> > Container for appattempt_1458842675930_0002_000002 exited with
> > exitCode: -1000
> > For more detailed output, check application tracking
> > page:http://headnodehost:9014/cluster/app/application_1458842675930_0002Then,
> > click on links to logs of each attempt.
> > Diagnostics: Rename cannot overwrite non empty destination directory
> > c:/apps/temp/hdfs/nm-local-dir/usercache/XXX/filecache/18
> > java.io.IOException: Rename cannot overwrite non empty destination
> > directory c:/apps/temp/hdfs/nm-local-dir/usercache/XXXX/filecache/18
> > at
> > org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:735)
> >
> > at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:236)
> > at
> > org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:678)
> > at org.apache.hadoop.fs.FileContext.rename(FileContext.java:958)
> > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:366)
> > at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >
> > at java.lang.Thread.run(Thread.java:745)
> > Failing this attempt. Failing the application.
> >
> >
> > /Mahender
> >
> >
> >
> >
>
Re: Hadoop 2.6 version
https://issues.apache.org/jira/browse/YARN-2624
Posted by mahender bigdata <Ma...@outlook.com>.
Is there any other way to do NM Node Cache directory, I'm using Windows
Cluster Hortan Works HDP System.
/mahender
On 3/24/2016 11:27 AM, mahender bigdata wrote:
> Hi,
>
> Has any one is holding work around for this bug, Looks like this
> problem still persists in hadoop 2.6. Templeton Job get failed as soon
> as job is submitted. Please let us know as early as possible
>
> Application application_1458842675930_0002 failed 2 times due to AM
> Container for appattempt_1458842675930_0002_000002 exited with
> exitCode: -1000
> For more detailed output, check application tracking
> page:http://headnodehost:9014/cluster/app/application_1458842675930_0002Then,
> click on links to logs of each attempt.
> Diagnostics: Rename cannot overwrite non empty destination directory
> c:/apps/temp/hdfs/nm-local-dir/usercache/XXX/filecache/18
> java.io.IOException: Rename cannot overwrite non empty destination
> directory c:/apps/temp/hdfs/nm-local-dir/usercache/XXXX/filecache/18
> at
> org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:735)
>
> at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:236)
> at
> org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:678)
> at org.apache.hadoop.fs.FileContext.rename(FileContext.java:958)
> at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:366)
> at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
> Failing this attempt. Failing the application.
>
>
> /Mahender
>
>
>
>