You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by unmesha sreeveni <un...@gmail.com> on 2013/12/19 05:53:41 UTC
File not getting created in hdfs
I have a hadoop implementation for an algorithm.
i am doing it in eclipse:
so my algorithm runs different MR jobs depending upon the datasets.(for a
413 bytes file 7 MR jobs are executed)
Algorithm
|
|___MR1-->creates a intermediate0.txt file.
|
|___MR2-->creates a intermediate1.txt file.
|
|___MR3-->creates a intermediate3.txt file.
|
|___MR4-->creates a intermediate4.txt file.
|
|___MR5-->creates a intermediate5.txt file.
|
|___MR6-->creates a intermediate6.txt file.
|
|___MR7-->creates a intermediate7.txt file.
Completes the job.
but except intermediate0.txt all others file to create a file in reducer
phase.
Do any one gone through this issue.
Pls help.
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: File not getting created in hdfs
Posted by unmesha sreeveni <un...@gmail.com>.
an edit***************************
conti
Completes the job.
but except intermediate0.txt all other files are not getting created in
hdfs from reducer.
On Thu, Dec 19, 2013 at 10:23 AM, unmesha sreeveni <un...@gmail.com>wrote:
>
> I have a hadoop implementation for an algorithm.
>
> i am doing it in eclipse:
> so my algorithm runs different MR jobs depending upon the datasets.(for a
> 413 bytes file 7 MR jobs are executed)
>
>
> Algorithm
> |
> |___MR1-->creates a intermediate0.txt file.
> |
> |___MR2-->creates a intermediate1.txt file.
> |
> |___MR3-->creates a intermediate3.txt file.
> |
> |___MR4-->creates a intermediate4.txt file.
> |
> |___MR5-->creates a intermediate5.txt file.
> |
> |___MR6-->creates a intermediate6.txt file.
> |
> |___MR7-->creates a intermediate7.txt file.
> Completes the job.
> but except intermediate0.txt all others file to create a file in reducer
> phase.
>
> Do any one gone through this issue.
>
> Pls help.
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: File not getting created in hdfs
Posted by unmesha sreeveni <un...@gmail.com>.
an edit***************************
conti
Completes the job.
but except intermediate0.txt all other files are not getting created in
hdfs from reducer.
On Thu, Dec 19, 2013 at 10:23 AM, unmesha sreeveni <un...@gmail.com>wrote:
>
> I have a hadoop implementation for an algorithm.
>
> i am doing it in eclipse:
> so my algorithm runs different MR jobs depending upon the datasets.(for a
> 413 bytes file 7 MR jobs are executed)
>
>
> Algorithm
> |
> |___MR1-->creates a intermediate0.txt file.
> |
> |___MR2-->creates a intermediate1.txt file.
> |
> |___MR3-->creates a intermediate3.txt file.
> |
> |___MR4-->creates a intermediate4.txt file.
> |
> |___MR5-->creates a intermediate5.txt file.
> |
> |___MR6-->creates a intermediate6.txt file.
> |
> |___MR7-->creates a intermediate7.txt file.
> Completes the job.
> but except intermediate0.txt all others file to create a file in reducer
> phase.
>
> Do any one gone through this issue.
>
> Pls help.
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: File not getting created in hdfs
Posted by unmesha sreeveni <un...@gmail.com>.
an edit***************************
conti
Completes the job.
but except intermediate0.txt all other files are not getting created in
hdfs from reducer.
On Thu, Dec 19, 2013 at 10:23 AM, unmesha sreeveni <un...@gmail.com>wrote:
>
> I have a hadoop implementation for an algorithm.
>
> i am doing it in eclipse:
> so my algorithm runs different MR jobs depending upon the datasets.(for a
> 413 bytes file 7 MR jobs are executed)
>
>
> Algorithm
> |
> |___MR1-->creates a intermediate0.txt file.
> |
> |___MR2-->creates a intermediate1.txt file.
> |
> |___MR3-->creates a intermediate3.txt file.
> |
> |___MR4-->creates a intermediate4.txt file.
> |
> |___MR5-->creates a intermediate5.txt file.
> |
> |___MR6-->creates a intermediate6.txt file.
> |
> |___MR7-->creates a intermediate7.txt file.
> Completes the job.
> but except intermediate0.txt all others file to create a file in reducer
> phase.
>
> Do any one gone through this issue.
>
> Pls help.
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: File not getting created in hdfs
Posted by unmesha sreeveni <un...@gmail.com>.
an edit***************************
conti
Completes the job.
but except intermediate0.txt all other files are not getting created in
hdfs from reducer.
On Thu, Dec 19, 2013 at 10:23 AM, unmesha sreeveni <un...@gmail.com>wrote:
>
> I have a hadoop implementation for an algorithm.
>
> i am doing it in eclipse:
> so my algorithm runs different MR jobs depending upon the datasets.(for a
> 413 bytes file 7 MR jobs are executed)
>
>
> Algorithm
> |
> |___MR1-->creates a intermediate0.txt file.
> |
> |___MR2-->creates a intermediate1.txt file.
> |
> |___MR3-->creates a intermediate3.txt file.
> |
> |___MR4-->creates a intermediate4.txt file.
> |
> |___MR5-->creates a intermediate5.txt file.
> |
> |___MR6-->creates a intermediate6.txt file.
> |
> |___MR7-->creates a intermediate7.txt file.
> Completes the job.
> but except intermediate0.txt all others file to create a file in reducer
> phase.
>
> Do any one gone through this issue.
>
> Pls help.
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*