You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Mohit Vadhera <pr...@gmail.com> on 2013/04/19 08:38:58 UTC
log
Can anybody let me know the meaning of the below log plz " Target Replicas
is 10 but found 1 replica(s)." ?
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
Under replicated
BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
Target
Replicas is 10 but found 1 replica(s).
Thanks,
Re: log
Posted by Nitin Pawar <ni...@gmail.com>.
For this particular file you have set the replication factor to be 10 but
there is only one available. Did your dadanodes go down ? or you retired
datanodes? Or your number of datanodes is less than that of replication
factor?
On Apr 19, 2013 12:09 PM, "Mohit Vadhera" <pr...@gmail.com>
wrote:
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
>
> Thanks,
>
Re: log
Posted by Nitin Pawar <ni...@gmail.com>.
For this particular file you have set the replication factor to be 10 but
there is only one available. Did your dadanodes go down ? or you retired
datanodes? Or your number of datanodes is less than that of replication
factor?
On Apr 19, 2013 12:09 PM, "Mohit Vadhera" <pr...@gmail.com>
wrote:
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
>
> Thanks,
>
Re: log
Posted by Nitin Pawar <ni...@gmail.com>.
For this particular file you have set the replication factor to be 10 but
there is only one available. Did your dadanodes go down ? or you retired
datanodes? Or your number of datanodes is less than that of replication
factor?
On Apr 19, 2013 12:09 PM, "Mohit Vadhera" <pr...@gmail.com>
wrote:
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
>
> Thanks,
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
But my files are still there. As an example
-rw-r--r-- 10 User hadmin 6392159 2013-02-05 21:32
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/User/.staging/job_201302050715_0032/job.jar
Thanks,
On Fri, Apr 19, 2013 at 2:51 PM, Bejoy Ks <be...@gmail.com> wrote:
> This basically happens while running a mapreduce job. When a map reduce
> job is triggered the job files are put in hdfs with high replication (
> replication is controlled by - 'mapred.submit.replication' default value
> is 10).
>
> The job files are cleaned up after the job is completed and hence that
> could be the reason you are seeing the hdfs file system status as healthy
> after running the job.
>
>
> On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <
> project.linux.proj@gmail.com> wrote:
>
>> its one (1). Output is below.
>>
>> .......Status: HEALTHY
>> Total size: 903709673179 B
>> Total dirs: 2906
>> Total files: 11110
>> Total blocks (validated): 20906 (avg. block size 43227287 B)
>> Minimally replicated blocks: 20906 (100.0 %)
>> Over-replicated blocks: 0 (0.0 %)
>> Under-replicated blocks: 248 (1.1862624 %)
>> Mis-replicated blocks: 0 (0.0 %)
>> Default replication factor: 1
>> Average block replication: 1.0
>> Corrupt blocks: 0
>> Missing replicas: 2232 (9.646469 %)
>> Number of data-nodes: 1
>> Number of racks: 1
>> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>>
>>
>> The filesystem under path '/' is HEALTHY
>>
>>
>>
>> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>>
>>> It means that some of your data blocks are not replicated as intended.
>>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>>
>>> ** **
>>>
>>> Can you paste the output of ****
>>>
>>> ** **
>>>
>>> *bin/hadoop fsck /****
>>>
>>> ** **
>>>
>>> --****
>>>
>>> Manoj****
>>>
>>> ** **
>>>
>>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>>> *Sent:* Friday, April 19, 2013 12:09 PM
>>> *To:* <us...@hadoop.apache.org>
>>> *Subject:* log****
>>>
>>> ** **
>>>
>>> Can anybody let me know the meaning of the below log plz " Target
>>> Replicas is 10 but found 1 replica(s)." ?
>>>
>>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>>> Under replicated
>>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>>> Target
>>> Replicas is 10 but found 1 replica(s).
>>>
>>> ****
>>>
>>> Thanks,****
>>>
>>
>>
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
But my files are still there. As an example
-rw-r--r-- 10 User hadmin 6392159 2013-02-05 21:32
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/User/.staging/job_201302050715_0032/job.jar
Thanks,
On Fri, Apr 19, 2013 at 2:51 PM, Bejoy Ks <be...@gmail.com> wrote:
> This basically happens while running a mapreduce job. When a map reduce
> job is triggered the job files are put in hdfs with high replication (
> replication is controlled by - 'mapred.submit.replication' default value
> is 10).
>
> The job files are cleaned up after the job is completed and hence that
> could be the reason you are seeing the hdfs file system status as healthy
> after running the job.
>
>
> On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <
> project.linux.proj@gmail.com> wrote:
>
>> its one (1). Output is below.
>>
>> .......Status: HEALTHY
>> Total size: 903709673179 B
>> Total dirs: 2906
>> Total files: 11110
>> Total blocks (validated): 20906 (avg. block size 43227287 B)
>> Minimally replicated blocks: 20906 (100.0 %)
>> Over-replicated blocks: 0 (0.0 %)
>> Under-replicated blocks: 248 (1.1862624 %)
>> Mis-replicated blocks: 0 (0.0 %)
>> Default replication factor: 1
>> Average block replication: 1.0
>> Corrupt blocks: 0
>> Missing replicas: 2232 (9.646469 %)
>> Number of data-nodes: 1
>> Number of racks: 1
>> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>>
>>
>> The filesystem under path '/' is HEALTHY
>>
>>
>>
>> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>>
>>> It means that some of your data blocks are not replicated as intended.
>>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>>
>>> ** **
>>>
>>> Can you paste the output of ****
>>>
>>> ** **
>>>
>>> *bin/hadoop fsck /****
>>>
>>> ** **
>>>
>>> --****
>>>
>>> Manoj****
>>>
>>> ** **
>>>
>>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>>> *Sent:* Friday, April 19, 2013 12:09 PM
>>> *To:* <us...@hadoop.apache.org>
>>> *Subject:* log****
>>>
>>> ** **
>>>
>>> Can anybody let me know the meaning of the below log plz " Target
>>> Replicas is 10 but found 1 replica(s)." ?
>>>
>>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>>> Under replicated
>>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>>> Target
>>> Replicas is 10 but found 1 replica(s).
>>>
>>> ****
>>>
>>> Thanks,****
>>>
>>
>>
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
But my files are still there. As an example
-rw-r--r-- 10 User hadmin 6392159 2013-02-05 21:32
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/User/.staging/job_201302050715_0032/job.jar
Thanks,
On Fri, Apr 19, 2013 at 2:51 PM, Bejoy Ks <be...@gmail.com> wrote:
> This basically happens while running a mapreduce job. When a map reduce
> job is triggered the job files are put in hdfs with high replication (
> replication is controlled by - 'mapred.submit.replication' default value
> is 10).
>
> The job files are cleaned up after the job is completed and hence that
> could be the reason you are seeing the hdfs file system status as healthy
> after running the job.
>
>
> On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <
> project.linux.proj@gmail.com> wrote:
>
>> its one (1). Output is below.
>>
>> .......Status: HEALTHY
>> Total size: 903709673179 B
>> Total dirs: 2906
>> Total files: 11110
>> Total blocks (validated): 20906 (avg. block size 43227287 B)
>> Minimally replicated blocks: 20906 (100.0 %)
>> Over-replicated blocks: 0 (0.0 %)
>> Under-replicated blocks: 248 (1.1862624 %)
>> Mis-replicated blocks: 0 (0.0 %)
>> Default replication factor: 1
>> Average block replication: 1.0
>> Corrupt blocks: 0
>> Missing replicas: 2232 (9.646469 %)
>> Number of data-nodes: 1
>> Number of racks: 1
>> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>>
>>
>> The filesystem under path '/' is HEALTHY
>>
>>
>>
>> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>>
>>> It means that some of your data blocks are not replicated as intended.
>>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>>
>>> ** **
>>>
>>> Can you paste the output of ****
>>>
>>> ** **
>>>
>>> *bin/hadoop fsck /****
>>>
>>> ** **
>>>
>>> --****
>>>
>>> Manoj****
>>>
>>> ** **
>>>
>>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>>> *Sent:* Friday, April 19, 2013 12:09 PM
>>> *To:* <us...@hadoop.apache.org>
>>> *Subject:* log****
>>>
>>> ** **
>>>
>>> Can anybody let me know the meaning of the below log plz " Target
>>> Replicas is 10 but found 1 replica(s)." ?
>>>
>>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>>> Under replicated
>>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>>> Target
>>> Replicas is 10 but found 1 replica(s).
>>>
>>> ****
>>>
>>> Thanks,****
>>>
>>
>>
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
But my files are still there. As an example
-rw-r--r-- 10 User hadmin 6392159 2013-02-05 21:32
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/User/.staging/job_201302050715_0032/job.jar
Thanks,
On Fri, Apr 19, 2013 at 2:51 PM, Bejoy Ks <be...@gmail.com> wrote:
> This basically happens while running a mapreduce job. When a map reduce
> job is triggered the job files are put in hdfs with high replication (
> replication is controlled by - 'mapred.submit.replication' default value
> is 10).
>
> The job files are cleaned up after the job is completed and hence that
> could be the reason you are seeing the hdfs file system status as healthy
> after running the job.
>
>
> On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <
> project.linux.proj@gmail.com> wrote:
>
>> its one (1). Output is below.
>>
>> .......Status: HEALTHY
>> Total size: 903709673179 B
>> Total dirs: 2906
>> Total files: 11110
>> Total blocks (validated): 20906 (avg. block size 43227287 B)
>> Minimally replicated blocks: 20906 (100.0 %)
>> Over-replicated blocks: 0 (0.0 %)
>> Under-replicated blocks: 248 (1.1862624 %)
>> Mis-replicated blocks: 0 (0.0 %)
>> Default replication factor: 1
>> Average block replication: 1.0
>> Corrupt blocks: 0
>> Missing replicas: 2232 (9.646469 %)
>> Number of data-nodes: 1
>> Number of racks: 1
>> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>>
>>
>> The filesystem under path '/' is HEALTHY
>>
>>
>>
>> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>>
>>> It means that some of your data blocks are not replicated as intended.
>>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>>
>>> ** **
>>>
>>> Can you paste the output of ****
>>>
>>> ** **
>>>
>>> *bin/hadoop fsck /****
>>>
>>> ** **
>>>
>>> --****
>>>
>>> Manoj****
>>>
>>> ** **
>>>
>>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>>> *Sent:* Friday, April 19, 2013 12:09 PM
>>> *To:* <us...@hadoop.apache.org>
>>> *Subject:* log****
>>>
>>> ** **
>>>
>>> Can anybody let me know the meaning of the below log plz " Target
>>> Replicas is 10 but found 1 replica(s)." ?
>>>
>>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>>> Under replicated
>>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>>> Target
>>> Replicas is 10 but found 1 replica(s).
>>>
>>> ****
>>>
>>> Thanks,****
>>>
>>
>>
>
Re: log
Posted by Bejoy Ks <be...@gmail.com>.
This basically happens while running a mapreduce job. When a map reduce job
is triggered the job files are put in hdfs with high replication (
replication is controlled by - 'mapred.submit.replication' default value
is 10).
The job files are cleaned up after the job is completed and hence that
could be the reason you are seeing the hdfs file system status as healthy
after running the job.
On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <project.linux.proj@gmail.com
> wrote:
> its one (1). Output is below.
>
> .......Status: HEALTHY
> Total size: 903709673179 B
> Total dirs: 2906
> Total files: 11110
> Total blocks (validated): 20906 (avg. block size 43227287 B)
> Minimally replicated blocks: 20906 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 248 (1.1862624 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 0
> Missing replicas: 2232 (9.646469 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>
>
> The filesystem under path '/' is HEALTHY
>
>
>
> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>
>> It means that some of your data blocks are not replicated as intended.
>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>
>> ** **
>>
>> Can you paste the output of ****
>>
>> ** **
>>
>> *bin/hadoop fsck /****
>>
>> ** **
>>
>> --****
>>
>> Manoj****
>>
>> ** **
>>
>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>> *Sent:* Friday, April 19, 2013 12:09 PM
>> *To:* <us...@hadoop.apache.org>
>> *Subject:* log****
>>
>> ** **
>>
>> Can anybody let me know the meaning of the below log plz " Target
>> Replicas is 10 but found 1 replica(s)." ?
>>
>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>> Under replicated
>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>> Target
>> Replicas is 10 but found 1 replica(s).
>>
>> ****
>>
>> Thanks,****
>>
>
>
Re: log
Posted by Bejoy Ks <be...@gmail.com>.
This basically happens while running a mapreduce job. When a map reduce job
is triggered the job files are put in hdfs with high replication (
replication is controlled by - 'mapred.submit.replication' default value
is 10).
The job files are cleaned up after the job is completed and hence that
could be the reason you are seeing the hdfs file system status as healthy
after running the job.
On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <project.linux.proj@gmail.com
> wrote:
> its one (1). Output is below.
>
> .......Status: HEALTHY
> Total size: 903709673179 B
> Total dirs: 2906
> Total files: 11110
> Total blocks (validated): 20906 (avg. block size 43227287 B)
> Minimally replicated blocks: 20906 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 248 (1.1862624 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 0
> Missing replicas: 2232 (9.646469 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>
>
> The filesystem under path '/' is HEALTHY
>
>
>
> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>
>> It means that some of your data blocks are not replicated as intended.
>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>
>> ** **
>>
>> Can you paste the output of ****
>>
>> ** **
>>
>> *bin/hadoop fsck /****
>>
>> ** **
>>
>> --****
>>
>> Manoj****
>>
>> ** **
>>
>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>> *Sent:* Friday, April 19, 2013 12:09 PM
>> *To:* <us...@hadoop.apache.org>
>> *Subject:* log****
>>
>> ** **
>>
>> Can anybody let me know the meaning of the below log plz " Target
>> Replicas is 10 but found 1 replica(s)." ?
>>
>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>> Under replicated
>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>> Target
>> Replicas is 10 but found 1 replica(s).
>>
>> ****
>>
>> Thanks,****
>>
>
>
Re: log
Posted by Bejoy Ks <be...@gmail.com>.
This basically happens while running a mapreduce job. When a map reduce job
is triggered the job files are put in hdfs with high replication (
replication is controlled by - 'mapred.submit.replication' default value
is 10).
The job files are cleaned up after the job is completed and hence that
could be the reason you are seeing the hdfs file system status as healthy
after running the job.
On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <project.linux.proj@gmail.com
> wrote:
> its one (1). Output is below.
>
> .......Status: HEALTHY
> Total size: 903709673179 B
> Total dirs: 2906
> Total files: 11110
> Total blocks (validated): 20906 (avg. block size 43227287 B)
> Minimally replicated blocks: 20906 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 248 (1.1862624 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 0
> Missing replicas: 2232 (9.646469 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>
>
> The filesystem under path '/' is HEALTHY
>
>
>
> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>
>> It means that some of your data blocks are not replicated as intended.
>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>
>> ** **
>>
>> Can you paste the output of ****
>>
>> ** **
>>
>> *bin/hadoop fsck /****
>>
>> ** **
>>
>> --****
>>
>> Manoj****
>>
>> ** **
>>
>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>> *Sent:* Friday, April 19, 2013 12:09 PM
>> *To:* <us...@hadoop.apache.org>
>> *Subject:* log****
>>
>> ** **
>>
>> Can anybody let me know the meaning of the below log plz " Target
>> Replicas is 10 but found 1 replica(s)." ?
>>
>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>> Under replicated
>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>> Target
>> Replicas is 10 but found 1 replica(s).
>>
>> ****
>>
>> Thanks,****
>>
>
>
Re: log
Posted by Bejoy Ks <be...@gmail.com>.
This basically happens while running a mapreduce job. When a map reduce job
is triggered the job files are put in hdfs with high replication (
replication is controlled by - 'mapred.submit.replication' default value
is 10).
The job files are cleaned up after the job is completed and hence that
could be the reason you are seeing the hdfs file system status as healthy
after running the job.
On Fri, Apr 19, 2013 at 1:04 PM, Mohit Vadhera <project.linux.proj@gmail.com
> wrote:
> its one (1). Output is below.
>
> .......Status: HEALTHY
> Total size: 903709673179 B
> Total dirs: 2906
> Total files: 11110
> Total blocks (validated): 20906 (avg. block size 43227287 B)
> Minimally replicated blocks: 20906 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 248 (1.1862624 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 0
> Missing replicas: 2232 (9.646469 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
>
>
> The filesystem under path '/' is HEALTHY
>
>
>
> On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
>
>> It means that some of your data blocks are not replicated as intended.
>> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>>
>> ** **
>>
>> Can you paste the output of ****
>>
>> ** **
>>
>> *bin/hadoop fsck /****
>>
>> ** **
>>
>> --****
>>
>> Manoj****
>>
>> ** **
>>
>> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
>> *Sent:* Friday, April 19, 2013 12:09 PM
>> *To:* <us...@hadoop.apache.org>
>> *Subject:* log****
>>
>> ** **
>>
>> Can anybody let me know the meaning of the below log plz " Target
>> Replicas is 10 but found 1 replica(s)." ?
>>
>> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
>> Under replicated
>> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
>> Target
>> Replicas is 10 but found 1 replica(s).
>>
>> ****
>>
>> Thanks,****
>>
>
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
its one (1). Output is below.
.......Status: HEALTHY
Total size: 903709673179 B
Total dirs: 2906
Total files: 11110
Total blocks (validated): 20906 (avg. block size 43227287 B)
Minimally replicated blocks: 20906 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 248 (1.1862624 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 0
Missing replicas: 2232 (9.646469 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
The filesystem under path '/' is HEALTHY
On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
> It means that some of your data blocks are not replicated as intended.
> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>
> ** **
>
> Can you paste the output of ****
>
> ** **
>
> *bin/hadoop fsck /****
>
> ** **
>
> --****
>
> Manoj****
>
> ** **
>
> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
> *Sent:* Friday, April 19, 2013 12:09 PM
> *To:* <us...@hadoop.apache.org>
> *Subject:* log****
>
> ** **
>
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
> ****
>
> Thanks,****
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
its one (1). Output is below.
.......Status: HEALTHY
Total size: 903709673179 B
Total dirs: 2906
Total files: 11110
Total blocks (validated): 20906 (avg. block size 43227287 B)
Minimally replicated blocks: 20906 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 248 (1.1862624 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 0
Missing replicas: 2232 (9.646469 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
The filesystem under path '/' is HEALTHY
On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
> It means that some of your data blocks are not replicated as intended.
> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>
> ** **
>
> Can you paste the output of ****
>
> ** **
>
> *bin/hadoop fsck /****
>
> ** **
>
> --****
>
> Manoj****
>
> ** **
>
> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
> *Sent:* Friday, April 19, 2013 12:09 PM
> *To:* <us...@hadoop.apache.org>
> *Subject:* log****
>
> ** **
>
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
> ****
>
> Thanks,****
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
its one (1). Output is below.
.......Status: HEALTHY
Total size: 903709673179 B
Total dirs: 2906
Total files: 11110
Total blocks (validated): 20906 (avg. block size 43227287 B)
Minimally replicated blocks: 20906 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 248 (1.1862624 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 0
Missing replicas: 2232 (9.646469 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
The filesystem under path '/' is HEALTHY
On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
> It means that some of your data blocks are not replicated as intended.
> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>
> ** **
>
> Can you paste the output of ****
>
> ** **
>
> *bin/hadoop fsck /****
>
> ** **
>
> --****
>
> Manoj****
>
> ** **
>
> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
> *Sent:* Friday, April 19, 2013 12:09 PM
> *To:* <us...@hadoop.apache.org>
> *Subject:* log****
>
> ** **
>
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
> ****
>
> Thanks,****
>
Re: log
Posted by Mohit Vadhera <pr...@gmail.com>.
its one (1). Output is below.
.......Status: HEALTHY
Total size: 903709673179 B
Total dirs: 2906
Total files: 11110
Total blocks (validated): 20906 (avg. block size 43227287 B)
Minimally replicated blocks: 20906 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 248 (1.1862624 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 0
Missing replicas: 2232 (9.646469 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Apr 19 03:47:04 EDT 2013 in 2224 milliseconds
The filesystem under path '/' is HEALTHY
On Fri, Apr 19, 2013 at 12:28 PM, S, Manoj <ma...@intel.com> wrote:
> It means that some of your data blocks are not replicated as intended.
> What is the value of “dfs.replication” in your hadoop-site.xml file?****
>
> ** **
>
> Can you paste the output of ****
>
> ** **
>
> *bin/hadoop fsck /****
>
> ** **
>
> --****
>
> Manoj****
>
> ** **
>
> *From:* Mohit Vadhera [mailto:project.linux.proj@gmail.com]
> *Sent:* Friday, April 19, 2013 12:09 PM
> *To:* <us...@hadoop.apache.org>
> *Subject:* log****
>
> ** **
>
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
> ****
>
> Thanks,****
>
RE: log
Posted by "S, Manoj" <ma...@intel.com>.
It means that some of your data blocks are not replicated as intended. What is the value of "dfs.replication" in your hadoop-site.xml file?
Can you paste the output of
*bin/hadoop fsck /
--
Manoj
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, April 19, 2013 12:09 PM
To: <us...@hadoop.apache.org>
Subject: log
Can anybody let me know the meaning of the below log plz " Target Replicas is 10 but found 1 replica(s)." ?
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split: Under replicated BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720. Target
Replicas is 10 but found 1 replica(s).
Thanks,
RE: log
Posted by "S, Manoj" <ma...@intel.com>.
It means that some of your data blocks are not replicated as intended. What is the value of "dfs.replication" in your hadoop-site.xml file?
Can you paste the output of
*bin/hadoop fsck /
--
Manoj
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, April 19, 2013 12:09 PM
To: <us...@hadoop.apache.org>
Subject: log
Can anybody let me know the meaning of the below log plz " Target Replicas is 10 but found 1 replica(s)." ?
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split: Under replicated BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720. Target
Replicas is 10 but found 1 replica(s).
Thanks,
RE: log
Posted by "S, Manoj" <ma...@intel.com>.
It means that some of your data blocks are not replicated as intended. What is the value of "dfs.replication" in your hadoop-site.xml file?
Can you paste the output of
*bin/hadoop fsck /
--
Manoj
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, April 19, 2013 12:09 PM
To: <us...@hadoop.apache.org>
Subject: log
Can anybody let me know the meaning of the below log plz " Target Replicas is 10 but found 1 replica(s)." ?
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split: Under replicated BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720. Target
Replicas is 10 but found 1 replica(s).
Thanks,
RE: log
Posted by "S, Manoj" <ma...@intel.com>.
It means that some of your data blocks are not replicated as intended. What is the value of "dfs.replication" in your hadoop-site.xml file?
Can you paste the output of
*bin/hadoop fsck /
--
Manoj
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, April 19, 2013 12:09 PM
To: <us...@hadoop.apache.org>
Subject: log
Can anybody let me know the meaning of the below log plz " Target Replicas is 10 but found 1 replica(s)." ?
/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split: Under replicated BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720. Target
Replicas is 10 but found 1 replica(s).
Thanks,
Re: log
Posted by Nitin Pawar <ni...@gmail.com>.
For this particular file you have set the replication factor to be 10 but
there is only one available. Did your dadanodes go down ? or you retired
datanodes? Or your number of datanodes is less than that of replication
factor?
On Apr 19, 2013 12:09 PM, "Mohit Vadhera" <pr...@gmail.com>
wrote:
> Can anybody let me know the meaning of the below log plz " Target Replicas
> is 10 but found 1 replica(s)." ?
>
> /var/lib/hadoop-hdfs/cache/mapred/mapred/staging/test_user/.staging/job_201302180313_0623/job.split:
> Under replicated
> BP-2091347308-172.20.3.119-1356632249303:blk_6297333561560198850_70720.
> Target
> Replicas is 10 but found 1 replica(s).
>
>
> Thanks,
>