You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Mohit Vadhera <pr...@gmail.com> on 2013/03/01 19:52:01 UTC
hadoop filesystem corrupt
Hi,
While moving the data my data folder didn't move successfully. Now while
running the FSCK i get the file system is corrupt. Can anybody help me at
the earliest please. I shall be thankful
$ sudo - hdfs hadoop fsck /
-----------------------------
-------------------------
...Status: CORRUPT
Total size: 739698399117 B
Total dirs: 2179
Total files: 9064 (Files currently being written: 1)
Total blocks (validated): 17060 (avg. block size 43358640 B)
********************************
CORRUPT FILES: 4
CORRUPT BLOCKS: 4
********************************
Minimally replicated blocks: 17060 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 232 (1.3599062 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 4
Missing replicas: 2088 (10.904533 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
The filesystem under path '/' is CORRUPT
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Can anybody let me know how to get block size back into the running system
? I want data_brk files back into the directory data ? I want the running
filesystem should start it reading .
$ sudo ls -l /mnt/san1/hdfs/hdfs/dfs/
total 16
drwx------. 3 hdfs hdfs 4096 Mar 1 12:50 data
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 data_brk
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 12:50 name
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 13:04 namesecondary
Thanks,
On Sat, Mar 2, 2013 at 2:31 AM, Mohit Vadhera
<pr...@gmail.com>wrote:
> Hi,
>
> I solved this problem by running command " hadoop fsck / -delete" . As I
> written in my email that partial data has been moved and remaining is not
> moved. Can i merge the data again . Below are directories. How can i sure
> the hadoop cluster is running fine . Is there any way to verify ?
>
> # ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
> total 8
> drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
> -rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
>
>
> Data that is not
> # ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
> total 4
> drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
>
> size
> # sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
> 171G /mnt/san1/hdfs/hdfs/dfs/data
> 30G /mnt/san1/hdfs/hdfs/dfs/data_brk
> 411M /mnt/san1/hdfs/hdfs/dfs/name
> 8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
>
> Thanks,
>
>
>
>
> On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> Hi Mohit,
>>
>> Is your replication factor really setup to 1?
>>
>> "Default replication factor: 1"
>>
>> Also, can you look into you data directories and ensure you always
>> have the right structur and all the related META files?
>>
>> JM
>>
>> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
>> > Hi,
>> >
>> > While moving the data my data folder didn't move successfully. Now while
>> > running the FSCK i get the file system is corrupt. Can anybody help me
>> at
>> > the earliest please. I shall be thankful
>> >
>> > $ sudo - hdfs hadoop fsck /
>> >
>> > -----------------------------
>> > -------------------------
>> >
>> > ...Status: CORRUPT
>> > Total size: 739698399117 B
>> > Total dirs: 2179
>> > Total files: 9064 (Files currently being written: 1)
>> > Total blocks (validated): 17060 (avg. block size 43358640 B)
>> > ********************************
>> > CORRUPT FILES: 4
>> > CORRUPT BLOCKS: 4
>> > ********************************
>> > Minimally replicated blocks: 17060 (100.0 %)
>> > Over-replicated blocks: 0 (0.0 %)
>> > Under-replicated blocks: 232 (1.3599062 %)
>> > Mis-replicated blocks: 0 (0.0 %)
>> > Default replication factor: 1
>> > Average block replication: 1.0
>> > Corrupt blocks: 4
>> > Missing replicas: 2088 (10.904533 %)
>> > Number of data-nodes: 1
>> > Number of racks: 1
>> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>> >
>> >
>> > The filesystem under path '/' is CORRUPT
>> >
>>
>
>
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Can anybody let me know how to get block size back into the running system
? I want data_brk files back into the directory data ? I want the running
filesystem should start it reading .
$ sudo ls -l /mnt/san1/hdfs/hdfs/dfs/
total 16
drwx------. 3 hdfs hdfs 4096 Mar 1 12:50 data
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 data_brk
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 12:50 name
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 13:04 namesecondary
Thanks,
On Sat, Mar 2, 2013 at 2:31 AM, Mohit Vadhera
<pr...@gmail.com>wrote:
> Hi,
>
> I solved this problem by running command " hadoop fsck / -delete" . As I
> written in my email that partial data has been moved and remaining is not
> moved. Can i merge the data again . Below are directories. How can i sure
> the hadoop cluster is running fine . Is there any way to verify ?
>
> # ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
> total 8
> drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
> -rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
>
>
> Data that is not
> # ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
> total 4
> drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
>
> size
> # sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
> 171G /mnt/san1/hdfs/hdfs/dfs/data
> 30G /mnt/san1/hdfs/hdfs/dfs/data_brk
> 411M /mnt/san1/hdfs/hdfs/dfs/name
> 8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
>
> Thanks,
>
>
>
>
> On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> Hi Mohit,
>>
>> Is your replication factor really setup to 1?
>>
>> "Default replication factor: 1"
>>
>> Also, can you look into you data directories and ensure you always
>> have the right structur and all the related META files?
>>
>> JM
>>
>> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
>> > Hi,
>> >
>> > While moving the data my data folder didn't move successfully. Now while
>> > running the FSCK i get the file system is corrupt. Can anybody help me
>> at
>> > the earliest please. I shall be thankful
>> >
>> > $ sudo - hdfs hadoop fsck /
>> >
>> > -----------------------------
>> > -------------------------
>> >
>> > ...Status: CORRUPT
>> > Total size: 739698399117 B
>> > Total dirs: 2179
>> > Total files: 9064 (Files currently being written: 1)
>> > Total blocks (validated): 17060 (avg. block size 43358640 B)
>> > ********************************
>> > CORRUPT FILES: 4
>> > CORRUPT BLOCKS: 4
>> > ********************************
>> > Minimally replicated blocks: 17060 (100.0 %)
>> > Over-replicated blocks: 0 (0.0 %)
>> > Under-replicated blocks: 232 (1.3599062 %)
>> > Mis-replicated blocks: 0 (0.0 %)
>> > Default replication factor: 1
>> > Average block replication: 1.0
>> > Corrupt blocks: 4
>> > Missing replicas: 2088 (10.904533 %)
>> > Number of data-nodes: 1
>> > Number of racks: 1
>> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>> >
>> >
>> > The filesystem under path '/' is CORRUPT
>> >
>>
>
>
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Can anybody let me know how to get block size back into the running system
? I want data_brk files back into the directory data ? I want the running
filesystem should start it reading .
$ sudo ls -l /mnt/san1/hdfs/hdfs/dfs/
total 16
drwx------. 3 hdfs hdfs 4096 Mar 1 12:50 data
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 data_brk
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 12:50 name
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 13:04 namesecondary
Thanks,
On Sat, Mar 2, 2013 at 2:31 AM, Mohit Vadhera
<pr...@gmail.com>wrote:
> Hi,
>
> I solved this problem by running command " hadoop fsck / -delete" . As I
> written in my email that partial data has been moved and remaining is not
> moved. Can i merge the data again . Below are directories. How can i sure
> the hadoop cluster is running fine . Is there any way to verify ?
>
> # ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
> total 8
> drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
> -rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
>
>
> Data that is not
> # ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
> total 4
> drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
>
> size
> # sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
> 171G /mnt/san1/hdfs/hdfs/dfs/data
> 30G /mnt/san1/hdfs/hdfs/dfs/data_brk
> 411M /mnt/san1/hdfs/hdfs/dfs/name
> 8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
>
> Thanks,
>
>
>
>
> On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> Hi Mohit,
>>
>> Is your replication factor really setup to 1?
>>
>> "Default replication factor: 1"
>>
>> Also, can you look into you data directories and ensure you always
>> have the right structur and all the related META files?
>>
>> JM
>>
>> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
>> > Hi,
>> >
>> > While moving the data my data folder didn't move successfully. Now while
>> > running the FSCK i get the file system is corrupt. Can anybody help me
>> at
>> > the earliest please. I shall be thankful
>> >
>> > $ sudo - hdfs hadoop fsck /
>> >
>> > -----------------------------
>> > -------------------------
>> >
>> > ...Status: CORRUPT
>> > Total size: 739698399117 B
>> > Total dirs: 2179
>> > Total files: 9064 (Files currently being written: 1)
>> > Total blocks (validated): 17060 (avg. block size 43358640 B)
>> > ********************************
>> > CORRUPT FILES: 4
>> > CORRUPT BLOCKS: 4
>> > ********************************
>> > Minimally replicated blocks: 17060 (100.0 %)
>> > Over-replicated blocks: 0 (0.0 %)
>> > Under-replicated blocks: 232 (1.3599062 %)
>> > Mis-replicated blocks: 0 (0.0 %)
>> > Default replication factor: 1
>> > Average block replication: 1.0
>> > Corrupt blocks: 4
>> > Missing replicas: 2088 (10.904533 %)
>> > Number of data-nodes: 1
>> > Number of racks: 1
>> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>> >
>> >
>> > The filesystem under path '/' is CORRUPT
>> >
>>
>
>
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Can anybody let me know how to get block size back into the running system
? I want data_brk files back into the directory data ? I want the running
filesystem should start it reading .
$ sudo ls -l /mnt/san1/hdfs/hdfs/dfs/
total 16
drwx------. 3 hdfs hdfs 4096 Mar 1 12:50 data
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 data_brk
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 12:50 name
drwxr-xr-x 3 hdfs hdfs 4096 Mar 1 13:04 namesecondary
Thanks,
On Sat, Mar 2, 2013 at 2:31 AM, Mohit Vadhera
<pr...@gmail.com>wrote:
> Hi,
>
> I solved this problem by running command " hadoop fsck / -delete" . As I
> written in my email that partial data has been moved and remaining is not
> moved. Can i merge the data again . Below are directories. How can i sure
> the hadoop cluster is running fine . Is there any way to verify ?
>
> # ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
> total 8
> drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
> -rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
>
>
> Data that is not
> # ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
> total 4
> drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
>
> size
> # sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
> 171G /mnt/san1/hdfs/hdfs/dfs/data
> 30G /mnt/san1/hdfs/hdfs/dfs/data_brk
> 411M /mnt/san1/hdfs/hdfs/dfs/name
> 8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
>
> Thanks,
>
>
>
>
> On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> Hi Mohit,
>>
>> Is your replication factor really setup to 1?
>>
>> "Default replication factor: 1"
>>
>> Also, can you look into you data directories and ensure you always
>> have the right structur and all the related META files?
>>
>> JM
>>
>> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
>> > Hi,
>> >
>> > While moving the data my data folder didn't move successfully. Now while
>> > running the FSCK i get the file system is corrupt. Can anybody help me
>> at
>> > the earliest please. I shall be thankful
>> >
>> > $ sudo - hdfs hadoop fsck /
>> >
>> > -----------------------------
>> > -------------------------
>> >
>> > ...Status: CORRUPT
>> > Total size: 739698399117 B
>> > Total dirs: 2179
>> > Total files: 9064 (Files currently being written: 1)
>> > Total blocks (validated): 17060 (avg. block size 43358640 B)
>> > ********************************
>> > CORRUPT FILES: 4
>> > CORRUPT BLOCKS: 4
>> > ********************************
>> > Minimally replicated blocks: 17060 (100.0 %)
>> > Over-replicated blocks: 0 (0.0 %)
>> > Under-replicated blocks: 232 (1.3599062 %)
>> > Mis-replicated blocks: 0 (0.0 %)
>> > Default replication factor: 1
>> > Average block replication: 1.0
>> > Corrupt blocks: 4
>> > Missing replicas: 2088 (10.904533 %)
>> > Number of data-nodes: 1
>> > Number of racks: 1
>> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>> >
>> >
>> > The filesystem under path '/' is CORRUPT
>> >
>>
>
>
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Hi,
I solved this problem by running command " hadoop fsck / -delete" . As I
written in my email that partial data has been moved and remaining is not
moved. Can i merge the data again . Below are directories. How can i sure
the hadoop cluster is running fine . Is there any way to verify ?
# ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
total 8
drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
-rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
Data that is not
# ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
total 4
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
size
# sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
171G /mnt/san1/hdfs/hdfs/dfs/data
30G /mnt/san1/hdfs/hdfs/dfs/data_brk
411M /mnt/san1/hdfs/hdfs/dfs/name
8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
Thanks,
On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> Hi Mohit,
>
> Is your replication factor really setup to 1?
>
> "Default replication factor: 1"
>
> Also, can you look into you data directories and ensure you always
> have the right structur and all the related META files?
>
> JM
>
> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> > Hi,
> >
> > While moving the data my data folder didn't move successfully. Now while
> > running the FSCK i get the file system is corrupt. Can anybody help me at
> > the earliest please. I shall be thankful
> >
> > $ sudo - hdfs hadoop fsck /
> >
> > -----------------------------
> > -------------------------
> >
> > ...Status: CORRUPT
> > Total size: 739698399117 B
> > Total dirs: 2179
> > Total files: 9064 (Files currently being written: 1)
> > Total blocks (validated): 17060 (avg. block size 43358640 B)
> > ********************************
> > CORRUPT FILES: 4
> > CORRUPT BLOCKS: 4
> > ********************************
> > Minimally replicated blocks: 17060 (100.0 %)
> > Over-replicated blocks: 0 (0.0 %)
> > Under-replicated blocks: 232 (1.3599062 %)
> > Mis-replicated blocks: 0 (0.0 %)
> > Default replication factor: 1
> > Average block replication: 1.0
> > Corrupt blocks: 4
> > Missing replicas: 2088 (10.904533 %)
> > Number of data-nodes: 1
> > Number of racks: 1
> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
> >
> >
> > The filesystem under path '/' is CORRUPT
> >
>
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Hi,
I solved this problem by running command " hadoop fsck / -delete" . As I
written in my email that partial data has been moved and remaining is not
moved. Can i merge the data again . Below are directories. How can i sure
the hadoop cluster is running fine . Is there any way to verify ?
# ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
total 8
drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
-rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
Data that is not
# ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
total 4
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
size
# sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
171G /mnt/san1/hdfs/hdfs/dfs/data
30G /mnt/san1/hdfs/hdfs/dfs/data_brk
411M /mnt/san1/hdfs/hdfs/dfs/name
8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
Thanks,
On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> Hi Mohit,
>
> Is your replication factor really setup to 1?
>
> "Default replication factor: 1"
>
> Also, can you look into you data directories and ensure you always
> have the right structur and all the related META files?
>
> JM
>
> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> > Hi,
> >
> > While moving the data my data folder didn't move successfully. Now while
> > running the FSCK i get the file system is corrupt. Can anybody help me at
> > the earliest please. I shall be thankful
> >
> > $ sudo - hdfs hadoop fsck /
> >
> > -----------------------------
> > -------------------------
> >
> > ...Status: CORRUPT
> > Total size: 739698399117 B
> > Total dirs: 2179
> > Total files: 9064 (Files currently being written: 1)
> > Total blocks (validated): 17060 (avg. block size 43358640 B)
> > ********************************
> > CORRUPT FILES: 4
> > CORRUPT BLOCKS: 4
> > ********************************
> > Minimally replicated blocks: 17060 (100.0 %)
> > Over-replicated blocks: 0 (0.0 %)
> > Under-replicated blocks: 232 (1.3599062 %)
> > Mis-replicated blocks: 0 (0.0 %)
> > Default replication factor: 1
> > Average block replication: 1.0
> > Corrupt blocks: 4
> > Missing replicas: 2088 (10.904533 %)
> > Number of data-nodes: 1
> > Number of racks: 1
> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
> >
> >
> > The filesystem under path '/' is CORRUPT
> >
>
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Hi,
I solved this problem by running command " hadoop fsck / -delete" . As I
written in my email that partial data has been moved and remaining is not
moved. Can i merge the data again . Below are directories. How can i sure
the hadoop cluster is running fine . Is there any way to verify ?
# ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
total 8
drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
-rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
Data that is not
# ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
total 4
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
size
# sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
171G /mnt/san1/hdfs/hdfs/dfs/data
30G /mnt/san1/hdfs/hdfs/dfs/data_brk
411M /mnt/san1/hdfs/hdfs/dfs/name
8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
Thanks,
On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> Hi Mohit,
>
> Is your replication factor really setup to 1?
>
> "Default replication factor: 1"
>
> Also, can you look into you data directories and ensure you always
> have the right structur and all the related META files?
>
> JM
>
> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> > Hi,
> >
> > While moving the data my data folder didn't move successfully. Now while
> > running the FSCK i get the file system is corrupt. Can anybody help me at
> > the earliest please. I shall be thankful
> >
> > $ sudo - hdfs hadoop fsck /
> >
> > -----------------------------
> > -------------------------
> >
> > ...Status: CORRUPT
> > Total size: 739698399117 B
> > Total dirs: 2179
> > Total files: 9064 (Files currently being written: 1)
> > Total blocks (validated): 17060 (avg. block size 43358640 B)
> > ********************************
> > CORRUPT FILES: 4
> > CORRUPT BLOCKS: 4
> > ********************************
> > Minimally replicated blocks: 17060 (100.0 %)
> > Over-replicated blocks: 0 (0.0 %)
> > Under-replicated blocks: 232 (1.3599062 %)
> > Mis-replicated blocks: 0 (0.0 %)
> > Default replication factor: 1
> > Average block replication: 1.0
> > Corrupt blocks: 4
> > Missing replicas: 2088 (10.904533 %)
> > Number of data-nodes: 1
> > Number of racks: 1
> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
> >
> >
> > The filesystem under path '/' is CORRUPT
> >
>
Re: hadoop filesystem corrupt
Posted by Mohit Vadhera <pr...@gmail.com>.
Hi,
I solved this problem by running command " hadoop fsck / -delete" . As I
written in my email that partial data has been moved and remaining is not
moved. Can i merge the data again . Below are directories. How can i sure
the hadoop cluster is running fine . Is there any way to verify ?
# ll /var/lib/cache/hdfs/hdfs/dfs/data (running data)
total 8
drwxr-xr-x. 3 hdfs hdfs 4096 Dec 27 13:31 current
-rw-r--r-- 1 hdfs hdfs 29 Mar 1 12:50 in_use.lock
Data that is not
# ll /var/lib/cache/hdfs/hdfs/dfs/data_brk/ old data
total 4
drwx------ 3 hdfs hdfs 4096 Mar 1 12:20 current
size
# sudo du -sh /var/lib/cache/hdfs/hdfs/dfs/*
171G /mnt/san1/hdfs/hdfs/dfs/data
30G /mnt/san1/hdfs/hdfs/dfs/data_brk
411M /mnt/san1/hdfs/hdfs/dfs/name
8.0K /mnt/san1/hdfs/hdfs/dfs/namesecondary
Thanks,
On Sat, Mar 2, 2013 at 1:02 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> Hi Mohit,
>
> Is your replication factor really setup to 1?
>
> "Default replication factor: 1"
>
> Also, can you look into you data directories and ensure you always
> have the right structur and all the related META files?
>
> JM
>
> 2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> > Hi,
> >
> > While moving the data my data folder didn't move successfully. Now while
> > running the FSCK i get the file system is corrupt. Can anybody help me at
> > the earliest please. I shall be thankful
> >
> > $ sudo - hdfs hadoop fsck /
> >
> > -----------------------------
> > -------------------------
> >
> > ...Status: CORRUPT
> > Total size: 739698399117 B
> > Total dirs: 2179
> > Total files: 9064 (Files currently being written: 1)
> > Total blocks (validated): 17060 (avg. block size 43358640 B)
> > ********************************
> > CORRUPT FILES: 4
> > CORRUPT BLOCKS: 4
> > ********************************
> > Minimally replicated blocks: 17060 (100.0 %)
> > Over-replicated blocks: 0 (0.0 %)
> > Under-replicated blocks: 232 (1.3599062 %)
> > Mis-replicated blocks: 0 (0.0 %)
> > Default replication factor: 1
> > Average block replication: 1.0
> > Corrupt blocks: 4
> > Missing replicas: 2088 (10.904533 %)
> > Number of data-nodes: 1
> > Number of racks: 1
> > FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
> >
> >
> > The filesystem under path '/' is CORRUPT
> >
>
Re: hadoop filesystem corrupt
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Mohit,
Is your replication factor really setup to 1?
"Default replication factor: 1"
Also, can you look into you data directories and ensure you always
have the right structur and all the related META files?
JM
2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> Hi,
>
> While moving the data my data folder didn't move successfully. Now while
> running the FSCK i get the file system is corrupt. Can anybody help me at
> the earliest please. I shall be thankful
>
> $ sudo - hdfs hadoop fsck /
>
> -----------------------------
> -------------------------
>
> ...Status: CORRUPT
> Total size: 739698399117 B
> Total dirs: 2179
> Total files: 9064 (Files currently being written: 1)
> Total blocks (validated): 17060 (avg. block size 43358640 B)
> ********************************
> CORRUPT FILES: 4
> CORRUPT BLOCKS: 4
> ********************************
> Minimally replicated blocks: 17060 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 232 (1.3599062 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 4
> Missing replicas: 2088 (10.904533 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>
>
> The filesystem under path '/' is CORRUPT
>
RE: hadoop filesystem corrupt
Posted by Michael Namaiandeh <mn...@healthcit.com>.
Mohit,
Take a look at this article:
http://www.kernelhardware.org/how-should-run-fsck-linux-file-system/
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, March 01, 2013 1:52 PM
To: <us...@hadoop.apache.org>
Subject: hadoop filesystem corrupt
Hi,
While moving the data my data folder didn't move successfully. Now while running the FSCK i get the file system is corrupt. Can anybody help me at the earliest please. I shall be thankful
$ sudo - hdfs hadoop fsck /
-----------------------------
-------------------------
...Status: CORRUPT
Total size: 739698399117 B
Total dirs: 2179
Total files: 9064 (Files currently being written: 1)
Total blocks (validated): 17060 (avg. block size 43358640 B)
********************************
CORRUPT FILES: 4
CORRUPT BLOCKS: 4
********************************
Minimally replicated blocks: 17060 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 232 (1.3599062 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 4
Missing replicas: 2088 (10.904533 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
The filesystem under path '/' is CORRUPT
Re: hadoop filesystem corrupt
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Mohit,
Is your replication factor really setup to 1?
"Default replication factor: 1"
Also, can you look into you data directories and ensure you always
have the right structur and all the related META files?
JM
2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> Hi,
>
> While moving the data my data folder didn't move successfully. Now while
> running the FSCK i get the file system is corrupt. Can anybody help me at
> the earliest please. I shall be thankful
>
> $ sudo - hdfs hadoop fsck /
>
> -----------------------------
> -------------------------
>
> ...Status: CORRUPT
> Total size: 739698399117 B
> Total dirs: 2179
> Total files: 9064 (Files currently being written: 1)
> Total blocks (validated): 17060 (avg. block size 43358640 B)
> ********************************
> CORRUPT FILES: 4
> CORRUPT BLOCKS: 4
> ********************************
> Minimally replicated blocks: 17060 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 232 (1.3599062 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 4
> Missing replicas: 2088 (10.904533 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>
>
> The filesystem under path '/' is CORRUPT
>
Re: hadoop filesystem corrupt
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Mohit,
Is your replication factor really setup to 1?
"Default replication factor: 1"
Also, can you look into you data directories and ensure you always
have the right structur and all the related META files?
JM
2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> Hi,
>
> While moving the data my data folder didn't move successfully. Now while
> running the FSCK i get the file system is corrupt. Can anybody help me at
> the earliest please. I shall be thankful
>
> $ sudo - hdfs hadoop fsck /
>
> -----------------------------
> -------------------------
>
> ...Status: CORRUPT
> Total size: 739698399117 B
> Total dirs: 2179
> Total files: 9064 (Files currently being written: 1)
> Total blocks (validated): 17060 (avg. block size 43358640 B)
> ********************************
> CORRUPT FILES: 4
> CORRUPT BLOCKS: 4
> ********************************
> Minimally replicated blocks: 17060 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 232 (1.3599062 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 4
> Missing replicas: 2088 (10.904533 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>
>
> The filesystem under path '/' is CORRUPT
>
RE: hadoop filesystem corrupt
Posted by Michael Namaiandeh <mn...@healthcit.com>.
Mohit,
Take a look at this article:
http://www.kernelhardware.org/how-should-run-fsck-linux-file-system/
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, March 01, 2013 1:52 PM
To: <us...@hadoop.apache.org>
Subject: hadoop filesystem corrupt
Hi,
While moving the data my data folder didn't move successfully. Now while running the FSCK i get the file system is corrupt. Can anybody help me at the earliest please. I shall be thankful
$ sudo - hdfs hadoop fsck /
-----------------------------
-------------------------
...Status: CORRUPT
Total size: 739698399117 B
Total dirs: 2179
Total files: 9064 (Files currently being written: 1)
Total blocks (validated): 17060 (avg. block size 43358640 B)
********************************
CORRUPT FILES: 4
CORRUPT BLOCKS: 4
********************************
Minimally replicated blocks: 17060 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 232 (1.3599062 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 4
Missing replicas: 2088 (10.904533 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
The filesystem under path '/' is CORRUPT
RE: hadoop filesystem corrupt
Posted by Michael Namaiandeh <mn...@healthcit.com>.
Mohit,
Take a look at this article:
http://www.kernelhardware.org/how-should-run-fsck-linux-file-system/
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, March 01, 2013 1:52 PM
To: <us...@hadoop.apache.org>
Subject: hadoop filesystem corrupt
Hi,
While moving the data my data folder didn't move successfully. Now while running the FSCK i get the file system is corrupt. Can anybody help me at the earliest please. I shall be thankful
$ sudo - hdfs hadoop fsck /
-----------------------------
-------------------------
...Status: CORRUPT
Total size: 739698399117 B
Total dirs: 2179
Total files: 9064 (Files currently being written: 1)
Total blocks (validated): 17060 (avg. block size 43358640 B)
********************************
CORRUPT FILES: 4
CORRUPT BLOCKS: 4
********************************
Minimally replicated blocks: 17060 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 232 (1.3599062 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 4
Missing replicas: 2088 (10.904533 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
The filesystem under path '/' is CORRUPT
RE: hadoop filesystem corrupt
Posted by Michael Namaiandeh <mn...@healthcit.com>.
Mohit,
Take a look at this article:
http://www.kernelhardware.org/how-should-run-fsck-linux-file-system/
From: Mohit Vadhera [mailto:project.linux.proj@gmail.com]
Sent: Friday, March 01, 2013 1:52 PM
To: <us...@hadoop.apache.org>
Subject: hadoop filesystem corrupt
Hi,
While moving the data my data folder didn't move successfully. Now while running the FSCK i get the file system is corrupt. Can anybody help me at the earliest please. I shall be thankful
$ sudo - hdfs hadoop fsck /
-----------------------------
-------------------------
...Status: CORRUPT
Total size: 739698399117 B
Total dirs: 2179
Total files: 9064 (Files currently being written: 1)
Total blocks (validated): 17060 (avg. block size 43358640 B)
********************************
CORRUPT FILES: 4
CORRUPT BLOCKS: 4
********************************
Minimally replicated blocks: 17060 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 232 (1.3599062 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Corrupt blocks: 4
Missing replicas: 2088 (10.904533 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
The filesystem under path '/' is CORRUPT
Re: hadoop filesystem corrupt
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Mohit,
Is your replication factor really setup to 1?
"Default replication factor: 1"
Also, can you look into you data directories and ensure you always
have the right structur and all the related META files?
JM
2013/3/1 Mohit Vadhera <pr...@gmail.com>:
> Hi,
>
> While moving the data my data folder didn't move successfully. Now while
> running the FSCK i get the file system is corrupt. Can anybody help me at
> the earliest please. I shall be thankful
>
> $ sudo - hdfs hadoop fsck /
>
> -----------------------------
> -------------------------
>
> ...Status: CORRUPT
> Total size: 739698399117 B
> Total dirs: 2179
> Total files: 9064 (Files currently being written: 1)
> Total blocks (validated): 17060 (avg. block size 43358640 B)
> ********************************
> CORRUPT FILES: 4
> CORRUPT BLOCKS: 4
> ********************************
> Minimally replicated blocks: 17060 (100.0 %)
> Over-replicated blocks: 0 (0.0 %)
> Under-replicated blocks: 232 (1.3599062 %)
> Mis-replicated blocks: 0 (0.0 %)
> Default replication factor: 1
> Average block replication: 1.0
> Corrupt blocks: 4
> Missing replicas: 2088 (10.904533 %)
> Number of data-nodes: 1
> Number of racks: 1
> FSCK ended at Fri Mar 01 13:56:41 EST 2013 in 509 milliseconds
>
>
> The filesystem under path '/' is CORRUPT
>