You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Yabo Xu <ar...@gmail.com> on 2012/05/06 07:13:39 UTC
Failed to apply HBASE-5128 on v0.90.6
Hi all:
We are trying to repair some of the corrupted regions from earlier data
migration. To be specific, we have many regions with .regioninfo corrupted.
We manually removed those corrupted regions, and attempt to fix the
ROOT/META by running OfflineMetaRepair. It reports there are many holes
discovered with messages as below:
> p|2b8ad6458052eca8bd78012b41bc6533|165148928|web|
> f3a13d30730ef68fae0f1355ff436872 and p|3e8997c536a88039549cb8a2963d5d
> 83|232368128|web|6776c73f7429fe85ef7932221bf60a07. You need to create a
> new regioninfo and region dir in hdfs to plug the hole.
Another search leads us to
HBASE-5128<https://issues.apache.org/jira/browse/HBASE-5128> ,
a HBaseFsck patch that seems to be exactly what we want. When we try to
apply the patch, it has the following confilcts. FYI: our hadoop/hbase
version is 0.20.2/0.90.6. Did we do anything wrong or there is just no
patch for 0.90.6 and we have to make our own?
patching file
> src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.javaHunk #1
> FAILED at 175.Hunk #2 succeeded at 185 with fuzz 1 (offset -12 lines).1 out
> of 2 hunks FAILED -- saving rejects to file
> src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java.rejpatching
> file
> src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.javaHunk #1
> FAILED at 133.1 out of 2 hunks FAILED -- saving rejects to file
> src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java.rejpatching
> file src/main/java/org/apache/hadoop/hbase/master/HMaster.javaHunk #1
> succeeded at 1085 (offset -1 lines).Hunk #2 FAILED at 1123.1 out of 2 hunks
> FAILED -- saving rejects to file
> src/main/java/org/apache/hadoop/hbase/master/HMaster.java.rejpatching file
> src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.javapatching file
> src/main/java/org/apache/hadoop/hbase/util/HBaseFsckRepair.javapatching
> file
> src/main/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRepair.javapatching
> file
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandler.javapatching
> file
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandlerImpl.javapatching
> file src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.javapatching
> file src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.javapatching
> file
> src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckComparator.javapatching
> file
> src/test/java/org/apache/hadoop/hbase/util/hbck/HbckTestingUtil.javapatching
> file
> src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
Best,
Arber
Re: Failed to apply HBASE-5128 on v0.90.6
Posted by Yabo Xu <ar...@gmail.com>.
Thanks, Ted & Jimmy. Eventually we manually correct the patch and fix the
problem.
PS. There are quite a few bugs in the aforementioned patch though. Will
check if it is fixed in later version after we meet the current deadline.
Best,
Arber
On Mon, May 7, 2012 at 12:24 AM, Jimmy Xiang <jx...@cloudera.com> wrote:
> You don't need to apply this patch to fix your problem. To use the
> enhanced hbck in 0.90, you can
> get the latest in 0.90, and build the hbase jar file, then make a copy of
> your own hbase home,
> replace the hbase jar in your copy of your hbase home with the hbase jar
> you just built from latest
> 0.90. Now you can use the enhanced hbck, while your existing installed
> code is not changed.
>
> Thanks,
> Jimmy
>
> On Sun, May 6, 2012 at 7:14 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > Can you pastebin the contents of .rejpatching files ?
> >
> > Cheers
> >
> > On Sat, May 5, 2012 at 10:13 PM, Yabo Xu <ar...@gmail.com>
> wrote:
> >
> > > Hi all:
> > >
> > > We are trying to repair some of the corrupted regions from earlier data
> > > migration. To be specific, we have many regions with .regioninfo
> > corrupted.
> > >
> > > We manually removed those corrupted regions, and attempt to fix the
> > > ROOT/META by running OfflineMetaRepair. It reports there are many holes
> > > discovered with messages as below:
> > >
> > > > p|2b8ad6458052eca8bd78012b41bc6533|165148928|web|
> > > > f3a13d30730ef68fae0f1355ff436872 and p|3e8997c536a88039549cb8a2963d5d
> > > > 83|232368128|web|6776c73f7429fe85ef7932221bf60a07. You need to
> create
> > a
> > > > new regioninfo and region dir in hdfs to plug the hole.
> > >
> > >
> > > Another search leads us to
> > > HBASE-5128<https://issues.apache.org/jira/browse/HBASE-5128> ,
> > > a HBaseFsck patch that seems to be exactly what we want. When we try to
> > > apply the patch, it has the following confilcts. FYI: our hadoop/hbase
> > > version is 0.20.2/0.90.6. Did we do anything wrong or there is just no
> > > patch for 0.90.6 and we have to make our own?
> > >
> > > patching file
> > > > src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.javaHunk
> #1
> > > > FAILED at 175.Hunk #2 succeeded at 185 with fuzz 1 (offset -12
> lines).1
> > > out
> > > > of 2 hunks FAILED -- saving rejects to file
> > > >
> > >
> >
> src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java.rejpatching
> > > > file
> > > >
> src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.javaHunk
> > > #1
> > > > FAILED at 133.1 out of 2 hunks FAILED -- saving rejects to file
> > > >
> > >
> >
> src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java.rejpatching
> > > > file src/main/java/org/apache/hadoop/hbase/master/HMaster.javaHunk #1
> > > > succeeded at 1085 (offset -1 lines).Hunk #2 FAILED at 1123.1 out of 2
> > > hunks
> > > > FAILED -- saving rejects to file
> > > > src/main/java/org/apache/hadoop/hbase/master/HMaster.java.rejpatching
> > > file
> > > > src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.javapatching
> file
> > > >
> src/main/java/org/apache/hadoop/hbase/util/HBaseFsckRepair.javapatching
> > > > file
> > > >
> > >
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRepair.javapatching
> > > > file
> > > >
> > >
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandler.javapatching
> > > > file
> > > >
> > >
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandlerImpl.javapatching
> > > > file
> > > src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.javapatching
> > > > file
> > > src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.javapatching
> > > > file
> > > >
> > >
> >
> src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckComparator.javapatching
> > > > file
> > > >
> > >
> >
> src/test/java/org/apache/hadoop/hbase/util/hbck/HbckTestingUtil.javapatching
> > > > file
> > > >
> > >
> >
> src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
> > >
> > >
> > >
> > > Best,
> > > Arber
> > >
> >
>
Re: Failed to apply HBASE-5128 on v0.90.6
Posted by Jimmy Xiang <jx...@cloudera.com>.
You don't need to apply this patch to fix your problem. To use the
enhanced hbck in 0.90, you can
get the latest in 0.90, and build the hbase jar file, then make a copy of
your own hbase home,
replace the hbase jar in your copy of your hbase home with the hbase jar
you just built from latest
0.90. Now you can use the enhanced hbck, while your existing installed
code is not changed.
Thanks,
Jimmy
On Sun, May 6, 2012 at 7:14 AM, Ted Yu <yu...@gmail.com> wrote:
> Can you pastebin the contents of .rejpatching files ?
>
> Cheers
>
> On Sat, May 5, 2012 at 10:13 PM, Yabo Xu <ar...@gmail.com> wrote:
>
> > Hi all:
> >
> > We are trying to repair some of the corrupted regions from earlier data
> > migration. To be specific, we have many regions with .regioninfo
> corrupted.
> >
> > We manually removed those corrupted regions, and attempt to fix the
> > ROOT/META by running OfflineMetaRepair. It reports there are many holes
> > discovered with messages as below:
> >
> > > p|2b8ad6458052eca8bd78012b41bc6533|165148928|web|
> > > f3a13d30730ef68fae0f1355ff436872 and p|3e8997c536a88039549cb8a2963d5d
> > > 83|232368128|web|6776c73f7429fe85ef7932221bf60a07. You need to create
> a
> > > new regioninfo and region dir in hdfs to plug the hole.
> >
> >
> > Another search leads us to
> > HBASE-5128<https://issues.apache.org/jira/browse/HBASE-5128> ,
> > a HBaseFsck patch that seems to be exactly what we want. When we try to
> > apply the patch, it has the following confilcts. FYI: our hadoop/hbase
> > version is 0.20.2/0.90.6. Did we do anything wrong or there is just no
> > patch for 0.90.6 and we have to make our own?
> >
> > patching file
> > > src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.javaHunk #1
> > > FAILED at 175.Hunk #2 succeeded at 185 with fuzz 1 (offset -12 lines).1
> > out
> > > of 2 hunks FAILED -- saving rejects to file
> > >
> >
> src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java.rejpatching
> > > file
> > > src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.javaHunk
> > #1
> > > FAILED at 133.1 out of 2 hunks FAILED -- saving rejects to file
> > >
> >
> src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java.rejpatching
> > > file src/main/java/org/apache/hadoop/hbase/master/HMaster.javaHunk #1
> > > succeeded at 1085 (offset -1 lines).Hunk #2 FAILED at 1123.1 out of 2
> > hunks
> > > FAILED -- saving rejects to file
> > > src/main/java/org/apache/hadoop/hbase/master/HMaster.java.rejpatching
> > file
> > > src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.javapatching file
> > > src/main/java/org/apache/hadoop/hbase/util/HBaseFsckRepair.javapatching
> > > file
> > >
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRepair.javapatching
> > > file
> > >
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandler.javapatching
> > > file
> > >
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandlerImpl.javapatching
> > > file
> > src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.javapatching
> > > file
> > src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.javapatching
> > > file
> > >
> >
> src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckComparator.javapatching
> > > file
> > >
> >
> src/test/java/org/apache/hadoop/hbase/util/hbck/HbckTestingUtil.javapatching
> > > file
> > >
> >
> src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
> >
> >
> >
> > Best,
> > Arber
> >
>
Re: Failed to apply HBASE-5128 on v0.90.6
Posted by Ted Yu <yu...@gmail.com>.
Can you pastebin the contents of .rejpatching files ?
Cheers
On Sat, May 5, 2012 at 10:13 PM, Yabo Xu <ar...@gmail.com> wrote:
> Hi all:
>
> We are trying to repair some of the corrupted regions from earlier data
> migration. To be specific, we have many regions with .regioninfo corrupted.
>
> We manually removed those corrupted regions, and attempt to fix the
> ROOT/META by running OfflineMetaRepair. It reports there are many holes
> discovered with messages as below:
>
> > p|2b8ad6458052eca8bd78012b41bc6533|165148928|web|
> > f3a13d30730ef68fae0f1355ff436872 and p|3e8997c536a88039549cb8a2963d5d
> > 83|232368128|web|6776c73f7429fe85ef7932221bf60a07. You need to create a
> > new regioninfo and region dir in hdfs to plug the hole.
>
>
> Another search leads us to
> HBASE-5128<https://issues.apache.org/jira/browse/HBASE-5128> ,
> a HBaseFsck patch that seems to be exactly what we want. When we try to
> apply the patch, it has the following confilcts. FYI: our hadoop/hbase
> version is 0.20.2/0.90.6. Did we do anything wrong or there is just no
> patch for 0.90.6 and we have to make our own?
>
> patching file
> > src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.javaHunk #1
> > FAILED at 175.Hunk #2 succeeded at 185 with fuzz 1 (offset -12 lines).1
> out
> > of 2 hunks FAILED -- saving rejects to file
> >
> src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java.rejpatching
> > file
> > src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.javaHunk
> #1
> > FAILED at 133.1 out of 2 hunks FAILED -- saving rejects to file
> >
> src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java.rejpatching
> > file src/main/java/org/apache/hadoop/hbase/master/HMaster.javaHunk #1
> > succeeded at 1085 (offset -1 lines).Hunk #2 FAILED at 1123.1 out of 2
> hunks
> > FAILED -- saving rejects to file
> > src/main/java/org/apache/hadoop/hbase/master/HMaster.java.rejpatching
> file
> > src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.javapatching file
> > src/main/java/org/apache/hadoop/hbase/util/HBaseFsckRepair.javapatching
> > file
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRepair.javapatching
> > file
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandler.javapatching
> > file
> >
> src/main/java/org/apache/hadoop/hbase/util/hbck/TableIntegrityErrorHandlerImpl.javapatching
> > file
> src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.javapatching
> > file
> src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.javapatching
> > file
> >
> src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckComparator.javapatching
> > file
> >
> src/test/java/org/apache/hadoop/hbase/util/hbck/HbckTestingUtil.javapatching
> > file
> >
> src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
>
>
>
> Best,
> Arber
>