You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2008/05/28 07:51:45 UTC
[jira] Created: (HBASE-646) EOFException opening HStoreFile info
file (spin on HBASE-645 and 550)
EOFException opening HStoreFile info file (spin on HBASE-645 and 550)
---------------------------------------------------------------------
Key: HBASE-646
URL: https://issues.apache.org/jira/browse/HBASE-646
Project: Hadoop HBase
Issue Type: Bug
Reporter: stack
{code}
2008-05-28 05:46:06,271 ERROR org.apache.hadoop.hbase.HRegionServer: error opening region enwiki_080312_meta,UzbHXtgD-y4ZIUVDJIXXK-==,1207951941241
java.io.EOFException
at java.io.DataInputStream.readByte(Unknown Source)
at org.apache.hadoop.hbase.HStoreFile.loadInfo(HStoreFile.java:298)
at org.apache.hadoop.hbase.HStore.<init>(HStore.java:808)
at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:431)
at org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:1256)
at org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1202)
at java.lang.Thread.run(Unknown Source)
{code}
Lets get rid of info files when we move to new mapfile format.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HBASE-646) EOFException opening HStoreFile info
file (spin on HBASE-645 and 550)
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-646.
-------------------------
Resolution: Fixed
Fix Version/s: 0.2.0
0.1.3
Committed to branch and to trunk.
Will leave 'fixing' of empty info files for another issue -- if they aren't removed altogether meantime.
> EOFException opening HStoreFile info file (spin on HBASE-645 and 550)
> ---------------------------------------------------------------------
>
> Key: HBASE-646
> URL: https://issues.apache.org/jira/browse/HBASE-646
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Fix For: 0.1.3, 0.2.0
>
> Attachments: 646.patch
>
>
> {code}
> 2008-05-28 05:46:06,271 ERROR org.apache.hadoop.hbase.HRegionServer: error opening region enwiki_080312_meta,UzbHXtgD-y4ZIUVDJIXXK-==,1207951941241
> java.io.EOFException
> at java.io.DataInputStream.readByte(Unknown Source)
> at org.apache.hadoop.hbase.HStoreFile.loadInfo(HStoreFile.java:298)
> at org.apache.hadoop.hbase.HStore.<init>(HStore.java:808)
> at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:431)
> at org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:1256)
> at org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1202)
> at java.lang.Thread.run(Unknown Source)
> {code}
> Lets get rid of info files when we move to new mapfile format.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HBASE-646) EOFException opening HStoreFile info
file (spin on HBASE-645 and 550)
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack reassigned HBASE-646:
---------------------------
Assignee: stack
> EOFException opening HStoreFile info file (spin on HBASE-645 and 550)
> ---------------------------------------------------------------------
>
> Key: HBASE-646
> URL: https://issues.apache.org/jira/browse/HBASE-646
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Attachments: 646.patch
>
>
> {code}
> 2008-05-28 05:46:06,271 ERROR org.apache.hadoop.hbase.HRegionServer: error opening region enwiki_080312_meta,UzbHXtgD-y4ZIUVDJIXXK-==,1207951941241
> java.io.EOFException
> at java.io.DataInputStream.readByte(Unknown Source)
> at org.apache.hadoop.hbase.HStoreFile.loadInfo(HStoreFile.java:298)
> at org.apache.hadoop.hbase.HStore.<init>(HStore.java:808)
> at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:431)
> at org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:1256)
> at org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1202)
> at java.lang.Thread.run(Unknown Source)
> {code}
> Lets get rid of info files when we move to new mapfile format.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-646) EOFException opening HStoreFile info
file (spin on HBASE-645 and 550)
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12600529#action_12600529 ]
stack commented on HBASE-646:
-----------------------------
Was trying to figure a repair. If modification times on the mapfiles can be trusted, could calculate a sequence id that had this flush sit in the right chronological slot. If HBASE-647, this issues goes away.
> EOFException opening HStoreFile info file (spin on HBASE-645 and 550)
> ---------------------------------------------------------------------
>
> Key: HBASE-646
> URL: https://issues.apache.org/jira/browse/HBASE-646
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
>
> {code}
> 2008-05-28 05:46:06,271 ERROR org.apache.hadoop.hbase.HRegionServer: error opening region enwiki_080312_meta,UzbHXtgD-y4ZIUVDJIXXK-==,1207951941241
> java.io.EOFException
> at java.io.DataInputStream.readByte(Unknown Source)
> at org.apache.hadoop.hbase.HStoreFile.loadInfo(HStoreFile.java:298)
> at org.apache.hadoop.hbase.HStore.<init>(HStore.java:808)
> at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:431)
> at org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:1256)
> at org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1202)
> at java.lang.Thread.run(Unknown Source)
> {code}
> Lets get rid of info files when we move to new mapfile format.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-646) EOFException opening HStoreFile info
file (spin on HBASE-645 and 550)
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12600556#action_12600556 ]
stack commented on HBASE-646:
-----------------------------
Of note, we had data loss on our hdfs because of a misconfiguration. This is why we've been running into this spate of EOF issues.
> EOFException opening HStoreFile info file (spin on HBASE-645 and 550)
> ---------------------------------------------------------------------
>
> Key: HBASE-646
> URL: https://issues.apache.org/jira/browse/HBASE-646
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Attachments: 646.patch
>
>
> {code}
> 2008-05-28 05:46:06,271 ERROR org.apache.hadoop.hbase.HRegionServer: error opening region enwiki_080312_meta,UzbHXtgD-y4ZIUVDJIXXK-==,1207951941241
> java.io.EOFException
> at java.io.DataInputStream.readByte(Unknown Source)
> at org.apache.hadoop.hbase.HStoreFile.loadInfo(HStoreFile.java:298)
> at org.apache.hadoop.hbase.HStore.<init>(HStore.java:808)
> at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:431)
> at org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:1256)
> at org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1202)
> at java.lang.Thread.run(Unknown Source)
> {code}
> Lets get rid of info files when we move to new mapfile format.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-646) EOFException opening HStoreFile info
file (spin on HBASE-645 and 550)
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-646:
------------------------
Attachment: 646.patch
This patch looks for empty info files on open (and for empty data files).
{code}
M src/java/org/apache/hadoop/hbase/HStore.java
Check info file is not empty. If it is, log and continue.
Added also a check for an empty data file. Possible if data loss
in hdfs. If empty, remove the mapfile and info file and report.
(isEmptyDataFile): Added.
M src/java/org/apache/hadoop/hbase/HRegion.java
Added test for null before using resultSets and keys data members.
If fail on construction, these will be null throwing NPE hiding
real issue.
{code}
> EOFException opening HStoreFile info file (spin on HBASE-645 and 550)
> ---------------------------------------------------------------------
>
> Key: HBASE-646
> URL: https://issues.apache.org/jira/browse/HBASE-646
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Attachments: 646.patch
>
>
> {code}
> 2008-05-28 05:46:06,271 ERROR org.apache.hadoop.hbase.HRegionServer: error opening region enwiki_080312_meta,UzbHXtgD-y4ZIUVDJIXXK-==,1207951941241
> java.io.EOFException
> at java.io.DataInputStream.readByte(Unknown Source)
> at org.apache.hadoop.hbase.HStoreFile.loadInfo(HStoreFile.java:298)
> at org.apache.hadoop.hbase.HStore.<init>(HStore.java:808)
> at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:431)
> at org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:1256)
> at org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1202)
> at java.lang.Thread.run(Unknown Source)
> {code}
> Lets get rid of info files when we move to new mapfile format.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.