You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2011/02/03 00:48:29 UTC
[jira] Created: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
-------------------------------------------------------------------------------------
Key: HBASE-3502
URL: https://issues.apache.org/jira/browse/HBASE-3502
Project: HBase
Issue Type: Bug
Reporter: stack
Priority: Critical
Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
{code}
2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
{code}
... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12991794#comment-12991794 ]
Hudson commented on HBASE-3502:
-------------------------------
Integrated in HBase-TRUNK #1737 (See [https://hudson.apache.org/hudson/job/HBase-TRUNK/1737/])
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Critical
> Fix For: 0.90.1
>
> Attachments: 3502.txt
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-3502:
-------------------------
Assignee: stack
Status: Patch Available (was: Open)
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Critical
> Fix For: 0.90.1
>
> Attachments: 3502.txt
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989921#comment-12989921 ]
Todd Lipcon commented on HBASE-3502:
------------------------------------
I think at one point I opened a jira that we should create this file, then move it into place once it's closed in order to avoid this issue... can't remember the ticket number
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Priority: Critical
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989927#comment-12989927 ]
stack commented on HBASE-3502:
------------------------------
I couldn't find it after a depressing scroll through all the issues where you are the reporter Todd (I'm off to slash my wrists now). So, move into place, it'll either succeed or not. Ok. Sounds right. Thanks.
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Priority: Critical
> Fix For: 0.90.1
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989932#comment-12989932 ]
stack commented on HBASE-3502:
------------------------------
I tried this up on cluster. Looks to be doing right thing. Review please.
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Critical
> Fix For: 0.90.1
>
> Attachments: 3502.txt
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12990779#comment-12990779 ]
stack commented on HBASE-3502:
------------------------------
I was thinking its not end of world if we don't write the .regioninfo. If we throw an exception, then region will never open.
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Critical
> Fix For: 0.90.1
>
> Attachments: 3502.txt
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-3502:
-------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed to branch and trunk.
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Critical
> Fix For: 0.90.1
>
> Attachments: 3502.txt
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-3502:
-------------------------
Fix Version/s: 0.90.1
Bringing into 0.90.x. This is kinda bad. Once we hit it, we can't online the effected region.
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Priority: Critical
> Fix For: 0.90.1
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-3502:
-------------------------
Attachment: 3502.txt
Does simple create in the region dir of .regioninfo. Adds timestamp to tmpfile as primitive guard against filename classes in tmpdir. After successful write, does rename.
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Priority: Critical
> Fix For: 0.90.1
>
> Attachments: 3502.txt
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3502) Can't open region because can't open
.regioninfo because AlreadyBeingCreatedException
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12990763#comment-12990763 ]
Todd Lipcon commented on HBASE-3502:
------------------------------------
Why just WARN and not throw an exception if it can't rename? Other than that looks good.
> Can't open region because can't open .regioninfo because AlreadyBeingCreatedException
> -------------------------------------------------------------------------------------
>
> Key: HBASE-3502
> URL: https://issues.apache.org/jira/browse/HBASE-3502
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Critical
> Fix For: 0.90.1
>
> Attachments: 3502.txt
>
>
> Testing killing .META. I tripped over this one. Last thing seen on regionserver killed was:
> {code}
> 2011-02-02 21:44:48,379 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated TestTable,0591556500,1296683085472.76c9a32c5f068d16240e42a15fed8417.
> {code}
> ... which means we could have been inside checkRegioninfoOnFilesystem when we were killed.
> This tries to create the .regioninfo file. Seems like that was started over at the NN but then the RS died shortly afterward. Its stopping the Region opening. I suppose I could try and open it for append to shut it then reopen?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira