You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2009/01/10 05:05:59 UTC

[jira] Created: (HBASE-1117) Master does not assign all regions on startup

Master does not assign all regions on startup
---------------------------------------------

                 Key: HBASE-1117
                 URL: https://issues.apache.org/jira/browse/HBASE-1117
             Project: Hadoop HBase
          Issue Type: Bug
         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
            Reporter: Andrew Purtell
            Priority: Critical
             Fix For: 0.19.0


I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1117) Region assignment on startup is broken

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662677#action_12662677 ] 

stack commented on HBASE-1117:
------------------------------

All of hudson seems hung -- probably not us.  Let me fix the broken tests later today.

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HBASE-1117) Failed region assignments on startup after Hadoop upgrade

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell resolved HBASE-1117.
-----------------------------------

    Resolution: Duplicate

Closing as duplicate of HBASE-1124. This issue is messy. (My fault.)

> Failed region assignments on startup after Hadoop upgrade
> ---------------------------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HBASE-1117) Failed region assignments on startup after Hadoop upgrade

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell reassigned HBASE-1117:
-------------------------------------

    Assignee:     (was: Andrew Purtell)

> Failed region assignments on startup after Hadoop upgrade
> ---------------------------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

    Attachment: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662706#action_12662706 ] 

Andrew Purtell commented on HBASE-1117:
---------------------------------------

The problem is on the HRS side, in compaction. I backed out to r732908 (jimk, 2009-01-09 HBASE-1104) and my cluster comes up right away. The next commit after this is r733213 (stack, 2009-01-10 HBASE-1114). 

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

    Comment: was deleted

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

    Priority: Blocker  (was: Critical)
     Summary: Region assignment on startup is broken  (was: Master does not assign all regions on startup)

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662703#action_12662703 ] 

Andrew Purtell commented on HBASE-1117:
---------------------------------------

This is not a symptom of HBASE-1119.

Regions stay in transition states, I think because the master is not allowing opens from HRS it thinks are overloaded, yet the HRS are insistent to open. HRS leases time out. META goes offline. 

What is going on here? 


> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

    Attachment: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log

Attached master log from 0 to +20 minutes of a start up attempt. Towards the end META stops accepting writes.

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

    Issue Type: Bug  (was: Sub-task)
        Parent:     (was: HBASE-1114)

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Failed region assignments on startup after Hadoop upgrade

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

         Priority: Major  (was: Blocker)
    Fix Version/s:     (was: 0.19.0)
          Summary: Failed region assignments on startup after Hadoop upgrade  (was: Region assignment on startup is broken)

It was just luck that the cluster came up before (twice). I'm seeing this again on r732908, even on r723491, which is before the big set of master changes that Jim committed. Sorry to incorrectly report blame. Is something new. Could be legacy data issue. I did not have any problems with HBase TRUNK until I upgraded Hadoop. I'm going to move the old data out of the way and start a new experiment to see if this happens again. 

> Failed region assignments on startup after Hadoop upgrade
> ---------------------------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (HBASE-1117) Master does not assign all regions on startup

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662619#action_12662619 ] 

apurtell edited comment on HBASE-1117 at 1/9/09 8:12 PM:
---------------------------------------------------------------

I think master decided the HRS serving META should be on the dead list also.

      was (Author: apurtell):
    I think master decided the HRS serving META was on the dead list also.
  
> Master does not assign all regions on startup
> ---------------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.19.0
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1117) Master does not assign all regions on startup

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662618#action_12662618 ] 

Andrew Purtell commented on HBASE-1117:
---------------------------------------

Master appears to not want to ack PROCESS_OPEN from HRS it thinks are overloaded, but they're very insistent.

> Master does not assign all regions on startup
> ---------------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.19.0
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

    Issue Type: Sub-task  (was: Bug)
        Parent: HBASE-1114

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Sub-task
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log, hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1117:
----------------------------------

    Comment: was deleted

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell reassigned HBASE-1117:
-------------------------------------

    Assignee: Andrew Purtell

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662641#action_12662641 ] 

Andrew Purtell commented on HBASE-1117:
---------------------------------------

This could well be a symptom of HBASE-1119

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1117) Region assignment on startup is broken

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662635#action_12662635 ] 

Andrew Purtell commented on HBASE-1117:
---------------------------------------

I moved hbase files in HDFS off to the side and am restarting a new experiment. Will restart the cluster every now and then to see if this reoccurs without chance that legacy data is contributing. 

> Region assignment on startup is broken
> --------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: hbase-hadoop-wtp.back.cluster.HMaster-sjdc-atr-dc-2.log
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1117) Master does not assign all regions on startup

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662619#action_12662619 ] 

Andrew Purtell commented on HBASE-1117:
---------------------------------------

I think master decided the HRS serving META was on the dead list also.

> Master does not assign all regions on startup
> ---------------------------------------------
>
>                 Key: HBASE-1117
>                 URL: https://issues.apache.org/jira/browse/HBASE-1117
>             Project: Hadoop HBase
>          Issue Type: Bug
>         Environment: apurtell cluster, HBase TRUNK on Hadoop 0.19.1-dev
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.19.0
>
>
> I can't get my cluster all the way up after upgrading to Hadoop 0.19. Master is ignoring MSG_REPORT_PROCESS_OPEN from various regionservers, skipping regions it thinks are in transition. Master UI is also unresponsive. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.