You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "chunhui shen (Created) (JIRA)" <ji...@apache.org> on 2012/03/12 06:36:42 UTC

[jira] [Created] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

HRegionInfo#compareTo add the comparison of regionId
----------------------------------------------------

                 Key: HBASE-5563
                 URL: https://issues.apache.org/jira/browse/HBASE-5563
             Project: HBase
          Issue Type: Bug
            Reporter: chunhui shen
            Assignee: chunhui shen


In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229801#comment-13229801 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

A bunch of the failures have been fixed with this addition, but there are a still a few remaining to hunt down.

{code}
diff --git a/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
index 479861d..cad4314 100644
--- a/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
+++ b/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
@@ -2705,8 +2705,10 @@ public class AssignmentManager extends ZooKeeperListener 
    */
   public List<HRegionInfo> getRegionsOfTable(byte[] tableName) {
     List<HRegionInfo> tableRegions = new ArrayList<HRegionInfo>();
+    // boundary needs to have table's name but regionID 0 so that it is sorted 
+    // before all table's regions.
     HRegionInfo boundary =
-      new HRegionInfo(tableName, null, null);
+      new HRegionInfo(tableName, null, null, false, 0L);
     synchronized (this.regions) {
       for (HRegionInfo regionInfo: this.regions.tailMap(boundary).keySet()) {
         if(Bytes.equals(regionInfo.getTableName(), tableName)) {
{code}
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231187#comment-13231187 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

@Chunhui

I get it -- we just didn't see the robot run the v2 to show that it fixed the problem.

Are you ok with the newer patch (and test?) that fixes getRegionsOfTable?  I think it is more intuitive since older HRI's with smaller datestamp/regionIds are smaller than newer HRI's with larger datestamp/regionIds.  

It's helpful to add comments and tests to show what you intend -- hopefully the updated patch I provided makes it clear.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231236#comment-13231236 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

Tests came back clean or came back with failures that were intermittent but clean when run locally on all version.  
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231557#comment-13231557 ] 

stack commented on HBASE-5563:
------------------------------

+1 on patch for trunk and 0.92  (again).  Older regionids should appear earlier in a sorted list than newer regionids as per this patch.  
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "chunhui shen (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

chunhui shen updated HBASE-5563:
--------------------------------

    Attachment: HBASE-5563.patch
    
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo should compare regionId as well

Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237268#comment-13237268 ] 

stack commented on HBASE-5563:
------------------------------

+1 on committing it
                
> HRegionInfo#compareTo should compare regionId as well
> -----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-0.90.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo should compare regionId as well

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237318#comment-13237318 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

Committed to 0.90 branch as well.  Thanks for review stack!
                
> HRegionInfo#compareTo should compare regionId as well
> -----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-0.90.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227749#comment-13227749 ] 

stack commented on HBASE-5563:
------------------------------

Although, thats a bunch of failures.  Want to retry your patch against hadoopqa again Chunhui?  Or try the build locally.  Do you see the same amount of failures?
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230774#comment-13230774 ] 

Hadoop QA commented on HBASE-5563:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12518570/hbase-5563-v3-0.92.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1196//console

This message is automatically generated.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231696#comment-13231696 ] 

Hudson commented on HBASE-5563:
-------------------------------

Integrated in HBase-TRUNK #2686 (See [https://builds.apache.org/job/HBase-TRUNK/2686/])
    HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh) (Revision 1301779)

     Result = SUCCESS
jmhsieh : 
Files : 
* /hbase/trunk/src/main/java/org/apache/hadoop/hbase/HRegionInfo.java
* /hbase/trunk/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java

                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227587#comment-13227587 ] 

Hadoop QA commented on HBASE-5563:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12517985/HBASE-5563.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    -1 javadoc.  The javadoc tool appears to have generated -123 warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs.  The patch appears to introduce 159 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

     -1 core tests.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.master.TestRollingRestart
                  org.apache.hadoop.hbase.io.hfile.TestLruBlockCache
                  org.apache.hadoop.hbase.coprocessor.TestClassLoading
                  org.apache.hadoop.hbase.client.TestAdmin
                  org.apache.hadoop.hbase.master.TestDistributedLogSplitting
                  org.apache.hadoop.hbase.client.TestShell
                  org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable
                  org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface
                  org.apache.hadoop.hbase.mapreduce.TestImportTsv
                  org.apache.hadoop.hbase.mapred.TestTableMapReduce
                  org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1163//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1163//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1163//console

This message is automatically generated.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230693#comment-13230693 ] 

stack commented on HBASE-5563:
------------------------------

+1 on committing everywhere, even into 0.92 (I've tagged RC0; if we do an RC1 it should be included.  Mark fix in 0.92.2 I'd say for now)
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo should compare regionId as well

Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5563:
----------------------------------

    Attachment: hbase-5563-0.90.patch

The 0.90 version of this patch is required for 0.90 HBASE-5128's unit tests to pass consistently.
                
> HRegionInfo#compareTo should compare regionId as well
> -----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-0.90.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5563:
----------------------------------

    Attachment: hbase-5563-v3.patch
    
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo should compare regionId as well

Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5563:
----------------------------------

    Fix Version/s: 0.90.7
    
> HRegionInfo#compareTo should compare regionId as well
> -----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.90.7, 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-0.90.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo should compare regionId as well

Posted by "Zhihong Yu (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhihong Yu updated HBASE-5563:
------------------------------

    Summary: HRegionInfo#compareTo should compare regionId as well  (was: HRegionInfo#compareTo add the comparison of regionId)
    
> HRegionInfo#compareTo should compare regionId as well
> -----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230702#comment-13230702 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------


TestColumnSeeking passes for me locally, first time its ever failed for me.

{code}
jon@swoop:~/proj/hbase-trunk$ mvn test -PlocalTests -Dtest=TestColumnSeeking
..
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hbase.regionserver.TestColumnSeeking
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.061 sec

Results :

Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
{code}
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo should compare regionId as well

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231757#comment-13231757 ] 

Hudson commented on HBASE-5563:
-------------------------------

Integrated in HBase-0.92 #325 (See [https://builds.apache.org/job/HBase-0.92/325/])
    HBASE-5563 Addendum: Updating CHANGES.txt (Revision 1301782)
HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh) (Revision 1301780)

     Result = FAILURE
jmhsieh : 
Files : 
* /hbase/branches/0.92/CHANGES.txt

jmhsieh : 
Files : 
* /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/HRegionInfo.java
* /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
* /hbase/branches/0.92/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java

                
> HRegionInfo#compareTo should compare regionId as well
> -----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo should compare regionId as well

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231860#comment-13231860 ] 

Hudson commented on HBASE-5563:
-------------------------------

Integrated in HBase-TRUNK-security #140 (See [https://builds.apache.org/job/HBase-TRUNK-security/140/])
    HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh) (Revision 1301779)

     Result = SUCCESS
jmhsieh : 
Files : 
* /hbase/trunk/src/main/java/org/apache/hadoop/hbase/HRegionInfo.java
* /hbase/trunk/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java

                
> HRegionInfo#compareTo should compare regionId as well
> -----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231729#comment-13231729 ] 

Hudson commented on HBASE-5563:
-------------------------------

Integrated in HBase-0.94 #37 (See [https://builds.apache.org/job/HBase-0.94/37/])
    HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh) (Revision 1301783)

     Result = SUCCESS
jmhsieh : 
Files : 
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/HRegionInfo.java
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
* /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java

                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-5563:
-------------------------

    Attachment: HBASE-5563v2.patch

Retry of v2 patch against hadoopqa.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230681#comment-13230681 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

This patch also makes older regions smaller than newer regions (reversing chenhui's sort order).  This makes fixing the test cases easier.

Oddly, TestAdmin.testEnableTableRoundRobinAssignement seems to fail for me locally but pass in my jenkins test runners.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230688#comment-13230688 ] 

Hadoop QA commented on HBASE-5563:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12518565/hbase-5563-v3.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs.  The patch appears to introduce 161 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

     -1 core tests.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.regionserver.TestColumnSeeking

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1195//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1195//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1195//console

This message is automatically generated.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Ted Yu (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ted Yu updated HBASE-5563:
--------------------------

    Status: Open  (was: Patch Available)
    
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231661#comment-13231661 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

@stack @lars -- 0.94 ok too?
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228846#comment-13228846 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

@chunhui

Check out the review patch in HBASE-5128 (its big but in there) -- there is a fix for TestRegionObserverInterface in that patch which can probably go over here.   We need to look into the other faliures as well (the one I fixed was a Medium test -- the others are likely Large tests that aren't run until small and medium pass)
  
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229645#comment-13229645 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

@Chenhui -- lets keep this open amd take care of this issue particular here.  The HBASE-5128 is too big already and this a more manageable hunk to review / commit.  

I'm starting to hunt down the failures new -- I think TestClassLoading is intermittent. 
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230682#comment-13230682 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

This will probably be needed for hbck in HBASE-5128 for 0.92, 0.94, and trunk/0.96.  It was not required for 0.90.x hbck updates.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Ted Yu (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ted Yu updated HBASE-5563:
--------------------------

    Status: Patch Available  (was: Open)
    
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5563:
----------------------------------

    Attachment: hbase-5563-v3-0.92.patch

hbase-5563-v3.patch applies cleanly to 0.94 branch.  

Attached 0.92 version -- it passes the trouble cases from v1/v2.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "chunhui shen (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228171#comment-13228171 ] 

chunhui shen commented on HBASE-5563:
-------------------------------------

@stack
Because of some bug, we find same region assigned twice on two RS, however these two regions will both be splitted and the new four regions has the same startKey and endKey, caused serious unconsistent.

I find the one with the larger regionid should sort before the region with the lesser regionid, otherwise AssignmentManager#getRegionsOfTable() will return error regions.

Could run hadoopqa with patchv2 again?
Thanks.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "chunhui shen (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230816#comment-13230816 ] 

chunhui shen commented on HBASE-5563:
-------------------------------------

@Jonathan 
bq.have newer regions (larger timestamps) sorted before older HRegionInfos? If so why? My intuition says to to have newer regions sorted after older ones.

I just in order to make AssignmentManager#getRegionsOfTable() returns correct without changing it.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "chunhui shen (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

chunhui shen updated HBASE-5563:
--------------------------------

    Attachment: HBASE-5563v2.patch
    
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228177#comment-13228177 ] 

stack commented on HBASE-5563:
------------------------------

I just saw that this fix shows up in Jonathon's hbck fixup for similar reasons you cite above.  Let me try it in hadoopqa again.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230725#comment-13230725 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

I have full tests suites running for the trunk, 0.94, and 0.92 versions.  If they come back clean, I'll commit first thing tommorrow am.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227748#comment-13227748 ] 

stack commented on HBASE-5563:
------------------------------

Both regions were online?

Does this patch make the newest made region -- the one with the larger regionid -- sort AFTER the region with the lesser regionid?  I think it does but am not sure.

+1 on this patch...
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230695#comment-13230695 ] 

stack commented on HBASE-5563:
------------------------------

Does TestColumnSeeking work locally for you?  This patch shouldn't matter for that test?
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5563:
----------------------------------

    Status: Patch Available  (was: Open)

Updated Patch to add test case and to fix broken test cases.  
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231662#comment-13231662 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

Committed to 0.92/0.94/trunk.  Thanks for initial patch chunhui, thanks for review stack.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "chunhui shen (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228960#comment-13228960 ] 

chunhui shen commented on HBASE-5563:
-------------------------------------

@Jonathan
I have seen HBASE-5128. So we could close this issue.
Thanks.
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230236#comment-13230236 ] 

Jonathan Hsieh commented on HBASE-5563:
---------------------------------------

Hey Chenhui, looked at your code and had a question (similar to stack's) -- did you intend to have newer regions (larger timestamps) sorted *before* older HRegionInfos?  If so why?  My intuition says to to have newer regions sorted after older ones.  At the moment nothing depends on one order vs another, so I would like to add some simple unit tests to make the desired behavior this explicitly tested.  

Also, I have a few runs with the broken test passing now (a bunch of tests seem to be flakey on my setup). 
                
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5563:
----------------------------------

       Resolution: Fixed
    Fix Version/s: 0.96.0
                   0.94.0
                   0.92.2
     Hadoop Flags: Reviewed
           Status: Resolved  (was: Patch Available)
    
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3-0.92.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5563) HRegionInfo#compareTo add the comparison of regionId

Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5563:
----------------------------------

    Affects Version/s: 0.96.0
                       0.94.0
                       0.90.5
                       0.92.0
    
> HRegionInfo#compareTo add the comparison of regionId
> ----------------------------------------------------
>
>                 Key: HBASE-5563
>                 URL: https://issues.apache.org/jira/browse/HBASE-5563
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.5, 0.92.0, 0.94.0, 0.96.0
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-5563.patch, HBASE-5563v2.patch, HBASE-5563v2.patch, hbase-5563-v3.patch
>
>
> In the one region multi assigned case,  we could find that two regions have the same table name, same startKey, same endKey, and different regionId, so these two regions are same in TreeMap but different in HashMap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira