You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Jeremy Hinegardner (JIRA)" <ji...@apache.org> on 2010/10/25 19:46:22 UTC

[jira] Created: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
--------------------------------------------------------------------------------------------

                 Key: PIG-1699
                 URL: https://issues.apache.org/jira/browse/PIG-1699
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.8.0, 0.9.0
            Reporter: Jeremy Hinegardner


When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979212#action_12979212 ] 

Dmitriy V. Ryaboy commented on PIG-1699:
----------------------------------------

This is actually intentional. 

End keys reported by HBase are not inclusive -- an hbase region contains row keys in the range [start_key, end_key).  So if endkey == gtevalue, the gte value is NOT in this region.  
This is documented on this wiki page: http://wiki.apache.org/hadoop/Hbase/HbaseArchitecture .

Did you encounter a situation in which a region was filtered out incorrectly that required this fix?

-D

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>         Attachments: PIG-1699.patch
>
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Jeremy Hinegardner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Hinegardner updated PIG-1699:
------------------------------------

    Status: Patch Available  (was: Open)

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Jeremy Hinegardner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Hinegardner updated PIG-1699:
------------------------------------

    Attachment:     (was: PIG-1699.patch)

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Jeremy Hinegardner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Hinegardner updated PIG-1699:
------------------------------------

    Status: Open  (was: Patch Available)

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Jeremy Hinegardner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Hinegardner updated PIG-1699:
------------------------------------

    Attachment: PIG-1699.patch

One line fix.

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>         Attachments: PIG-1699.patch
>
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Jeremy Hinegardner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Hinegardner updated PIG-1699:
------------------------------------

      Priority: Minor  (was: Major)
    Patch Info: [Patch Available]

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Jeremy Hinegardner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Hinegardner updated PIG-1699:
------------------------------------

    Attachment: PIG-1699.patch

One line fix.

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (PIG-1699) HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL

Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dmitriy V. Ryaboy resolved PIG-1699.
------------------------------------

    Resolution: Not A Problem

Resolving as 'not a problem' since I don't believe it to be and have not been provided with a counter example.

Please reopen if I am wrong.

> HBaseStorage option -gte resolves to CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL
> --------------------------------------------------------------------------------------------
>
>                 Key: PIG-1699
>                 URL: https://issues.apache.org/jira/browse/PIG-1699
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Jeremy Hinegardner
>            Priority: Minor
>         Attachments: PIG-1699.patch
>
>
> When using HBaseStorage, and using  '-gte'  option, this is passed to  HTableInputFormat, which then uses CompareOp.GREATER instead of CompareOp.GREATER_OR_EQUAL for split decisions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.