You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Ted Malaska (JIRA)" <ji...@apache.org> on 2012/08/22 02:46:37 UTC

[jira] [Commented] (PIG-2886) Add Scan TimeRange to HBaseStorage

    [ https://issues.apache.org/jira/browse/PIG-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439191#comment-13439191 ] 

Ted Malaska commented on PIG-2886:
----------------------------------

Submitted fix with pull request from tmalaska/pig github.  Let me know what I need to get this into PIG.  My client would like to use HBaseStorage from PIG instead of a fixed version I gave them in a jar.
                
> Add Scan TimeRange to HBaseStorage 
> -----------------------------------
>
>                 Key: PIG-2886
>                 URL: https://issues.apache.org/jira/browse/PIG-2886
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Ted Malaska
>            Priority: Minor
>
> I have a client that wants to use pig.  They are using MR now.  They can't use PIG right now because they only want to fetch the last day's worth of data in HBase.  A filter with time range would require reading all the HStore files.  If we hold major compaction until after the fetch and use Scan Time Range we only need to read very little in compression. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira