You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Bassam Tabbara (JIRA)" <ji...@apache.org> on 2010/01/07 09:14:01 UTC
[jira] Created: (HBASE-2095) TableInputFormat should support more
confs for the scanner
TableInputFormat should support more confs for the scanner
----------------------------------------------------------
Key: HBASE-2095
URL: https://issues.apache.org/jira/browse/HBASE-2095
Project: Hadoop HBase
Issue Type: Improvement
Components: mapreduce
Affects Versions: 0.20.2
Reporter: Bassam Tabbara
Fix For: 0.20.3
TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:
* hbase.mapreduce.scan.columns
* hbase.mapreduce.scan.timestamp
* hbase.mapreduce.scan.timerange.start
* hbase.mapreduce.scan.timerange.end
* hbase.mapreduce.scan.maxversions
* hbase.mapreduce.scan.cacheblocks
* hbase.mapreduce.scan.cachedrows
Ideally we would also support filters but I think that would be harder to implement.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2095) TableInputFormat should support more
confs for the scanner
Posted by "Lars George (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797559#action_12797559 ]
Lars George commented on HBASE-2095:
------------------------------------
Patch looks good.
+1
> TableInputFormat should support more confs for the scanner
> ----------------------------------------------------------
>
> Key: HBASE-2095
> URL: https://issues.apache.org/jira/browse/HBASE-2095
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.20.2
> Reporter: Bassam Tabbara
> Fix For: 0.20.3
>
> Attachments: HBASE-2095.patch
>
>
> TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:
> * hbase.mapreduce.scan.columns
> * hbase.mapreduce.scan.timestamp
> * hbase.mapreduce.scan.timerange.start
> * hbase.mapreduce.scan.timerange.end
> * hbase.mapreduce.scan.maxversions
> * hbase.mapreduce.scan.cacheblocks
> * hbase.mapreduce.scan.cachedrows
> Ideally we would also support filters but I think that would be harder to implement.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-2095) TableInputFormat should support more
confs for the scanner
Posted by "Bassam Tabbara (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bassam Tabbara updated HBASE-2095:
----------------------------------
Attachment: HBASE-2095.patch
> TableInputFormat should support more confs for the scanner
> ----------------------------------------------------------
>
> Key: HBASE-2095
> URL: https://issues.apache.org/jira/browse/HBASE-2095
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.20.2
> Reporter: Bassam Tabbara
> Fix For: 0.20.3
>
> Attachments: HBASE-2095.patch
>
>
> TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:
> * hbase.mapreduce.scan.columns
> * hbase.mapreduce.scan.timestamp
> * hbase.mapreduce.scan.timerange.start
> * hbase.mapreduce.scan.timerange.end
> * hbase.mapreduce.scan.maxversions
> * hbase.mapreduce.scan.cacheblocks
> * hbase.mapreduce.scan.cachedrows
> Ideally we would also support filters but I think that would be harder to implement.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2095) TableInputFormat should support more
confs for the scanner
Posted by "Lars George (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797558#action_12797558 ]
Lars George commented on HBASE-2095:
------------------------------------
Hey Bassam,
I did the BASE64 encoding back then because of the same reason you are facing now, i.e. the scan has so many options and subclasses that the easiest was to encode it as a serialized object and recreate it on the other end. I thought about a similar set of options but when arriving at the filters I stopped and went the different route. But as long as yours is an alternative to the fully specified Scan then all well.
Lars
> TableInputFormat should support more confs for the scanner
> ----------------------------------------------------------
>
> Key: HBASE-2095
> URL: https://issues.apache.org/jira/browse/HBASE-2095
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.20.2
> Reporter: Bassam Tabbara
> Fix For: 0.20.3
>
> Attachments: HBASE-2095.patch
>
>
> TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:
> * hbase.mapreduce.scan.columns
> * hbase.mapreduce.scan.timestamp
> * hbase.mapreduce.scan.timerange.start
> * hbase.mapreduce.scan.timerange.end
> * hbase.mapreduce.scan.maxversions
> * hbase.mapreduce.scan.cacheblocks
> * hbase.mapreduce.scan.cachedrows
> Ideally we would also support filters but I think that would be harder to implement.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2095) TableInputFormat should support more
confs for the scanner
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797688#action_12797688 ]
Andrew Purtell commented on HBASE-2095:
---------------------------------------
bq. Ideally we would also support filters but I think that would be harder to implement.
I need to do this also for HBASE-1696.
> TableInputFormat should support more confs for the scanner
> ----------------------------------------------------------
>
> Key: HBASE-2095
> URL: https://issues.apache.org/jira/browse/HBASE-2095
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.20.2
> Reporter: Bassam Tabbara
> Fix For: 0.20.3
>
> Attachments: HBASE-2095.patch
>
>
> TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:
> * hbase.mapreduce.scan.columns
> * hbase.mapreduce.scan.timestamp
> * hbase.mapreduce.scan.timerange.start
> * hbase.mapreduce.scan.timerange.end
> * hbase.mapreduce.scan.maxversions
> * hbase.mapreduce.scan.cacheblocks
> * hbase.mapreduce.scan.cachedrows
> Ideally we would also support filters but I think that would be harder to implement.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-2095) TableInputFormat should support more
confs for the scanner
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Purtell updated HBASE-2095:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.21.0
Assignee: Bassam Tabbara
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed to 0.20 branch and trunk. Thanks for the patch Bassam! Thanks for the review Lars!
> TableInputFormat should support more confs for the scanner
> ----------------------------------------------------------
>
> Key: HBASE-2095
> URL: https://issues.apache.org/jira/browse/HBASE-2095
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.20.2
> Reporter: Bassam Tabbara
> Assignee: Bassam Tabbara
> Fix For: 0.20.3, 0.21.0
>
> Attachments: HBASE-2095.patch
>
>
> TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:
> * hbase.mapreduce.scan.columns
> * hbase.mapreduce.scan.timestamp
> * hbase.mapreduce.scan.timerange.start
> * hbase.mapreduce.scan.timerange.end
> * hbase.mapreduce.scan.maxversions
> * hbase.mapreduce.scan.cacheblocks
> * hbase.mapreduce.scan.cachedrows
> Ideally we would also support filters but I think that would be harder to implement.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-2095) TableInputFormat should support more
confs for the scanner
Posted by "Bassam Tabbara (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bassam Tabbara updated HBASE-2095:
----------------------------------
Status: Patch Available (was: Open)
> TableInputFormat should support more confs for the scanner
> ----------------------------------------------------------
>
> Key: HBASE-2095
> URL: https://issues.apache.org/jira/browse/HBASE-2095
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.20.2
> Reporter: Bassam Tabbara
> Fix For: 0.20.3
>
>
> TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:
> * hbase.mapreduce.scan.columns
> * hbase.mapreduce.scan.timestamp
> * hbase.mapreduce.scan.timerange.start
> * hbase.mapreduce.scan.timerange.end
> * hbase.mapreduce.scan.maxversions
> * hbase.mapreduce.scan.cacheblocks
> * hbase.mapreduce.scan.cachedrows
> Ideally we would also support filters but I think that would be harder to implement.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.