You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "Billie Rinaldi (JIRA)" <ji...@apache.org> on 2012/07/24 20:27:35 UTC
[jira] [Created] (ACCUMULO-700) Improve iterator configuration for
MapReduces
Billie Rinaldi created ACCUMULO-700:
---------------------------------------
Summary: Improve iterator configuration for MapReduces
Key: ACCUMULO-700
URL: https://issues.apache.org/jira/browse/ACCUMULO-700
Project: Accumulo
Issue Type: Improvement
Components: client
Reporter: Billie Rinaldi
Assignee: Billie Rinaldi
Fix For: 1.5.0
The InputFormatBase currently uses AccumuloIterator and AccumuloIteratorOption configuration objects to serialize iterator information for MapReduce. These objects predate IteratorSetting, which is now used to configure iterators. We should just make IteratorSetting Writable so it can be used directly for serializing iterator information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-700) Improve iterator configuration
for MapReduces
Posted by "David Medinets (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435559#comment-13435559 ]
David Medinets commented on ACCUMULO-700:
-----------------------------------------
Will there be a tool that can convert the representations into human-readable form?
> Improve iterator configuration for MapReduces
> ---------------------------------------------
>
> Key: ACCUMULO-700
> URL: https://issues.apache.org/jira/browse/ACCUMULO-700
> Project: Accumulo
> Issue Type: Improvement
> Components: client
> Reporter: Billie Rinaldi
> Assignee: Billie Rinaldi
> Fix For: 1.5.0
>
>
> The InputFormatBase currently uses AccumuloIterator and AccumuloIteratorOption configuration objects to serialize iterator information for MapReduce. These objects predate IteratorSetting, which is now used to configure iterators. We should just make IteratorSetting Writable so it can be used directly for serializing iterator information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-700) Improve iterator configuration
for MapReduces
Posted by "Josh Elser (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435679#comment-13435679 ]
Josh Elser commented on ACCUMULO-700:
-------------------------------------
I would see no reason not to Writable the settings. We got bit by such issues back in 1.3 land with the old InputFormat.
Could expose a static method or main() which calls a toString on the serialized IteratorSetting via bin/accumulo to satisfy David's request.
> Improve iterator configuration for MapReduces
> ---------------------------------------------
>
> Key: ACCUMULO-700
> URL: https://issues.apache.org/jira/browse/ACCUMULO-700
> Project: Accumulo
> Issue Type: Improvement
> Components: client
> Reporter: Billie Rinaldi
> Assignee: Billie Rinaldi
> Fix For: 1.5.0
>
>
> The InputFormatBase currently uses AccumuloIterator and AccumuloIteratorOption configuration objects to serialize iterator information for MapReduce. These objects predate IteratorSetting, which is now used to configure iterators. We should just make IteratorSetting Writable so it can be used directly for serializing iterator information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-700) Improve iterator configuration
for MapReduces
Posted by "Billie Rinaldi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435523#comment-13435523 ]
Billie Rinaldi commented on ACCUMULO-700:
-----------------------------------------
If we configure iterators using, say, comma-separated base64-encoded representations of IteratorSettings, a potential disadvantage is that the iterator information will no longer be readable in the job configuration. Does anyone need this to remain readable?
> Improve iterator configuration for MapReduces
> ---------------------------------------------
>
> Key: ACCUMULO-700
> URL: https://issues.apache.org/jira/browse/ACCUMULO-700
> Project: Accumulo
> Issue Type: Improvement
> Components: client
> Reporter: Billie Rinaldi
> Assignee: Billie Rinaldi
> Fix For: 1.5.0
>
>
> The InputFormatBase currently uses AccumuloIterator and AccumuloIteratorOption configuration objects to serialize iterator information for MapReduce. These objects predate IteratorSetting, which is now used to configure iterators. We should just make IteratorSetting Writable so it can be used directly for serializing iterator information.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira