You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Jim Kellerman (JIRA)" <ji...@apache.org> on 2007/08/17 02:23:30 UTC
[jira] Commented: (HADOOP-1727) Make ...hbase.io.MapWritable more
generic so that it can be included in ...hadoop.io
[ https://issues.apache.org/jira/browse/HADOOP-1727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12520425 ]
Jim Kellerman commented on HADOOP-1727:
---------------------------------------
On Fri, 2007-08-17 at 01:14 +0200, Andrzej Bialecki wrote:
jimk@apache.org wrote:
> > Author: jimk
> > Date: Thu Aug 16 15:51:03 2007
> > New Revision: 566878
> >
> > Changes:
> >
> > New class MapWritable replaces KeyedData and KeyedDataArrayWritable
>
> There is already a class with this name in Nutch
> (org.apache.nutch.crawl.MapWritable), which serves basically the same
> purpose, only it's able to hold instances of different classes (both
> keys and values), and (de)serialize them efficiently. Is there any
> chance to merge these two implementations?
Absolutely. When we developed the version for HBase we were unaware of the Nutch class. When I asked Doug Cutting if he thought our MapWritable would be useful in Hadoop, he pointed me to the Nutch class and also suggested using RefllectionUtils, so that, indeed, is the plan.
> Make ...hbase.io.MapWritable more generic so that it can be included in ...hadoop.io
> ------------------------------------------------------------------------------------
>
> Key: HADOOP-1727
> URL: https://issues.apache.org/jira/browse/HADOOP-1727
> Project: Hadoop
> Issue Type: New Feature
> Components: io
> Affects Versions: 0.15.0
> Reporter: Jim Kellerman
> Assignee: Jim Kellerman
> Priority: Minor
> Fix For: 0.15.0
>
>
> The class org.apache.hadoop.hbase.io.MapWritable could be made more generic through the use of ReflectionUtils so that it could support more Map key and value classes. Currently it supports Map<WritableComparable, Writable> only.
> When more generalized, submit for consideration to be included in org.apache.hadoop.io
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Commented: (HADOOP-1727) Make ...hbase.io.MapWritable
more generic so that it can be included in ...hadoop.io
Posted by Andrzej Bialecki <ab...@getopt.org>.
Jim Kellerman (JIRA) wrote:
>>> New class MapWritable replaces KeyedData and
>>> KeyedDataArrayWritable
>> There is already a class with this name in Nutch
>> (org.apache.nutch.crawl.MapWritable), which serves basically the
>> same purpose, only it's able to hold instances of different classes
>> (both keys and values), and (de)serialize them efficiently. Is
>> there any chance to merge these two implementations?
>
> Absolutely. When we developed the version for HBase we were unaware
> of the Nutch class. When I asked Doug Cutting if he thought our
> MapWritable would be useful in Hadoop, he pointed me to the Nutch
> class and also suggested using RefllectionUtils, so that, indeed, is
> the plan.
Great! I'm pretty familiar with the implementation of this class, if you
encounter any issues during the integration, feel free to ask me.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com