[jira] Updated: (HBASE-1593) TableMap's generic type inconsistcy with Hadoop

["jaehong choi (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

jaehong choi updated HBASE-1593:
--------------------------------

    Description: 
Hello~

I've been trying to global sort rows whose key is LongWritable and value is Text type.
Since there are a few result files after finishing a mapreduce job, I need to do a merge sort on them. 

I want to sort rows in a decreasing order, but ImmutableBytesWritable only supports increasing sort.
So, I assign LongWritable.DecreasingComparator on JobConf.setOutputKeyComparatorClass() in order that output keys are in decreasing order.

However, There is a big problem. As you see, TableMap requires K must implement or extend WritableComparable<K>, but LongWritable only implements WritableComparable, not WritableComparable<LongWritable>. This makes a compilation time error.  

I think we should come up with an idea to solve this one. 

<code>
public interface TableMap<K extends WritableComparable<K>, V extends Writable>
extends Mapper<ImmutableBytesWritable, Result, K, V> {
}
<code>
<code>
public class LongWritable implements WritableComparable
<code>


  was:
Hello~

I've been trying to global sort rows whose key is LongWritable and value is Text type.
Since there are a few result files after finishing a mapreduce job, I need to do a merge sort on them. 

I want to sort rows in a decreasing order, but ImmutableBytesWritable only supports increasing sort.
So, I assign LongWritable.DecreasingComparator on JobConf.setOutputKeyComparatorClass() in order that output keys are in decreasing order.

However, There is a big problem. As you see, TableMap requires K must implement or extend WritableComparable<K>, but LongWritable only implements WritableComparable, not WritableComparable<LongWritable>. This makes a compilation time error.  

I think we should come up with an idea to solve this one. 

<code>
public interface TableMap<K extends WritableComparable<K>, V extends Writable>
extends Mapper<ImmutableBytesWritable, Result, K, V> {
}
</code>
<code>
public class LongWritable implements WritableComparable
</code>



> TableMap's generic type inconsistcy with Hadoop
> -----------------------------------------------
>
>                 Key: HBASE-1593
>                 URL: https://issues.apache.org/jira/browse/HBASE-1593
>             Project: Hadoop HBase
>          Issue Type: Bug
>          Components: mapred
>            Reporter: jaehong choi
>
> Hello~
> I've been trying to global sort rows whose key is LongWritable and value is Text type.
> Since there are a few result files after finishing a mapreduce job, I need to do a merge sort on them. 
> I want to sort rows in a decreasing order, but ImmutableBytesWritable only supports increasing sort.
> So, I assign LongWritable.DecreasingComparator on JobConf.setOutputKeyComparatorClass() in order that output keys are in decreasing order.
> However, There is a big problem. As you see, TableMap requires K must implement or extend WritableComparable<K>, but LongWritable only implements WritableComparable, not WritableComparable<LongWritable>. This makes a compilation time error.  
> I think we should come up with an idea to solve this one. 
> <code>
> public interface TableMap<K extends WritableComparable<K>, V extends Writable>
> extends Mapper<ImmutableBytesWritable, Result, K, V> {
> }
> <code>
> <code>
> public class LongWritable implements WritableComparable
> <code>

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.