[jira] [Commented] (CRUNCH-672) Crunch uses HBase classes annotated with @InterfaceAudience.Private

["Micah Whitacre (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CRUNCH-672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611346#comment-16611346 ] 

Micah Whitacre commented on CRUNCH-672:
---------------------------------------

[~asasvari] while it isn't ideal to depend on those it is necessary to support common use cases like creating HBase bulk loads or utilizing HFiles for processing which can be more efficient than hitting HBase itself.

Also if there a specific HBase version you were using as a reference?  While Crunch doesn't target the newest code stream yet, some of those classes have been promoted to be considered "public" (e.g. TableMapReduceUtil is one that sticks out).

Does depending on these packages cause a problem for you?  

> Crunch uses HBase classes annotated with @InterfaceAudience.Private
> -------------------------------------------------------------------
>
>                 Key: CRUNCH-672
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-672
>             Project: Crunch
>          Issue Type: Improvement
>            Reporter: Attila Sasvari
>            Priority: Major
>
> The following classes are used in crunch-hbase and annotated with {{@InterfaceAudience.Private}}:
> {code}
> org.apache.hadoop.hbase.CellComparatorImpl
> org.apache.hadoop.hbase.HConstants
> org.apache.hadoop.hbase.KeyValue
> org.apache.hadoop.hbase.KeyValueUtil
> org.apache.hadoop.hbase.PrivateCellUtil
> org.apache.hadoop.hbase.Tag
> org.apache.hadoop.hbase.client.Result
> org.apache.hadoop.hbase.io.hfile.CacheConfig
> org.apache.hadoop.hbase.io.hfile.HFile
> org.apache.hadoop.hbase.io.hfile.HFileContext
> org.apache.hadoop.hbase.io.hfile.HFileContextBuilder
> org.apache.hadoop.hbase.io.hfile.HFileScanner
> org.apache.hadoop.hbase.io.hfile.HFileWriterImpl
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil
> org.apache.hadoop.hbase.protobuf.ProtobufUtil
> org.apache.hadoop.hbase.regionserver.HStoreFile
> org.apache.hadoop.hbase.regionserver.KeyValueHeap
> org.apache.hadoop.hbase.regionserver.KeyValueScanner
> org.apache.hadoop.hbase.regionserver.StoreFileReader
> org.apache.hadoop.hbase.regionserver.StoreFileScanner
> org.apache.hadoop.hbase.regionserver.StoreFileWriter
> org.apache.hadoop.hbase.util.BloomFilter
> org.apache.hadoop.hbase.util.BloomFilterFactory
> {code}
> The problem is that it is not guaranteed that HBase internal classes won't change in future versions. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)