[jira] [Commented] (HBASE-14375) define public API for spark integration module

["Jerry He (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-14375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884377#comment-15884377 ] 

Jerry He commented on HBASE-14375:
----------------------------------

Attached an initial patch trying to annotate the classes/functions in the spark module.

Went through each of the classes.  I tried to do the following:


-- HBaseContext  --> public, evolving.
-- HBase RDD functions (bulk get, bulk put, bulk load, stream, etc)  --> public, evolving.
-- NewHBaseRDD (wraps NewHadoopRDD)  --> public, evolving.
-- Some scala convenience/wrapper classes for hbase  --> public, evolving.
-- HBaseSparkConf, HBaseTableCatalog (for Spark SQL / DataFrame  datasource)  --> public, evolving.
-- Data type encoder interface (for Spark SQL / DataFrame  datasource)  --> LimitedPrivate with HBaseInterfaceAudience.SPARK  --> Advanced user can have custom implementation.
-- Everything else, internal implementation of anything related to the datasource  --> private

> define public API for spark integration module
> ----------------------------------------------
>
>                 Key: HBASE-14375
>                 URL: https://issues.apache.org/jira/browse/HBASE-14375
>             Project: HBase
>          Issue Type: Task
>          Components: spark
>            Reporter: Sean Busbey
>            Assignee: Jerry He
>            Priority: Blocker
>             Fix For: 2.0.0
>
>
> before we can put the spark integration module into a release, we need to annotate its public api surface.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)