You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Jerry He (JIRA)" <ji...@apache.org> on 2016/02/05 23:32:39 UTC

[jira] [Created] (HBASE-15223) Make pubic convertScanToString for Spark

Jerry He created HBASE-15223:
--------------------------------

             Summary: Make pubic convertScanToString for Spark
                 Key: HBASE-15223
                 URL: https://issues.apache.org/jira/browse/HBASE-15223
             Project: HBase
          Issue Type: Improvement
            Reporter: Jerry He


One way to access HBase from Spark is to use newAPIHadoopRDD, which can take a TableInputFormat as class name.  But we are not able to set a Scan object in there, for example to set a HBase filter.

In MR,  the public API TableMapReduceUtil.initTableMapperJob() or equivalent is used which can take a Scan object.  But this call is not used in Spark conveniently. 

We need to make the TableMapReduceUtil.convertScanToString() public.
So that a Scan object can be created, populated and then convert to the property and used by Spark.  They are now package private.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)