You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Ted Malaska (JIRA)" <ji...@apache.org> on 2015/08/30 23:59:45 UTC
[jira] [Created] (HBASE-14340) Add second bulk load option to Spark
Bulk Load to send puts as the value
Ted Malaska created HBASE-14340:
-----------------------------------
Summary: Add second bulk load option to Spark Bulk Load to send puts as the value
Key: HBASE-14340
URL: https://issues.apache.org/jira/browse/HBASE-14340
Project: HBase
Issue Type: New Feature
Components: spark
Reporter: Ted Malaska
Assignee: Ted Malaska
Priority: Minor
The initial bulk load option for Spark bulk load sends values over one by one through the shuffle. This is the similar to how the original MR bulk load worked.
How ever the MR bulk loader have more then one bulk load option. There is a second option that allows for all the Column Families, Qualifiers, and Values or a row to be combined in the map side.
This only works if the row is not super wide.
But if the row is not super wide this method of sending values through the shuffle will reduce the data and work the shuffle has to deal with.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)