You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Chris Tarnas (JIRA)" <ji...@apache.org> on 2016/05/25 23:24:12 UTC
[jira] [Created] (PHOENIX-2938) HFile support for SparkSQL
DataFrame saves
Chris Tarnas created PHOENIX-2938:
-------------------------------------
Summary: HFile support for SparkSQL DataFrame saves
Key: PHOENIX-2938
URL: https://issues.apache.org/jira/browse/PHOENIX-2938
Project: Phoenix
Issue Type: Improvement
Reporter: Chris Tarnas
Priority: Minor
Currently when saving a DataFrame in Spark it is persisted as upserts. Having an option to do saves natively via HFiles, as the MapReduce loader does, would be a great performance improvement for large bulk loads. The current work around to reduce the load on the regionservers would be to save to csv from Spark then load via the MapReduce loader.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)