[jira] [Created] (SPARK-9501) Encryption on RDDs or in-memory/cache on Apache Spark

["Matthew O'Reilly (JIRA)" <ji...@apache.org>]

Matthew O'Reilly created SPARK-9501:
---------------------------------------

             Summary: Encryption on RDDs or in-memory/cache on Apache Spark
                 Key: SPARK-9501
                 URL: https://issues.apache.org/jira/browse/SPARK-9501
             Project: Spark
          Issue Type: Question
          Components: Java API, Spark Core, Spark Shell, Spark Submit, Windows
            Reporter: Matthew O'Reilly
            Priority: Trivial


I am currently working on the latest version of Apache Spark (1.4.1), pre-built package for Hadoop 2.6+.

Is there any feature in Spark/Hadoop to encrypt RDDs or in-memory/cache (similarly to Altibase's HDB: http://altibase.com/in-memory-database-computing-solutions/security/) when running applications in Spark? Or is there an external library/framework which could be used to encrypt RDDs or in-memory/cache in Spark?

I discovered it is possible to encrypt the data, and encapsulate it into RDD. However, I feel this affects Spark's fast data processing as it is slower to encrypt the data, and then encapsulate it to RDD. Encryption and storing data should be done parallel.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org