You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jeremy Freeman (JIRA)" <ji...@apache.org> on 2014/12/25 19:25:13 UTC

[jira] [Created] (SPARK-4969) Add binaryRecords support to streaming

Jeremy Freeman created SPARK-4969:
-------------------------------------

             Summary: Add binaryRecords support to streaming
                 Key: SPARK-4969
                 URL: https://issues.apache.org/jira/browse/SPARK-4969
             Project: Spark
          Issue Type: Improvement
          Components: PySpark, Streaming
    Affects Versions: 1.2.0
            Reporter: Jeremy Freeman
            Priority: Minor


As of Spark 1.2 there is support for loading fixed length records from flat binary files. This is a useful way to load dense numerical array data into Spark, especially in scientific computing applications.

We should add support for loading this same file type in Spark Streaming, both in Scala/Java and in Python. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org