[jira] [Created] (REEF-1765) Building a Parquet Reader for Potential Integrations with Other ML Frameworks

["Shouheng Yi (JIRA)" <ji...@apache.org>]

Shouheng Yi created REEF-1765:
---------------------------------

             Summary: Building a Parquet Reader for Potential Integrations with Other ML Frameworks
                 Key: REEF-1765
                 URL: https://issues.apache.org/jira/browse/REEF-1765
             Project: REEF
          Issue Type: New Feature
          Components: REEF.NET IO
    Affects Versions: 0.16
            Reporter: Shouheng Yi
            Priority: Minor


Parquet file format is very common in some well-known frameworks like Hadoop and Spark. By enabling REEF to read parquet file, we could potentially integrate with those frameworks. Currently we want to only support data of non-nested types with a table-like property. This allows us to transform the data into formats like RDDs, etc.

A draft of ParquetReader is provided.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)