You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Teng Qiu (JIRA)" <ji...@apache.org> on 2014/07/26 04:08:38 UTC

[jira] [Created] (SPARK-2699) Improve compatibility with parquet file/table

Teng Qiu created SPARK-2699:
-------------------------------

             Summary: Improve compatibility with parquet file/table
                 Key: SPARK-2699
                 URL: https://issues.apache.org/jira/browse/SPARK-2699
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 1.1.0
            Reporter: Teng Qiu


after SPARK-2446, the compatibility with parquet file created by old spark release (spark 1.0.x) and by impala (all of versions until now: 1.4.x-cdh5) is broken.

strings in those parquet files are not annotated with UTF8 or are just only ASCII char set (impala doesn't support UTF8 yet)

this ticket aims to add a configuration option or some version check to support those parquet files.



--
This message was sent by Atlassian JIRA
(v6.2#6252)