[jira] [Created] (PARQUET-125) Enhance the way path checking is done in ParquetFileWriter.mergeFooters

["Chris Albright (JIRA)" <ji...@apache.org>]

Chris Albright created PARQUET-125:
--------------------------------------

             Summary: Enhance the way path checking is done in ParquetFileWriter.mergeFooters
                 Key: PARQUET-125
                 URL: https://issues.apache.org/jira/browse/PARQUET-125
             Project: Parquet
          Issue Type: Improvement
          Components: parquet-mr
    Affects Versions: parquet-mr_1.6.0, 1.6.0rc2
            Reporter: Chris Albright
            Priority: Minor


To ensure a metadata summary is only written to the same path as the files from which the summary is created, there is a check against the the root path for each footer's file. Only the path is compared, which leaves a possibility that the same path on 2 different types of filesystems (hdfs vs. file for example) could cause some unexpected or erroneous output.

This outcome would be unlikely, but it is not explicitly prevented anywhere which exposes risk to future changes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)