You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Atul Mohan (Jira)" <ji...@apache.org> on 2022/08/26 23:53:00 UTC

[jira] [Created] (PARQUET-2178) ParquetReader constructed using builder fails to read encrypted files

Atul Mohan created PARQUET-2178:
-----------------------------------

             Summary: ParquetReader constructed using builder fails to read encrypted files
                 Key: PARQUET-2178
                 URL: https://issues.apache.org/jira/browse/PARQUET-2178
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
    Affects Versions: 1.12.2
            Reporter: Atul Mohan


ParquetReader objects can be constructed using the builder as follows:

 
{code:java}
ParquetReader<Group> builderReader = ParquetReader.builder(
new GroupReadSupport(),
new Path("path/to/c000.snappy.parquet"))
.withConf(conf)
.build();{code}
 

 

This parquetReader object cannot be used to read encrypted files as 
{noformat}
builderReader.read(){noformat}
 fails with the following exception:

 
 
{code:java}
java.lang.NullPointerException at org.apache.parquet.crypto.keytools.FileKeyUnwrapper.getKey(FileKeyUnwrapper.java:87)  {code}
It seems like the reason is that the _withConf_ method within the ParquetReader builder [clears the optionsBuilder set earlier|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetReader.java#L231].
My proposal for a solution would be to un-deprecate the constructor: 
{code:java}
ParquetReader(Configuration conf, Path file, ReadSupport<T> readSupport){code}
 so that applications can read encrypted parquet files using the ParquetReader.
If approved, I can do a PR to make this change.
Here is a sample test showcasing the issue: [https://gist.github.com/a2l007/3d813cc5e44c45100dda169dc6245ae4]
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)