You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by Gidon Gershinsky <gg...@gmail.com> on 2022/10/26 06:51:39 UTC

Re: Parquet modular encryption on nested fields

There is a discussion on this at
https://issues.apache.org/jira/browse/PARQUET-2193 .
Basically, a workaround exists today, please check if it works for you.
Currently, I'm checking options for a more permanent solution.

(in the future, please send emails with text, instead of attaching it as a
file).

Cheers, Gidon


On Tue, Oct 25, 2022 at 1:02 PM nicolas paris <ni...@riseup.net>
wrote:

>

Re: Parquet modular encryption on nested fields

Posted by nicolas paris <ni...@riseup.net>.

> https://issues.apache.org/jira/browse/PARQUET-2193 .
> Basically, a workaround exists today, please check if it works for
> you.

Indeed, setting the bellow code in the reader side is a working
workaround. Thanks for looking for more general solution.

```
spark.sparkContext.hadoopConfiguration.set("parquet.split.files",
"false")
```


> (in the future, please send emails with text, instead of attaching it
> as afile).

sorry for this, I tried a new feature of my email client (evolution)
based on markdown, and this is attaching a html file, my bad.