You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by HARSH TAKKAR <ta...@gmail.com> on 2018/01/31 14:20:17 UTC

Data of ArrayType field getting truncated when saving to parquet

Hi

I have a dataframe with a field of type array which is of large size, when
i am trying to save the data to parquet file and read it again , array
field comes out as empty array.

Please help


Harsh