You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Zoltan Ivanfi (JIRA)" <ji...@apache.org> on 2018/08/13 13:53:00 UTC
[jira] [Created] (SPARK-25102) Write Spark version information to
Parquet file footers
Zoltan Ivanfi created SPARK-25102:
-------------------------------------
Summary: Write Spark version information to Parquet file footers
Key: SPARK-25102
URL: https://issues.apache.org/jira/browse/SPARK-25102
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.3.1
Reporter: Zoltan Ivanfi
-PARQUET-352- added support for the "writer.model.name" property in the Parquet metadata to identify the object model (application) that wrote the file.
The easiest way to write this property is by overriding getName() of org.apache.parquet.hadoop.api.WriteSupport. In Spark, this would mean adding getName() to the org.apache.spark.sql.execution.datasources.parquet.ParquetWriteSupport class.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org