You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by GitBox <gi...@apache.org> on 2019/09/03 14:03:34 UTC
[GitHub] [nifi] bbende commented on a change in pull request #3679:
NIFI-6089 Add Parquet record reader and writer
bbende commented on a change in pull request #3679: NIFI-6089 Add Parquet record reader and writer
URL: https://github.com/apache/nifi/pull/3679#discussion_r320289731
##########
File path: nifi-nar-bundles/nifi-parquet-bundle/nifi-parquet-processors/src/main/java/org/apache/nifi/parquet/utils/ParquetUtils.java
##########
@@ -96,18 +97,40 @@
.allowableValues(org.apache.parquet.column.ParquetProperties.WriterVersion.values())
.build();
- public static List<AllowableValue> COMPRESSION_TYPES = getCompressionTypes();
+ public static final PropertyDescriptor AVRO_READ_COMPATIBILITY = new PropertyDescriptor.Builder()
+ .name("avro-read-compatibility")
+ .displayName("Avro Read Compatibility")
+ .description("Specifies the value for 'parquet.avro.compatible' in the underlying Parquet library")
+ .allowableValues("true", "false")
+ .defaultValue("true")
+ .required(true)
+ .build();
- public static final PropertyDescriptor COMPRESSION_TYPE = new PropertyDescriptor.Builder()
- .name("compression-type")
- .displayName("Compression Type")
- .description("The type of compression for the file being written.")
- .allowableValues(COMPRESSION_TYPES.toArray(new AllowableValue[0]))
- .defaultValue(COMPRESSION_TYPES.get(0).getValue())
+ public static final String PARQUET_AVRO_ADD_LIST_ELEMENT_RECORDS = "parquet.avro.add-list-element-records";
+
+ public static final PropertyDescriptor AVRO_ADD_LIST_ELEMENT_RECORDS = new PropertyDescriptor.Builder()
+ .name("avro-add-list-element-records")
+ .displayName("Avro Add List Element Records")
+ .description("Specifies the value for 'parquet.avro.add-list-element-records' in the underlying Parquet library")
+ .allowableValues("true", "false")
+ .defaultValue("true")
+ .required(true)
+ .build();
+
+ public static final String PARQUET_AVRO_WRITE_OLD_LIST_STRUCTURE = "parquet.avro.write-old-list-structure";
Review comment:
Good idea, will update
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services