[GitHub] dhruve opened a new pull request #23735: [SPARK-26801][SQL] Read avro types other than record

[GitBox <gi...@apache.org>]

dhruve opened a new pull request #23735: [SPARK-26801][SQL] Read avro types other than record
URL: https://github.com/apache/spark/pull/23735
 
 
   ## What changes were proposed in this pull request?
   Currently spark reads avro files of type records only as this is internally mapped to the SQL StructType. Any other avro type is currently not supported reading at the top level. Primitive and Non-record types are supported within a record but not on their own. This change fixes the issue by wrapping the incompatible types under a record so these can be successfully read. Note, the issue is while reading only, as during writing, spark writes these types wrapped in a record itself.
   
   ## How was this patch tested?
   Manually loaded avro primitive types and added unit tests. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org