You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/02/12 20:53:11 UTC

[GitHub] dhruve commented on issue #23735: [SPARK-26801][SQL] Read avro types other than record

dhruve commented on issue #23735: [SPARK-26801][SQL] Read avro types other than record
URL: https://github.com/apache/spark/pull/23735#issuecomment-462930054
 
 
   - I can't say for certain how the spark community would like to handle the issue. If there is an incompatibility between avro serde's, I believe most of the consumers of avro module would be affected. We could either support reading the old and new format or we could just let the users deal with writing converters. But then I believe the issue will be more broader as its not just spark that will be affected but every open source project providing utilities to deal with avro files. 
   - I thought about generating the files dynamically, but this was more of a convenience as we would have to add one more dependency for just generating the avro files and specify schemas for all of them.  I am not too picky about this.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org