[GitHub] [spark] HyukjinKwon commented on pull request #37352: [SPARK-39927][BUILD] Upgrade to Avro 1.11.1

[GitBox <gi...@apache.org>]

HyukjinKwon commented on PR #37352:
URL: https://github.com/apache/spark/pull/37352#issuecomment-1200549582

   Seems like the test failure looks related:
   
   ```
   AvroV1Suite.support user provided avro schema for writing non-nullable enum type
   java.lang.AssertionError: assertion failed: Exception tree doesn't contain the expected exception of type org.apache.avro.AvroTypeException with message: Not an enum: null
   org.apache.avro.AvroTypeException: value null is not a SuitEnumType
   	at org.apache.avro.generic.GenericDatumWriter.writeEnum(GenericDatumWriter.java:269)
   	at org.apache.avro.specific.SpecificDatumWriter.writeEnum(SpecificDatumWriter.java:66)
   	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:148)
   	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:95)
   	at org.apache.avro.reflect.ReflectDatumWriter.write(ReflectDatumWriter.java:158)
   	at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:245)
   	at org.apache.avro.specific.SpecificDatumWriter.writeField(SpecificDatumWriter.java:117)
   	at org.apache.avro.reflect.ReflectDatumWriter.writeField(ReflectDatumWriter.java:184)
   	at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:234)
   	at org.apache.avro.specific.SpecificDatumWriter.writeRecord(SpecificDatumWriter.java:92)
   	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:145)
   	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:95)
   	at org.apache.avro.reflect.ReflectDatumWriter.write(ReflectDatumWriter.java:158)
   	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:82)
   	at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:314)
   	at org.apache.spark.sql.avro.SparkAvroKeyRecordWriter.write(SparkAvroKeyOutputFormat.java:86)
   	at org.apache.spark.sql.avro.SparkAvroKeyRecordWriter.write(SparkAvroKeyOutputFormat.java:63)
   	at org.apache.spark.sql.avro.AvroOutputWriter.write(AvroOutputWriter.scala:86)
   	at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.write(FileFormatDataWriter.scala:175)
   	at org.apache.spark.sql.execution.datasources.FileFormatDataWriter.writeWithMetrics(FileFormatDataWriter.scala:85)
   	at org.apache.spark.sql.execution.datasources.FileFormatDataWriter.writeWithIterator(FileFormatDataWriter.scala:92)
   	at org.apache.spark.sql.execution.datasources.FileFormatWriter$.$anonfun$executeTask$1(FileFormatWriter.scala:323)
   	at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1524)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org