[GitHub] [iceberg] wobrycki commented on issue #4581: Spark: Cannot read or write UUID columns

[GitBox <gi...@apache.org>]

wobrycki commented on issue #4581:
URL: https://github.com/apache/iceberg/issues/4581#issuecomment-1185280784

   Hi @RussellSpitzer ,
   
   when we want to read a Spark df using iceberg, and this df has UUID column type, 
   while exporting this df to CSV we got an error:
   
   ```
   py4j.protocol.Py4JJavaError: An error occurred while calling o669.csv.
   : org.apache.spark.SparkException: Job aborted.
           at org.apache.spark.sql.errors.QueryExecutionErrors$.jobAbortedError(QueryExecutionErrors.scala:496)
           at org.apache.spark.sql.execution.datasources.FileFormatWriter$.write(FileFormatWriter.scala:251)
           at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand.run(InsertIntoHadoopFsRelationCommand.scala:186)
   (...)
           ... 1 moreCaused by: java.lang.ClassCastException: class [B cannot be cast to class org.apache.spark.unsafe.types.UTF8String ([B is in module java.base of loader 'bootstrap'; org.apache.spa
   rk.unsafe.types.UTF8String is in unnamed module of loader 'app')
           at org.apache.spark.sql.catalyst.expressions.BaseGenericInternalRow.getUTF8String(rows.scala:46)
           at org.apache.spark.sql.catalyst.expressions.BaseGenericInternalRow.getUTF8String$(rows.scala:46)
           at org.apache.spark.sql.catalyst.expressions.GenericInternalRow.getUTF8String(rows.scala:195)
           at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source)
           at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
   ```
   
   Can this be related to this issue?
   We could reproduce that by having a table with only one column of UUID type.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org