You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/07/14 20:49:55 UTC

[GitHub] [iceberg] RussellSpitzer commented on issue #1111: Reading partitions metadata table for unpartitioned tables in Spark results in a cryptic error message

RussellSpitzer commented on issue #1111:
URL: https://github.com/apache/iceberg/issues/1111#issuecomment-658406057


   In TypeToSparkType it may also make sense to either throw an error when an empty Struct in Spark is about to be created (since this will most likely break catalyst) or just replace an empty Struct with a dummy one. Something like
   
   ```  
   if (fields.size() == 0) {
         sparkFields.add(StructField.apply("EmptyStruct", DataTypes.BinaryType, true, Metadata.empty()));
   }
   ```
   
   I did a quick test and this would clean up the error message but not inform the user that something impossible was tried


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org