[GitHub] [incubator-iceberg] rdblue commented on issue #464: add optional stringType column after a new long type column , when write data get an exception

[GitBox <gi...@apache.org>]

rdblue commented on issue #464: add optional  stringType column after a new long type column ,when write data get an  exception
URL: https://github.com/apache/incubator-iceberg/issues/464#issuecomment-535120609
 
 
   @shawnding, I think your reproduction case is missing how you are filling in data for the new columns in Spark. All of the Records you store only have one field, `i`. (I think this is why @ZhijieWang could not reproduce the problem.)
   
   The problem here is that the value Iceberg is attempting to store is invalid. The `UTF8String` has a field, `numBytes`, that is negative and causing the exception. From the stack trace you posted, it looks like this is correctly using an `OptionWriter` to handle the case where the string is not set (hence the data may be corrupt) but that appears to not be the problem.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org