You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/01/22 04:29:24 UTC

[GitHub] [iceberg] HeartSaVioR commented on issue #2122: Spark can't read Iceberg table created from Presto

HeartSaVioR commented on issue #2122:
URL: https://github.com/apache/iceberg/issues/2122#issuecomment-765113297


   That's a fundamental issue on "Spark" side, not "Iceberg" side. Spark only has the type "timestamp" which is used as "timestamp with timezone". Iceberg can't add the support of "timestamp without timezone" arbitrarily on Spark. Spark's "user defined type" is not a public API so Iceberg can't even expose the column of the type as UDT as well.
   
   There still has a possibility to expose it under "long" type, but you'll lose the characteristic of "timestamp" there. If we think it's still better than "don't support", probably a way to move forward.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org