[GitHub] [incubator-iceberg] rdblue opened a new pull request #219: Fix concurrent access to lazy PartitionSpec methods

[GitBox <gi...@apache.org>]

rdblue opened a new pull request #219: Fix concurrent access to lazy PartitionSpec methods
URL: https://github.com/apache/incubator-iceberg/pull/219
 
 
   This was causing `NullPointerException` in `PartitionData.get`. When two Spark tasks started at the same time on an executor, both would load the same partition spec instance because of the spec parser's cache. One thread would create `lazyJavaClasses` and another would access it before it was fully initialized, causing Spark's converter to partition to cache null classes for some partitions, leading to the NPE from `PartitionData.get`.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org