You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/08/11 12:09:00 UTC
[jira] [Commented] (SPARK-32588) SizeEstimator class not always
properly initialized in tests.
[ https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175507#comment-17175507 ]
Apache Spark commented on SPARK-32588:
--------------------------------------
User 'mundaym' has created a pull request for this issue:
https://github.com/apache/spark/pull/29407
> SizeEstimator class not always properly initialized in tests.
> -------------------------------------------------------------
>
> Key: SPARK-32588
> URL: https://issues.apache.org/jira/browse/SPARK-32588
> Project: Spark
> Issue Type: Bug
> Components: Tests
> Affects Versions: 3.0.0
> Environment: openjdk version "1.8.0_265"
> OpenJDK Runtime Environment (build 1.8.0_265-b01)
> Eclipse OpenJ9 VM (build openj9-0.21.0, JRE 1.8.0 Linux s390x-64-Bit 20200728_255 (JIT enabled, AOT enabled)
> OpenJ9 - 34cf4c075
> OMR - 113e54219
> JCL - c82ff0c20f based on jdk8u265-b01)
> Reporter: Michael Munday
> Priority: Minor
> Labels: OpenJ9
>
> The SizeEstimator class reads some system properties when it is initialized. Some tests override these system properties in order to force the SizeEstimator class to produce the same results on all platforms. However there are multiple places where the SizeEstimator class is either not re-initialized after system properties have been changed or system properties are not correctly set.
> This causes test failures when using OpenJ9 compiled in large heap mode. This build of OpenJ9 does not use compressed references which affects the settings that SizeEstimator is originally initialized with.
> I have a PR that fixes this and will submit it shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org