[jira] [Created] (SPARK-32588) SizeEstimator class not always properly initialized in tests.

["Michael Munday (Jira)" <ji...@apache.org>]

Michael Munday created SPARK-32588:
--------------------------------------

             Summary: SizeEstimator class not always properly initialized in tests.
                 Key: SPARK-32588
                 URL: https://issues.apache.org/jira/browse/SPARK-32588
             Project: Spark
          Issue Type: Bug
          Components: Tests
    Affects Versions: 3.0.0
         Environment: openjdk version "1.8.0_265"
OpenJDK Runtime Environment (build 1.8.0_265-b01)
Eclipse OpenJ9 VM (build openj9-0.21.0, JRE 1.8.0 Linux s390x-64-Bit 20200728_255 (JIT enabled, AOT enabled)
OpenJ9 - 34cf4c075
OMR - 113e54219
JCL - c82ff0c20f based on jdk8u265-b01)
            Reporter: Michael Munday


The SizeEstimator class reads some system properties when it is initialized. Some tests override these system properties in order to force the SizeEstimator class to produce the same results on all platforms. However there are multiple places where the SizeEstimator class is either not re-initialized after system properties have been changed or system properties are not correctly set.

This causes test failures when using OpenJ9 compiled in large heap mode. This build of OpenJ9 does not use compressed references which affects the settings that SizeEstimator is originally initialized with.

I have a PR that fixes this and will submit it shortly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org