Flaky test issue report

[Beam Jira Bot <ji...@apache.org>]

This is your daily summary of Beam's current flaky tests. These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software.

    BEAM-11837: Null checking causes build flakes: "Memory constraints are impeding performance" (https://issues.apache.org/jira/browse/BEAM-11837)
    BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (https://issues.apache.org/jira/browse/BEAM-11666)
    BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (https://issues.apache.org/jira/browse/BEAM-11661)
    BEAM-11646: beam_PostCommit_XVR_Spark failing (https://issues.apache.org/jira/browse/BEAM-11646)
    BEAM-11645: beam_PostCommit_XVR_Flink failing (https://issues.apache.org/jira/browse/BEAM-11645)
    BEAM-11493: Spark test failure: org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows (https://issues.apache.org/jira/browse/BEAM-11493)
    BEAM-11492: Spark test failure: org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyMergingWindows (https://issues.apache.org/jira/browse/BEAM-11492)
    BEAM-11491: Spark test failure: org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyMultipleWindows (https://issues.apache.org/jira/browse/BEAM-11491)
    BEAM-11490: Spark test failure: org.apache.beam.sdk.transforms.ReifyTimestampsTest.inValuesSucceeds (https://issues.apache.org/jira/browse/BEAM-11490)
    BEAM-11489: Spark test failure: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (https://issues.apache.org/jira/browse/BEAM-11489)
    BEAM-11488: Spark test failure: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedCounterMetrics (https://issues.apache.org/jira/browse/BEAM-11488)
    BEAM-11487: Spark test failure: org.apache.beam.sdk.transforms.WithTimestampsTest.withTimestampsShouldApplyTimestamps (https://issues.apache.org/jira/browse/BEAM-11487)
    BEAM-11486: Spark test failure: org.apache.beam.sdk.testing.PAssertTest.testSerializablePredicate (https://issues.apache.org/jira/browse/BEAM-11486)
    BEAM-11485: Spark test failure: org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineNullValues (https://issues.apache.org/jira/browse/BEAM-11485)
    BEAM-11484: Spark test failure: org.apache.beam.runners.core.metrics.MetricsPusherTest.pushesUserMetrics (https://issues.apache.org/jira/browse/BEAM-11484)
    BEAM-11483: Spark PostCommit Test Improvements (https://issues.apache.org/jira/browse/BEAM-11483)
    BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (https://issues.apache.org/jira/browse/BEAM-10987)
    BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (https://issues.apache.org/jira/browse/BEAM-10968)
    BEAM-10955: Flink Java Runner test flake: Could not find Flink job  (https://issues.apache.org/jira/browse/BEAM-10955)
    BEAM-10923: Python requirements installation in docker container is flaky (https://issues.apache.org/jira/browse/BEAM-10923)
    BEAM-10901: Flaky test: PipelineInstrumentTest.test_able_to_cache_intermediate_unbounded_source_pcollection (https://issues.apache.org/jira/browse/BEAM-10901)
    BEAM-10763: Spotless flake (NullPointerException) (https://issues.apache.org/jira/browse/BEAM-10763)
    BEAM-10590: BigQueryQueryToTableIT flaky: test_big_query_new_types (https://issues.apache.org/jira/browse/BEAM-10590)
    BEAM-10589: Samza ValidatesRunner failure: testParDoWithSideInputsIsCumulative (https://issues.apache.org/jira/browse/BEAM-10589)
    BEAM-10519: MultipleInputsAndOutputTests.testParDoWithSideInputsIsCumulative flaky on Samza (https://issues.apache.org/jira/browse/BEAM-10519)
    BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (https://issues.apache.org/jira/browse/BEAM-10504)
    BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (https://issues.apache.org/jira/browse/BEAM-10501)
    BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (https://issues.apache.org/jira/browse/BEAM-10485)
    BEAM-10272: Failure in CassandraIOTest init: cannot create cluster due to netty link error (https://issues.apache.org/jira/browse/BEAM-10272)
    BEAM-9757: Flake in JavaPortabilityApi precommit (https://issues.apache.org/jira/browse/BEAM-9757)
    BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (https://issues.apache.org/jira/browse/BEAM-9649)
    BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (https://issues.apache.org/jira/browse/BEAM-9232)
    BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (https://issues.apache.org/jira/browse/BEAM-9119)
    BEAM-8879: IOError flake in PortableRunnerTest (https://issues.apache.org/jira/browse/BEAM-8879)
    BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (https://issues.apache.org/jira/browse/BEAM-8101)
    BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults]  Flake: Outputs must be in timestamp order (https://issues.apache.org/jira/browse/BEAM-8035)
    BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (https://issues.apache.org/jira/browse/BEAM-7992)
    BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (https://issues.apache.org/jira/browse/BEAM-7827)
    BEAM-7469: [beam_PostCommit_Java_Nexmark_Dataflow] [:sdks:java:testing:nexmark:run] Job was unexpectedly updated (https://issues.apache.org/jira/browse/BEAM-7469)
    BEAM-6804: [beam_PostCommit_Java] [PubsubReadIT.testReadPublicData] Timeout waiting on Sub (https://issues.apache.org/jira/browse/BEAM-6804)
    BEAM-5814: Failure in RegisterAndProcessBundleOperationTest.testProcessingBundleHandlesMultimapSideInputRequests (https://issues.apache.org/jira/browse/BEAM-5814)
    BEAM-5811: Timeout in Python datastore_write_it_test.DatastoreWriteIT (https://issues.apache.org/jira/browse/BEAM-5811)
    BEAM-5286: [beam_PostCommit_Java_GradleBuild][org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline][Flake] .sh script: text file busy. (https://issues.apache.org/jira/browse/BEAM-5286)
    BEAM-5171: org.apache.beam.sdk.io.CountingSourceTest.test[Un]boundedSourceSplits tests are flaky in Spark runner (https://issues.apache.org/jira/browse/BEAM-5171)
    BEAM-5150: MqttIOTest.testRead is flaky (https://issues.apache.org/jira/browse/BEAM-5150)
    BEAM-5070: nexmark.sources.UnboundedEventSourceTest.resumeFromCheckpoint is flaky (https://issues.apache.org/jira/browse/BEAM-5070)
    BEAM-3604: MqttIOTest testReadNoClientId failure timeout flaky test (https://issues.apache.org/jira/browse/BEAM-3604)
    BEAM-1582: ResumeFromCheckpointStreamingTest flakes with what appears as a second firing. (https://issues.apache.org/jira/browse/BEAM-1582)