You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/08/03 17:07:02 UTC
[jira] [Commented] (BEAM-10088) Examples Spark Runner tests failing
[Java 11]
[ https://issues.apache.org/jira/browse/BEAM-10088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170195#comment-17170195 ]
Beam JIRA Bot commented on BEAM-10088:
--------------------------------------
This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3.
Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean.
> Examples Spark Runner tests failing [Java 11]
> ---------------------------------------------
>
> Key: BEAM-10088
> URL: https://issues.apache.org/jira/browse/BEAM-10088
> Project: Beam
> Issue Type: Sub-task
> Components: runner-spark
> Reporter: Pawel Pasterz
> Priority: P2
> Labels: stale-P2
>
> Gradle *_:examples:java:sparkRunnerPreCommit _*fails during Java 11 Precommit job
> Example stack trace:
> {code:java}
> > Task :examples:java:sparkRunnerPreCommit
> 20/05/26 07:11:13 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Entering directly-translatable composite transform: 'WordCount.CountWords/Count.PerElement/Combine.perKey(Count)'
> 20/05/26 07:11:13 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Entering directly-translatable composite transform: 'WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle'
> 20/05/26 07:11:14 INFO org.apache.beam.runners.spark.metrics.MetricsAccumulator: Instantiated metrics accumulator: {
> "metrics": {
> }
> }
> 20/05/26 07:11:14 INFO org.apache.beam.runners.spark.aggregators.AggregatorsAccumulator: Instantiated aggregators accumulator:
> 20/05/26 07:11:14 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating Read(CompressedSource)
> 20/05/26 07:11:14 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating org.apache.beam.examples.WordCount$ExtractWordsFn@174ba402
> 20/05/26 07:11:15 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating org.apache.beam.sdk.transforms.MapElements$1@4c4d8e23
> 20/05/26 07:11:15 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Entering directly-translatable composite transform: 'WordCount.CountWords/Count.PerElement/Combine.perKey(Count)'
> 20/05/26 07:11:15 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating Combine.perKey(Count)
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating org.apache.beam.sdk.transforms.MapElements$1@6bfdc26a
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating Window.Assign
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn@57c4b142
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating GroupByKey
> 20/05/26 07:11:19 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder ShardedKeyCoder(VarIntCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn@3122d00d
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating org.apache.beam.sdk.io.WriteFiles$WriteUnshardedBundlesToTempFiles$1@7639f2af
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating Flatten.PCollections
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating org.apache.beam.sdk.transforms.View$VoidKeyToMultimapMaterialization$VoidKeyToMultimapMaterializationDoFn@bcb712b
> 20/05/26 07:11:19 INFO org.apache.beam.runners.spark.SparkRunner$Evaluator: Evaluating View.CreatePCollectionView
> org.apache.beam.examples.WordCountIT > testE2EWordCount FAILED
> java.lang.IllegalArgumentException: Unsupported class file major version 55
> 1 test completed, 1 failed
> Finished generating test XML results (0.002 secs) into: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java11_Phrase/src/examples/java/build/test-results/sparkRunnerPreCommit
> Generating HTML test report...
> Finished generating test html results (0.003 secs) into: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java11_Phrase/src/examples/java/build/reports/tests/sparkRunnerPreCommit
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)