You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Alexey Romanenko (Jira)" <ji...@apache.org> on 2019/11/27 14:34:00 UTC
[jira] [Updated] (BEAM-8839) Failed ValidatesRunner tests for new
Spark Runner
[ https://issues.apache.org/jira/browse/BEAM-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexey Romanenko updated BEAM-8839:
-----------------------------------
Description:
Some of the transform translations for new Spark runner (Flatten and Combine in particular) fail on several corner cases when ValidatesRunner tests are running. These tests were excluded from run for new Spark Runner to keep Jenkins job green and detect regression easily (if any) but they have to be addressed and correspondent translations have to be fixed.
List of these tests:
{code}
'org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContextEmpty'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testFixedWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSessionsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSlidingWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
'org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded'
{code}
was:
Some of the transform translations for new Spark runner (Flatten and Combine in particular) fail on several corner cases when ValidatesRunner tests are running. These tests were excluded from run for new Spark Runner to keep Jenkins job green and detect regression easily (if any) but they have to be addressed and correspondent translations have to be fixed.
List of these tests:
{code}
'org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContextEmpty'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testFixedWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSessionsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSlidingWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
'org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded'
> Failed ValidatesRunner tests for new Spark Runner
> -------------------------------------------------
>
> Key: BEAM-8839
> URL: https://issues.apache.org/jira/browse/BEAM-8839
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Alexey Romanenko
> Priority: Major
>
> Some of the transform translations for new Spark runner (Flatten and Combine in particular) fail on several corner cases when ValidatesRunner tests are running. These tests were excluded from run for new Spark Runner to keep Jenkins job green and detect regression easily (if any) but they have to be addressed and correspondent translations have to be fixed.
> List of these tests:
> {code}
> 'org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineWithContext'
> 'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContext'
> 'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContextEmpty'
> 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testFixedWindowsCombineWithContext'
> 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSessionsCombineWithContext'
> 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSlidingWindowsCombineWithContext'
> 'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders'
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
> 'org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded'
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)