You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Udi Meiri (JIRA)" <ji...@apache.org> on 2018/05/10 17:59:00 UTC
[jira] [Comment Edited] (BEAM-4268) Metrics and State Sampler
integration is troublesome in Dataflow
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470761#comment-16470761 ]
Udi Meiri edited comment on BEAM-4268 at 5/10/18 5:58 PM:
----------------------------------------------------------
Yes, if it was broken for DF (I was testing DR). There are these results using TestDataflowRunner, but no DirectRunner equivalent:
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
For DirectRunner, run_postcommit.sh only runs apache_beam.examples.wordcount.
was (Author: udim):
Yes, if it was broken for DF (I was testing DR). There are these results using TestDataflowRunner, but no DirectRunner equivalent:
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
For DirectRunner, run_postcommit.sh only runs apache_beam.examples.wordcount.
> Metrics and State Sampler integration is troublesome in Dataflow
> ----------------------------------------------------------------
>
> Key: BEAM-4268
> URL: https://issues.apache.org/jira/browse/BEAM-4268
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Pablo Estrada
> Assignee: Pablo Estrada
> Priority: Blocker
> Fix For: 2.5.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Improvements on how dependencies import each other should fix this
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)