[jira] [Comment Edited] (BEAM-3964) Java Github HEAD doesn't run on Dataflow

["Etienne Chauchot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418639#comment-16418639 ] 

Etienne Chauchot edited comment on BEAM-3964 at 3/29/18 10:01 AM:
------------------------------------------------------------------

Yes, there was a change in the API. I did not see the PostCommits failing, was there a fail? I think  we need to rebuild the dataflow worker after the API change like we did there: https://issues.apache.org/jira/browse/BEAM-2012 for example


was (Author: echauchot):
Yes, there was a change in the API. I did not see the PostCommits failing, was there a fail? When we change something in the API we need to rebuild the dataflow worker no? Like we did there: https://issues.apache.org/jira/browse/BEAM-2012 for example

> Java Github HEAD doesn't run on Dataflow
> ----------------------------------------
>
>                 Key: BEAM-3964
>                 URL: https://issues.apache.org/jira/browse/BEAM-3964
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow
>            Reporter: Thomas Groh
>            Assignee: Thomas Groh
>            Priority: Major
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Rather: it runs, but cannot make progress, seemingly due to an Error with metric names:
>  
> exception: "java.lang.NoSuchMethodError: org.apache.beam.sdk.metrics.MetricName.name()Ljava/lang/String; at com.google.cloud.dataflow.worker.MetricsToCounterUpdateConverter.structuredNameAndMetadata(MetricsToCounterUpdateConverter.java:99) at com.google.cloud.dataflow.worker.MetricsToCounterUpdateConverter.fromCounter(MetricsToCounterUpdateConverter.java:68) at com.google.cloud.dataflow.worker.BatchModeExecutionContext.lambda$null$1(BatchModeExecutionContext.java:463) at com.google.cloud.dataflow.worker.repackaged.com.google.common.collect.Iterators$7.transform(Iterators.java:750) at com.google.cloud.dataflow.worker.repackaged.com.google.common.collect.TransformedIterator.next(TransformedIterator.java:47) at com.google.cloud.dataflow.worker.repackaged.com.google.common.collect.MultitransformedIterator.next(MultitransformedIterator.java:66) at com.google.cloud.dataflow.worker.repackaged.com.google.common.collect.ImmutableCollection$Builder.addAll(ImmutableCollection.java:388) at com.google.cloud.dataflow.worker.repackaged.com.google.common.collect.ImmutableCollection$ArrayBasedBuilder.addAll(ImmutableCollection.java:472) at com.google.cloud.dataflow.worker.repackaged.com.google.common.collect.ImmutableList$Builder.addAll(ImmutableList.java:669) at com.google.cloud.dataflow.worker.WorkItemStatusClient.populateCounterUpdates(WorkItemStatusClient.java:256) at com.google.cloud.dataflow.worker.WorkItemStatusClient.createStatusUpdate(WorkItemStatusClient.java:240) at com.google.cloud.dataflow.worker.WorkItemStatusClient.reportError(WorkItemStatusClient.java:94) at com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:358) at com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:284) at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134) at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114) at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
>  
> Probably requires an updated container version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)