You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by PedroMrChaves <pe...@gmail.com> on 2018/03/20 13:58:00 UTC
Re: Metric Registry Warnings
Hello,
I still have the same issue with Flink Version 1.4.2.
java.lang.IllegalArgumentException: A metric named
<hostname-anonyn>.taskmanager.6aa8d13575228d38ae4abdfb37fa229e.CDC.Source:
EVENTS.1.numRecordsIn already exists
at
com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
at
org.apache.flink.dropwizard.ScheduledDropwizardReporter.notifyOfAddedMetric(ScheduledDropwizardReporter.java:131)
at
org.apache.flink.runtime.metrics.MetricRegistryImpl.register(MetricRegistryImpl.java:319)
at
org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.addMetric(AbstractMetricGroup.java:370)
at
org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.counter(AbstractMetricGroup.java:303)
at
org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.counter(AbstractMetricGroup.java:293)
at
org.apache.flink.runtime.metrics.groups.OperatorIOMetricGroup.<init>(OperatorIOMetricGroup.java:40)
at
org.apache.flink.runtime.metrics.groups.OperatorMetricGroup.<init>(OperatorMetricGroup.java:48)
at
org.apache.flink.runtime.metrics.groups.TaskMetricGroup.addOperator(TaskMetricGroup.java:146)
at
org.apache.flink.streaming.api.operators.AbstractStreamOperator.setup(AbstractStreamOperator.java:182)
at
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.setup(AbstractUdfStreamOperator.java:82)
at
org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:136)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:231)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)
at java.lang.Thread.run(Thread.java:748)
-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Metric Registry Warnings
Posted by PedroMrChaves <pe...@gmail.com>.
I have multiple sources but with distinct names and UIDs.
More information about my execution environment:
Flink Version: 1.4.2 bundled with hadoop 2.8
State backend: Hadoop 2.8
Job compiled for version 1.4.2 using the Scala version libs from Scala
version 2.11.
Am using the com.github.davidb to export the metrics to influxdb as
exemplified here:
https://github.com/jgrier/flink-stuff/tree/master/flink-influx-reporter but
recompiled for version 1.4.2.
-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Metric Registry Warnings
Posted by Chesnay Schepler <ch...@apache.org>.
FLINK-7100 is about taskmanager metrics being registered twice, whereas
here we're dealing with job metrics.
Do you have multiple sources? If so, do they have unique names?
On 20.03.2018 15:06, Fabian Hueske wrote:
> Hi Pedro,
>
> Can you reopen FLINK-7100 and post a comment with your error message
> and environment?
>
> Thanks,
> Fabian
>
> 2018-03-20 14:58 GMT+01:00 PedroMrChaves <pedro.mr.chaves@gmail.com
> <ma...@gmail.com>>:
>
> Hello,
>
> I still have the same issue with Flink Version 1.4.2.
>
> java.lang.IllegalArgumentException: A metric named
> <hostname-anonyn>.taskmanager.6aa8d13575228d38ae4abdfb37fa229e.CDC.Source:
> EVENTS.1.numRecordsIn already exists
> at
> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
> at
> org.apache.flink.dropwizard.ScheduledDropwizardReporter.notifyOfAddedMetric(ScheduledDropwizardReporter.java:131)
> at
> org.apache.flink.runtime.metrics.MetricRegistryImpl.register(MetricRegistryImpl.java:319)
> at
> org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.addMetric(AbstractMetricGroup.java:370)
> at
> org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.counter(AbstractMetricGroup.java:303)
> at
> org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.counter(AbstractMetricGroup.java:293)
> at
> org.apache.flink.runtime.metrics.groups.OperatorIOMetricGroup.<init>(OperatorIOMetricGroup.java:40)
> at
> org.apache.flink.runtime.metrics.groups.OperatorMetricGroup.<init>(OperatorMetricGroup.java:48)
> at
> org.apache.flink.runtime.metrics.groups.TaskMetricGroup.addOperator(TaskMetricGroup.java:146)
> at
> org.apache.flink.streaming.api.operators.AbstractStreamOperator.setup(AbstractStreamOperator.java:182)
> at
> org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.setup(AbstractUdfStreamOperator.java:82)
> at
> org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:136)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:231)
> at
> org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)
> at java.lang.Thread.run(Thread.java:748)
>
>
>
> -----
> Best Regards,
> Pedro Chaves
> --
> Sent from:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/>
>
>
Re: Metric Registry Warnings
Posted by Fabian Hueske <fh...@gmail.com>.
Hi Pedro,
Can you reopen FLINK-7100 and post a comment with your error message and
environment?
Thanks,
Fabian
2018-03-20 14:58 GMT+01:00 PedroMrChaves <pe...@gmail.com>:
> Hello,
>
> I still have the same issue with Flink Version 1.4.2.
>
> java.lang.IllegalArgumentException: A metric named
> <hostname-anonyn>.taskmanager.6aa8d13575228d38ae4abdfb37fa229e.CDC.Source:
> EVENTS.1.numRecordsIn already exists
> at
> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
> at
> org.apache.flink.dropwizard.ScheduledDropwizardReporter.
> notifyOfAddedMetric(ScheduledDropwizardReporter.java:131)
> at
> org.apache.flink.runtime.metrics.MetricRegistryImpl.
> register(MetricRegistryImpl.java:319)
> at
> org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.addMetric(
> AbstractMetricGroup.java:370)
> at
> org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.counter(
> AbstractMetricGroup.java:303)
> at
> org.apache.flink.runtime.metrics.groups.AbstractMetricGroup.counter(
> AbstractMetricGroup.java:293)
> at
> org.apache.flink.runtime.metrics.groups.OperatorIOMetricGroup.<init>(
> OperatorIOMetricGroup.java:40)
> at
> org.apache.flink.runtime.metrics.groups.OperatorMetricGroup.<init>(
> OperatorMetricGroup.java:48)
> at
> org.apache.flink.runtime.metrics.groups.TaskMetricGroup.addOperator(
> TaskMetricGroup.java:146)
> at
> org.apache.flink.streaming.api.operators.AbstractStreamOperator.setup(
> AbstractStreamOperator.java:182)
> at
> org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.setup(
> AbstractUdfStreamOperator.java:82)
> at
> org.apache.flink.streaming.runtime.tasks.OperatorChain.<
> init>(OperatorChain.java:136)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.
> invoke(StreamTask.java:231)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)
> at java.lang.Thread.run(Thread.java:748)
>
>
>
> -----
> Best Regards,
> Pedro Chaves
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/
>