You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Juan Rodríguez Hortalá <ju...@gmail.com> on 2015/06/23 16:59:29 UTC
java.lang.IllegalArgumentException: A metric named ... already exists
Hi,
I'm running a program in Spark 1.4 where several Spark Streaming contexts
are created from the same Spark context. As pointed in
https://spark.apache.org/docs/latest/streaming-programming-guide.html each
Spark Streaming context is stopped before creating the next Spark Streaming
context. The program works ok, but I get exceptions like the following when
a new Spark Streaming context is created
15/06/23 16:34:51 INFO MetricsSystem: Metrics already registered
java.lang.IllegalArgumentException: A metric named
local-1435070090627.driver.SampleStreamingTest.StreamingMetrics.streaming.lastReceivedBatch_processingEndTime
already exists
at
com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
at
com.codahale.metrics.MetricRegistry.registerAll(MetricRegistry.java:385)
at
com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:85)
Is this something to be concerned, or just a minor nuisance?
Thanks a lot in advance.
Greetings,
Juan Rodriguez Hortala
Re: java.lang.IllegalArgumentException: A metric named ... already exists
Posted by Tathagata Das <td...@databricks.com>.
I have already opened a JIRA about this.
https://issues.apache.org/jira/browse/SPARK-8743
On Mon, Jul 6, 2015 at 1:02 AM, Juan Rodríguez Hortalá <
juan.rodriguez.hortala@gmail.com> wrote:
> Hi,
>
> I haven't been able to reproduce the error reliably, I will open a JIRA as
> soon as I can
>
> Greetings,
>
> Juan
>
> 2015-06-23 21:57 GMT+02:00 Tathagata Das <td...@databricks.com>:
>
>> Aaah this could be potentially major issue as it may prevent metrics from
>> restarted streaming context be not published. Can you make it a JIRA.
>>
>> TD
>>
>> On Tue, Jun 23, 2015 at 7:59 AM, Juan Rodríguez Hortalá <
>> juan.rodriguez.hortala@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm running a program in Spark 1.4 where several Spark Streaming
>>> contexts are created from the same Spark context. As pointed in
>>> https://spark.apache.org/docs/latest/streaming-programming-guide.html
>>> each Spark Streaming context is stopped before creating the next Spark
>>> Streaming context. The program works ok, but I get exceptions like the
>>> following when a new Spark Streaming context is created
>>>
>>> 15/06/23 16:34:51 INFO MetricsSystem: Metrics already registered
>>> java.lang.IllegalArgumentException: A metric named
>>> local-1435070090627.driver.SampleStreamingTest.StreamingMetrics.streaming.lastReceivedBatch_processingEndTime
>>> already exists
>>> at
>>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
>>> at
>>> com.codahale.metrics.MetricRegistry.registerAll(MetricRegistry.java:385)
>>> at
>>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:85)
>>>
>>>
>>> Is this something to be concerned, or just a minor nuisance?
>>>
>>> Thanks a lot in advance.
>>>
>>> Greetings,
>>>
>>> Juan Rodriguez Hortala
>>>
>>
>>
>
Re: java.lang.IllegalArgumentException: A metric named ... already exists
Posted by Juan Rodríguez Hortalá <ju...@gmail.com>.
Hi,
I haven't been able to reproduce the error reliably, I will open a JIRA as
soon as I can
Greetings,
Juan
2015-06-23 21:57 GMT+02:00 Tathagata Das <td...@databricks.com>:
> Aaah this could be potentially major issue as it may prevent metrics from
> restarted streaming context be not published. Can you make it a JIRA.
>
> TD
>
> On Tue, Jun 23, 2015 at 7:59 AM, Juan Rodríguez Hortalá <
> juan.rodriguez.hortala@gmail.com> wrote:
>
>> Hi,
>>
>> I'm running a program in Spark 1.4 where several Spark Streaming contexts
>> are created from the same Spark context. As pointed in
>> https://spark.apache.org/docs/latest/streaming-programming-guide.html
>> each Spark Streaming context is stopped before creating the next Spark
>> Streaming context. The program works ok, but I get exceptions like the
>> following when a new Spark Streaming context is created
>>
>> 15/06/23 16:34:51 INFO MetricsSystem: Metrics already registered
>> java.lang.IllegalArgumentException: A metric named
>> local-1435070090627.driver.SampleStreamingTest.StreamingMetrics.streaming.lastReceivedBatch_processingEndTime
>> already exists
>> at
>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
>> at
>> com.codahale.metrics.MetricRegistry.registerAll(MetricRegistry.java:385)
>> at
>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:85)
>>
>>
>> Is this something to be concerned, or just a minor nuisance?
>>
>> Thanks a lot in advance.
>>
>> Greetings,
>>
>> Juan Rodriguez Hortala
>>
>
>
Re: java.lang.IllegalArgumentException: A metric named ... already exists
Posted by Tathagata Das <td...@databricks.com>.
Aaah this could be potentially major issue as it may prevent metrics from
restarted streaming context be not published. Can you make it a JIRA.
TD
On Tue, Jun 23, 2015 at 7:59 AM, Juan Rodríguez Hortalá <
juan.rodriguez.hortala@gmail.com> wrote:
> Hi,
>
> I'm running a program in Spark 1.4 where several Spark Streaming contexts
> are created from the same Spark context. As pointed in
> https://spark.apache.org/docs/latest/streaming-programming-guide.html
> each Spark Streaming context is stopped before creating the next Spark
> Streaming context. The program works ok, but I get exceptions like the
> following when a new Spark Streaming context is created
>
> 15/06/23 16:34:51 INFO MetricsSystem: Metrics already registered
> java.lang.IllegalArgumentException: A metric named
> local-1435070090627.driver.SampleStreamingTest.StreamingMetrics.streaming.lastReceivedBatch_processingEndTime
> already exists
> at
> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
> at
> com.codahale.metrics.MetricRegistry.registerAll(MetricRegistry.java:385)
> at
> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:85)
>
>
> Is this something to be concerned, or just a minor nuisance?
>
> Thanks a lot in advance.
>
> Greetings,
>
> Juan Rodriguez Hortala
>