You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Akmal Abbasov <ak...@icloud.com> on 2015/04/21 18:43:50 UTC
Filtering hadoop metrics
Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
datanode.sink.file.record.filter.exclude=UgiMetrics
datanode.sink.file.record.filter.exclude=MetricsSystem
But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
but, in both cases I got the same result, only UgiMetrics are excluded.
Is there any way to exclude arbitrary number of records?
Thank you.
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi, I was wondering is there is a way to disable some of the sources of metrics in Hadoop? In fact I do not want to receive ugi, metricssystem and defaut metrics. Is there any way to achieve this?
Thank you.
> On 21 Apr 2015, at 19:49, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I’ve tried [Ugi]*Metrics[System]*,
> and in this case the output contains both of them.
> Thank you.
>
>> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>>
>> Hi Ted,
>> I am using hadoop-2.5.1
>> Thank you.
>>
>>> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>>>
>>> What release of hadoop are you using ?
>>>
>>> Maybe try regex such as:
>>> [Ugi]*Metrics[System]*
>>>
>>> Cheers
>>>
>>>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com> wrote:
>>>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>>>> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
>>>> datanode.sink.file.record.filter.exclude=UgiMetrics
>>>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>>>
>>>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
>>>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>>>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>>>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>>>
>>>> Is there any way to exclude arbitrary number of records?
>>>> Thank you.
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi, I was wondering is there is a way to disable some of the sources of metrics in Hadoop? In fact I do not want to receive ugi, metricssystem and defaut metrics. Is there any way to achieve this?
Thank you.
> On 21 Apr 2015, at 19:49, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I�ve tried [Ugi]*Metrics[System]*,
> and in this case the output contains both of them.
> Thank you.
>
>> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>>
>> Hi Ted,
>> I am using hadoop-2.5.1
>> Thank you.
>>
>>> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>>>
>>> What release of hadoop are you using ?
>>>
>>> Maybe try regex such as:
>>> [Ugi]*Metrics[System]*
>>>
>>> Cheers
>>>
>>>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com> wrote:
>>>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>>>> In fact I am trying to exclude �UgiMetrics� and �MetricsSystem� records, by using the following
>>>> datanode.sink.file.record.filter.exclude=UgiMetrics
>>>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>>>
>>>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I�ve tried to use something like
>>>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>>>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>>>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>>>
>>>> Is there any way to exclude arbitrary number of records?
>>>> Thank you.
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi, I was wondering is there is a way to disable some of the sources of metrics in Hadoop? In fact I do not want to receive ugi, metricssystem and defaut metrics. Is there any way to achieve this?
Thank you.
> On 21 Apr 2015, at 19:49, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I’ve tried [Ugi]*Metrics[System]*,
> and in this case the output contains both of them.
> Thank you.
>
>> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>>
>> Hi Ted,
>> I am using hadoop-2.5.1
>> Thank you.
>>
>>> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>>>
>>> What release of hadoop are you using ?
>>>
>>> Maybe try regex such as:
>>> [Ugi]*Metrics[System]*
>>>
>>> Cheers
>>>
>>>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com> wrote:
>>>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>>>> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
>>>> datanode.sink.file.record.filter.exclude=UgiMetrics
>>>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>>>
>>>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
>>>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>>>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>>>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>>>
>>>> Is there any way to exclude arbitrary number of records?
>>>> Thank you.
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi, I was wondering is there is a way to disable some of the sources of metrics in Hadoop? In fact I do not want to receive ugi, metricssystem and defaut metrics. Is there any way to achieve this?
Thank you.
> On 21 Apr 2015, at 19:49, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I�ve tried [Ugi]*Metrics[System]*,
> and in this case the output contains both of them.
> Thank you.
>
>> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>>
>> Hi Ted,
>> I am using hadoop-2.5.1
>> Thank you.
>>
>>> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>>>
>>> What release of hadoop are you using ?
>>>
>>> Maybe try regex such as:
>>> [Ugi]*Metrics[System]*
>>>
>>> Cheers
>>>
>>>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com> wrote:
>>>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>>>> In fact I am trying to exclude �UgiMetrics� and �MetricsSystem� records, by using the following
>>>> datanode.sink.file.record.filter.exclude=UgiMetrics
>>>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>>>
>>>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I�ve tried to use something like
>>>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>>>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>>>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>>>
>>>> Is there any way to exclude arbitrary number of records?
>>>> Thank you.
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I’ve tried [Ugi]*Metrics[System]*,
and in this case the output contains both of them.
Thank you.
> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I am using hadoop-2.5.1
> Thank you.
>
>> On 21 Apr 2015, at 19:32, Ted Yu <yuzhihong@gmail.com <ma...@gmail.com>> wrote:
>>
>> What release of hadoop are you using ?
>>
>> Maybe try regex such as:
>> [Ugi]*Metrics[System]*
>>
>> Cheers
>>
>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
>> datanode.sink.file.record.filter.exclude=UgiMetrics
>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>
>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>
>> Is there any way to exclude arbitrary number of records?
>> Thank you.
>>
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I’ve tried [Ugi]*Metrics[System]*,
and in this case the output contains both of them.
Thank you.
> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I am using hadoop-2.5.1
> Thank you.
>
>> On 21 Apr 2015, at 19:32, Ted Yu <yuzhihong@gmail.com <ma...@gmail.com>> wrote:
>>
>> What release of hadoop are you using ?
>>
>> Maybe try regex such as:
>> [Ugi]*Metrics[System]*
>>
>> Cheers
>>
>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
>> datanode.sink.file.record.filter.exclude=UgiMetrics
>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>
>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>
>> Is there any way to exclude arbitrary number of records?
>> Thank you.
>>
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I’ve tried [Ugi]*Metrics[System]*,
and in this case the output contains both of them.
Thank you.
> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I am using hadoop-2.5.1
> Thank you.
>
>> On 21 Apr 2015, at 19:32, Ted Yu <yuzhihong@gmail.com <ma...@gmail.com>> wrote:
>>
>> What release of hadoop are you using ?
>>
>> Maybe try regex such as:
>> [Ugi]*Metrics[System]*
>>
>> Cheers
>>
>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
>> datanode.sink.file.record.filter.exclude=UgiMetrics
>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>
>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>
>> Is there any way to exclude arbitrary number of records?
>> Thank you.
>>
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I’ve tried [Ugi]*Metrics[System]*,
and in this case the output contains both of them.
Thank you.
> On 21 Apr 2015, at 19:39, Akmal Abbasov <ak...@icloud.com> wrote:
>
> Hi Ted,
> I am using hadoop-2.5.1
> Thank you.
>
>> On 21 Apr 2015, at 19:32, Ted Yu <yuzhihong@gmail.com <ma...@gmail.com>> wrote:
>>
>> What release of hadoop are you using ?
>>
>> Maybe try regex such as:
>> [Ugi]*Metrics[System]*
>>
>> Cheers
>>
>> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
>> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
>> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
>> datanode.sink.file.record.filter.exclude=UgiMetrics
>> datanode.sink.file.record.filter.exclude=MetricsSystem
>>
>> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
>> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
>> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
>> but, in both cases I got the same result, only UgiMetrics are excluded.
>>
>> Is there any way to exclude arbitrary number of records?
>> Thank you.
>>
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I am using hadoop-2.5.1
Thank you.
> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>
> What release of hadoop are you using ?
>
> Maybe try regex such as:
> [Ugi]*Metrics[System]*
>
> Cheers
>
> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I am using hadoop-2.5.1
Thank you.
> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>
> What release of hadoop are you using ?
>
> Maybe try regex such as:
> [Ugi]*Metrics[System]*
>
> Cheers
>
> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I am using hadoop-2.5.1
Thank you.
> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>
> What release of hadoop are you using ?
>
> Maybe try regex such as:
> [Ugi]*Metrics[System]*
>
> Cheers
>
> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.
>
Re: Filtering hadoop metrics
Posted by Akmal Abbasov <ak...@icloud.com>.
Hi Ted,
I am using hadoop-2.5.1
Thank you.
> On 21 Apr 2015, at 19:32, Ted Yu <yu...@gmail.com> wrote:
>
> What release of hadoop are you using ?
>
> Maybe try regex such as:
> [Ugi]*Metrics[System]*
>
> Cheers
>
> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com <ma...@icloud.com>> wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing with hadoop-metrics2.properties file. I would like to use filters to exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records, by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.
>
Re: Filtering hadoop metrics
Posted by Ted Yu <yu...@gmail.com>.
What release of hadoop are you using ?
Maybe try regex such as:
[Ugi]*Metrics[System]*
Cheers
On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com>
wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing
> with hadoop-metrics2.properties file. I would like to use filters to
> exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records,
> by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different
> values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.
Re: Filtering hadoop metrics
Posted by Ted Yu <yu...@gmail.com>.
What release of hadoop are you using ?
Maybe try regex such as:
[Ugi]*Metrics[System]*
Cheers
On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com>
wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing
> with hadoop-metrics2.properties file. I would like to use filters to
> exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records,
> by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different
> values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.
Re: Filtering hadoop metrics
Posted by Ted Yu <yu...@gmail.com>.
What release of hadoop are you using ?
Maybe try regex such as:
[Ugi]*Metrics[System]*
Cheers
On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com>
wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing
> with hadoop-metrics2.properties file. I would like to use filters to
> exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records,
> by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different
> values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.
Re: Filtering hadoop metrics
Posted by Ted Yu <yu...@gmail.com>.
What release of hadoop are you using ?
Maybe try regex such as:
[Ugi]*Metrics[System]*
Cheers
On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov <ak...@icloud.com>
wrote:
> Hi, I am now working on hadoop cluster monitoring, and currently playing
> with hadoop-metrics2.properties file. I would like to use filters to
> exclude the records which I am not going to use.
> In fact I am trying to exclude “UgiMetrics” and “MetricsSystem” records,
> by using the following
> datanode.sink.file.record.filter.exclude=UgiMetrics
> datanode.sink.file.record.filter.exclude=MetricsSystem
>
> But the problem, is that since I am using the same key for different
> values, only the first one is excluded. I’ve tried to use something like
> 1. datanode.sink.file.record.filter.exclude= UgiMetrics, MetricsSystem
> 2. datanode.sink.file.record.filter.exclude= UgiMetrics | MetricsSystem
> but, in both cases I got the same result, only UgiMetrics are excluded.
>
> Is there any way to exclude arbitrary number of records?
> Thank you.