You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by Anil Donthireddy <An...@sstech.us> on 2019/02/12 14:40:06 UTC
How to query profiler data between custom dates
Hi,
I will have two custom dates (i.e 1st Jan 2019, 30 Jan 2019) picked and I need to query profiler data from a profile between these days (i.e. the profiler data between 1st Jan 2019 to 30th Jan 2019).
I have gone through the profiler client documentation and unable to figure out a way to query profiler data as per the above requirement.
I would like know if there is any way to query profiler data as per above requirement if I am missing any documentation.
Looking forward to hear suggestions on implementing above use case.
Thanking you.
Thanks,
Anil.
Re: How to query profiler data between custom dates
Posted by Mohan Venkateshaiah <mv...@hortonworks.com>.
Hi ,
You have to use profiler-spark if you have to profile based on telemetry data that was captured in the past . You should set the below properties at batch-profiler.properties before running your batch profiler ..
profiler.batch.input.begin="2019-01-01T00:00:00Z"
profiler.batch.input.end="2019-01-30T00:00:00Z"
Thanks
Mohan DV
From: Anil Donthireddy <An...@sstech.us>
Reply-To: "user@metron.apache.org" <us...@metron.apache.org>
Date: Tuesday, February 12, 2019 at 8:10 PM
To: "user@metron.apache.org" <us...@metron.apache.org>, "dev@metron.apache.org" <de...@metron.apache.org>
Subject: How to query profiler data between custom dates
Hi,
I will have two custom dates (i.e 1st Jan 2019, 30 Jan 2019) picked and I need to query profiler data from a profile between these days (i.e. the profiler data between 1st Jan 2019 to 30th Jan 2019).
I have gone through the profiler client documentation and unable to figure out a way to query profiler data as per the above requirement.
I would like know if there is any way to query profiler data as per above requirement if I am missing any documentation.
Looking forward to hear suggestions on implementing above use case.
Thanking you.
Thanks,
Anil.
Re: How to query profiler data between custom dates
Posted by Mohan Venkateshaiah <mv...@hortonworks.com>.
Hi ,
You have to use profiler-spark if you have to profile based on telemetry data that was captured in the past . You should set the below properties at batch-profiler.properties before running your batch profiler ..
profiler.batch.input.begin="2019-01-01T00:00:00Z"
profiler.batch.input.end="2019-01-30T00:00:00Z"
Thanks
Mohan DV
From: Anil Donthireddy <An...@sstech.us>
Reply-To: "user@metron.apache.org" <us...@metron.apache.org>
Date: Tuesday, February 12, 2019 at 8:10 PM
To: "user@metron.apache.org" <us...@metron.apache.org>, "dev@metron.apache.org" <de...@metron.apache.org>
Subject: How to query profiler data between custom dates
Hi,
I will have two custom dates (i.e 1st Jan 2019, 30 Jan 2019) picked and I need to query profiler data from a profile between these days (i.e. the profiler data between 1st Jan 2019 to 30th Jan 2019).
I have gone through the profiler client documentation and unable to figure out a way to query profiler data as per the above requirement.
I would like know if there is any way to query profiler data as per above requirement if I am missing any documentation.
Looking forward to hear suggestions on implementing above use case.
Thanking you.
Thanks,
Anil.