You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by Anil Donthireddy <An...@sstech.us> on 2019/02/12 14:40:06 UTC

How to query profiler data between custom dates

Hi,

I will have two custom dates (i.e 1st Jan 2019, 30 Jan 2019) picked and I need to query profiler data from a profile between these days (i.e. the profiler data between 1st Jan 2019 to 30th Jan 2019).

I have gone through the profiler client documentation and unable to figure out a way to query profiler data as per the above requirement.

I would like know if there is any way to query profiler data as per above requirement if I am missing any documentation.

Looking forward to hear suggestions on implementing above use case.

Thanking you.

Thanks,
Anil.

Re: How to query profiler data between custom dates

Posted by Mohan Venkateshaiah <mv...@hortonworks.com>.
Hi ,


You have to use profiler-spark if you have to profile based on telemetry data that was captured in the past . You should set the below properties at batch-profiler.properties before running your batch profiler ..


profiler.batch.input.begin="2019-01-01T00:00:00Z"


profiler.batch.input.end="2019-01-30T00:00:00Z"


Thanks
Mohan DV

From: Anil Donthireddy <An...@sstech.us>
Reply-To: "user@metron.apache.org" <us...@metron.apache.org>
Date: Tuesday, February 12, 2019 at 8:10 PM
To: "user@metron.apache.org" <us...@metron.apache.org>, "dev@metron.apache.org" <de...@metron.apache.org>
Subject: How to query profiler data between custom dates

Hi,

I will have two custom dates (i.e 1st Jan 2019, 30 Jan 2019) picked and I need to query profiler data from a profile between these days (i.e. the profiler data between 1st Jan 2019 to 30th Jan 2019).

I have gone through the profiler client documentation and unable to figure out a way to query profiler data as per the above requirement.

I would like know if there is any way to query profiler data as per above requirement if I am missing any documentation.

Looking forward to hear suggestions on implementing above use case.

Thanking you.

Thanks,
Anil.

Re: How to query profiler data between custom dates

Posted by Mohan Venkateshaiah <mv...@hortonworks.com>.
Hi ,


You have to use profiler-spark if you have to profile based on telemetry data that was captured in the past . You should set the below properties at batch-profiler.properties before running your batch profiler ..


profiler.batch.input.begin="2019-01-01T00:00:00Z"


profiler.batch.input.end="2019-01-30T00:00:00Z"


Thanks
Mohan DV

From: Anil Donthireddy <An...@sstech.us>
Reply-To: "user@metron.apache.org" <us...@metron.apache.org>
Date: Tuesday, February 12, 2019 at 8:10 PM
To: "user@metron.apache.org" <us...@metron.apache.org>, "dev@metron.apache.org" <de...@metron.apache.org>
Subject: How to query profiler data between custom dates

Hi,

I will have two custom dates (i.e 1st Jan 2019, 30 Jan 2019) picked and I need to query profiler data from a profile between these days (i.e. the profiler data between 1st Jan 2019 to 30th Jan 2019).

I have gone through the profiler client documentation and unable to figure out a way to query profiler data as per the above requirement.

I would like know if there is any way to query profiler data as per above requirement if I am missing any documentation.

Looking forward to hear suggestions on implementing above use case.

Thanking you.

Thanks,
Anil.