You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by YouPeng Yang <yy...@gmail.com> on 2013/06/16 12:03:55 UTC
hprof profiler output location
Hi All
I want to profile a fraction of the tasks in a job,so I configured my
job as [1].
However I could not get the hprof profiler output on the host on which
I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
Where can I find the hprof profiler output?
[1]
job.setProfileEnabled(true);
job.setProfileParams(
"-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
"thread=y,verbose=n,file=%s");
job.setProfileTaskRange(true, "0-2");
job.setProfileTaskRange(false,"");
or
job.getConfiguration().setBoolean("mapreduce.task.profile", true);
job.getConfiguration().set("mapreduce.task.profile.params",
"-agentlib:hprof=cpu=samples," +
"heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
job.getConfiguration().set("mapreduce.task.profile.reduces", "");
Regards
Thanks.
Re: hprof profiler output location
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi Rahul
I even search the files using find / - name attemp*.profile.but still nothing was found.
Can you indicate the format of the file name.
Thanks
发自我的 iPhone
在 2013-6-18，20:27，Rahul Bhattacharjee <ra...@gmail.com> 写道：
> In the same directory from which the job has been triggered.
>
> Thanks,
> Rahul
>
>
> On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com> wrote:
>>
>> Hi All
>>
>> I want to profile a fraction of the tasks in a job,so I configured my job as [1].
>> However I could not get the hprof profiler output on the host on which I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>>
>>
>> Where can I find the hprof profiler output?
>>
>> [1]
>> job.setProfileEnabled(true);
>> job.setProfileParams(
>> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
>> "thread=y,verbose=n,file=%s");
>> job.setProfileTaskRange(true, "0-2");
>> job.setProfileTaskRange(false,"");
>>
>> or
>>
>> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
>> job.getConfiguration().set("mapreduce.task.profile.params", "-agentlib:hprof=cpu=samples," +
>> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
>> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
>> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>>
>>
>> Regards
>>
>> Thanks.
>
Re: hprof profiler output location
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi Rahul
I even search the files using find / - name attemp*.profile.but still nothing was found.
Can you indicate the format of the file name.
Thanks
�����ҵ� iPhone
�� 2013-6-18��20:27��Rahul Bhattacharjee <ra...@gmail.com> ���
> In the same directory from which the job has been triggered.
>
> Thanks,
> Rahul
>
>
> On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com> wrote:
>>
>> Hi All
>>
>> I want to profile a fraction of the tasks in a job,so I configured my job as [1].
>> However I could not get the hprof profiler output on the host on which I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>>
>>
>> Where can I find the hprof profiler output?
>>
>> [1]
>> job.setProfileEnabled(true);
>> job.setProfileParams(
>> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
>> "thread=y,verbose=n,file=%s");
>> job.setProfileTaskRange(true, "0-2");
>> job.setProfileTaskRange(false,"");
>>
>> or
>>
>> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
>> job.getConfiguration().set("mapreduce.task.profile.params", "-agentlib:hprof=cpu=samples," +
>> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
>> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
>> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>>
>>
>> Regards
>>
>> Thanks.
>
Re: hprof profiler output location
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi Rahul
I even search the files using find / - name attemp*.profile.but still nothing was found.
Can you indicate the format of the file name.
Thanks
发自我的 iPhone
在 2013-6-18，20:27，Rahul Bhattacharjee <ra...@gmail.com> 写道：
> In the same directory from which the job has been triggered.
>
> Thanks,
> Rahul
>
>
> On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com> wrote:
>>
>> Hi All
>>
>> I want to profile a fraction of the tasks in a job,so I configured my job as [1].
>> However I could not get the hprof profiler output on the host on which I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>>
>>
>> Where can I find the hprof profiler output?
>>
>> [1]
>> job.setProfileEnabled(true);
>> job.setProfileParams(
>> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
>> "thread=y,verbose=n,file=%s");
>> job.setProfileTaskRange(true, "0-2");
>> job.setProfileTaskRange(false,"");
>>
>> or
>>
>> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
>> job.getConfiguration().set("mapreduce.task.profile.params", "-agentlib:hprof=cpu=samples," +
>> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
>> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
>> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>>
>>
>> Regards
>>
>> Thanks.
>
Re: hprof profiler output location
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi Rahul
I even search the files using find / - name attemp*.profile.but still nothing was found.
Can you indicate the format of the file name.
Thanks
�����ҵ� iPhone
�� 2013-6-18��20:27��Rahul Bhattacharjee <ra...@gmail.com> ���
> In the same directory from which the job has been triggered.
>
> Thanks,
> Rahul
>
>
> On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com> wrote:
>>
>> Hi All
>>
>> I want to profile a fraction of the tasks in a job,so I configured my job as [1].
>> However I could not get the hprof profiler output on the host on which I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>>
>>
>> Where can I find the hprof profiler output?
>>
>> [1]
>> job.setProfileEnabled(true);
>> job.setProfileParams(
>> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
>> "thread=y,verbose=n,file=%s");
>> job.setProfileTaskRange(true, "0-2");
>> job.setProfileTaskRange(false,"");
>>
>> or
>>
>> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
>> job.getConfiguration().set("mapreduce.task.profile.params", "-agentlib:hprof=cpu=samples," +
>> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
>> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
>> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>>
>>
>> Regards
>>
>> Thanks.
>
Re: hprof profiler output location
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
In the same directory from which the job has been triggered.
Thanks,
Rahul
On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com>wrote:
>
> Hi All
>
> I want to profile a fraction of the tasks in a job,so I configured my
> job as [1].
> However I could not get the hprof profiler output on the host on which
> I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>
>
> Where can I find the hprof profiler output?
>
> [1]
> job.setProfileEnabled(true);
> job.setProfileParams(
> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
> "thread=y,verbose=n,file=%s");
> job.setProfileTaskRange(true, "0-2");
> job.setProfileTaskRange(false,"");
>
> or
>
> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
> job.getConfiguration().set("mapreduce.task.profile.params",
> "-agentlib:hprof=cpu=samples," +
> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>
>
> Regards
>
> Thanks.
>
Re: hprof profiler output location
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
In the same directory from which the job has been triggered.
Thanks,
Rahul
On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com>wrote:
>
> Hi All
>
> I want to profile a fraction of the tasks in a job,so I configured my
> job as [1].
> However I could not get the hprof profiler output on the host on which
> I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>
>
> Where can I find the hprof profiler output?
>
> [1]
> job.setProfileEnabled(true);
> job.setProfileParams(
> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
> "thread=y,verbose=n,file=%s");
> job.setProfileTaskRange(true, "0-2");
> job.setProfileTaskRange(false,"");
>
> or
>
> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
> job.getConfiguration().set("mapreduce.task.profile.params",
> "-agentlib:hprof=cpu=samples," +
> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>
>
> Regards
>
> Thanks.
>
Re: hprof profiler output location
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
In the same directory from which the job has been triggered.
Thanks,
Rahul
On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com>wrote:
>
> Hi All
>
> I want to profile a fraction of the tasks in a job,so I configured my
> job as [1].
> However I could not get the hprof profiler output on the host on which
> I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>
>
> Where can I find the hprof profiler output?
>
> [1]
> job.setProfileEnabled(true);
> job.setProfileParams(
> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
> "thread=y,verbose=n,file=%s");
> job.setProfileTaskRange(true, "0-2");
> job.setProfileTaskRange(false,"");
>
> or
>
> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
> job.getConfiguration().set("mapreduce.task.profile.params",
> "-agentlib:hprof=cpu=samples," +
> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>
>
> Regards
>
> Thanks.
>
Re: hprof profiler output location
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
In the same directory from which the job has been triggered.
Thanks,
Rahul
On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <yy...@gmail.com>wrote:
>
> Hi All
>
> I want to profile a fraction of the tasks in a job,so I configured my
> job as [1].
> However I could not get the hprof profiler output on the host on which
> I submitted my job.(I use MRv2 with YARN --CDH4.1.2---)
>
>
> Where can I find the hprof profiler output?
>
> [1]
> job.setProfileEnabled(true);
> job.setProfileParams(
> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
> "thread=y,verbose=n,file=%s");
> job.setProfileTaskRange(true, "0-2");
> job.setProfileTaskRange(false,"");
>
> or
>
> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
> job.getConfiguration().set("mapreduce.task.profile.params",
> "-agentlib:hprof=cpu=samples," +
> "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
> job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>
>
> Regards
>
> Thanks.
>