You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by xeonmailinglist <xe...@gmail.com> on 2015/02/19 17:46:50 UTC
Can't find logs in YARN
I have this map function that is printing something to the system
output, but I can't find the output.
Where YARN prints the logs of the function of map and reduce defined by
the user?
|public static class TokenizerMapper
extends Mapper<Object, Text, Text, IntWritable>{
private final static IntWritable one = new IntWritable(1);
private Text word = new Text();
public void map(Object key, Text value, Context context
) throws IOException, InterruptedException {
System.out.println(value.toString());
StringTokenizer itr = new StringTokenizer(value.toString());
while (itr.hasMoreTokens()) {
word.set(itr.nextToken());
context.write(word, one);
}
}
}
|
Re: Can't find logs in YARN
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
All logs (including stdout/stderr) should be accessible from the web-UI. You should navigate to the YARN web application and then to the MapReduce specific pages from there.
+Vinod
On Feb 19, 2015, at 8:46 AM, xeonmailinglist <xe...@gmail.com> wrote:
> I have this map function that is printing something to the system output, but I can't find the output.
> Where YARN prints the logs of the function of map and reduce defined by the user?
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can't find logs in YARN
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
All logs (including stdout/stderr) should be accessible from the web-UI. You should navigate to the YARN web application and then to the MapReduce specific pages from there.
+Vinod
On Feb 19, 2015, at 8:46 AM, xeonmailinglist <xe...@gmail.com> wrote:
> I have this map function that is printing something to the system output, but I can't find the output.
> Where YARN prints the logs of the function of map and reduce defined by the user?
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can't find logs in YARN
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
All logs (including stdout/stderr) should be accessible from the web-UI. You should navigate to the YARN web application and then to the MapReduce specific pages from there.
+Vinod
On Feb 19, 2015, at 8:46 AM, xeonmailinglist <xe...@gmail.com> wrote:
> I have this map function that is printing something to the system output, but I can't find the output.
> Where YARN prints the logs of the function of map and reduce defined by the user?
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can't find logs in YARN
Posted by Ray Chiang <rc...@cloudera.com>.
If you go to the RM UI (usually at http://<RM Machine>:8088/), then you can
see the list of jobs run, click on the History link for your job run, then
the Map link (the Map and Reduce entries won't necessarily look like links,
but they are), then you can look at the logs for each specific task.
-Ray
On Thu, Feb 19, 2015 at 8:46 AM, xeonmailinglist <xe...@gmail.com>
wrote:
> I have this map function that is printing something to the system
> output, but I can't find the output.
>
> Where YARN prints the logs of the function of map and reduce defined by
> the user?
>
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
>
>
Re: Can't find logs in YARN
Posted by Ray Chiang <rc...@cloudera.com>.
If you go to the RM UI (usually at http://<RM Machine>:8088/), then you can
see the list of jobs run, click on the History link for your job run, then
the Map link (the Map and Reduce entries won't necessarily look like links,
but they are), then you can look at the logs for each specific task.
-Ray
On Thu, Feb 19, 2015 at 8:46 AM, xeonmailinglist <xe...@gmail.com>
wrote:
> I have this map function that is printing something to the system
> output, but I can't find the output.
>
> Where YARN prints the logs of the function of map and reduce defined by
> the user?
>
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
>
>
Re: Can't find logs in YARN
Posted by Ray Chiang <rc...@cloudera.com>.
If you go to the RM UI (usually at http://<RM Machine>:8088/), then you can
see the list of jobs run, click on the History link for your job run, then
the Map link (the Map and Reduce entries won't necessarily look like links,
but they are), then you can look at the logs for each specific task.
-Ray
On Thu, Feb 19, 2015 at 8:46 AM, xeonmailinglist <xe...@gmail.com>
wrote:
> I have this map function that is printing something to the system
> output, but I can't find the output.
>
> Where YARN prints the logs of the function of map and reduce defined by
> the user?
>
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
>
>
Re: Can't find logs in YARN
Posted by Ray Chiang <rc...@cloudera.com>.
If you go to the RM UI (usually at http://<RM Machine>:8088/), then you can
see the list of jobs run, click on the History link for your job run, then
the Map link (the Map and Reduce entries won't necessarily look like links,
but they are), then you can look at the logs for each specific task.
-Ray
On Thu, Feb 19, 2015 at 8:46 AM, xeonmailinglist <xe...@gmail.com>
wrote:
> I have this map function that is printing something to the system
> output, but I can't find the output.
>
> Where YARN prints the logs of the function of map and reduce defined by
> the user?
>
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
>
>
Re: Can't find logs in YARN
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
All logs (including stdout/stderr) should be accessible from the web-UI. You should navigate to the YARN web application and then to the MapReduce specific pages from there.
+Vinod
On Feb 19, 2015, at 8:46 AM, xeonmailinglist <xe...@gmail.com> wrote:
> I have this map function that is printing something to the system output, but I can't find the output.
> Where YARN prints the logs of the function of map and reduce defined by the user?
> public static class TokenizerMapper
> extends Mapper<Object, Text, Text, IntWritable>{
>
> private final static IntWritable one = new IntWritable(1);
> private Text word = new Text();
>
> public void map(Object key, Text value, Context context
> ) throws IOException, InterruptedException {
> System.out.println(value.toString());
> StringTokenizer itr = new StringTokenizer(value.toString());
> while (itr.hasMoreTokens()) {
> word.set(itr.nextToken());
> context.write(word, one);
> }
> }
> }
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.