You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Subho Banerjee (JIRA)" <ji...@apache.org> on 2012/08/13 05:44:37 UTC
[jira] [Created] (HADOOP-8688) Hadoop in Pseudo-Distributed mode on
Mac OS X 10.8
Subho Banerjee created HADOOP-8688:
--------------------------------------
Summary: Hadoop in Pseudo-Distributed mode on Mac OS X 10.8
Key: HADOOP-8688
URL: https://issues.apache.org/jira/browse/HADOOP-8688
Project: Hadoop Common
Issue Type: Bug
Environment: Mac OS X 10.8, Java_1.6.0_33-b03-424
Reporter: Subho Banerjee
Priority: Minor
When running hadoop on pseudo-distributed mode, the map seems to work, but it cannot compute the reduce.
12/08/13 08:58:12 INFO mapred.JobClient: Running job: job_201208130857_0001
12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0%
12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0%
12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0%
12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0%
12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0%
12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0%
12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0%
12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0%
12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0%
12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0%
12/08/13 08:59:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000000_0, Status : FAILED
Too many fetch-failures
12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout
12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr
12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0%
12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0%
12/08/13 09:00:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000001_0, Status : FAILED
Too many fetch-failures
Here is what I get when I try to see the tasklog using the links given in the output
http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr --->
2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info from SCDynamicStore
http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout --->
I have changed my hadoop-env.sh acoording to Mathew Buckett in https://issues.apache.org/jira/browse/HADOOP-7489
Also this error of Unable to load realm info from SCDynamicStore does not show up when I do 'hadoop namenode -format' or 'start-all.sh'
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8688) Hadoop in Pseudo-Distributed mode
on Mac OS X 10.8
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432903#comment-13432903 ]
Harsh J commented on HADOOP-8688:
---------------------------------
Hi Subho,
Please redirect your question to the user@hadoop.apache.org lists. The JIRA is for identified bugs on the project, not user support.
P.s. "Unable to load realm info from SCDynamicStore" warnings shouldn't block out functionality, and is more of an annoyance than anything else. 403 suggests a permission issue of some sort, and I'd look at the TaskTracker logs for any logs from org.mortbay package classes. In any case, please do send your issue to user@hadoop.apache.org and am sure the community will help you out.
> Hadoop in Pseudo-Distributed mode on Mac OS X 10.8
> --------------------------------------------------
>
> Key: HADOOP-8688
> URL: https://issues.apache.org/jira/browse/HADOOP-8688
> Project: Hadoop Common
> Issue Type: Bug
> Environment: Mac OS X 10.8, Java_1.6.0_33-b03-424
> Reporter: Subho Banerjee
> Priority: Minor
>
> When running hadoop on pseudo-distributed mode, the map seems to work, but it cannot compute the reduce.
> 12/08/13 08:58:12 INFO mapred.JobClient: Running job: job_201208130857_0001
> 12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0%
> 12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0%
> 12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0%
> 12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0%
> 12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0%
> 12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0%
> 12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0%
> 12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0%
> 12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0%
> 12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 08:59:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000000_0, Status : FAILED
> Too many fetch-failures
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr
> 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0%
> 12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 09:00:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000001_0, Status : FAILED
> Too many fetch-failures
> Here is what I get when I try to see the tasklog using the links given in the output
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr --->
> 2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info from SCDynamicStore
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout --->
> I have changed my hadoop-env.sh acoording to Mathew Buckett in https://issues.apache.org/jira/browse/HADOOP-7489
> Also this error of Unable to load realm info from SCDynamicStore does not show up when I do 'hadoop namenode -format' or 'start-all.sh'
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-8688) Hadoop in Pseudo-Distributed mode
on Mac OS X 10.8
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J resolved HADOOP-8688.
-----------------------------
Resolution: Invalid
Thanks!
> Hadoop in Pseudo-Distributed mode on Mac OS X 10.8
> --------------------------------------------------
>
> Key: HADOOP-8688
> URL: https://issues.apache.org/jira/browse/HADOOP-8688
> Project: Hadoop Common
> Issue Type: Bug
> Environment: Mac OS X 10.8, Java_1.6.0_33-b03-424
> Reporter: Subho Banerjee
> Priority: Minor
>
> When running hadoop on pseudo-distributed mode, the map seems to work, but it cannot compute the reduce.
> 12/08/13 08:58:12 INFO mapred.JobClient: Running job: job_201208130857_0001
> 12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0%
> 12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0%
> 12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0%
> 12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0%
> 12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0%
> 12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0%
> 12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0%
> 12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0%
> 12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0%
> 12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 08:59:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000000_0, Status : FAILED
> Too many fetch-failures
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr
> 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0%
> 12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 09:00:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000001_0, Status : FAILED
> Too many fetch-failures
> Here is what I get when I try to see the tasklog using the links given in the output
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr --->
> 2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info from SCDynamicStore
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout --->
> I have changed my hadoop-env.sh acoording to Mathew Buckett in https://issues.apache.org/jira/browse/HADOOP-7489
> Also this error of Unable to load realm info from SCDynamicStore does not show up when I do 'hadoop namenode -format' or 'start-all.sh'
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8688) Hadoop in Pseudo-Distributed mode
on Mac OS X 10.8
Posted by "Subho Banerjee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432911#comment-13432911 ]
Subho Banerjee commented on HADOOP-8688:
----------------------------------------
Ok... I will send it there!
Thanks.
> Hadoop in Pseudo-Distributed mode on Mac OS X 10.8
> --------------------------------------------------
>
> Key: HADOOP-8688
> URL: https://issues.apache.org/jira/browse/HADOOP-8688
> Project: Hadoop Common
> Issue Type: Bug
> Environment: Mac OS X 10.8, Java_1.6.0_33-b03-424
> Reporter: Subho Banerjee
> Priority: Minor
>
> When running hadoop on pseudo-distributed mode, the map seems to work, but it cannot compute the reduce.
> 12/08/13 08:58:12 INFO mapred.JobClient: Running job: job_201208130857_0001
> 12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0%
> 12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0%
> 12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0%
> 12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0%
> 12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0%
> 12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0%
> 12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0%
> 12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0%
> 12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0%
> 12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 08:59:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000000_0, Status : FAILED
> Too many fetch-failures
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr
> 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0%
> 12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 09:00:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000001_0, Status : FAILED
> Too many fetch-failures
> Here is what I get when I try to see the tasklog using the links given in the output
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr --->
> 2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info from SCDynamicStore
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout --->
> I have changed my hadoop-env.sh acoording to Mathew Buckett in https://issues.apache.org/jira/browse/HADOOP-7489
> Also this error of Unable to load realm info from SCDynamicStore does not show up when I do 'hadoop namenode -format' or 'start-all.sh'
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8688) Hadoop in Pseudo-Distributed mode
on Mac OS X 10.8
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433200#comment-13433200 ]
Steve Loughran commented on HADOOP-8688:
----------------------------------------
"Unable to load realm info from SCDynamicStore" is OSX whining about kerberos stuff -happens a lot, meaningless, no way to disable it (it's coming in at the java.util.logging stream, too)
> Hadoop in Pseudo-Distributed mode on Mac OS X 10.8
> --------------------------------------------------
>
> Key: HADOOP-8688
> URL: https://issues.apache.org/jira/browse/HADOOP-8688
> Project: Hadoop Common
> Issue Type: Bug
> Environment: Mac OS X 10.8, Java_1.6.0_33-b03-424
> Reporter: Subho Banerjee
> Priority: Minor
>
> When running hadoop on pseudo-distributed mode, the map seems to work, but it cannot compute the reduce.
> 12/08/13 08:58:12 INFO mapred.JobClient: Running job: job_201208130857_0001
> 12/08/13 08:58:13 INFO mapred.JobClient: map 0% reduce 0%
> 12/08/13 08:58:27 INFO mapred.JobClient: map 20% reduce 0%
> 12/08/13 08:58:33 INFO mapred.JobClient: map 30% reduce 0%
> 12/08/13 08:58:36 INFO mapred.JobClient: map 40% reduce 0%
> 12/08/13 08:58:39 INFO mapred.JobClient: map 50% reduce 0%
> 12/08/13 08:58:42 INFO mapred.JobClient: map 60% reduce 0%
> 12/08/13 08:58:45 INFO mapred.JobClient: map 70% reduce 0%
> 12/08/13 08:58:48 INFO mapred.JobClient: map 80% reduce 0%
> 12/08/13 08:58:51 INFO mapred.JobClient: map 90% reduce 0%
> 12/08/13 08:58:54 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 08:59:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000000_0, Status : FAILED
> Too many fetch-failures
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout
> 12/08/13 08:59:14 WARN mapred.JobClient: Error reading task outputServer returned HTTP response code: 403 for URL: http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr
> 12/08/13 08:59:18 INFO mapred.JobClient: map 89% reduce 0%
> 12/08/13 08:59:21 INFO mapred.JobClient: map 100% reduce 0%
> 12/08/13 09:00:14 INFO mapred.JobClient: Task Id : attempt_201208130857_0001_m_000001_0, Status : FAILED
> Too many fetch-failures
> Here is what I get when I try to see the tasklog using the links given in the output
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stderr --->
> 2012-08-13 08:58:39.189 java[74092:1203] Unable to load realm info from SCDynamicStore
> http://10.1.66.17:50060/tasklog?plaintext=true&attemptid=attempt_201208130857_0001_m_000000_0&filter=stdout --->
> I have changed my hadoop-env.sh acoording to Mathew Buckett in https://issues.apache.org/jira/browse/HADOOP-7489
> Also this error of Unable to load realm info from SCDynamicStore does not show up when I do 'hadoop namenode -format' or 'start-all.sh'
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira