You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Ramya S <ra...@suntecgroup.com> on 2013/05/10 12:25:46 UTC
Issue with running my first hadoop program using eclipse
Hi,
I am new to hadoop,so please help me to tackle the following issue.
I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node with hadoop-1.0.4.It works fine and i tried some examples of wordcount on putty too. But getting into eclipse IDE on windows i was struck up with the first program. I have already installed jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop error occurs as follows:-
*
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
*
ERROR security.UserGroupInformation: PriviledgedActionException as:ramyas cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
*
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
*
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
*
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
*
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
*
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
*
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
*
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
*
at java.security.AccessController.doPrivileged(Native Method)
*
at javax.security.auth.Subject.doAs(Unknown Source)
*
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
*
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
*
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
*
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
*
at WordCount.main(WordCount.java:29)
*
Also I want to know about configuring map/reduce plugin in eclipse.
Thanks and Regards
Ramya.S
Re: Issue with running my first hadoop program using eclipse
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Ramya,
You might find this
JIRA<https://issues.apache.org/jira/browse/HADOOP-7682?focusedCommentId=13236645#comment-13236645>useful
which talks about the same problem. And for configuring the eclipse
plugin you could visit
this<http://cloudfront.blogspot.in/2012/07/how-to-run-mapreduce-programs-using.html#.UYzeTkAW38s>
page.
I have tries to explain the procedure. Let me know if you face any problem.
Warm Regards,
Tariq
cloudfront.blogspot.com
On Fri, May 10, 2013 at 4:32 PM, Ramya S <ra...@suntecgroup.com> wrote:
> Hi,
>
> So it is not due to the problem of map/reduce plugin, rt?
> Then it will be due to error in configuring map/reduce plugin na?
> So can you explain it with necessary steps?
>
>
> ________________________________
>
> From: Geelong Yao [mailto:geelongyao@gmail.com]
> Sent: Fri 5/10/2013 4:27 PM
> To: user@hadoop.apache.org
> Subject: Re: Issue with running my first hadoop program using eclipse
>
>
> I think the main problem maybe the permission of your tmp directory.
>
>
> 2013/5/10 Ramya S <ra...@suntecgroup.com>
>
>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single
> Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i
> tried some examples of wordcount on putty too. But getting into eclipse IDE
> on windows i was struck up with the first program. I have already installed
> jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop
> error occurs as follows:-
>
>
>
>
> *
> WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> *
> ERROR security.UserGroupInformation:
>
> PriviledgedActionException as:ramyas cause:java.io.IOException:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
>
> *
> java.io.IOException
> : Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> FileUtil.java:689)
> *
> at org.apache.hadoop.fs.FileUtil.setPermission(
> FileUtil.java:662)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> RawLocalFileSystem.java:509)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> RawLocalFileSystem.java:344)
> *
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> FilterFileSystem.java:189)
> *
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> JobSubmissionFiles.java:116)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:856)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:850)
> *
> at java.security.AccessController.doPrivileged(
> Native Method)
> *
> at javax.security.auth.Subject.doAs(Unknown Source)
> *
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1121)
> *
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> JobClient.java:850)
> *
> at org.apache.hadoop.mapred.JobClient.submitJob(
> JobClient.java:824)
> *
> at org.apache.hadoop.mapred.JobClient.runJob(
> JobClient.java:1261)
> *
> at WordCount.main(
> WordCount.java:29)
> * Also I want to know about configuring map/reduce plugin in
> eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
>
>
>
> --
> From Good To Great
>
Re: Issue with running my first hadoop program using eclipse
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Ramya,
You might find this
JIRA<https://issues.apache.org/jira/browse/HADOOP-7682?focusedCommentId=13236645#comment-13236645>useful
which talks about the same problem. And for configuring the eclipse
plugin you could visit
this<http://cloudfront.blogspot.in/2012/07/how-to-run-mapreduce-programs-using.html#.UYzeTkAW38s>
page.
I have tries to explain the procedure. Let me know if you face any problem.
Warm Regards,
Tariq
cloudfront.blogspot.com
On Fri, May 10, 2013 at 4:32 PM, Ramya S <ra...@suntecgroup.com> wrote:
> Hi,
>
> So it is not due to the problem of map/reduce plugin, rt?
> Then it will be due to error in configuring map/reduce plugin na?
> So can you explain it with necessary steps?
>
>
> ________________________________
>
> From: Geelong Yao [mailto:geelongyao@gmail.com]
> Sent: Fri 5/10/2013 4:27 PM
> To: user@hadoop.apache.org
> Subject: Re: Issue with running my first hadoop program using eclipse
>
>
> I think the main problem maybe the permission of your tmp directory.
>
>
> 2013/5/10 Ramya S <ra...@suntecgroup.com>
>
>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single
> Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i
> tried some examples of wordcount on putty too. But getting into eclipse IDE
> on windows i was struck up with the first program. I have already installed
> jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop
> error occurs as follows:-
>
>
>
>
> *
> WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> *
> ERROR security.UserGroupInformation:
>
> PriviledgedActionException as:ramyas cause:java.io.IOException:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
>
> *
> java.io.IOException
> : Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> FileUtil.java:689)
> *
> at org.apache.hadoop.fs.FileUtil.setPermission(
> FileUtil.java:662)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> RawLocalFileSystem.java:509)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> RawLocalFileSystem.java:344)
> *
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> FilterFileSystem.java:189)
> *
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> JobSubmissionFiles.java:116)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:856)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:850)
> *
> at java.security.AccessController.doPrivileged(
> Native Method)
> *
> at javax.security.auth.Subject.doAs(Unknown Source)
> *
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1121)
> *
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> JobClient.java:850)
> *
> at org.apache.hadoop.mapred.JobClient.submitJob(
> JobClient.java:824)
> *
> at org.apache.hadoop.mapred.JobClient.runJob(
> JobClient.java:1261)
> *
> at WordCount.main(
> WordCount.java:29)
> * Also I want to know about configuring map/reduce plugin in
> eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
>
>
>
> --
> From Good To Great
>
Re: Issue with running my first hadoop program using eclipse
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Ramya,
You might find this
JIRA<https://issues.apache.org/jira/browse/HADOOP-7682?focusedCommentId=13236645#comment-13236645>useful
which talks about the same problem. And for configuring the eclipse
plugin you could visit
this<http://cloudfront.blogspot.in/2012/07/how-to-run-mapreduce-programs-using.html#.UYzeTkAW38s>
page.
I have tries to explain the procedure. Let me know if you face any problem.
Warm Regards,
Tariq
cloudfront.blogspot.com
On Fri, May 10, 2013 at 4:32 PM, Ramya S <ra...@suntecgroup.com> wrote:
> Hi,
>
> So it is not due to the problem of map/reduce plugin, rt?
> Then it will be due to error in configuring map/reduce plugin na?
> So can you explain it with necessary steps?
>
>
> ________________________________
>
> From: Geelong Yao [mailto:geelongyao@gmail.com]
> Sent: Fri 5/10/2013 4:27 PM
> To: user@hadoop.apache.org
> Subject: Re: Issue with running my first hadoop program using eclipse
>
>
> I think the main problem maybe the permission of your tmp directory.
>
>
> 2013/5/10 Ramya S <ra...@suntecgroup.com>
>
>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single
> Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i
> tried some examples of wordcount on putty too. But getting into eclipse IDE
> on windows i was struck up with the first program. I have already installed
> jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop
> error occurs as follows:-
>
>
>
>
> *
> WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> *
> ERROR security.UserGroupInformation:
>
> PriviledgedActionException as:ramyas cause:java.io.IOException:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
>
> *
> java.io.IOException
> : Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> FileUtil.java:689)
> *
> at org.apache.hadoop.fs.FileUtil.setPermission(
> FileUtil.java:662)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> RawLocalFileSystem.java:509)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> RawLocalFileSystem.java:344)
> *
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> FilterFileSystem.java:189)
> *
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> JobSubmissionFiles.java:116)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:856)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:850)
> *
> at java.security.AccessController.doPrivileged(
> Native Method)
> *
> at javax.security.auth.Subject.doAs(Unknown Source)
> *
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1121)
> *
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> JobClient.java:850)
> *
> at org.apache.hadoop.mapred.JobClient.submitJob(
> JobClient.java:824)
> *
> at org.apache.hadoop.mapred.JobClient.runJob(
> JobClient.java:1261)
> *
> at WordCount.main(
> WordCount.java:29)
> * Also I want to know about configuring map/reduce plugin in
> eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
>
>
>
> --
> From Good To Great
>
Re: Issue with running my first hadoop program using eclipse
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Ramya,
You might find this
JIRA<https://issues.apache.org/jira/browse/HADOOP-7682?focusedCommentId=13236645#comment-13236645>useful
which talks about the same problem. And for configuring the eclipse
plugin you could visit
this<http://cloudfront.blogspot.in/2012/07/how-to-run-mapreduce-programs-using.html#.UYzeTkAW38s>
page.
I have tries to explain the procedure. Let me know if you face any problem.
Warm Regards,
Tariq
cloudfront.blogspot.com
On Fri, May 10, 2013 at 4:32 PM, Ramya S <ra...@suntecgroup.com> wrote:
> Hi,
>
> So it is not due to the problem of map/reduce plugin, rt?
> Then it will be due to error in configuring map/reduce plugin na?
> So can you explain it with necessary steps?
>
>
> ________________________________
>
> From: Geelong Yao [mailto:geelongyao@gmail.com]
> Sent: Fri 5/10/2013 4:27 PM
> To: user@hadoop.apache.org
> Subject: Re: Issue with running my first hadoop program using eclipse
>
>
> I think the main problem maybe the permission of your tmp directory.
>
>
> 2013/5/10 Ramya S <ra...@suntecgroup.com>
>
>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single
> Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i
> tried some examples of wordcount on putty too. But getting into eclipse IDE
> on windows i was struck up with the first program. I have already installed
> jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop
> error occurs as follows:-
>
>
>
>
> *
> WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> *
> ERROR security.UserGroupInformation:
>
> PriviledgedActionException as:ramyas cause:java.io.IOException:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
>
> *
> java.io.IOException
> : Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> FileUtil.java:689)
> *
> at org.apache.hadoop.fs.FileUtil.setPermission(
> FileUtil.java:662)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> RawLocalFileSystem.java:509)
> *
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> RawLocalFileSystem.java:344)
> *
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> FilterFileSystem.java:189)
> *
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> JobSubmissionFiles.java:116)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:856)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(
> JobClient.java:850)
> *
> at java.security.AccessController.doPrivileged(
> Native Method)
> *
> at javax.security.auth.Subject.doAs(Unknown Source)
> *
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1121)
> *
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> JobClient.java:850)
> *
> at org.apache.hadoop.mapred.JobClient.submitJob(
> JobClient.java:824)
> *
> at org.apache.hadoop.mapred.JobClient.runJob(
> JobClient.java:1261)
> *
> at WordCount.main(
> WordCount.java:29)
> * Also I want to know about configuring map/reduce plugin in
> eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
>
>
>
> --
> From Good To Great
>
RE: Issue with running my first hadoop program using eclipse
Posted by Ramya S <ra...@suntecgroup.com>.
Hi,
So it is not due to the problem of map/reduce plugin, rt?
Then it will be due to error in configuring map/reduce plugin na?
So can you explain it with necessary steps?
________________________________
From: Geelong Yao [mailto:geelongyao@gmail.com]
Sent: Fri 5/10/2013 4:27 PM
To: user@hadoop.apache.org
Subject: Re: Issue with running my first hadoop program using eclipse
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
Hi,
I am new to hadoop,so please help me to tackle the following issue.
I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i tried some examples of wordcount on putty too. But getting into eclipse IDE on windows i was struck up with the first program. I have already installed jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop error occurs as follows:-
*
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
*
ERROR security.UserGroupInformation:
PriviledgedActionException as:ramyas cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
java.io.IOException
: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
at org.apache.hadoop.fs.FileUtil.checkReturnValue(
FileUtil.java:689)
*
at org.apache.hadoop.fs.FileUtil.setPermission(
FileUtil.java:662)
*
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
RawLocalFileSystem.java:509)
*
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
RawLocalFileSystem.java:344)
*
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
FilterFileSystem.java:189)
*
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
JobSubmissionFiles.java:116)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:856)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:850)
*
at java.security.AccessController.doPrivileged(
Native Method)
*
at javax.security.auth.Subject.doAs(Unknown Source)
*
at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1121)
*
at org.apache.hadoop.mapred.JobClient.submitJobInternal(
JobClient.java:850)
*
at org.apache.hadoop.mapred.JobClient.submitJob(
JobClient.java:824)
*
at org.apache.hadoop.mapred.JobClient.runJob(
JobClient.java:1261)
*
at WordCount.main(
WordCount.java:29)
* Also I want to know about configuring map/reduce plugin in eclipse.
Thanks and Regards
Ramya.S
--
From Good To Great
RE: Issue with running my first hadoop program using eclipse
Posted by Ramya S <ra...@suntecgroup.com>.
Hi,
So it is not due to the problem of map/reduce plugin, rt?
Then it will be due to error in configuring map/reduce plugin na?
So can you explain it with necessary steps?
________________________________
From: Geelong Yao [mailto:geelongyao@gmail.com]
Sent: Fri 5/10/2013 4:27 PM
To: user@hadoop.apache.org
Subject: Re: Issue with running my first hadoop program using eclipse
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
Hi,
I am new to hadoop,so please help me to tackle the following issue.
I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i tried some examples of wordcount on putty too. But getting into eclipse IDE on windows i was struck up with the first program. I have already installed jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop error occurs as follows:-
*
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
*
ERROR security.UserGroupInformation:
PriviledgedActionException as:ramyas cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
java.io.IOException
: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
at org.apache.hadoop.fs.FileUtil.checkReturnValue(
FileUtil.java:689)
*
at org.apache.hadoop.fs.FileUtil.setPermission(
FileUtil.java:662)
*
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
RawLocalFileSystem.java:509)
*
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
RawLocalFileSystem.java:344)
*
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
FilterFileSystem.java:189)
*
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
JobSubmissionFiles.java:116)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:856)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:850)
*
at java.security.AccessController.doPrivileged(
Native Method)
*
at javax.security.auth.Subject.doAs(Unknown Source)
*
at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1121)
*
at org.apache.hadoop.mapred.JobClient.submitJobInternal(
JobClient.java:850)
*
at org.apache.hadoop.mapred.JobClient.submitJob(
JobClient.java:824)
*
at org.apache.hadoop.mapred.JobClient.runJob(
JobClient.java:1261)
*
at WordCount.main(
WordCount.java:29)
* Also I want to know about configuring map/reduce plugin in eclipse.
Thanks and Regards
Ramya.S
--
From Good To Great
RE: Issue with running my first hadoop program using eclipse
Posted by Ramya S <ra...@suntecgroup.com>.
Hi,
So it is not due to the problem of map/reduce plugin, rt?
Then it will be due to error in configuring map/reduce plugin na?
So can you explain it with necessary steps?
________________________________
From: Geelong Yao [mailto:geelongyao@gmail.com]
Sent: Fri 5/10/2013 4:27 PM
To: user@hadoop.apache.org
Subject: Re: Issue with running my first hadoop program using eclipse
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
Hi,
I am new to hadoop,so please help me to tackle the following issue.
I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i tried some examples of wordcount on putty too. But getting into eclipse IDE on windows i was struck up with the first program. I have already installed jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop error occurs as follows:-
*
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
*
ERROR security.UserGroupInformation:
PriviledgedActionException as:ramyas cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
java.io.IOException
: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
at org.apache.hadoop.fs.FileUtil.checkReturnValue(
FileUtil.java:689)
*
at org.apache.hadoop.fs.FileUtil.setPermission(
FileUtil.java:662)
*
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
RawLocalFileSystem.java:509)
*
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
RawLocalFileSystem.java:344)
*
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
FilterFileSystem.java:189)
*
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
JobSubmissionFiles.java:116)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:856)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:850)
*
at java.security.AccessController.doPrivileged(
Native Method)
*
at javax.security.auth.Subject.doAs(Unknown Source)
*
at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1121)
*
at org.apache.hadoop.mapred.JobClient.submitJobInternal(
JobClient.java:850)
*
at org.apache.hadoop.mapred.JobClient.submitJob(
JobClient.java:824)
*
at org.apache.hadoop.mapred.JobClient.runJob(
JobClient.java:1261)
*
at WordCount.main(
WordCount.java:29)
* Also I want to know about configuring map/reduce plugin in eclipse.
Thanks and Regards
Ramya.S
--
From Good To Great
RE: Issue with running my first hadoop program using eclipse
Posted by Ramya S <ra...@suntecgroup.com>.
Hi,
So it is not due to the problem of map/reduce plugin, rt?
Then it will be due to error in configuring map/reduce plugin na?
So can you explain it with necessary steps?
________________________________
From: Geelong Yao [mailto:geelongyao@gmail.com]
Sent: Fri 5/10/2013 4:27 PM
To: user@hadoop.apache.org
Subject: Re: Issue with running my first hadoop program using eclipse
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
Hi,
I am new to hadoop,so please help me to tackle the following issue.
I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node with hadoop-1.0.4.It <http://hadoop-1.0.4.it/> works fine and i tried some examples of wordcount on putty too. But getting into eclipse IDE on windows i was struck up with the first program. I have already installed jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop error occurs as follows:-
*
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
*
ERROR security.UserGroupInformation:
PriviledgedActionException as:ramyas cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
java.io.IOException
: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
at org.apache.hadoop.fs.FileUtil.checkReturnValue(
FileUtil.java:689)
*
at org.apache.hadoop.fs.FileUtil.setPermission(
FileUtil.java:662)
*
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
RawLocalFileSystem.java:509)
*
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
RawLocalFileSystem.java:344)
*
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
FilterFileSystem.java:189)
*
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
JobSubmissionFiles.java:116)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:856)
*
at org.apache.hadoop.mapred.JobClient$2.run(
JobClient.java:850)
*
at java.security.AccessController.doPrivileged(
Native Method)
*
at javax.security.auth.Subject.doAs(Unknown Source)
*
at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1121)
*
at org.apache.hadoop.mapred.JobClient.submitJobInternal(
JobClient.java:850)
*
at org.apache.hadoop.mapred.JobClient.submitJob(
JobClient.java:824)
*
at org.apache.hadoop.mapred.JobClient.runJob(
JobClient.java:1261)
*
at WordCount.main(
WordCount.java:29)
* Also I want to know about configuring map/reduce plugin in eclipse.
Thanks and Regards
Ramya.S
--
From Good To Great
Re: Issue with running my first hadoop program using eclipse
Posted by Geelong Yao <ge...@gmail.com>.
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node
> with hadoop-1.0.4.It works fine and i tried some examples of wordcount on
> putty too. But getting into eclipse IDE on windows i was struck up with the
> first program. I have already installed jdk6 and mapreduce plugin
> version1.0.4 also. When trying to run on hadoop error occurs as follows:-
>
>
>
> - WARN util.NativeCodeLoader: Unable to load native-hadoop library for
> your platform... using builtin-java classes where applicable
> - ERROR security.UserGroupInformation:
>
> *PriviledgedActionException* as:ramyas *cause:java.io.IOException*:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> java.io.IOException
> *: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> *FileUtil.java:689*)
> at org.apache.hadoop.fs.FileUtil.setPermission(
> *FileUtil.java:662*)
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> *RawLocalFileSystem.java:509*)
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> *RawLocalFileSystem.java:344*)
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> *FilterFileSystem.java:189*)
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> *JobSubmissionFiles.java:116*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:856*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:850*)
> at java.security.AccessController.doPrivileged(
> *Native Method*)
> at javax.security.auth.Subject.doAs(Unknown Source)
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> *UserGroupInformation.java:1121*)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> *JobClient.java:850*)
> at org.apache.hadoop.mapred.JobClient.submitJob(
> *JobClient.java:824*)
> at org.apache.hadoop.mapred.JobClient.runJob(
> *JobClient.java:1261*)
> at WordCount.main(
> *WordCount.java:29*)
>
> Also I want to know about configuring map/reduce plugin in eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
--
>From Good To Great
Re: Issue with running my first hadoop program using eclipse
Posted by Geelong Yao <ge...@gmail.com>.
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node
> with hadoop-1.0.4.It works fine and i tried some examples of wordcount on
> putty too. But getting into eclipse IDE on windows i was struck up with the
> first program. I have already installed jdk6 and mapreduce plugin
> version1.0.4 also. When trying to run on hadoop error occurs as follows:-
>
>
>
> - WARN util.NativeCodeLoader: Unable to load native-hadoop library for
> your platform... using builtin-java classes where applicable
> - ERROR security.UserGroupInformation:
>
> *PriviledgedActionException* as:ramyas *cause:java.io.IOException*:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> java.io.IOException
> *: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> *FileUtil.java:689*)
> at org.apache.hadoop.fs.FileUtil.setPermission(
> *FileUtil.java:662*)
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> *RawLocalFileSystem.java:509*)
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> *RawLocalFileSystem.java:344*)
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> *FilterFileSystem.java:189*)
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> *JobSubmissionFiles.java:116*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:856*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:850*)
> at java.security.AccessController.doPrivileged(
> *Native Method*)
> at javax.security.auth.Subject.doAs(Unknown Source)
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> *UserGroupInformation.java:1121*)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> *JobClient.java:850*)
> at org.apache.hadoop.mapred.JobClient.submitJob(
> *JobClient.java:824*)
> at org.apache.hadoop.mapred.JobClient.runJob(
> *JobClient.java:1261*)
> at WordCount.main(
> *WordCount.java:29*)
>
> Also I want to know about configuring map/reduce plugin in eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
--
>From Good To Great
Re: Issue with running my first hadoop program using eclipse
Posted by Steve Loughran <st...@hortonworks.com>.
This is exactly the kind of thing that the hadoop users list was created to
discuss
On 10 May 2013 04:12, Job Thomas <jo...@suntecgroup.com> wrote:
>
> I am also suffering with the same issue. please help us
> ________________________________
>
> From: maisnam ns [mailto:maisnam.ns@gmail.com]
> Sent: Fri 5/10/2013 4:36 PM
> To: hdfs-dev@hadoop.apache.org
> Subject: Re: Issue with running my first hadoop program using eclipse
>
>
>
> @Ramya
> Hope this link will give you some idea
> http://stackoverflow.com/questions/10509427/hadoop-in-windows
>
>
> On Fri, May 10, 2013 at 4:05 PM, Ramya S <ra...@suntecgroup.com> wrote:
>
> >
> > Hi,
> > I am new to hadoop,so please help me to tackle the following issue.
> >
> > I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node
> > with hadoop-1.0.4.It works fine and i tried some examples of wordcount
> on
> > putty too. But getting into eclipse IDE on windows i was struck up with
> > compiling the first program. I have already installed jdk6 and mapreduce
> > plugin version1.0.4 also. When trying to run on hadoop error occurs as
> > follows:-
> >
> >
> >
> > *
> > WARN util.NativeCodeLoader: Unable to load native-hadoop library
> > for your platform... using builtin-java classes where applicable
> > *
> > ERROR security.UserGroupInformation: PriviledgedActionException
> > as:ramyas cause:java.io.IOException: Failed to set permissions of path:
> > \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> >
> > *
> > java.io.IOException: Failed to set permissions of path:
> > \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> > *
> > at
> > org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
> > *
> > at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
> > *
> > at
> >
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> > *
> > at
> >
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> > *
> > at
> > org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> > *
> > at
> >
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
> > *
> > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
> > *
> > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> > *
> > at java.security.AccessController.doPrivileged(Native Method)
> > *
> > at javax.security.auth.Subject.doAs(Unknown Source)
> > *
> > at
> >
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> > *
> > at
> > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> > *
> > at
> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> > *
> > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
> > *
> > at WordCount.main(WordCount.java:29)
> > *
> >
> > Also I want to know about configuring map/reduce plugin in eclipse.
> >
> > Thanks and Regards
> >
> > Ramya.S
> >
> >
>
>
>
RE: Issue with running my first hadoop program using eclipse
Posted by Bikas Saha <bi...@hortonworks.com>.
If you are working on Windows and willing to build the code yourself (which
should be straightforward) then you can try to download the code from
Hadoop git repo and use it. The following branches will give you Hadoop
that runs natively on Windows without Cygwin support. This would be the way
to go for windows.
For branch-1 line: branch-1-win
>From trunk line : trunk
If you want a pre-packaged build of Hadoop on Windows then you can try
this<http://hortonworks.com/download/>
.
Bikas
-----Original Message-----
From: Job Thomas [mailto:jobt@suntecgroup.com]
Sent: Friday, May 10, 2013 4:12 AM
To: hdfs-dev@hadoop.apache.org
Subject: RE: Issue with running my first hadoop program using eclipse
I am also suffering with the same issue. please help us
________________________________
From: maisnam ns [mailto:maisnam.ns@gmail.com <ma...@gmail.com>]
Sent: Fri 5/10/2013 4:36 PM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Issue with running my first hadoop program using eclipse
@Ramya
Hope this link will give you some idea
http://stackoverflow.com/questions/10509427/hadoop-in-windows
On Fri, May 10, 2013 at 4:05 PM, Ramya S <ra...@suntecgroup.com> wrote:
>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single
> Node with hadoop-1.0.4.It works fine and i tried some examples of
> wordcount on putty too. But getting into eclipse IDE on windows i was
> struck up with compiling the first program. I have already installed
> jdk6 and mapreduce plugin version1.0.4 also. When trying to run on
> hadoop error occurs as
> follows:-
>
>
>
> *
> WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where
> applicable
> *
> ERROR security.UserGroupInformation:
> PriviledgedActionException as:ramyas cause:java.io.IOException: Failed to
set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
>
> *
> java.io.IOException: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
> *
> at
> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
> *
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSyst
> em.java:509)
> *
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java
> :344)
> *
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189
> )
> *
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmis
> sionFiles.java:116)
> *
> at
> org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
> *
> at
> org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> *
> at java.security.AccessController.doPrivileged(Native Method)
> *
> at javax.security.auth.Subject.doAs(Unknown Source)
> *
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformat
> ion.java:1121)
> *
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:85
> 0)
> *
> at
> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> *
> at
> org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
> *
> at WordCount.main(WordCount.java:29)
> *
>
> Also I want to know about configuring map/reduce plugin in eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
>
RE: Issue with running my first hadoop program using eclipse
Posted by Job Thomas <jo...@suntecgroup.com>.
I am also suffering with the same issue. please help us
________________________________
From: maisnam ns [mailto:maisnam.ns@gmail.com]
Sent: Fri 5/10/2013 4:36 PM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Issue with running my first hadoop program using eclipse
@Ramya
Hope this link will give you some idea
http://stackoverflow.com/questions/10509427/hadoop-in-windows
On Fri, May 10, 2013 at 4:05 PM, Ramya S <ra...@suntecgroup.com> wrote:
>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node
> with hadoop-1.0.4.It works fine and i tried some examples of wordcount on
> putty too. But getting into eclipse IDE on windows i was struck up with
> compiling the first program. I have already installed jdk6 and mapreduce
> plugin version1.0.4 also. When trying to run on hadoop error occurs as
> follows:-
>
>
>
> *
> WARN util.NativeCodeLoader: Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
> *
> ERROR security.UserGroupInformation: PriviledgedActionException
> as:ramyas cause:java.io.IOException: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
>
> *
> java.io.IOException: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
> *
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
> *
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> *
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> *
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> *
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> *
> at java.security.AccessController.doPrivileged(Native Method)
> *
> at javax.security.auth.Subject.doAs(Unknown Source)
> *
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> *
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> *
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> *
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
> *
> at WordCount.main(WordCount.java:29)
> *
>
> Also I want to know about configuring map/reduce plugin in eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
>
Re: Issue with running my first hadoop program using eclipse
Posted by maisnam ns <ma...@gmail.com>.
@Ramya
Hope this link will give you some idea
http://stackoverflow.com/questions/10509427/hadoop-in-windows
On Fri, May 10, 2013 at 4:05 PM, Ramya S <ra...@suntecgroup.com> wrote:
>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node
> with hadoop-1.0.4.It works fine and i tried some examples of wordcount on
> putty too. But getting into eclipse IDE on windows i was struck up with
> compiling the first program. I have already installed jdk6 and mapreduce
> plugin version1.0.4 also. When trying to run on hadoop error occurs as
> follows:-
>
>
>
> *
> WARN util.NativeCodeLoader: Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
> *
> ERROR security.UserGroupInformation: PriviledgedActionException
> as:ramyas cause:java.io.IOException: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
>
> *
> java.io.IOException: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
> *
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
> *
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> *
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> *
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> *
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
> *
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> *
> at java.security.AccessController.doPrivileged(Native Method)
> *
> at javax.security.auth.Subject.doAs(Unknown Source)
> *
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> *
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> *
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> *
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
> *
> at WordCount.main(WordCount.java:29)
> *
>
> Also I want to know about configuring map/reduce plugin in eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
>
Issue with running my first hadoop program using eclipse
Posted by Ramya S <ra...@suntecgroup.com>.
Hi,
I am new to hadoop,so please help me to tackle the following issue.
I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node with hadoop-1.0.4.It works fine and i tried some examples of wordcount on putty too. But getting into eclipse IDE on windows i was struck up with compiling the first program. I have already installed jdk6 and mapreduce plugin version1.0.4 also. When trying to run on hadoop error occurs as follows:-
*
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
*
ERROR security.UserGroupInformation: PriviledgedActionException as:ramyas cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
java.io.IOException: Failed to set permissions of path: \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
*
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
*
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
*
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
*
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
*
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
*
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
*
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
*
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
*
at java.security.AccessController.doPrivileged(Native Method)
*
at javax.security.auth.Subject.doAs(Unknown Source)
*
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
*
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
*
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
*
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
*
at WordCount.main(WordCount.java:29)
*
Also I want to know about configuring map/reduce plugin in eclipse.
Thanks and Regards
Ramya.S
Re: Issue with running my first hadoop program using eclipse
Posted by Geelong Yao <ge...@gmail.com>.
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node
> with hadoop-1.0.4.It works fine and i tried some examples of wordcount on
> putty too. But getting into eclipse IDE on windows i was struck up with the
> first program. I have already installed jdk6 and mapreduce plugin
> version1.0.4 also. When trying to run on hadoop error occurs as follows:-
>
>
>
> - WARN util.NativeCodeLoader: Unable to load native-hadoop library for
> your platform... using builtin-java classes where applicable
> - ERROR security.UserGroupInformation:
>
> *PriviledgedActionException* as:ramyas *cause:java.io.IOException*:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> java.io.IOException
> *: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> *FileUtil.java:689*)
> at org.apache.hadoop.fs.FileUtil.setPermission(
> *FileUtil.java:662*)
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> *RawLocalFileSystem.java:509*)
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> *RawLocalFileSystem.java:344*)
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> *FilterFileSystem.java:189*)
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> *JobSubmissionFiles.java:116*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:856*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:850*)
> at java.security.AccessController.doPrivileged(
> *Native Method*)
> at javax.security.auth.Subject.doAs(Unknown Source)
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> *UserGroupInformation.java:1121*)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> *JobClient.java:850*)
> at org.apache.hadoop.mapred.JobClient.submitJob(
> *JobClient.java:824*)
> at org.apache.hadoop.mapred.JobClient.runJob(
> *JobClient.java:1261*)
> at WordCount.main(
> *WordCount.java:29*)
>
> Also I want to know about configuring map/reduce plugin in eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
--
>From Good To Great
Re: Issue with running my first hadoop program using eclipse
Posted by Geelong Yao <ge...@gmail.com>.
I think the main problem maybe the permission of your tmp directory.
2013/5/10 Ramya S <ra...@suntecgroup.com>
> Hi,
> I am new to hadoop,so please help me to tackle the following issue.
>
> I have Installed Apache Hadoop Pseudo Distributed Mode on a Single Node
> with hadoop-1.0.4.It works fine and i tried some examples of wordcount on
> putty too. But getting into eclipse IDE on windows i was struck up with the
> first program. I have already installed jdk6 and mapreduce plugin
> version1.0.4 also. When trying to run on hadoop error occurs as follows:-
>
>
>
> - WARN util.NativeCodeLoader: Unable to load native-hadoop library for
> your platform... using builtin-java classes where applicable
> - ERROR security.UserGroupInformation:
>
> *PriviledgedActionException* as:ramyas *cause:java.io.IOException*:
> Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> *
> java.io.IOException
> *: Failed to set permissions of path:
> \tmp\hadoop-ramyas\mapred\staging\ramyas-1375395355\.staging to 0700
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(
> *FileUtil.java:689*)
> at org.apache.hadoop.fs.FileUtil.setPermission(
> *FileUtil.java:662*)
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
> *RawLocalFileSystem.java:509*)
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(
> *RawLocalFileSystem.java:344*)
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(
> *FilterFileSystem.java:189*)
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
> *JobSubmissionFiles.java:116*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:856*)
> at org.apache.hadoop.mapred.JobClient$2.run(
> *JobClient.java:850*)
> at java.security.AccessController.doPrivileged(
> *Native Method*)
> at javax.security.auth.Subject.doAs(Unknown Source)
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> *UserGroupInformation.java:1121*)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(
> *JobClient.java:850*)
> at org.apache.hadoop.mapred.JobClient.submitJob(
> *JobClient.java:824*)
> at org.apache.hadoop.mapred.JobClient.runJob(
> *JobClient.java:1261*)
> at WordCount.main(
> *WordCount.java:29*)
>
> Also I want to know about configuring map/reduce plugin in eclipse.
>
> Thanks and Regards
>
> Ramya.S
>
--
>From Good To Great