You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Shashidhar Rao <ra...@gmail.com> on 2013/06/01 02:01:04 UTC
MR2 submit job help
Hi Users,
Please help me with some documentation on how to submit job in YARN and
upload files in HDFS. Can I still use the MR1 commands for file uploading
to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
errors saying file cannot be uploaded as file cannot found. The directory
structure is same .
MR2 Directory structure/same as MR1
hadoop/bin/~all hadoop files including hadoop excecutable
hadoop/ file.txt, job.jar etc
hadoop/etc/hadoop/ ~all site files and properties
I cd to hadoop and then I am executing bin/hadoop fs -put file file
It says file cannot be found but I was able to run without error in MR1
Thanks
shashidhar
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Shahab Yunus,
You are right , thanks so much for your help , now I am able to see the
file with
bin/hadoop fs -ls /
Thanks
Shashidhar
On Sun, Jun 2, 2013 at 12:51 AM, Shahab Yunus <sh...@gmail.com>wrote:
> Shashidhar,
>
> You ran the put command with 'fs'
> bin/hadoop fs -put sample.txt /sample3.txt
>
> Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
> with 'fs'.
>
> Plus, the warning can be ignored. You would most probably need to build
> the code with your native libs but I think it is not needed at this point.
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Thanks Rahul, worked a bit but not fully
>>
>> Now when I run
>> bin/hadoop fs -put sample.txt /sample3.txt
>>
>> The warning still comes
>> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>>
>> But, `sample.txt': No such file or directory error which came earlier do
>> not came.
>>
>> Now when I run ,bin/hadoop hdfs -ls
>>
>> Error: Could not find or load main class hdfs
>>
>> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
>> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
>> also the bin dir is inside HADOOP_HOME .
>>
>> Anything i have to export?
>>
>> Thanks
>> shashidhar
>>
>>
>> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> Thats a warn
>>>
>>> You might not have the users dir in hdfs.
>>>
>>> try
>>>
>>>
>>> hadoop fs -put sample.txt /sample.txt
>>>
>>> Rahul
>>>
>>>
>>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> After building MR2 , I am able to start all the daemons
>>>> 27873 Jps
>>>> 27096 NameNode
>>>> 27169 DataNode
>>>> 27326 NodeManager
>>>> 27398 JobHistoryServer
>>>> 13329
>>>> 27257 ResourceManager
>>>> 27043 Bootstrap
>>>>
>>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>>> I get the error
>>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>>> native-hadoop library for your platform... using builtin-java classes where
>>>> applicable
>>>> put: `sample.txt': No such file or directory
>>>>
>>>> Native-hadoop library is not loaded
>>>>
>>>> what I need to do?
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>>
>>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>>> you made sure about that? Is any other command working? Have you tried
>>>>> copyFromLocal?
>>>>>
>>>>> Regards,
>>>>> Shahab
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>>
>>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>>> directory where you are running the command.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Users,
>>>>>>>
>>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>>> directory structure is same .
>>>>>>>
>>>>>>> MR2 Directory structure/same as MR1
>>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>>> hadoop/ file.txt, job.jar etc
>>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>>
>>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>>> It says file cannot be found but I was able to run without error in
>>>>>>> MR1
>>>>>>>
>>>>>>> Thanks
>>>>>>> shashidhar
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Shahab Yunus,
You are right , thanks so much for your help , now I am able to see the
file with
bin/hadoop fs -ls /
Thanks
Shashidhar
On Sun, Jun 2, 2013 at 12:51 AM, Shahab Yunus <sh...@gmail.com>wrote:
> Shashidhar,
>
> You ran the put command with 'fs'
> bin/hadoop fs -put sample.txt /sample3.txt
>
> Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
> with 'fs'.
>
> Plus, the warning can be ignored. You would most probably need to build
> the code with your native libs but I think it is not needed at this point.
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Thanks Rahul, worked a bit but not fully
>>
>> Now when I run
>> bin/hadoop fs -put sample.txt /sample3.txt
>>
>> The warning still comes
>> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>>
>> But, `sample.txt': No such file or directory error which came earlier do
>> not came.
>>
>> Now when I run ,bin/hadoop hdfs -ls
>>
>> Error: Could not find or load main class hdfs
>>
>> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
>> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
>> also the bin dir is inside HADOOP_HOME .
>>
>> Anything i have to export?
>>
>> Thanks
>> shashidhar
>>
>>
>> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> Thats a warn
>>>
>>> You might not have the users dir in hdfs.
>>>
>>> try
>>>
>>>
>>> hadoop fs -put sample.txt /sample.txt
>>>
>>> Rahul
>>>
>>>
>>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> After building MR2 , I am able to start all the daemons
>>>> 27873 Jps
>>>> 27096 NameNode
>>>> 27169 DataNode
>>>> 27326 NodeManager
>>>> 27398 JobHistoryServer
>>>> 13329
>>>> 27257 ResourceManager
>>>> 27043 Bootstrap
>>>>
>>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>>> I get the error
>>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>>> native-hadoop library for your platform... using builtin-java classes where
>>>> applicable
>>>> put: `sample.txt': No such file or directory
>>>>
>>>> Native-hadoop library is not loaded
>>>>
>>>> what I need to do?
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>>
>>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>>> you made sure about that? Is any other command working? Have you tried
>>>>> copyFromLocal?
>>>>>
>>>>> Regards,
>>>>> Shahab
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>>
>>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>>> directory where you are running the command.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Users,
>>>>>>>
>>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>>> directory structure is same .
>>>>>>>
>>>>>>> MR2 Directory structure/same as MR1
>>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>>> hadoop/ file.txt, job.jar etc
>>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>>
>>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>>> It says file cannot be found but I was able to run without error in
>>>>>>> MR1
>>>>>>>
>>>>>>> Thanks
>>>>>>> shashidhar
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Shahab Yunus,
You are right , thanks so much for your help , now I am able to see the
file with
bin/hadoop fs -ls /
Thanks
Shashidhar
On Sun, Jun 2, 2013 at 12:51 AM, Shahab Yunus <sh...@gmail.com>wrote:
> Shashidhar,
>
> You ran the put command with 'fs'
> bin/hadoop fs -put sample.txt /sample3.txt
>
> Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
> with 'fs'.
>
> Plus, the warning can be ignored. You would most probably need to build
> the code with your native libs but I think it is not needed at this point.
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Thanks Rahul, worked a bit but not fully
>>
>> Now when I run
>> bin/hadoop fs -put sample.txt /sample3.txt
>>
>> The warning still comes
>> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>>
>> But, `sample.txt': No such file or directory error which came earlier do
>> not came.
>>
>> Now when I run ,bin/hadoop hdfs -ls
>>
>> Error: Could not find or load main class hdfs
>>
>> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
>> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
>> also the bin dir is inside HADOOP_HOME .
>>
>> Anything i have to export?
>>
>> Thanks
>> shashidhar
>>
>>
>> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> Thats a warn
>>>
>>> You might not have the users dir in hdfs.
>>>
>>> try
>>>
>>>
>>> hadoop fs -put sample.txt /sample.txt
>>>
>>> Rahul
>>>
>>>
>>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> After building MR2 , I am able to start all the daemons
>>>> 27873 Jps
>>>> 27096 NameNode
>>>> 27169 DataNode
>>>> 27326 NodeManager
>>>> 27398 JobHistoryServer
>>>> 13329
>>>> 27257 ResourceManager
>>>> 27043 Bootstrap
>>>>
>>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>>> I get the error
>>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>>> native-hadoop library for your platform... using builtin-java classes where
>>>> applicable
>>>> put: `sample.txt': No such file or directory
>>>>
>>>> Native-hadoop library is not loaded
>>>>
>>>> what I need to do?
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>>
>>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>>> you made sure about that? Is any other command working? Have you tried
>>>>> copyFromLocal?
>>>>>
>>>>> Regards,
>>>>> Shahab
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>>
>>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>>> directory where you are running the command.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Users,
>>>>>>>
>>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>>> directory structure is same .
>>>>>>>
>>>>>>> MR2 Directory structure/same as MR1
>>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>>> hadoop/ file.txt, job.jar etc
>>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>>
>>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>>> It says file cannot be found but I was able to run without error in
>>>>>>> MR1
>>>>>>>
>>>>>>> Thanks
>>>>>>> shashidhar
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Shahab Yunus,
You are right , thanks so much for your help , now I am able to see the
file with
bin/hadoop fs -ls /
Thanks
Shashidhar
On Sun, Jun 2, 2013 at 12:51 AM, Shahab Yunus <sh...@gmail.com>wrote:
> Shashidhar,
>
> You ran the put command with 'fs'
> bin/hadoop fs -put sample.txt /sample3.txt
>
> Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
> with 'fs'.
>
> Plus, the warning can be ignored. You would most probably need to build
> the code with your native libs but I think it is not needed at this point.
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Thanks Rahul, worked a bit but not fully
>>
>> Now when I run
>> bin/hadoop fs -put sample.txt /sample3.txt
>>
>> The warning still comes
>> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>>
>> But, `sample.txt': No such file or directory error which came earlier do
>> not came.
>>
>> Now when I run ,bin/hadoop hdfs -ls
>>
>> Error: Could not find or load main class hdfs
>>
>> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
>> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
>> also the bin dir is inside HADOOP_HOME .
>>
>> Anything i have to export?
>>
>> Thanks
>> shashidhar
>>
>>
>> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> Thats a warn
>>>
>>> You might not have the users dir in hdfs.
>>>
>>> try
>>>
>>>
>>> hadoop fs -put sample.txt /sample.txt
>>>
>>> Rahul
>>>
>>>
>>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> After building MR2 , I am able to start all the daemons
>>>> 27873 Jps
>>>> 27096 NameNode
>>>> 27169 DataNode
>>>> 27326 NodeManager
>>>> 27398 JobHistoryServer
>>>> 13329
>>>> 27257 ResourceManager
>>>> 27043 Bootstrap
>>>>
>>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>>> I get the error
>>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>>> native-hadoop library for your platform... using builtin-java classes where
>>>> applicable
>>>> put: `sample.txt': No such file or directory
>>>>
>>>> Native-hadoop library is not loaded
>>>>
>>>> what I need to do?
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>>
>>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>>> you made sure about that? Is any other command working? Have you tried
>>>>> copyFromLocal?
>>>>>
>>>>> Regards,
>>>>> Shahab
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>>
>>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>>> directory where you are running the command.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Users,
>>>>>>>
>>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>>> directory structure is same .
>>>>>>>
>>>>>>> MR2 Directory structure/same as MR1
>>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>>> hadoop/ file.txt, job.jar etc
>>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>>
>>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>>> It says file cannot be found but I was able to run without error in
>>>>>>> MR1
>>>>>>>
>>>>>>> Thanks
>>>>>>> shashidhar
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Shashidhar,
You ran the put command with 'fs'
bin/hadoop fs -put sample.txt /sample3.txt
Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
with 'fs'.
Plus, the warning can be ignored. You would most probably need to build the
code with your native libs but I think it is not needed at this point.
Regards,
Shahab
On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Thanks Rahul, worked a bit but not fully
>
> Now when I run
> bin/hadoop fs -put sample.txt /sample3.txt
>
> The warning still comes
> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
>
> But, `sample.txt': No such file or directory error which came earlier do
> not came.
>
> Now when I run ,bin/hadoop hdfs -ls
>
> Error: Could not find or load main class hdfs
>
> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
> also the bin dir is inside HADOOP_HOME .
>
> Anything i have to export?
>
> Thanks
> shashidhar
>
>
> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> Thats a warn
>>
>> You might not have the users dir in hdfs.
>>
>> try
>>
>>
>> hadoop fs -put sample.txt /sample.txt
>>
>> Rahul
>>
>>
>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> After building MR2 , I am able to start all the daemons
>>> 27873 Jps
>>> 27096 NameNode
>>> 27169 DataNode
>>> 27326 NodeManager
>>> 27398 JobHistoryServer
>>> 13329
>>> 27257 ResourceManager
>>> 27043 Bootstrap
>>>
>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>> I get the error
>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>> native-hadoop library for your platform... using builtin-java classes where
>>> applicable
>>> put: `sample.txt': No such file or directory
>>>
>>> Native-hadoop library is not loaded
>>>
>>> what I need to do?
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>
>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>> you made sure about that? Is any other command working? Have you tried
>>>> copyFromLocal?
>>>>
>>>> Regards,
>>>> Shahab
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>
>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>> directory where you are running the command.
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>
>>>>>> Hi Users,
>>>>>>
>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>> directory structure is same .
>>>>>>
>>>>>> MR2 Directory structure/same as MR1
>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>> hadoop/ file.txt, job.jar etc
>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>
>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>> It says file cannot be found but I was able to run without error in
>>>>>> MR1
>>>>>>
>>>>>> Thanks
>>>>>> shashidhar
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Shashidhar,
You ran the put command with 'fs'
bin/hadoop fs -put sample.txt /sample3.txt
Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
with 'fs'.
Plus, the warning can be ignored. You would most probably need to build the
code with your native libs but I think it is not needed at this point.
Regards,
Shahab
On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Thanks Rahul, worked a bit but not fully
>
> Now when I run
> bin/hadoop fs -put sample.txt /sample3.txt
>
> The warning still comes
> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
>
> But, `sample.txt': No such file or directory error which came earlier do
> not came.
>
> Now when I run ,bin/hadoop hdfs -ls
>
> Error: Could not find or load main class hdfs
>
> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
> also the bin dir is inside HADOOP_HOME .
>
> Anything i have to export?
>
> Thanks
> shashidhar
>
>
> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> Thats a warn
>>
>> You might not have the users dir in hdfs.
>>
>> try
>>
>>
>> hadoop fs -put sample.txt /sample.txt
>>
>> Rahul
>>
>>
>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> After building MR2 , I am able to start all the daemons
>>> 27873 Jps
>>> 27096 NameNode
>>> 27169 DataNode
>>> 27326 NodeManager
>>> 27398 JobHistoryServer
>>> 13329
>>> 27257 ResourceManager
>>> 27043 Bootstrap
>>>
>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>> I get the error
>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>> native-hadoop library for your platform... using builtin-java classes where
>>> applicable
>>> put: `sample.txt': No such file or directory
>>>
>>> Native-hadoop library is not loaded
>>>
>>> what I need to do?
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>
>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>> you made sure about that? Is any other command working? Have you tried
>>>> copyFromLocal?
>>>>
>>>> Regards,
>>>> Shahab
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>
>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>> directory where you are running the command.
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>
>>>>>> Hi Users,
>>>>>>
>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>> directory structure is same .
>>>>>>
>>>>>> MR2 Directory structure/same as MR1
>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>> hadoop/ file.txt, job.jar etc
>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>
>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>> It says file cannot be found but I was able to run without error in
>>>>>> MR1
>>>>>>
>>>>>> Thanks
>>>>>> shashidhar
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Shashidhar,
You ran the put command with 'fs'
bin/hadoop fs -put sample.txt /sample3.txt
Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
with 'fs'.
Plus, the warning can be ignored. You would most probably need to build the
code with your native libs but I think it is not needed at this point.
Regards,
Shahab
On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Thanks Rahul, worked a bit but not fully
>
> Now when I run
> bin/hadoop fs -put sample.txt /sample3.txt
>
> The warning still comes
> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
>
> But, `sample.txt': No such file or directory error which came earlier do
> not came.
>
> Now when I run ,bin/hadoop hdfs -ls
>
> Error: Could not find or load main class hdfs
>
> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
> also the bin dir is inside HADOOP_HOME .
>
> Anything i have to export?
>
> Thanks
> shashidhar
>
>
> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> Thats a warn
>>
>> You might not have the users dir in hdfs.
>>
>> try
>>
>>
>> hadoop fs -put sample.txt /sample.txt
>>
>> Rahul
>>
>>
>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> After building MR2 , I am able to start all the daemons
>>> 27873 Jps
>>> 27096 NameNode
>>> 27169 DataNode
>>> 27326 NodeManager
>>> 27398 JobHistoryServer
>>> 13329
>>> 27257 ResourceManager
>>> 27043 Bootstrap
>>>
>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>> I get the error
>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>> native-hadoop library for your platform... using builtin-java classes where
>>> applicable
>>> put: `sample.txt': No such file or directory
>>>
>>> Native-hadoop library is not loaded
>>>
>>> what I need to do?
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>
>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>> you made sure about that? Is any other command working? Have you tried
>>>> copyFromLocal?
>>>>
>>>> Regards,
>>>> Shahab
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>
>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>> directory where you are running the command.
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>
>>>>>> Hi Users,
>>>>>>
>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>> directory structure is same .
>>>>>>
>>>>>> MR2 Directory structure/same as MR1
>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>> hadoop/ file.txt, job.jar etc
>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>
>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>> It says file cannot be found but I was able to run without error in
>>>>>> MR1
>>>>>>
>>>>>> Thanks
>>>>>> shashidhar
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Shashidhar,
You ran the put command with 'fs'
bin/hadoop fs -put sample.txt /sample3.txt
Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
with 'fs'.
Plus, the warning can be ignored. You would most probably need to build the
code with your native libs but I think it is not needed at this point.
Regards,
Shahab
On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Thanks Rahul, worked a bit but not fully
>
> Now when I run
> bin/hadoop fs -put sample.txt /sample3.txt
>
> The warning still comes
> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
>
> But, `sample.txt': No such file or directory error which came earlier do
> not came.
>
> Now when I run ,bin/hadoop hdfs -ls
>
> Error: Could not find or load main class hdfs
>
> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
> HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
> also the bin dir is inside HADOOP_HOME .
>
> Anything i have to export?
>
> Thanks
> shashidhar
>
>
> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> Thats a warn
>>
>> You might not have the users dir in hdfs.
>>
>> try
>>
>>
>> hadoop fs -put sample.txt /sample.txt
>>
>> Rahul
>>
>>
>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> After building MR2 , I am able to start all the daemons
>>> 27873 Jps
>>> 27096 NameNode
>>> 27169 DataNode
>>> 27326 NodeManager
>>> 27398 JobHistoryServer
>>> 13329
>>> 27257 ResourceManager
>>> 27043 Bootstrap
>>>
>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>> I get the error
>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>> native-hadoop library for your platform... using builtin-java classes where
>>> applicable
>>> put: `sample.txt': No such file or directory
>>>
>>> Native-hadoop library is not loaded
>>>
>>> what I need to do?
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>>
>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>> you made sure about that? Is any other command working? Have you tried
>>>> copyFromLocal?
>>>>
>>>> Regards,
>>>> Shahab
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>
>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>> directory where you are running the command.
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>
>>>>>> Hi Users,
>>>>>>
>>>>>> Please help me with some documentation on how to submit job in YARN
>>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>>> directory structure is same .
>>>>>>
>>>>>> MR2 Directory structure/same as MR1
>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>> hadoop/ file.txt, job.jar etc
>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>
>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>>> It says file cannot be found but I was able to run without error in
>>>>>> MR1
>>>>>>
>>>>>> Thanks
>>>>>> shashidhar
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Rahul, worked a bit but not fully
Now when I run
bin/hadoop fs -put sample.txt /sample3.txt
The warning still comes
13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
But, `sample.txt': No such file or directory error which came earlier do
not came.
Now when I run ,bin/hadoop hdfs -ls
Error: Could not find or load main class hdfs
I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
also the bin dir is inside HADOOP_HOME .
Anything i have to export?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> Thats a warn
>
> You might not have the users dir in hdfs.
>
> try
>
>
> hadoop fs -put sample.txt /sample.txt
>
> Rahul
>
>
> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> After building MR2 , I am able to start all the daemons
>> 27873 Jps
>> 27096 NameNode
>> 27169 DataNode
>> 27326 NodeManager
>> 27398 JobHistoryServer
>> 13329
>> 27257 ResourceManager
>> 27043 Bootstrap
>>
>> but when I run bin/hadoop fs -put sample.txt sample.txt
>> I get the error
>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> put: `sample.txt': No such file or directory
>>
>> Native-hadoop library is not loaded
>>
>> what I need to do?
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> Is you file name file.txt or file that you are trying to upload? Have
>>> you made sure about that? Is any other command working? Have you tried
>>> copyFromLocal?
>>>
>>> Regards,
>>> Shahab
>>>
>>>
>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>> rahul.rec.dgp@gmail.com> wrote:
>>>
>>>> you should be able to use hadoop fs -put <file> . file in the directory
>>>> where you are running the command.
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>> raoshashidhar123@gmail.com> wrote:
>>>>
>>>>> Hi Users,
>>>>>
>>>>> Please help me with some documentation on how to submit job in YARN
>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>> directory structure is same .
>>>>>
>>>>> MR2 Directory structure/same as MR1
>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>> hadoop/ file.txt, job.jar etc
>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>
>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>> It says file cannot be found but I was able to run without error in MR1
>>>>>
>>>>> Thanks
>>>>> shashidhar
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Rahul, worked a bit but not fully
Now when I run
bin/hadoop fs -put sample.txt /sample3.txt
The warning still comes
13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
But, `sample.txt': No such file or directory error which came earlier do
not came.
Now when I run ,bin/hadoop hdfs -ls
Error: Could not find or load main class hdfs
I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
also the bin dir is inside HADOOP_HOME .
Anything i have to export?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> Thats a warn
>
> You might not have the users dir in hdfs.
>
> try
>
>
> hadoop fs -put sample.txt /sample.txt
>
> Rahul
>
>
> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> After building MR2 , I am able to start all the daemons
>> 27873 Jps
>> 27096 NameNode
>> 27169 DataNode
>> 27326 NodeManager
>> 27398 JobHistoryServer
>> 13329
>> 27257 ResourceManager
>> 27043 Bootstrap
>>
>> but when I run bin/hadoop fs -put sample.txt sample.txt
>> I get the error
>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> put: `sample.txt': No such file or directory
>>
>> Native-hadoop library is not loaded
>>
>> what I need to do?
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> Is you file name file.txt or file that you are trying to upload? Have
>>> you made sure about that? Is any other command working? Have you tried
>>> copyFromLocal?
>>>
>>> Regards,
>>> Shahab
>>>
>>>
>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>> rahul.rec.dgp@gmail.com> wrote:
>>>
>>>> you should be able to use hadoop fs -put <file> . file in the directory
>>>> where you are running the command.
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>> raoshashidhar123@gmail.com> wrote:
>>>>
>>>>> Hi Users,
>>>>>
>>>>> Please help me with some documentation on how to submit job in YARN
>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>> directory structure is same .
>>>>>
>>>>> MR2 Directory structure/same as MR1
>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>> hadoop/ file.txt, job.jar etc
>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>
>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>> It says file cannot be found but I was able to run without error in MR1
>>>>>
>>>>> Thanks
>>>>> shashidhar
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Rahul, worked a bit but not fully
Now when I run
bin/hadoop fs -put sample.txt /sample3.txt
The warning still comes
13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
But, `sample.txt': No such file or directory error which came earlier do
not came.
Now when I run ,bin/hadoop hdfs -ls
Error: Could not find or load main class hdfs
I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
also the bin dir is inside HADOOP_HOME .
Anything i have to export?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> Thats a warn
>
> You might not have the users dir in hdfs.
>
> try
>
>
> hadoop fs -put sample.txt /sample.txt
>
> Rahul
>
>
> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> After building MR2 , I am able to start all the daemons
>> 27873 Jps
>> 27096 NameNode
>> 27169 DataNode
>> 27326 NodeManager
>> 27398 JobHistoryServer
>> 13329
>> 27257 ResourceManager
>> 27043 Bootstrap
>>
>> but when I run bin/hadoop fs -put sample.txt sample.txt
>> I get the error
>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> put: `sample.txt': No such file or directory
>>
>> Native-hadoop library is not loaded
>>
>> what I need to do?
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> Is you file name file.txt or file that you are trying to upload? Have
>>> you made sure about that? Is any other command working? Have you tried
>>> copyFromLocal?
>>>
>>> Regards,
>>> Shahab
>>>
>>>
>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>> rahul.rec.dgp@gmail.com> wrote:
>>>
>>>> you should be able to use hadoop fs -put <file> . file in the directory
>>>> where you are running the command.
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>> raoshashidhar123@gmail.com> wrote:
>>>>
>>>>> Hi Users,
>>>>>
>>>>> Please help me with some documentation on how to submit job in YARN
>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>> directory structure is same .
>>>>>
>>>>> MR2 Directory structure/same as MR1
>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>> hadoop/ file.txt, job.jar etc
>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>
>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>> It says file cannot be found but I was able to run without error in MR1
>>>>>
>>>>> Thanks
>>>>> shashidhar
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Rahul, worked a bit but not fully
Now when I run
bin/hadoop fs -put sample.txt /sample3.txt
The warning still comes
13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
But, `sample.txt': No such file or directory error which came earlier do
not came.
Now when I run ,bin/hadoop hdfs -ls
Error: Could not find or load main class hdfs
I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
HADOOP_HOME is the root dir and in this dir I have all the hdfs*.jars and
also the bin dir is inside HADOOP_HOME .
Anything i have to export?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> Thats a warn
>
> You might not have the users dir in hdfs.
>
> try
>
>
> hadoop fs -put sample.txt /sample.txt
>
> Rahul
>
>
> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> After building MR2 , I am able to start all the daemons
>> 27873 Jps
>> 27096 NameNode
>> 27169 DataNode
>> 27326 NodeManager
>> 27398 JobHistoryServer
>> 13329
>> 27257 ResourceManager
>> 27043 Bootstrap
>>
>> but when I run bin/hadoop fs -put sample.txt sample.txt
>> I get the error
>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> put: `sample.txt': No such file or directory
>>
>> Native-hadoop library is not loaded
>>
>> what I need to do?
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>>
>>> Is you file name file.txt or file that you are trying to upload? Have
>>> you made sure about that? Is any other command working? Have you tried
>>> copyFromLocal?
>>>
>>> Regards,
>>> Shahab
>>>
>>>
>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>> rahul.rec.dgp@gmail.com> wrote:
>>>
>>>> you should be able to use hadoop fs -put <file> . file in the directory
>>>> where you are running the command.
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>> raoshashidhar123@gmail.com> wrote:
>>>>
>>>>> Hi Users,
>>>>>
>>>>> Please help me with some documentation on how to submit job in YARN
>>>>> and upload files in HDFS. Can I still use the MR1 commands for file
>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput? Because I
>>>>> ran with errors saying file cannot be uploaded as file cannot found. The
>>>>> directory structure is same .
>>>>>
>>>>> MR2 Directory structure/same as MR1
>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>> hadoop/ file.txt, job.jar etc
>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>
>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>>> It says file cannot be found but I was able to run without error in MR1
>>>>>
>>>>> Thanks
>>>>> shashidhar
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thats a warn
You might not have the users dir in hdfs.
try
hadoop fs -put sample.txt /sample.txt
Rahul
On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> After building MR2 , I am able to start all the daemons
> 27873 Jps
> 27096 NameNode
> 27169 DataNode
> 27326 NodeManager
> 27398 JobHistoryServer
> 13329
> 27257 ResourceManager
> 27043 Bootstrap
>
> but when I run bin/hadoop fs -put sample.txt sample.txt
> I get the error
> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> put: `sample.txt': No such file or directory
>
> Native-hadoop library is not loaded
>
> what I need to do?
>
> Thanks
> shashidhar
>
>
>
>
> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> Is you file name file.txt or file that you are trying to upload? Have you
>> made sure about that? Is any other command working? Have you tried
>> copyFromLocal?
>>
>> Regards,
>> Shahab
>>
>>
>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> you should be able to use hadoop fs -put <file> . file in the directory
>>> where you are running the command.
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> Hi Users,
>>>>
>>>> Please help me with some documentation on how to submit job in YARN and
>>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>>> errors saying file cannot be uploaded as file cannot found. The directory
>>>> structure is same .
>>>>
>>>> MR2 Directory structure/same as MR1
>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>> hadoop/ file.txt, job.jar etc
>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>
>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>> It says file cannot be found but I was able to run without error in MR1
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thats a warn
You might not have the users dir in hdfs.
try
hadoop fs -put sample.txt /sample.txt
Rahul
On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> After building MR2 , I am able to start all the daemons
> 27873 Jps
> 27096 NameNode
> 27169 DataNode
> 27326 NodeManager
> 27398 JobHistoryServer
> 13329
> 27257 ResourceManager
> 27043 Bootstrap
>
> but when I run bin/hadoop fs -put sample.txt sample.txt
> I get the error
> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> put: `sample.txt': No such file or directory
>
> Native-hadoop library is not loaded
>
> what I need to do?
>
> Thanks
> shashidhar
>
>
>
>
> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> Is you file name file.txt or file that you are trying to upload? Have you
>> made sure about that? Is any other command working? Have you tried
>> copyFromLocal?
>>
>> Regards,
>> Shahab
>>
>>
>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> you should be able to use hadoop fs -put <file> . file in the directory
>>> where you are running the command.
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> Hi Users,
>>>>
>>>> Please help me with some documentation on how to submit job in YARN and
>>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>>> errors saying file cannot be uploaded as file cannot found. The directory
>>>> structure is same .
>>>>
>>>> MR2 Directory structure/same as MR1
>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>> hadoop/ file.txt, job.jar etc
>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>
>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>> It says file cannot be found but I was able to run without error in MR1
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thats a warn
You might not have the users dir in hdfs.
try
hadoop fs -put sample.txt /sample.txt
Rahul
On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> After building MR2 , I am able to start all the daemons
> 27873 Jps
> 27096 NameNode
> 27169 DataNode
> 27326 NodeManager
> 27398 JobHistoryServer
> 13329
> 27257 ResourceManager
> 27043 Bootstrap
>
> but when I run bin/hadoop fs -put sample.txt sample.txt
> I get the error
> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> put: `sample.txt': No such file or directory
>
> Native-hadoop library is not loaded
>
> what I need to do?
>
> Thanks
> shashidhar
>
>
>
>
> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> Is you file name file.txt or file that you are trying to upload? Have you
>> made sure about that? Is any other command working? Have you tried
>> copyFromLocal?
>>
>> Regards,
>> Shahab
>>
>>
>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> you should be able to use hadoop fs -put <file> . file in the directory
>>> where you are running the command.
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> Hi Users,
>>>>
>>>> Please help me with some documentation on how to submit job in YARN and
>>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>>> errors saying file cannot be uploaded as file cannot found. The directory
>>>> structure is same .
>>>>
>>>> MR2 Directory structure/same as MR1
>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>> hadoop/ file.txt, job.jar etc
>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>
>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>> It says file cannot be found but I was able to run without error in MR1
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thats a warn
You might not have the users dir in hdfs.
try
hadoop fs -put sample.txt /sample.txt
Rahul
On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> After building MR2 , I am able to start all the daemons
> 27873 Jps
> 27096 NameNode
> 27169 DataNode
> 27326 NodeManager
> 27398 JobHistoryServer
> 13329
> 27257 ResourceManager
> 27043 Bootstrap
>
> but when I run bin/hadoop fs -put sample.txt sample.txt
> I get the error
> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> put: `sample.txt': No such file or directory
>
> Native-hadoop library is not loaded
>
> what I need to do?
>
> Thanks
> shashidhar
>
>
>
>
> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com>wrote:
>
>> Is you file name file.txt or file that you are trying to upload? Have you
>> made sure about that? Is any other command working? Have you tried
>> copyFromLocal?
>>
>> Regards,
>> Shahab
>>
>>
>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> you should be able to use hadoop fs -put <file> . file in the directory
>>> where you are running the command.
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> Hi Users,
>>>>
>>>> Please help me with some documentation on how to submit job in YARN and
>>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>>> errors saying file cannot be uploaded as file cannot found. The directory
>>>> structure is same .
>>>>
>>>> MR2 Directory structure/same as MR1
>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>> hadoop/ file.txt, job.jar etc
>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>
>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>> It says file cannot be found but I was able to run without error in MR1
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
After building MR2 , I am able to start all the daemons
27873 Jps
27096 NameNode
27169 DataNode
27326 NodeManager
27398 JobHistoryServer
13329
27257 ResourceManager
27043 Bootstrap
but when I run bin/hadoop fs -put sample.txt sample.txt
I get the error
13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `sample.txt': No such file or directory
Native-hadoop library is not loaded
what I need to do?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com> wrote:
> Is you file name file.txt or file that you are trying to upload? Have you
> made sure about that? Is any other command working? Have you tried
> copyFromLocal?
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> you should be able to use hadoop fs -put <file> . file in the directory
>> where you are running the command.
>>
>>
>>
>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> Hi Users,
>>>
>>> Please help me with some documentation on how to submit job in YARN and
>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>> errors saying file cannot be uploaded as file cannot found. The directory
>>> structure is same .
>>>
>>> MR2 Directory structure/same as MR1
>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>> hadoop/ file.txt, job.jar etc
>>> hadoop/etc/hadoop/ ~all site files and properties
>>>
>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>> It says file cannot be found but I was able to run without error in MR1
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
After building MR2 , I am able to start all the daemons
27873 Jps
27096 NameNode
27169 DataNode
27326 NodeManager
27398 JobHistoryServer
13329
27257 ResourceManager
27043 Bootstrap
but when I run bin/hadoop fs -put sample.txt sample.txt
I get the error
13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `sample.txt': No such file or directory
Native-hadoop library is not loaded
what I need to do?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com> wrote:
> Is you file name file.txt or file that you are trying to upload? Have you
> made sure about that? Is any other command working? Have you tried
> copyFromLocal?
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> you should be able to use hadoop fs -put <file> . file in the directory
>> where you are running the command.
>>
>>
>>
>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> Hi Users,
>>>
>>> Please help me with some documentation on how to submit job in YARN and
>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>> errors saying file cannot be uploaded as file cannot found. The directory
>>> structure is same .
>>>
>>> MR2 Directory structure/same as MR1
>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>> hadoop/ file.txt, job.jar etc
>>> hadoop/etc/hadoop/ ~all site files and properties
>>>
>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>> It says file cannot be found but I was able to run without error in MR1
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
After building MR2 , I am able to start all the daemons
27873 Jps
27096 NameNode
27169 DataNode
27326 NodeManager
27398 JobHistoryServer
13329
27257 ResourceManager
27043 Bootstrap
but when I run bin/hadoop fs -put sample.txt sample.txt
I get the error
13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `sample.txt': No such file or directory
Native-hadoop library is not loaded
what I need to do?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com> wrote:
> Is you file name file.txt or file that you are trying to upload? Have you
> made sure about that? Is any other command working? Have you tried
> copyFromLocal?
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> you should be able to use hadoop fs -put <file> . file in the directory
>> where you are running the command.
>>
>>
>>
>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> Hi Users,
>>>
>>> Please help me with some documentation on how to submit job in YARN and
>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>> errors saying file cannot be uploaded as file cannot found. The directory
>>> structure is same .
>>>
>>> MR2 Directory structure/same as MR1
>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>> hadoop/ file.txt, job.jar etc
>>> hadoop/etc/hadoop/ ~all site files and properties
>>>
>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>> It says file cannot be found but I was able to run without error in MR1
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shashidhar Rao <ra...@gmail.com>.
After building MR2 , I am able to start all the daemons
27873 Jps
27096 NameNode
27169 DataNode
27326 NodeManager
27398 JobHistoryServer
13329
27257 ResourceManager
27043 Bootstrap
but when I run bin/hadoop fs -put sample.txt sample.txt
I get the error
13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `sample.txt': No such file or directory
Native-hadoop library is not loaded
what I need to do?
Thanks
shashidhar
On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <sh...@gmail.com> wrote:
> Is you file name file.txt or file that you are trying to upload? Have you
> made sure about that? Is any other command working? Have you tried
> copyFromLocal?
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> you should be able to use hadoop fs -put <file> . file in the directory
>> where you are running the command.
>>
>>
>>
>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>> raoshashidhar123@gmail.com> wrote:
>>
>>> Hi Users,
>>>
>>> Please help me with some documentation on how to submit job in YARN and
>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>> errors saying file cannot be uploaded as file cannot found. The directory
>>> structure is same .
>>>
>>> MR2 Directory structure/same as MR1
>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>> hadoop/ file.txt, job.jar etc
>>> hadoop/etc/hadoop/ ~all site files and properties
>>>
>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>> It says file cannot be found but I was able to run without error in MR1
>>>
>>> Thanks
>>> shashidhar
>>>
>>>
>>>
>>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Is you file name file.txt or file that you are trying to upload? Have you
made sure about that? Is any other command working? Have you tried
copyFromLocal?
Regards,
Shahab
On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <rahul.rec.dgp@gmail.com
> wrote:
> you should be able to use hadoop fs -put <file> . file in the directory
> where you are running the command.
>
>
>
> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Hi Users,
>>
>> Please help me with some documentation on how to submit job in YARN and
>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>> errors saying file cannot be uploaded as file cannot found. The directory
>> structure is same .
>>
>> MR2 Directory structure/same as MR1
>> hadoop/bin/~all hadoop files including hadoop excecutable
>> hadoop/ file.txt, job.jar etc
>> hadoop/etc/hadoop/ ~all site files and properties
>>
>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>> It says file cannot be found but I was able to run without error in MR1
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Is you file name file.txt or file that you are trying to upload? Have you
made sure about that? Is any other command working? Have you tried
copyFromLocal?
Regards,
Shahab
On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <rahul.rec.dgp@gmail.com
> wrote:
> you should be able to use hadoop fs -put <file> . file in the directory
> where you are running the command.
>
>
>
> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Hi Users,
>>
>> Please help me with some documentation on how to submit job in YARN and
>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>> errors saying file cannot be uploaded as file cannot found. The directory
>> structure is same .
>>
>> MR2 Directory structure/same as MR1
>> hadoop/bin/~all hadoop files including hadoop excecutable
>> hadoop/ file.txt, job.jar etc
>> hadoop/etc/hadoop/ ~all site files and properties
>>
>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>> It says file cannot be found but I was able to run without error in MR1
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Is you file name file.txt or file that you are trying to upload? Have you
made sure about that? Is any other command working? Have you tried
copyFromLocal?
Regards,
Shahab
On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <rahul.rec.dgp@gmail.com
> wrote:
> you should be able to use hadoop fs -put <file> . file in the directory
> where you are running the command.
>
>
>
> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Hi Users,
>>
>> Please help me with some documentation on how to submit job in YARN and
>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>> errors saying file cannot be uploaded as file cannot found. The directory
>> structure is same .
>>
>> MR2 Directory structure/same as MR1
>> hadoop/bin/~all hadoop files including hadoop excecutable
>> hadoop/ file.txt, job.jar etc
>> hadoop/etc/hadoop/ ~all site files and properties
>>
>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>> It says file cannot be found but I was able to run without error in MR1
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>
Re: MR2 submit job help
Posted by Shahab Yunus <sh...@gmail.com>.
Is you file name file.txt or file that you are trying to upload? Have you
made sure about that? Is any other command working? Have you tried
copyFromLocal?
Regards,
Shahab
On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <rahul.rec.dgp@gmail.com
> wrote:
> you should be able to use hadoop fs -put <file> . file in the directory
> where you are running the command.
>
>
>
> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Hi Users,
>>
>> Please help me with some documentation on how to submit job in YARN and
>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>> errors saying file cannot be uploaded as file cannot found. The directory
>> structure is same .
>>
>> MR2 Directory structure/same as MR1
>> hadoop/bin/~all hadoop files including hadoop excecutable
>> hadoop/ file.txt, job.jar etc
>> hadoop/etc/hadoop/ ~all site files and properties
>>
>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>> It says file cannot be found but I was able to run without error in MR1
>>
>> Thanks
>> shashidhar
>>
>>
>>
>>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
you should be able to use hadoop fs -put <file> . file in the directory
where you are running the command.
On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi Users,
>
> Please help me with some documentation on how to submit job in YARN and
> upload files in HDFS. Can I still use the MR1 commands for file uploading
> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
> errors saying file cannot be uploaded as file cannot found. The directory
> structure is same .
>
> MR2 Directory structure/same as MR1
> hadoop/bin/~all hadoop files including hadoop excecutable
> hadoop/ file.txt, job.jar etc
> hadoop/etc/hadoop/ ~all site files and properties
>
> I cd to hadoop and then I am executing bin/hadoop fs -put file file
> It says file cannot be found but I was able to run without error in MR1
>
> Thanks
> shashidhar
>
>
>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
you should be able to use hadoop fs -put <file> . file in the directory
where you are running the command.
On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi Users,
>
> Please help me with some documentation on how to submit job in YARN and
> upload files in HDFS. Can I still use the MR1 commands for file uploading
> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
> errors saying file cannot be uploaded as file cannot found. The directory
> structure is same .
>
> MR2 Directory structure/same as MR1
> hadoop/bin/~all hadoop files including hadoop excecutable
> hadoop/ file.txt, job.jar etc
> hadoop/etc/hadoop/ ~all site files and properties
>
> I cd to hadoop and then I am executing bin/hadoop fs -put file file
> It says file cannot be found but I was able to run without error in MR1
>
> Thanks
> shashidhar
>
>
>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
you should be able to use hadoop fs -put <file> . file in the directory
where you are running the command.
On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi Users,
>
> Please help me with some documentation on how to submit job in YARN and
> upload files in HDFS. Can I still use the MR1 commands for file uploading
> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
> errors saying file cannot be uploaded as file cannot found. The directory
> structure is same .
>
> MR2 Directory structure/same as MR1
> hadoop/bin/~all hadoop files including hadoop excecutable
> hadoop/ file.txt, job.jar etc
> hadoop/etc/hadoop/ ~all site files and properties
>
> I cd to hadoop and then I am executing bin/hadoop fs -put file file
> It says file cannot be found but I was able to run without error in MR1
>
> Thanks
> shashidhar
>
>
>
>
Re: MR2 submit job help
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
you should be able to use hadoop fs -put <file> . file in the directory
where you are running the command.
On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi Users,
>
> Please help me with some documentation on how to submit job in YARN and
> upload files in HDFS. Can I still use the MR1 commands for file uploading
> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
> errors saying file cannot be uploaded as file cannot found. The directory
> structure is same .
>
> MR2 Directory structure/same as MR1
> hadoop/bin/~all hadoop files including hadoop excecutable
> hadoop/ file.txt, job.jar etc
> hadoop/etc/hadoop/ ~all site files and properties
>
> I cd to hadoop and then I am executing bin/hadoop fs -put file file
> It says file cannot be found but I was able to run without error in MR1
>
> Thanks
> shashidhar
>
>
>
>