You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Liliana Mamani Sanchez <li...@gmail.com> on 2011/04/27 15:25:01 UTC
-copyFromLocal , -put commands failing
Hello all,
Actually, I realised about this problem when trying to use Mahout,
trying to create vectors using the
$MAHOUT_HOME/bin/mahout seqdirectory
in my case:
$MAHOUT_HOME/bin/mahout seqdirectory -i
/home/hadoop/programming/docs-test/ -o jojolete --charset ascii
command. This was not producing any output and after trying a lot to
find the reason, I thought it was because I had first to copy the
files to hadoop. Then I issued
dfs -copyFromLocal ../../programming/docs-test docs-test-maho
and I realised it "copies" the files but to zero byte files and I even
spotted the "jojolete" output from mahout command and this is zero
sized as well
$HADOOP_HOME/bin/hadoop dfs -ls
Found 5 items
drwxr-xr-x - hadoop supergroup 0 2011-04-27 11:52
/user/hadoop/docs-test-mah
drwxr-xr-x - hadoop supergroup 0 2011-04-27 12:00
/user/hadoop/docs-test-maho
drwxr-xr-x - hadoop supergroup 0 2011-04-27 13:30
/user/hadoop/gutenberg
drwxr-xr-x - hadoop supergroup 0 2011-04-26 17:46
/user/hadoop/jojolete
drwxr-xr-x - hadoop supergroup 0 2011-04-26 14:26
/user/hadoop/testing-output
I don't know if I'm doing something wrong, the commands never return
any failure message. Maybe some of you have had a similar experience.
I hope you can help me
Cheers
Liliana
--
Liliana Paola Mamani Sanchez
Re: -copyFromLocal , -put commands failing
Posted by James Seigel <ja...@tynt.com>.
Liliana,
Don’t worry so is Eric ;)
James.
On 2011-04-27, at 8:50 AM, Liliana Mamani Sanchez wrote:
> Hi Eric
>
> You are right :S
> You must have realised I'm a complete hadoop newbie.
>
> Cheers
>
> On Wed, Apr 27, 2011 at 2:35 PM, Eric Fiala <er...@fiala.ca> wrote:
>> Liliana,
>> I might be completely off base, but this output from your hadoop fs -ls
>> appears to be directories - do you have anything inside these directories
>> (try hadoop dfs -lsr /user/hadoop/jojolete to list recursively)
>>
>> EF
>>
>> On 27 April 2011 07:25, Liliana Mamani Sanchez <li...@gmail.com> wrote:
>>
>>> Hello all,
>>>
>>> Actually, I realised about this problem when trying to use Mahout,
>>> trying to create vectors using the
>>>
>>> $MAHOUT_HOME/bin/mahout seqdirectory
>>>
>>> in my case:
>>>
>>> $MAHOUT_HOME/bin/mahout seqdirectory -i
>>> /home/hadoop/programming/docs-test/ -o jojolete --charset ascii
>>>
>>> command. This was not producing any output and after trying a lot to
>>> find the reason, I thought it was because I had first to copy the
>>> files to hadoop. Then I issued
>>>
>>>
>>> dfs -copyFromLocal ../../programming/docs-test docs-test-maho
>>>
>>> and I realised it "copies" the files but to zero byte files and I even
>>> spotted the "jojolete" output from mahout command and this is zero
>>> sized as well
>>>
>>>
>>> $HADOOP_HOME/bin/hadoop dfs -ls
>>> Found 5 items
>>> drwxr-xr-x - hadoop supergroup 0 2011-04-27 11:52
>>> /user/hadoop/docs-test-mah
>>> drwxr-xr-x - hadoop supergroup 0 2011-04-27 12:00
>>> /user/hadoop/docs-test-maho
>>> drwxr-xr-x - hadoop supergroup 0 2011-04-27 13:30
>>> /user/hadoop/gutenberg
>>> drwxr-xr-x - hadoop supergroup 0 2011-04-26 17:46
>>> /user/hadoop/jojolete
>>> drwxr-xr-x - hadoop supergroup 0 2011-04-26 14:26
>>> /user/hadoop/testing-output
>>>
>>> I don't know if I'm doing something wrong, the commands never return
>>> any failure message. Maybe some of you have had a similar experience.
>>> I hope you can help me
>>>
>>> Cheers
>>>
>>> Liliana
>>>
>>>
>>>
>>> --
>>> Liliana Paola Mamani Sanchez
>>>
>>
>
>
>
> --
> Liliana Paola Mamani Sanchez
Re: -copyFromLocal , -put commands failing
Posted by Liliana Mamani Sanchez <li...@gmail.com>.
Hi Eric
You are right :S
You must have realised I'm a complete hadoop newbie.
Cheers
On Wed, Apr 27, 2011 at 2:35 PM, Eric Fiala <er...@fiala.ca> wrote:
> Liliana,
> I might be completely off base, but this output from your hadoop fs -ls
> appears to be directories - do you have anything inside these directories
> (try hadoop dfs -lsr /user/hadoop/jojolete to list recursively)
>
> EF
>
> On 27 April 2011 07:25, Liliana Mamani Sanchez <li...@gmail.com> wrote:
>
>> Hello all,
>>
>> Actually, I realised about this problem when trying to use Mahout,
>> trying to create vectors using the
>>
>> $MAHOUT_HOME/bin/mahout seqdirectory
>>
>> in my case:
>>
>> $MAHOUT_HOME/bin/mahout seqdirectory -i
>> /home/hadoop/programming/docs-test/ -o jojolete --charset ascii
>>
>> command. This was not producing any output and after trying a lot to
>> find the reason, I thought it was because I had first to copy the
>> files to hadoop. Then I issued
>>
>>
>> dfs -copyFromLocal ../../programming/docs-test docs-test-maho
>>
>> and I realised it "copies" the files but to zero byte files and I even
>> spotted the "jojolete" output from mahout command and this is zero
>> sized as well
>>
>>
>> $HADOOP_HOME/bin/hadoop dfs -ls
>> Found 5 items
>> drwxr-xr-x - hadoop supergroup 0 2011-04-27 11:52
>> /user/hadoop/docs-test-mah
>> drwxr-xr-x - hadoop supergroup 0 2011-04-27 12:00
>> /user/hadoop/docs-test-maho
>> drwxr-xr-x - hadoop supergroup 0 2011-04-27 13:30
>> /user/hadoop/gutenberg
>> drwxr-xr-x - hadoop supergroup 0 2011-04-26 17:46
>> /user/hadoop/jojolete
>> drwxr-xr-x - hadoop supergroup 0 2011-04-26 14:26
>> /user/hadoop/testing-output
>>
>> I don't know if I'm doing something wrong, the commands never return
>> any failure message. Maybe some of you have had a similar experience.
>> I hope you can help me
>>
>> Cheers
>>
>> Liliana
>>
>>
>>
>> --
>> Liliana Paola Mamani Sanchez
>>
>
--
Liliana Paola Mamani Sanchez
Re: -copyFromLocal , -put commands failing
Posted by Eric Fiala <er...@fiala.ca>.
Liliana,
I might be completely off base, but this output from your hadoop fs -ls
appears to be directories - do you have anything inside these directories
(try hadoop dfs -lsr /user/hadoop/jojolete to list recursively)
EF
On 27 April 2011 07:25, Liliana Mamani Sanchez <li...@gmail.com> wrote:
> Hello all,
>
> Actually, I realised about this problem when trying to use Mahout,
> trying to create vectors using the
>
> $MAHOUT_HOME/bin/mahout seqdirectory
>
> in my case:
>
> $MAHOUT_HOME/bin/mahout seqdirectory -i
> /home/hadoop/programming/docs-test/ -o jojolete --charset ascii
>
> command. This was not producing any output and after trying a lot to
> find the reason, I thought it was because I had first to copy the
> files to hadoop. Then I issued
>
>
> dfs -copyFromLocal ../../programming/docs-test docs-test-maho
>
> and I realised it "copies" the files but to zero byte files and I even
> spotted the "jojolete" output from mahout command and this is zero
> sized as well
>
>
> $HADOOP_HOME/bin/hadoop dfs -ls
> Found 5 items
> drwxr-xr-x - hadoop supergroup 0 2011-04-27 11:52
> /user/hadoop/docs-test-mah
> drwxr-xr-x - hadoop supergroup 0 2011-04-27 12:00
> /user/hadoop/docs-test-maho
> drwxr-xr-x - hadoop supergroup 0 2011-04-27 13:30
> /user/hadoop/gutenberg
> drwxr-xr-x - hadoop supergroup 0 2011-04-26 17:46
> /user/hadoop/jojolete
> drwxr-xr-x - hadoop supergroup 0 2011-04-26 14:26
> /user/hadoop/testing-output
>
> I don't know if I'm doing something wrong, the commands never return
> any failure message. Maybe some of you have had a similar experience.
> I hope you can help me
>
> Cheers
>
> Liliana
>
>
>
> --
> Liliana Paola Mamani Sanchez
>