You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Alexander Hristov <al...@planetalia.com> on 2012/10/02 08:12:03 UTC
Hadoop Archives under 0.23
Hello
I'm trying to test the Hadoop archive functionality under 0.23 and I
can't get it working.
I have in HDFS a /test folder with several text files. I created a
hadoop archive using
hadoop archive -archiveName test.har -p /test *.txt /sample
Ok, this creates a /sample/test.har with the appropriate parts (_index,
_SUCCESS,_masterindex,part-0). Performing a cat on _index shows the
texts files.
However, when I try to even list the contents of the HAR file using
hdfs dfs -ls -R har:///sample/test.har
I simply get "har:///sample/test.har : No such file or directory"! WTF?
Accessing the individual files does work, however:
hdfs dfs -cat har:///sample/test.har/file.txt
works
Regards
Alexander
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
Thanks, but hadoop dfs is deprecated, hdfs is the recommended way. In
any case, the result is exactly the same.
> use bin/hadoop dfs -lsr har:///sample/test.har
> not dfs -ls -R har:///sample/test.har
>
>
>
> On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov
> <alexh@planetalia.com <ma...@planetalia.com>> wrote:
>
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and
> I can't get it working.
>
> I have in HDFS a /test folder with several text files. I created
> a hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on
> _index shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"!
> WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
Thanks, but hadoop dfs is deprecated, hdfs is the recommended way. In
any case, the result is exactly the same.
> use bin/hadoop dfs -lsr har:///sample/test.har
> not dfs -ls -R har:///sample/test.har
>
>
>
> On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov
> <alexh@planetalia.com <ma...@planetalia.com>> wrote:
>
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and
> I can't get it working.
>
> I have in HDFS a /test folder with several text files. I created
> a hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on
> _index shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"!
> WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
Thanks, but hadoop dfs is deprecated, hdfs is the recommended way. In
any case, the result is exactly the same.
> use bin/hadoop dfs -lsr har:///sample/test.har
> not dfs -ls -R har:///sample/test.har
>
>
>
> On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov
> <alexh@planetalia.com <ma...@planetalia.com>> wrote:
>
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and
> I can't get it working.
>
> I have in HDFS a /test folder with several text files. I created
> a hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on
> _index shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"!
> WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
Thanks, but hadoop dfs is deprecated, hdfs is the recommended way. In
any case, the result is exactly the same.
> use bin/hadoop dfs -lsr har:///sample/test.har
> not dfs -ls -R har:///sample/test.har
>
>
>
> On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov
> <alexh@planetalia.com <ma...@planetalia.com>> wrote:
>
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and
> I can't get it working.
>
> I have in HDFS a /test folder with several text files. I created
> a hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on
> _index shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"!
> WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
Re: Hadoop Archives under 0.23
Posted by Visioner Sadak <vi...@gmail.com>.
use bin/hadoop dfs -lsr har:///sample/test.har
not dfs -ls -R har:///sample/test.har
On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov <al...@planetalia.com>wrote:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I can't
> get it working.
>
> I have in HDFS a /test folder with several text files. I created a hadoop
> archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts (_index,
> _SUCCESS,_masterindex,part-0). Performing a cat on _index shows the texts
> files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.**txt
>
> works
>
> Regards
>
> Alexander
>
>
Re: Hadoop Archives under 0.23
Posted by Visioner Sadak <vi...@gmail.com>.
use bin/hadoop dfs -lsr har:///sample/test.har
not dfs -ls -R har:///sample/test.har
On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov <al...@planetalia.com>wrote:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I can't
> get it working.
>
> I have in HDFS a /test folder with several text files. I created a hadoop
> archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts (_index,
> _SUCCESS,_masterindex,part-0). Performing a cat on _index shows the texts
> files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.**txt
>
> works
>
> Regards
>
> Alexander
>
>
Re: Hadoop Archives under 0.23
Posted by gschen <go...@yahoo.com.cn>.
于 2012/10/3 0:34, Alexander Hristov 写道:
> According to hdfs, -lsr is deprecated and -ls -R is to be used
> instead. In any case, it doesn't matter as the result is exactly the
> same.
>
>>
>> El 02/10/2012 2:12, Alexander Hristov escribió:
>>> Hello
>>>
>>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>>> can't get it working.
>>>
>>> I have in HDFS a /test folder with several text files. I created a
>>> hadoop archive using
>>>
>>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>>
>>> Ok, this creates a /sample/test.har with the appropriate parts
>>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>>> shows the texts files.
>>> However, when I try to even list the contents of the HAR file using
>>>
>>> hdfs dfs -ls -R har:///sample/test.har
>> The right command to do this is:
>> hdfs dfs -lsr har:///sample/test.har
>>
>>>
>>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>>
>>> Accessing the individual files does work, however:
>>>
>>> hdfs dfs -cat har:///sample/test.har/file.txt
>>>
>>> works
>>>
>>> Regards
>>>
>>> Alexander
>>>
>>>
>>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>>> INFORMATICAS...
>>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>>
>>> http://www.uci.cu
>>> http://www.facebook.com/universidad.uci
>>> http://www.flickr.com/photos/universidad_uci
>>
>
>
unsubscribe
Re: Hadoop Archives under 0.23
Posted by gschen <go...@yahoo.com.cn>.
于 2012/10/3 0:34, Alexander Hristov 写道:
> According to hdfs, -lsr is deprecated and -ls -R is to be used
> instead. In any case, it doesn't matter as the result is exactly the
> same.
>
>>
>> El 02/10/2012 2:12, Alexander Hristov escribió:
>>> Hello
>>>
>>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>>> can't get it working.
>>>
>>> I have in HDFS a /test folder with several text files. I created a
>>> hadoop archive using
>>>
>>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>>
>>> Ok, this creates a /sample/test.har with the appropriate parts
>>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>>> shows the texts files.
>>> However, when I try to even list the contents of the HAR file using
>>>
>>> hdfs dfs -ls -R har:///sample/test.har
>> The right command to do this is:
>> hdfs dfs -lsr har:///sample/test.har
>>
>>>
>>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>>
>>> Accessing the individual files does work, however:
>>>
>>> hdfs dfs -cat har:///sample/test.har/file.txt
>>>
>>> works
>>>
>>> Regards
>>>
>>> Alexander
>>>
>>>
>>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>>> INFORMATICAS...
>>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>>
>>> http://www.uci.cu
>>> http://www.facebook.com/universidad.uci
>>> http://www.flickr.com/photos/universidad_uci
>>
>
>
unsubscribe
Re: Hadoop Archives under 0.23
Posted by gschen <go...@yahoo.com.cn>.
于 2012/10/3 0:34, Alexander Hristov 写道:
> According to hdfs, -lsr is deprecated and -ls -R is to be used
> instead. In any case, it doesn't matter as the result is exactly the
> same.
>
>>
>> El 02/10/2012 2:12, Alexander Hristov escribió:
>>> Hello
>>>
>>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>>> can't get it working.
>>>
>>> I have in HDFS a /test folder with several text files. I created a
>>> hadoop archive using
>>>
>>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>>
>>> Ok, this creates a /sample/test.har with the appropriate parts
>>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>>> shows the texts files.
>>> However, when I try to even list the contents of the HAR file using
>>>
>>> hdfs dfs -ls -R har:///sample/test.har
>> The right command to do this is:
>> hdfs dfs -lsr har:///sample/test.har
>>
>>>
>>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>>
>>> Accessing the individual files does work, however:
>>>
>>> hdfs dfs -cat har:///sample/test.har/file.txt
>>>
>>> works
>>>
>>> Regards
>>>
>>> Alexander
>>>
>>>
>>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>>> INFORMATICAS...
>>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>>
>>> http://www.uci.cu
>>> http://www.facebook.com/universidad.uci
>>> http://www.flickr.com/photos/universidad_uci
>>
>
>
unsubscribe
Re: Hadoop Archives under 0.23
Posted by gschen <go...@yahoo.com.cn>.
于 2012/10/3 0:34, Alexander Hristov 写道:
> According to hdfs, -lsr is deprecated and -ls -R is to be used
> instead. In any case, it doesn't matter as the result is exactly the
> same.
>
>>
>> El 02/10/2012 2:12, Alexander Hristov escribió:
>>> Hello
>>>
>>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>>> can't get it working.
>>>
>>> I have in HDFS a /test folder with several text files. I created a
>>> hadoop archive using
>>>
>>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>>
>>> Ok, this creates a /sample/test.har with the appropriate parts
>>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>>> shows the texts files.
>>> However, when I try to even list the contents of the HAR file using
>>>
>>> hdfs dfs -ls -R har:///sample/test.har
>> The right command to do this is:
>> hdfs dfs -lsr har:///sample/test.har
>>
>>>
>>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>>
>>> Accessing the individual files does work, however:
>>>
>>> hdfs dfs -cat har:///sample/test.har/file.txt
>>>
>>> works
>>>
>>> Regards
>>>
>>> Alexander
>>>
>>>
>>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>>> INFORMATICAS...
>>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>>
>>> http://www.uci.cu
>>> http://www.facebook.com/universidad.uci
>>> http://www.flickr.com/photos/universidad_uci
>>
>
>
unsubscribe
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
According to hdfs, -lsr is deprecated and -ls -R is to be used instead. In any case, it doesn't matter as the result is exactly the same.
>
> El 02/10/2012 2:12, Alexander Hristov escribió:
>> Hello
>>
>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>> can't get it working.
>>
>> I have in HDFS a /test folder with several text files. I created a
>> hadoop archive using
>>
>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>
>> Ok, this creates a /sample/test.har with the appropriate parts
>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>> shows the texts files.
>> However, when I try to even list the contents of the HAR file using
>>
>> hdfs dfs -ls -R har:///sample/test.har
> The right command to do this is:
> hdfs dfs -lsr har:///sample/test.har
>
>>
>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>
>> Accessing the individual files does work, however:
>>
>> hdfs dfs -cat har:///sample/test.har/file.txt
>>
>> works
>>
>> Regards
>>
>> Alexander
>>
>>
>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>> INFORMATICAS...
>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>
>> http://www.uci.cu
>> http://www.facebook.com/universidad.uci
>> http://www.flickr.com/photos/universidad_uci
>
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
According to hdfs, -lsr is deprecated and -ls -R is to be used instead. In any case, it doesn't matter as the result is exactly the same.
>
> El 02/10/2012 2:12, Alexander Hristov escribió:
>> Hello
>>
>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>> can't get it working.
>>
>> I have in HDFS a /test folder with several text files. I created a
>> hadoop archive using
>>
>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>
>> Ok, this creates a /sample/test.har with the appropriate parts
>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>> shows the texts files.
>> However, when I try to even list the contents of the HAR file using
>>
>> hdfs dfs -ls -R har:///sample/test.har
> The right command to do this is:
> hdfs dfs -lsr har:///sample/test.har
>
>>
>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>
>> Accessing the individual files does work, however:
>>
>> hdfs dfs -cat har:///sample/test.har/file.txt
>>
>> works
>>
>> Regards
>>
>> Alexander
>>
>>
>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>> INFORMATICAS...
>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>
>> http://www.uci.cu
>> http://www.facebook.com/universidad.uci
>> http://www.flickr.com/photos/universidad_uci
>
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
According to hdfs, -lsr is deprecated and -ls -R is to be used instead. In any case, it doesn't matter as the result is exactly the same.
>
> El 02/10/2012 2:12, Alexander Hristov escribió:
>> Hello
>>
>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>> can't get it working.
>>
>> I have in HDFS a /test folder with several text files. I created a
>> hadoop archive using
>>
>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>
>> Ok, this creates a /sample/test.har with the appropriate parts
>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>> shows the texts files.
>> However, when I try to even list the contents of the HAR file using
>>
>> hdfs dfs -ls -R har:///sample/test.har
> The right command to do this is:
> hdfs dfs -lsr har:///sample/test.har
>
>>
>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>
>> Accessing the individual files does work, however:
>>
>> hdfs dfs -cat har:///sample/test.har/file.txt
>>
>> works
>>
>> Regards
>>
>> Alexander
>>
>>
>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>> INFORMATICAS...
>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>
>> http://www.uci.cu
>> http://www.facebook.com/universidad.uci
>> http://www.flickr.com/photos/universidad_uci
>
Re: Hadoop Archives under 0.23
Posted by Alexander Hristov <al...@planetalia.com>.
According to hdfs, -lsr is deprecated and -ls -R is to be used instead. In any case, it doesn't matter as the result is exactly the same.
>
> El 02/10/2012 2:12, Alexander Hristov escribió:
>> Hello
>>
>> I'm trying to test the Hadoop archive functionality under 0.23 and I
>> can't get it working.
>>
>> I have in HDFS a /test folder with several text files. I created a
>> hadoop archive using
>>
>> hadoop archive -archiveName test.har -p /test *.txt /sample
>>
>> Ok, this creates a /sample/test.har with the appropriate parts
>> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
>> shows the texts files.
>> However, when I try to even list the contents of the HAR file using
>>
>> hdfs dfs -ls -R har:///sample/test.har
> The right command to do this is:
> hdfs dfs -lsr har:///sample/test.har
>
>>
>> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>>
>> Accessing the individual files does work, however:
>>
>> hdfs dfs -cat har:///sample/test.har/file.txt
>>
>> works
>>
>> Regards
>>
>> Alexander
>>
>>
>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>> INFORMATICAS...
>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>
>> http://www.uci.cu
>> http://www.facebook.com/universidad.uci
>> http://www.flickr.com/photos/universidad_uci
>
Re: Hadoop Archives under 0.23
Posted by Marcos Ortiz <ml...@uci.cu>.
El 02/10/2012 2:12, Alexander Hristov escribió:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I
> can't get it working.
>
> I have in HDFS a /test folder with several text files. I created a
> hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
> shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
The right command to do this is:
hdfs dfs -lsr har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
> INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
--
Marcos Ortiz Valmaseda,
Data Engineer && Senior System Administrator at UCI
Blog: http://marcosluis2186.posterous.com
Linkedin: http://www.linkedin.com/in/marcosluis2186
Twitter: @marcosluis2186
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: Hadoop Archives under 0.23
Posted by Marcos Ortiz <ml...@uci.cu>.
El 02/10/2012 2:12, Alexander Hristov escribió:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I
> can't get it working.
>
> I have in HDFS a /test folder with several text files. I created a
> hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
> shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
The right command to do this is:
hdfs dfs -lsr har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
> INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
--
Marcos Ortiz Valmaseda,
Data Engineer && Senior System Administrator at UCI
Blog: http://marcosluis2186.posterous.com
Linkedin: http://www.linkedin.com/in/marcosluis2186
Twitter: @marcosluis2186
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: Hadoop Archives under 0.23
Posted by Marcos Ortiz <ml...@uci.cu>.
El 02/10/2012 2:12, Alexander Hristov escribió:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I
> can't get it working.
>
> I have in HDFS a /test folder with several text files. I created a
> hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
> shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
The right command to do this is:
hdfs dfs -lsr har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
> INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
--
Marcos Ortiz Valmaseda,
Data Engineer && Senior System Administrator at UCI
Blog: http://marcosluis2186.posterous.com
Linkedin: http://www.linkedin.com/in/marcosluis2186
Twitter: @marcosluis2186
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: Hadoop Archives under 0.23
Posted by Visioner Sadak <vi...@gmail.com>.
use bin/hadoop dfs -lsr har:///sample/test.har
not dfs -ls -R har:///sample/test.har
On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov <al...@planetalia.com>wrote:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I can't
> get it working.
>
> I have in HDFS a /test folder with several text files. I created a hadoop
> archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts (_index,
> _SUCCESS,_masterindex,part-0). Performing a cat on _index shows the texts
> files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.**txt
>
> works
>
> Regards
>
> Alexander
>
>
Re: Hadoop Archives under 0.23
Posted by Marcos Ortiz <ml...@uci.cu>.
El 02/10/2012 2:12, Alexander Hristov escribió:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I
> can't get it working.
>
> I have in HDFS a /test folder with several text files. I created a
> hadoop archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts
> (_index, _SUCCESS,_masterindex,part-0). Performing a cat on _index
> shows the texts files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
The right command to do this is:
hdfs dfs -lsr har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.txt
>
> works
>
> Regards
>
> Alexander
>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
> INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
--
Marcos Ortiz Valmaseda,
Data Engineer && Senior System Administrator at UCI
Blog: http://marcosluis2186.posterous.com
Linkedin: http://www.linkedin.com/in/marcosluis2186
Twitter: @marcosluis2186
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: Hadoop Archives under 0.23
Posted by Visioner Sadak <vi...@gmail.com>.
use bin/hadoop dfs -lsr har:///sample/test.har
not dfs -ls -R har:///sample/test.har
On Tue, Oct 2, 2012 at 11:42 AM, Alexander Hristov <al...@planetalia.com>wrote:
> Hello
>
> I'm trying to test the Hadoop archive functionality under 0.23 and I can't
> get it working.
>
> I have in HDFS a /test folder with several text files. I created a hadoop
> archive using
>
> hadoop archive -archiveName test.har -p /test *.txt /sample
>
> Ok, this creates a /sample/test.har with the appropriate parts (_index,
> _SUCCESS,_masterindex,part-0). Performing a cat on _index shows the texts
> files.
> However, when I try to even list the contents of the HAR file using
>
> hdfs dfs -ls -R har:///sample/test.har
>
> I simply get "har:///sample/test.har : No such file or directory"! WTF?
>
> Accessing the individual files does work, however:
>
> hdfs dfs -cat har:///sample/test.har/file.**txt
>
> works
>
> Regards
>
> Alexander
>
>