You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Ajitabh Pandey <aj...@gmail.com> on 2012/09/07 14:55:00 UTC
Hadoop archive not displaying files in the har
Hi,
I created a hadoop archive as follows:
$ hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
test.har -p /my/dir/path subdir1/some-file-name-*.gz
/my/dir/path/some-target-directory
The map reduce job runs fine and when the job finishes I see the following:
$ hadoop fs -ls /my/dir/path/some-target-directory/test.har
Found 3 items
-rw------- 5 ap users 9199 2012-09-07 12:30
/my/dir/path/some-target-directory/test.har/_index
-rw------- 5 ap users 24 2012-09-07 12:30
/my/dir/path/some-target-directory/test.har/_masterindex
-rw------- 3 ap users 3367997136 2012-09-07 12:28
/my/dir/path/some-target-directory/test.har/part-0
But when I do
$ hadoop fs -lsr har:///my/dir/path/some-target-directory/test.har/
I don't get an output, I just get the $ prompt back.
Any idea what is wrong here?
Regards.
--
Ajitabh Pandey
http://ajitabhpandey.info
Re: Hadoop archive not displaying files in the har
Posted by John George <jo...@yahoo-inc.com>.
My guess is that harchive does not like to be given a set of files as its
input, but rather a directory.
So try the following instead:
hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
test.har -p /my/dir/path subdir1/ /my/dir/path/some-target-directory
Regards,
John George
-----Original Message-----
From: Ajitabh Pandey <aj...@gmail.com>
Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Fri, 7 Sep 2012 05:55:00 -0700
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Subject: Hadoop archive not displaying files in the har
>Hi,
>
>I created a hadoop archive as follows:
>
>$ hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
>test.har -p /my/dir/path subdir1/some-file-name-*.gz
>/my/dir/path/some-target-directory
>
>The map reduce job runs fine and when the job finishes I see the
>following:
>
>$ hadoop fs -ls /my/dir/path/some-target-directory/test.har
>Found 3 items
>-rw------- 5 ap users 9199 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_index
>-rw------- 5 ap users 24 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_masterindex
>-rw------- 3 ap users 3367997136 2012-09-07 12:28
>/my/dir/path/some-target-directory/test.har/part-0
>
>But when I do
>
>$ hadoop fs -lsr har:///my/dir/path/some-target-directory/test.har/
>
>I don't get an output, I just get the $ prompt back.
>
>Any idea what is wrong here?
>
>Regards.
>--
>Ajitabh Pandey
>http://ajitabhpandey.info
Re: Hadoop archive not displaying files in the har
Posted by John George <jo...@yahoo-inc.com>.
My guess is that harchive does not like to be given a set of files as its
input, but rather a directory.
So try the following instead:
hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
test.har -p /my/dir/path subdir1/ /my/dir/path/some-target-directory
Regards,
John George
-----Original Message-----
From: Ajitabh Pandey <aj...@gmail.com>
Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Fri, 7 Sep 2012 05:55:00 -0700
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Subject: Hadoop archive not displaying files in the har
>Hi,
>
>I created a hadoop archive as follows:
>
>$ hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
>test.har -p /my/dir/path subdir1/some-file-name-*.gz
>/my/dir/path/some-target-directory
>
>The map reduce job runs fine and when the job finishes I see the
>following:
>
>$ hadoop fs -ls /my/dir/path/some-target-directory/test.har
>Found 3 items
>-rw------- 5 ap users 9199 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_index
>-rw------- 5 ap users 24 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_masterindex
>-rw------- 3 ap users 3367997136 2012-09-07 12:28
>/my/dir/path/some-target-directory/test.har/part-0
>
>But when I do
>
>$ hadoop fs -lsr har:///my/dir/path/some-target-directory/test.har/
>
>I don't get an output, I just get the $ prompt back.
>
>Any idea what is wrong here?
>
>Regards.
>--
>Ajitabh Pandey
>http://ajitabhpandey.info
Re: Hadoop archive not displaying files in the har
Posted by John George <jo...@yahoo-inc.com>.
My guess is that harchive does not like to be given a set of files as its
input, but rather a directory.
So try the following instead:
hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
test.har -p /my/dir/path subdir1/ /my/dir/path/some-target-directory
Regards,
John George
-----Original Message-----
From: Ajitabh Pandey <aj...@gmail.com>
Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Fri, 7 Sep 2012 05:55:00 -0700
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Subject: Hadoop archive not displaying files in the har
>Hi,
>
>I created a hadoop archive as follows:
>
>$ hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
>test.har -p /my/dir/path subdir1/some-file-name-*.gz
>/my/dir/path/some-target-directory
>
>The map reduce job runs fine and when the job finishes I see the
>following:
>
>$ hadoop fs -ls /my/dir/path/some-target-directory/test.har
>Found 3 items
>-rw------- 5 ap users 9199 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_index
>-rw------- 5 ap users 24 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_masterindex
>-rw------- 3 ap users 3367997136 2012-09-07 12:28
>/my/dir/path/some-target-directory/test.har/part-0
>
>But when I do
>
>$ hadoop fs -lsr har:///my/dir/path/some-target-directory/test.har/
>
>I don't get an output, I just get the $ prompt back.
>
>Any idea what is wrong here?
>
>Regards.
>--
>Ajitabh Pandey
>http://ajitabhpandey.info
Re: Hadoop archive not displaying files in the har
Posted by John George <jo...@yahoo-inc.com>.
My guess is that harchive does not like to be given a set of files as its
input, but rather a directory.
So try the following instead:
hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
test.har -p /my/dir/path subdir1/ /my/dir/path/some-target-directory
Regards,
John George
-----Original Message-----
From: Ajitabh Pandey <aj...@gmail.com>
Reply-To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Date: Fri, 7 Sep 2012 05:55:00 -0700
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Subject: Hadoop archive not displaying files in the har
>Hi,
>
>I created a hadoop archive as follows:
>
>$ hadoop archive -Dmapred.job.queue.name=myqueue -archiveName
>test.har -p /my/dir/path subdir1/some-file-name-*.gz
>/my/dir/path/some-target-directory
>
>The map reduce job runs fine and when the job finishes I see the
>following:
>
>$ hadoop fs -ls /my/dir/path/some-target-directory/test.har
>Found 3 items
>-rw------- 5 ap users 9199 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_index
>-rw------- 5 ap users 24 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_masterindex
>-rw------- 3 ap users 3367997136 2012-09-07 12:28
>/my/dir/path/some-target-directory/test.har/part-0
>
>But when I do
>
>$ hadoop fs -lsr har:///my/dir/path/some-target-directory/test.har/
>
>I don't get an output, I just get the $ prompt back.
>
>Any idea what is wrong here?
>
>Regards.
>--
>Ajitabh Pandey
>http://ajitabhpandey.info