http alternative for 'hadoop dfs -getmerge'?

[Alex Parvulescu <al...@gmail.com>]

Hello,

I'd like to know if there is any alternative to 'hadoop dfs -getmerge' over
http. The closest I could find is the 'Download this file' link but this is
available only for parts, not the whole directory (
http://hadoop:50075/streamFile?filename=%2Fuser%2Fhadoop-user%2Foutput%2Fsolr%2F%2Fpart-00000
)

What I'd like to do is push something from Hadoop to Solr.
The options are:

1. run 'dsf -getmerge' which will get me a unified file (all the parts as
one file) and scp that to the solr server , then run the actual push to
solr.

or

2. find a way to be able to provide this file (unified, not just parts of
it)  via http, so Solr (1.4) will be able to stream it.
You could add a http server, but I see no point in adding apache to this
mix, as long as there already is the hdfs browser running on 50070.

I'd really like to go with 2, as it seems a lot easier.

What do you think?

thanks,
alex