You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Chenguang Li <ho...@gmail.com> on 2011/08/16 12:20:29 UTC

Is is possible to use HFTP as input when streaming?

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Hi all,

Is it possible to use HFTP input like this:

$ hadoop jar hadoop-streaming.jar \
- -input hftp://node1/records \
- -output hdfs://node2/result
...

? I've tried several times with different versions but failed with
exceptions thrown as

"java.io.IOException: HTTP_PARTIAL expected, received 200" and
"java.io.IOException: Server returned HTTP response code: 500 for URL:..."

It seems like the official document is also lacking such examples. I am
not sure if I did this correctly, so if someone already successfully set
things up, would you please point me to some guide?

Thanks in advance.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.12 (Darwin)

iEYEAREIAAYFAk5KRGoACgkQTDLEMen/8ayBXgCfeTmdTwNZJjUro7ZETNI9WjTp
vUMAnRvWLGCip/2vYTzkhajGmhbu467u
=bwD2
-----END PGP SIGNATURE-----