You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Shi Yu <sh...@uchicago.edu> on 2011/08/11 17:24:04 UTC

Hadoop in PBS + Lustre

Hi,

I found some materials about submitting hadoop jobs via PBS.  Any idea 
how to interactively browse HDFS through PBS? Our supercomputer uses 
lustre storage system. I found a wiki talking about using Polyserve 
storage system but not using HDFS. Does anyone have tried lustre + 
hadoop + PBS? Any special care to do that? Thanks!

Shi