Possible to poll JobTracker for information from any language?

[Ryan Cole <ry...@rycole.com>]

Hello,

I'm interested in writing a library, to be used with Node.js, that can ask
the JobTracker for information about jobs. I see that this is possible
using the Java API, with the JobClient interface [1]. I also saw that on
the wiki, it mentions that clients can poll the JobTracker for information,
but does not go into detail [2]. Is it possible to get information about
jobs from the JobTracker using C, or C++, or Thrift, or something else?

Thanks,
Ryan


1.
http://hadoop.apache.org/common/docs/r1.0.1/mapred_tutorial.html#Job+Submission+and+Monitoring
2. http://wiki.apache.org/hadoop/JobTracker

Re: Possible to poll JobTracker for information from any language?

[Robert Evans <ev...@yahoo-inc.com>]

Ryan, Please don't cross post.

On the 1.0 line I do not know of any way to get this information out for any language but java.  And even then it is simplest to use the hadoop client libraries because the protocol has changed a lot from say 1.0 to 2.0 it is completely different.  However if you want to move to 2.0 a number of RESTful web service APIs have been added in that should allow you to pull out the information that you care about.

--Bobby Evans


On 3/28/12 8:07 PM, "Ryan Cole" <ry...@rycole.com> wrote:

Hello,

I'm interested in writing a library, to be used with Node.js, that can ask the JobTracker for information about jobs. I see that this is possible using the Java API, with the JobClient interface [1]. I also saw that on the wiki, it mentions that clients can poll the JobTracker for information, but does not go into detail [2]. Is it possible to get information about jobs from the JobTracker using C, or C++, or Thrift, or something else?

Thanks,
Ryan


1. http://hadoop.apache.org/common/docs/r1.0.1/mapred_tutorial.html#Job+Submission+and+Monitoring
2. http://wiki.apache.org/hadoop/JobTracker