You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Hiran Chaudhuri <hi...@amadeus.com> on 2013/12/17 16:38:19 UTC
Hadoop 2.2.0 Documentation wrong?
Hello there.
I downloaded Hadoop 2.2.0 and installed it over two servers. Upload of
files into the HDFS worked via a small Java client that I wrote.
Now I try to run a mapreduce job, and for this I am following this
document:
http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html
However the first code sample, right beneath this text, seems uncompilable
for me:
Writing a simple Client
The first step that a client needs to do is to connect to the
ResourceManager or to be more specific, the ApplicationsManager (AsM)
interface of the ResourceManager.
YarnConfiguration.YARN_SECURITY_INFO seems to not exist, and the
rpc.getProxy(...) call references the rpc object which comes out of
nowhere.
Have these been defined somehwere and I am just missing something?
Anyone to shed some light on this?
Hiran
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
Re: Hadoop 2.2.0 Documentation wrong?
Posted by Hiran Chaudhuri <hi...@amadeus.com>.
I have found part of the answer:
The reference to rpc.getProxy(...) compiles better if I change to
RPC.getProxy(...), and I have to add an <int> parameter as well.
So this tells me that the API might have changed but the documentation did
not.
Will try to still follow that tutorial...
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
From: Hiran Chaudhuri <hi...@amadeus.com>
To: user@hadoop.apache.org
Date: 17-12-13 16:41
Subject: Hadoop 2.2.0 Documentation wrong?
Hello there.
I downloaded Hadoop 2.2.0 and installed it over two servers. Upload of
files into the HDFS worked via a small Java client that I wrote.
Now I try to run a mapreduce job, and for this I am following this
document:
http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html
However the first code sample, right beneath this text, seems uncompilable
for me:
Writing a simple Client
The first step that a client needs to do is to connect to the
ResourceManager or to be more specific, the ApplicationsManager (AsM)
interface of the ResourceManager.
YarnConfiguration.YARN_SECURITY_INFO seems to not exist, and the
rpc.getProxy(...) call references the rpc object which comes out of
nowhere.
Have these been defined somehwere and I am just missing something?
Anyone to shed some light on this?
Hiran
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
Re: Hadoop 2.2.0 Documentation wrong?
Posted by Hiran Chaudhuri <hi...@amadeus.com>.
I have found part of the answer:
The reference to rpc.getProxy(...) compiles better if I change to
RPC.getProxy(...), and I have to add an <int> parameter as well.
So this tells me that the API might have changed but the documentation did
not.
Will try to still follow that tutorial...
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
From: Hiran Chaudhuri <hi...@amadeus.com>
To: user@hadoop.apache.org
Date: 17-12-13 16:41
Subject: Hadoop 2.2.0 Documentation wrong?
Hello there.
I downloaded Hadoop 2.2.0 and installed it over two servers. Upload of
files into the HDFS worked via a small Java client that I wrote.
Now I try to run a mapreduce job, and for this I am following this
document:
http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html
However the first code sample, right beneath this text, seems uncompilable
for me:
Writing a simple Client
The first step that a client needs to do is to connect to the
ResourceManager or to be more specific, the ApplicationsManager (AsM)
interface of the ResourceManager.
YarnConfiguration.YARN_SECURITY_INFO seems to not exist, and the
rpc.getProxy(...) call references the rpc object which comes out of
nowhere.
Have these been defined somehwere and I am just missing something?
Anyone to shed some light on this?
Hiran
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
Re: Hadoop 2.2.0 Documentation wrong?
Posted by Hiran Chaudhuri <hi...@amadeus.com>.
I have found part of the answer:
The reference to rpc.getProxy(...) compiles better if I change to
RPC.getProxy(...), and I have to add an <int> parameter as well.
So this tells me that the API might have changed but the documentation did
not.
Will try to still follow that tutorial...
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
From: Hiran Chaudhuri <hi...@amadeus.com>
To: user@hadoop.apache.org
Date: 17-12-13 16:41
Subject: Hadoop 2.2.0 Documentation wrong?
Hello there.
I downloaded Hadoop 2.2.0 and installed it over two servers. Upload of
files into the HDFS worked via a small Java client that I wrote.
Now I try to run a mapreduce job, and for this I am following this
document:
http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html
However the first code sample, right beneath this text, seems uncompilable
for me:
Writing a simple Client
The first step that a client needs to do is to connect to the
ResourceManager or to be more specific, the ApplicationsManager (AsM)
interface of the ResourceManager.
YarnConfiguration.YARN_SECURITY_INFO seems to not exist, and the
rpc.getProxy(...) call references the rpc object which comes out of
nowhere.
Have these been defined somehwere and I am just missing something?
Anyone to shed some light on this?
Hiran
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
Re: Hadoop 2.2.0 Documentation wrong?
Posted by Hiran Chaudhuri <hi...@amadeus.com>.
I have found part of the answer:
The reference to rpc.getProxy(...) compiles better if I change to
RPC.getProxy(...), and I have to add an <int> parameter as well.
So this tells me that the API might have changed but the documentation did
not.
Will try to still follow that tutorial...
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
From: Hiran Chaudhuri <hi...@amadeus.com>
To: user@hadoop.apache.org
Date: 17-12-13 16:41
Subject: Hadoop 2.2.0 Documentation wrong?
Hello there.
I downloaded Hadoop 2.2.0 and installed it over two servers. Upload of
files into the HDFS worked via a small Java client that I wrote.
Now I try to run a mapreduce job, and for this I am following this
document:
http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html
However the first code sample, right beneath this text, seems uncompilable
for me:
Writing a simple Client
The first step that a client needs to do is to connect to the
ResourceManager or to be more specific, the ApplicationsManager (AsM)
interface of the ResourceManager.
YarnConfiguration.YARN_SECURITY_INFO seems to not exist, and the
rpc.getProxy(...) call references the rpc object which comes out of
nowhere.
Have these been defined somehwere and I am just missing something?
Anyone to shed some light on this?
Hiran
Hiran Chaudhuri
System Support Programmer / Analyst
IT Service Assurance
Hosting & Regional Services (IH)
Amadeus Data Processing GmbH
Berghamer Strasse 6
85435 Erding
T: +49-8122-43x3662
hiran.chaudhuri@amadeus.com
http://www.amadeus.com
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany
IMPORTANT - CONFIDENTIALITY NOTICE - This e-mail is intended only for
the use of the individual or entity shown above as addressees. It may
contain information which is privileged, confidential or otherwise
protected from disclosure under applicable laws. If the reader of this
transmission is not the intended recipient, you are hereby notified that
any dissemination, printing, distribution, copying, disclosure or the
taking of any action in reliance on the contents of this information is
strictly prohibited. If you have received this transmission in error,
please immediately notify us by reply e-mail or using the address below
and delete the message and any attachments from your system.
Amadeus Data Processing GmbH
Geschäftsführer: Dr. Wolfgang Krips
Sitz der Gesellschaft: Erding
HR München 48 199
Berghamer Strasse 6
85435 Erding
Germany