RE: Basic question on HDFS - MR

[Devaraj K <de...@huawei.com>]

Stuti,

 

            No need to copy the job jar file to every machine in the
cluster. You can copy the jar file to the job tracker and execute it using
the 'jar' command. If you want to submit the job from the other
system/application, you can use the Job.submit() API to submit the job. Job
tracker will make use of the cluster to complete it.

 

Devaraj K 

----------------------------------------------------------------------------
---------------------------------------------------------
This e-mail and its attachments contain confidential information from
HUAWEI, which 
is intended only for the person or entity whose address is listed above. Any
use of the 
information contained herein in any way (including, but not limited to,
total or partial 
disclosure, reproduction, or dissemination) by persons other than the
intended 
recipient(s) is prohibited. If you receive this e-mail in error, please
notify the sender by 
phone or email immediately and delete it!ss

 

  _____  

From: Stuti Awasthi [mailto:stutiawasthi@hcl.com] 
Sent: Tuesday, October 18, 2011 4:33 PM
To: hdfs-user@hadoop.apache.org
Subject: Basic question on HDFS - MR

 

Hi,

I have a very basic question on MR jobs. Suppose I have a cluster 3 nodes
out of which 1 NN and 3 DN.

I wanted to run an MR job so I placed the jar on 1 of the cluster machine
and executed, it runs fine.

Now my question is do I need to copy my MR job to every DN for distributed
processing?

Or

Placing MR jar on any of the machine does not make any difference , MR job
will run in distributed fashion.

 

Thanks

Stuti

 

  _____  

::DISCLAIMER::
----------------------------------------------------------------------------
-------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and
intended for the named recipient(s) only.
It shall not attach any liability on the originator or HCL or its
affiliates. Any views or opinions presented in
this email are solely those of the author and may not necessarily reflect
the opinions of HCL or its affiliates.
Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of
this message without the prior written consent of the author of this e-mail
is strictly prohibited. If you have
received this email in error please delete it and notify the sender
immediately. Before opening any mail and
attachments please check them for viruses and defect.

----------------------------------------------------------------------------
-------------------------------------------