You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Visioner Sadak <vi...@gmail.com> on 2012/10/04 17:52:52 UTC
copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method
copies data from tht local box only wht if i have to copy data from uses
desktop pc(for example E drive) thru my my web application will i have to
first copy data to tht remote box using some java code then use
copyFromLocal method to copy in to hadoop....
Re: copyFromLocal
Posted by Robert Molina <rm...@hortonworks.com>.
Here is the information for webhdfs rest call that should allow you to
upload a file:
http://hadoop.apache.org/docs/r1.0.3/webhdfs.html#CREATE
HTH
On Fri, Oct 5, 2012 at 1:16 AM, Visioner Sadak <vi...@gmail.com>wrote:
> Hey thanks bejoy and andy act my user just has a desktop web user(like we
> browsing web) so i guess first i have to upload the file to my linux
> box(wher hadoop is installed) using a web app then frm there i have to use
> moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
> used to upload to hdfs using web ....
>
>
> On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
>
>> Hi Sadak
>>
>> If you are issuing copyFromLocal from a client/edge node you can copy the
>> files available in the client's lfs to hdfs in cluster. The client/edge
>> node could be a box that has all the hadoop jars and config files exactly
>> same as that of the cluster and the cluster nodes should be accessible from
>> this client.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *"Kartashov, Andy" <An...@mpac.ca>
>> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
>> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
>> *ReplyTo: *user@hadoop.apache.org
>> *Subject: *RE: copyFromLocal
>>
>> I use –put –get commands to bring files in/our of HDFS from/to my home
>> directory on EC2. Then use WinSCP to download files to my laptop.
>>
>>
>>
>> Andy Kartashov
>>
>> *MPAC*
>>
>> Architecture R&D, Co-op
>>
>> 1340 Pickering Parkway, Pickering, L1V 0C4
>>
>> ( Phone : (905) 837 6269
>>
>> ( Mobile: (416) 722 1787
>>
>> *andy.kartashov@mpac.ca*
>>
>>
>>
>> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
>> *Sent:* Thursday, October 04, 2012 11:53 AM
>> *To:* user@hadoop.apache.org
>> *Subject:* copyFromLocal
>>
>>
>>
>> guys i have hadoop installled in a remote box ... does copyFromLocal
>> method copies data from tht local box only wht if i have to copy data from
>> uses desktop pc(for example E drive) thru my my web application will i have
>> to first copy data to tht remote box using some java code then use
>> copyFromLocal method to copy in to hadoop....
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: copyFromLocal
Posted by Robert Molina <rm...@hortonworks.com>.
Here is the information for webhdfs rest call that should allow you to
upload a file:
http://hadoop.apache.org/docs/r1.0.3/webhdfs.html#CREATE
HTH
On Fri, Oct 5, 2012 at 1:16 AM, Visioner Sadak <vi...@gmail.com>wrote:
> Hey thanks bejoy and andy act my user just has a desktop web user(like we
> browsing web) so i guess first i have to upload the file to my linux
> box(wher hadoop is installed) using a web app then frm there i have to use
> moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
> used to upload to hdfs using web ....
>
>
> On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
>
>> Hi Sadak
>>
>> If you are issuing copyFromLocal from a client/edge node you can copy the
>> files available in the client's lfs to hdfs in cluster. The client/edge
>> node could be a box that has all the hadoop jars and config files exactly
>> same as that of the cluster and the cluster nodes should be accessible from
>> this client.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *"Kartashov, Andy" <An...@mpac.ca>
>> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
>> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
>> *ReplyTo: *user@hadoop.apache.org
>> *Subject: *RE: copyFromLocal
>>
>> I use –put –get commands to bring files in/our of HDFS from/to my home
>> directory on EC2. Then use WinSCP to download files to my laptop.
>>
>>
>>
>> Andy Kartashov
>>
>> *MPAC*
>>
>> Architecture R&D, Co-op
>>
>> 1340 Pickering Parkway, Pickering, L1V 0C4
>>
>> ( Phone : (905) 837 6269
>>
>> ( Mobile: (416) 722 1787
>>
>> *andy.kartashov@mpac.ca*
>>
>>
>>
>> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
>> *Sent:* Thursday, October 04, 2012 11:53 AM
>> *To:* user@hadoop.apache.org
>> *Subject:* copyFromLocal
>>
>>
>>
>> guys i have hadoop installled in a remote box ... does copyFromLocal
>> method copies data from tht local box only wht if i have to copy data from
>> uses desktop pc(for example E drive) thru my my web application will i have
>> to first copy data to tht remote box using some java code then use
>> copyFromLocal method to copy in to hadoop....
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: copyFromLocal
Posted by Robert Molina <rm...@hortonworks.com>.
Here is the information for webhdfs rest call that should allow you to
upload a file:
http://hadoop.apache.org/docs/r1.0.3/webhdfs.html#CREATE
HTH
On Fri, Oct 5, 2012 at 1:16 AM, Visioner Sadak <vi...@gmail.com>wrote:
> Hey thanks bejoy and andy act my user just has a desktop web user(like we
> browsing web) so i guess first i have to upload the file to my linux
> box(wher hadoop is installed) using a web app then frm there i have to use
> moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
> used to upload to hdfs using web ....
>
>
> On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
>
>> Hi Sadak
>>
>> If you are issuing copyFromLocal from a client/edge node you can copy the
>> files available in the client's lfs to hdfs in cluster. The client/edge
>> node could be a box that has all the hadoop jars and config files exactly
>> same as that of the cluster and the cluster nodes should be accessible from
>> this client.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *"Kartashov, Andy" <An...@mpac.ca>
>> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
>> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
>> *ReplyTo: *user@hadoop.apache.org
>> *Subject: *RE: copyFromLocal
>>
>> I use –put –get commands to bring files in/our of HDFS from/to my home
>> directory on EC2. Then use WinSCP to download files to my laptop.
>>
>>
>>
>> Andy Kartashov
>>
>> *MPAC*
>>
>> Architecture R&D, Co-op
>>
>> 1340 Pickering Parkway, Pickering, L1V 0C4
>>
>> ( Phone : (905) 837 6269
>>
>> ( Mobile: (416) 722 1787
>>
>> *andy.kartashov@mpac.ca*
>>
>>
>>
>> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
>> *Sent:* Thursday, October 04, 2012 11:53 AM
>> *To:* user@hadoop.apache.org
>> *Subject:* copyFromLocal
>>
>>
>>
>> guys i have hadoop installled in a remote box ... does copyFromLocal
>> method copies data from tht local box only wht if i have to copy data from
>> uses desktop pc(for example E drive) thru my my web application will i have
>> to first copy data to tht remote box using some java code then use
>> copyFromLocal method to copy in to hadoop....
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: copyFromLocal
Posted by Robert Molina <rm...@hortonworks.com>.
Here is the information for webhdfs rest call that should allow you to
upload a file:
http://hadoop.apache.org/docs/r1.0.3/webhdfs.html#CREATE
HTH
On Fri, Oct 5, 2012 at 1:16 AM, Visioner Sadak <vi...@gmail.com>wrote:
> Hey thanks bejoy and andy act my user just has a desktop web user(like we
> browsing web) so i guess first i have to upload the file to my linux
> box(wher hadoop is installed) using a web app then frm there i have to use
> moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
> used to upload to hdfs using web ....
>
>
> On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
>
>> Hi Sadak
>>
>> If you are issuing copyFromLocal from a client/edge node you can copy the
>> files available in the client's lfs to hdfs in cluster. The client/edge
>> node could be a box that has all the hadoop jars and config files exactly
>> same as that of the cluster and the cluster nodes should be accessible from
>> this client.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *"Kartashov, Andy" <An...@mpac.ca>
>> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
>> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
>> *ReplyTo: *user@hadoop.apache.org
>> *Subject: *RE: copyFromLocal
>>
>> I use –put –get commands to bring files in/our of HDFS from/to my home
>> directory on EC2. Then use WinSCP to download files to my laptop.
>>
>>
>>
>> Andy Kartashov
>>
>> *MPAC*
>>
>> Architecture R&D, Co-op
>>
>> 1340 Pickering Parkway, Pickering, L1V 0C4
>>
>> ( Phone : (905) 837 6269
>>
>> ( Mobile: (416) 722 1787
>>
>> *andy.kartashov@mpac.ca*
>>
>>
>>
>> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
>> *Sent:* Thursday, October 04, 2012 11:53 AM
>> *To:* user@hadoop.apache.org
>> *Subject:* copyFromLocal
>>
>>
>>
>> guys i have hadoop installled in a remote box ... does copyFromLocal
>> method copies data from tht local box only wht if i have to copy data from
>> uses desktop pc(for example E drive) thru my my web application will i have
>> to first copy data to tht remote box using some java code then use
>> copyFromLocal method to copy in to hadoop....
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: copyFromLocal
Posted by Visioner Sadak <vi...@gmail.com>.
Hey thanks bejoy and andy act my user just has a desktop web user(like we
browsing web) so i guess first i have to upload the file to my linux
box(wher hadoop is installed) using a web app then frm there i have to use
moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
used to upload to hdfs using web ....
On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
> Hi Sadak
>
> If you are issuing copyFromLocal from a client/edge node you can copy the
> files available in the client's lfs to hdfs in cluster. The client/edge
> node could be a box that has all the hadoop jars and config files exactly
> same as that of the cluster and the cluster nodes should be accessible from
> this client.
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
> ------------------------------
> *From: *"Kartashov, Andy" <An...@mpac.ca>
> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
> *ReplyTo: *user@hadoop.apache.org
> *Subject: *RE: copyFromLocal
>
> I use –put –get commands to bring files in/our of HDFS from/to my home
> directory on EC2. Then use WinSCP to download files to my laptop.
>
>
>
> Andy Kartashov
>
> *MPAC*
>
> Architecture R&D, Co-op
>
> 1340 Pickering Parkway, Pickering, L1V 0C4
>
> ( Phone : (905) 837 6269
>
> ( Mobile: (416) 722 1787
>
> *andy.kartashov@mpac.ca*
>
>
>
> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
> *Sent:* Thursday, October 04, 2012 11:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* copyFromLocal
>
>
>
> guys i have hadoop installled in a remote box ... does copyFromLocal
> method copies data from tht local box only wht if i have to copy data from
> uses desktop pc(for example E drive) thru my my web application will i have
> to first copy data to tht remote box using some java code then use
> copyFromLocal method to copy in to hadoop....
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: copyFromLocal
Posted by Visioner Sadak <vi...@gmail.com>.
Hey thanks bejoy and andy act my user just has a desktop web user(like we
browsing web) so i guess first i have to upload the file to my linux
box(wher hadoop is installed) using a web app then frm there i have to use
moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
used to upload to hdfs using web ....
On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
> Hi Sadak
>
> If you are issuing copyFromLocal from a client/edge node you can copy the
> files available in the client's lfs to hdfs in cluster. The client/edge
> node could be a box that has all the hadoop jars and config files exactly
> same as that of the cluster and the cluster nodes should be accessible from
> this client.
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
> ------------------------------
> *From: *"Kartashov, Andy" <An...@mpac.ca>
> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
> *ReplyTo: *user@hadoop.apache.org
> *Subject: *RE: copyFromLocal
>
> I use –put –get commands to bring files in/our of HDFS from/to my home
> directory on EC2. Then use WinSCP to download files to my laptop.
>
>
>
> Andy Kartashov
>
> *MPAC*
>
> Architecture R&D, Co-op
>
> 1340 Pickering Parkway, Pickering, L1V 0C4
>
> ( Phone : (905) 837 6269
>
> ( Mobile: (416) 722 1787
>
> *andy.kartashov@mpac.ca*
>
>
>
> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
> *Sent:* Thursday, October 04, 2012 11:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* copyFromLocal
>
>
>
> guys i have hadoop installled in a remote box ... does copyFromLocal
> method copies data from tht local box only wht if i have to copy data from
> uses desktop pc(for example E drive) thru my my web application will i have
> to first copy data to tht remote box using some java code then use
> copyFromLocal method to copy in to hadoop....
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: copyFromLocal
Posted by Visioner Sadak <vi...@gmail.com>.
Hey thanks bejoy and andy act my user just has a desktop web user(like we
browsing web) so i guess first i have to upload the file to my linux
box(wher hadoop is installed) using a web app then frm there i have to use
moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
used to upload to hdfs using web ....
On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
> Hi Sadak
>
> If you are issuing copyFromLocal from a client/edge node you can copy the
> files available in the client's lfs to hdfs in cluster. The client/edge
> node could be a box that has all the hadoop jars and config files exactly
> same as that of the cluster and the cluster nodes should be accessible from
> this client.
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
> ------------------------------
> *From: *"Kartashov, Andy" <An...@mpac.ca>
> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
> *ReplyTo: *user@hadoop.apache.org
> *Subject: *RE: copyFromLocal
>
> I use –put –get commands to bring files in/our of HDFS from/to my home
> directory on EC2. Then use WinSCP to download files to my laptop.
>
>
>
> Andy Kartashov
>
> *MPAC*
>
> Architecture R&D, Co-op
>
> 1340 Pickering Parkway, Pickering, L1V 0C4
>
> ( Phone : (905) 837 6269
>
> ( Mobile: (416) 722 1787
>
> *andy.kartashov@mpac.ca*
>
>
>
> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
> *Sent:* Thursday, October 04, 2012 11:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* copyFromLocal
>
>
>
> guys i have hadoop installled in a remote box ... does copyFromLocal
> method copies data from tht local box only wht if i have to copy data from
> uses desktop pc(for example E drive) thru my my web application will i have
> to first copy data to tht remote box using some java code then use
> copyFromLocal method to copy in to hadoop....
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: copyFromLocal
Posted by Visioner Sadak <vi...@gmail.com>.
Hey thanks bejoy and andy act my user just has a desktop web user(like we
browsing web) so i guess first i have to upload the file to my linux
box(wher hadoop is installed) using a web app then frm there i have to use
moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
used to upload to hdfs using web ....
On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <be...@gmail.com> wrote:
> Hi Sadak
>
> If you are issuing copyFromLocal from a client/edge node you can copy the
> files available in the client's lfs to hdfs in cluster. The client/edge
> node could be a box that has all the hadoop jars and config files exactly
> same as that of the cluster and the cluster nodes should be accessible from
> this client.
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
> ------------------------------
> *From: *"Kartashov, Andy" <An...@mpac.ca>
> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
> *To: *user@hadoop.apache.org<us...@hadoop.apache.org>
> *ReplyTo: *user@hadoop.apache.org
> *Subject: *RE: copyFromLocal
>
> I use –put –get commands to bring files in/our of HDFS from/to my home
> directory on EC2. Then use WinSCP to download files to my laptop.
>
>
>
> Andy Kartashov
>
> *MPAC*
>
> Architecture R&D, Co-op
>
> 1340 Pickering Parkway, Pickering, L1V 0C4
>
> ( Phone : (905) 837 6269
>
> ( Mobile: (416) 722 1787
>
> *andy.kartashov@mpac.ca*
>
>
>
> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com]
> *Sent:* Thursday, October 04, 2012 11:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* copyFromLocal
>
>
>
> guys i have hadoop installled in a remote box ... does copyFromLocal
> method copies data from tht local box only wht if i have to copy data from
> uses desktop pc(for example E drive) thru my my web application will i have
> to first copy data to tht remote box using some java code then use
> copyFromLocal method to copy in to hadoop....
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: copyFromLocal
Posted by Bejoy KS <be...@gmail.com>.
Hi Sadak
If you are issuing copyFromLocal from a client/edge node you can copy the files available in the client's lfs to hdfs in cluster. The client/edge node could be a box that has all the hadoop jars and config files exactly same as that of the cluster and the cluster nodes should be accessible from this client.
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message-----
From: "Kartashov, Andy" <An...@mpac.ca>
Date: Thu, 4 Oct 2012 16:51:35
To: user@hadoop.apache.org<us...@hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Subject: RE: copyFromLocal
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
Re: copyFromLocal
Posted by Bejoy KS <be...@gmail.com>.
Hi Sadak
If you are issuing copyFromLocal from a client/edge node you can copy the files available in the client's lfs to hdfs in cluster. The client/edge node could be a box that has all the hadoop jars and config files exactly same as that of the cluster and the cluster nodes should be accessible from this client.
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message-----
From: "Kartashov, Andy" <An...@mpac.ca>
Date: Thu, 4 Oct 2012 16:51:35
To: user@hadoop.apache.org<us...@hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Subject: RE: copyFromLocal
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
Re: copyFromLocal
Posted by Bejoy KS <be...@gmail.com>.
Hi Sadak
If you are issuing copyFromLocal from a client/edge node you can copy the files available in the client's lfs to hdfs in cluster. The client/edge node could be a box that has all the hadoop jars and config files exactly same as that of the cluster and the cluster nodes should be accessible from this client.
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message-----
From: "Kartashov, Andy" <An...@mpac.ca>
Date: Thu, 4 Oct 2012 16:51:35
To: user@hadoop.apache.org<us...@hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Subject: RE: copyFromLocal
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
Re: copyFromLocal
Posted by Bejoy KS <be...@gmail.com>.
Hi Sadak
If you are issuing copyFromLocal from a client/edge node you can copy the files available in the client's lfs to hdfs in cluster. The client/edge node could be a box that has all the hadoop jars and config files exactly same as that of the cluster and the cluster nodes should be accessible from this client.
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message-----
From: "Kartashov, Andy" <An...@mpac.ca>
Date: Thu, 4 Oct 2012 16:51:35
To: user@hadoop.apache.org<us...@hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Subject: RE: copyFromLocal
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: copyFromLocal
Posted by "Kartashov, Andy" <An...@mpac.ca>.
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: copyFromLocal
Posted by "Kartashov, Andy" <An...@mpac.ca>.
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: copyFromLocal
Posted by "Kartashov, Andy" <An...@mpac.ca>.
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: copyFromLocal
Posted by "Kartashov, Andy" <An...@mpac.ca>.
I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.
Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
andy.kartashov@mpac.ca<ma...@mpac.ca>
From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: Thursday, October 04, 2012 11:53 AM
To: user@hadoop.apache.org
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel