You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by "Kartashov, Andy" <An...@mpac.ca> on 2012/11/08 22:48:05 UTC
hadoop - running examples
Guys,
When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
Just making sure.
Thnx,
AK
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent être couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent courriel
Re: hadoop - running examples
Posted by Marcos Ortiz Valmaseda <ml...@uci.cu>.
Mohammad is right.
When you write a file to HDFS, it can´t be modified.
The pattern in HDFS is write-one/read-many-times.
If you want to use a distribution where you can read and write files, you should take a look
to MapR distribution.
----- Mensaje original -----
De: Mohammad Tariq <do...@gmail.com>
Para: user@hadoop.apache.org
Enviado: Thu, 08 Nov 2012 17:33:56 -0500 (CST)
Asunto: Re: hadoop - running examples
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: hadoop - running examples
Posted by Marcos Ortiz Valmaseda <ml...@uci.cu>.
Mohammad is right.
When you write a file to HDFS, it can´t be modified.
The pattern in HDFS is write-one/read-many-times.
If you want to use a distribution where you can read and write files, you should take a look
to MapR distribution.
----- Mensaje original -----
De: Mohammad Tariq <do...@gmail.com>
Para: user@hadoop.apache.org
Enviado: Thu, 08 Nov 2012 17:33:56 -0500 (CST)
Asunto: Re: hadoop - running examples
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: hadoop - running examples
Posted by Marcos Ortiz Valmaseda <ml...@uci.cu>.
Mohammad is right.
When you write a file to HDFS, it can´t be modified.
The pattern in HDFS is write-one/read-many-times.
If you want to use a distribution where you can read and write files, you should take a look
to MapR distribution.
----- Mensaje original -----
De: Mohammad Tariq <do...@gmail.com>
Para: user@hadoop.apache.org
Enviado: Thu, 08 Nov 2012 17:33:56 -0500 (CST)
Asunto: Re: hadoop - running examples
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: hadoop - running examples
Posted by Marcos Ortiz Valmaseda <ml...@uci.cu>.
Mohammad is right.
When you write a file to HDFS, it can´t be modified.
The pattern in HDFS is write-one/read-many-times.
If you want to use a distribution where you can read and write files, you should take a look
to MapR distribution.
----- Mensaje original -----
De: Mohammad Tariq <do...@gmail.com>
Para: user@hadoop.apache.org
Enviado: Thu, 08 Nov 2012 17:33:56 -0500 (CST)
Asunto: Re: hadoop - running examples
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Apologies for the wrong word. Yes, I meant non modifiable.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 4:01 AM, Jay Vyas <ja...@gmail.com> wrote:
> What do you mean immutable? Do u mean non modifiable maybe .? Immutable
> implies that they can't be deleted .
>
> Jay Vyas
> MMSB
> UCHC
>
> On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
>
> Files are immutable, once written into the Hdfs. And touchz creates a file
> of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
>
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make
>> some correction to a file, you need to make them on local FS and run
>> $hadoop fs -put ... again. You cannot just make changes to files inside
>> HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
Re: hadoop - running examples
Posted by Jay Vyas <ja...@gmail.com>.
What do you mean immutable? Do u mean non modifiable maybe .? Immutable implies that they can't be deleted .
Jay Vyas
MMSB
UCHC
On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Files are immutable, once written into the Hdfs. And touchz creates a file of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca> wrote:
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent être couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent courriel
>
Re: hadoop - running examples
Posted by Jay Vyas <ja...@gmail.com>.
What do you mean immutable? Do u mean non modifiable maybe .? Immutable implies that they can't be deleted .
Jay Vyas
MMSB
UCHC
On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Files are immutable, once written into the Hdfs. And touchz creates a file of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca> wrote:
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent être couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent courriel
>
Re: hadoop - running examples
Posted by Jay Vyas <ja...@gmail.com>.
What do you mean immutable? Do u mean non modifiable maybe .? Immutable implies that they can't be deleted .
Jay Vyas
MMSB
UCHC
On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Files are immutable, once written into the Hdfs. And touchz creates a file of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca> wrote:
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent être couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent courriel
>
Re: hadoop - running examples
Posted by Jay Vyas <ja...@gmail.com>.
What do you mean immutable? Do u mean non modifiable maybe .? Immutable implies that they can't be deleted .
Jay Vyas
MMSB
UCHC
On Nov 8, 2012, at 5:28 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Files are immutable, once written into the Hdfs. And touchz creates a file of 0 length.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca> wrote:
>> Guys,
>>
>> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
>>
>> Just making sure.
>>
>> Thnx,
>> AK
>> NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent être couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent courriel
>
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Files are immutable, once written into the Hdfs. And touchz creates a file
of 0 length.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
> Guys,
>
> When running examples, you bring them into HDFS. Say, you need to make
> some correction to a file, you need to make them on local FS and run
> $hadoop fs -put ... again. You cannot just make changes to files inside
> HDFS except for "touchz" a file, correct?
>
> Just making sure.
>
> Thnx,
> AK
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: hadoop - running examples
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Nov 8, 2012 at 1:48 PM, Kartashov, Andy <An...@mpac.ca> wrote:
> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
If you need to change existing data, you do need to write a new file,
or delete the old file then re-write it. So as far as that goes, yes,
you cannot just make changes.
However, files can be appended to in HDFS, although I am not aware of
a "hdfs dfs -append" command to do append from the commandline. So
it's not quite correct to say that touchz is the only thing to change
an existing file.
-andy
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Files are immutable, once written into the Hdfs. And touchz creates a file
of 0 length.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
> Guys,
>
> When running examples, you bring them into HDFS. Say, you need to make
> some correction to a file, you need to make them on local FS and run
> $hadoop fs -put ... again. You cannot just make changes to files inside
> HDFS except for "touchz" a file, correct?
>
> Just making sure.
>
> Thnx,
> AK
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: hadoop - running examples
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Nov 8, 2012 at 1:48 PM, Kartashov, Andy <An...@mpac.ca> wrote:
> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
If you need to change existing data, you do need to write a new file,
or delete the old file then re-write it. So as far as that goes, yes,
you cannot just make changes.
However, files can be appended to in HDFS, although I am not aware of
a "hdfs dfs -append" command to do append from the commandline. So
it's not quite correct to say that touchz is the only thing to change
an existing file.
-andy
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Files are immutable, once written into the Hdfs. And touchz creates a file
of 0 length.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
> Guys,
>
> When running examples, you bring them into HDFS. Say, you need to make
> some correction to a file, you need to make them on local FS and run
> $hadoop fs -put ... again. You cannot just make changes to files inside
> HDFS except for "touchz" a file, correct?
>
> Just making sure.
>
> Thnx,
> AK
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: hadoop - running examples
Posted by Mohammad Tariq <do...@gmail.com>.
Files are immutable, once written into the Hdfs. And touchz creates a file
of 0 length.
Regards,
Mohammad Tariq
On Fri, Nov 9, 2012 at 3:18 AM, Kartashov, Andy <An...@mpac.ca>wrote:
> Guys,
>
> When running examples, you bring them into HDFS. Say, you need to make
> some correction to a file, you need to make them on local FS and run
> $hadoop fs -put ... again. You cannot just make changes to files inside
> HDFS except for "touchz" a file, correct?
>
> Just making sure.
>
> Thnx,
> AK
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>
Re: hadoop - running examples
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Nov 8, 2012 at 1:48 PM, Kartashov, Andy <An...@mpac.ca> wrote:
> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
If you need to change existing data, you do need to write a new file,
or delete the old file then re-write it. So as far as that goes, yes,
you cannot just make changes.
However, files can be appended to in HDFS, although I am not aware of
a "hdfs dfs -append" command to do append from the commandline. So
it's not quite correct to say that touchz is the only thing to change
an existing file.
-andy
Re: hadoop - running examples
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Nov 8, 2012 at 1:48 PM, Kartashov, Andy <An...@mpac.ca> wrote:
> When running examples, you bring them into HDFS. Say, you need to make some correction to a file, you need to make them on local FS and run $hadoop fs -put ... again. You cannot just make changes to files inside HDFS except for "touchz" a file, correct?
If you need to change existing data, you do need to write a new file,
or delete the old file then re-write it. So as far as that goes, yes,
you cannot just make changes.
However, files can be appended to in HDFS, although I am not aware of
a "hdfs dfs -append" command to do append from the commandline. So
it's not quite correct to say that touchz is the only thing to change
an existing file.
-andy