You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by "Kartashov, Andy" <An...@mpac.ca> on 2012/11/20 17:31:21 UTC
block size
Guys,
After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
Thanks,
AK
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: block size
Posted by "Kartashov, Andy" <An...@mpac.ca>.
Cheers!
From: Kai Voigt [mailto:k@123.org]
Sent: Tuesday, November 20, 2012 11:34 AM
To: user@hadoop.apache.org
Subject: Re: block size
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>>:
After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org<ma...@123.org>
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: block size
Posted by "Kartashov, Andy" <An...@mpac.ca>.
Cheers!
From: Kai Voigt [mailto:k@123.org]
Sent: Tuesday, November 20, 2012 11:34 AM
To: user@hadoop.apache.org
Subject: Re: block size
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>>:
After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org<ma...@123.org>
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: block size
Posted by "Kartashov, Andy" <An...@mpac.ca>.
Cheers!
From: Kai Voigt [mailto:k@123.org]
Sent: Tuesday, November 20, 2012 11:34 AM
To: user@hadoop.apache.org
Subject: Re: block size
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>>:
After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org<ma...@123.org>
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
RE: block size
Posted by "Kartashov, Andy" <An...@mpac.ca>.
Cheers!
From: Kai Voigt [mailto:k@123.org]
Sent: Tuesday, November 20, 2012 11:34 AM
To: user@hadoop.apache.org
Subject: Re: block size
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>>:
After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org<ma...@123.org>
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel
Re: block size
Posted by Kai Voigt <k...@123.org>.
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>:
> After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org
Re: block size
Posted by Kai Voigt <k...@123.org>.
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>:
> After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org
Re: block size
Posted by Kai Voigt <k...@123.org>.
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>:
> After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org
Re: block size
Posted by Kai Voigt <k...@123.org>.
Hi,
Am 20.11.2012 um 17:31 schrieb "Kartashov, Andy" <An...@mpac.ca>:
> After changing property of block size from 64 to 128Mb, will I need to re-import data or will running hadoop balancer will resize blocks in hdfs?
the blocksize affects new files only, existing files will not be modified. As you said, you need to re-import those old files if you want to store them with the new blocksize.
Kai
--
Kai Voigt
k@123.org