You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Krish Donald <go...@gmail.com> on 2015/02/22 20:11:30 UTC
Default Block Size in HDFS
Hi,
I have read somewhere that default block size in Hadoop 2.4 is 256MB .
Is it correct ?
In which version default block size was 128MB ?
Thanks
Krish
Re: Default Block Size in HDFS
Posted by Ulul <ha...@ulul.org>.
Sorry forgot that "as of" meant "starting with" :-)
Actually 128 MB started around 2.2.0
2.0.5-alpha was still 64MB
In any case it's just a default, it is often raised on production
Le 22/02/2015 20:51, Ted Yu a écrit :
> As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
> https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
>
> Cheers
>
> On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <gotomypc27@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>
>
Re: Default Block Size in HDFS
Posted by Ulul <ha...@ulul.org>.
Sorry forgot that "as of" meant "starting with" :-)
Actually 128 MB started around 2.2.0
2.0.5-alpha was still 64MB
In any case it's just a default, it is often raised on production
Le 22/02/2015 20:51, Ted Yu a écrit :
> As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
> https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
>
> Cheers
>
> On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <gotomypc27@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>
>
Re: Default Block Size in HDFS
Posted by Ulul <ha...@ulul.org>.
Sorry forgot that "as of" meant "starting with" :-)
Actually 128 MB started around 2.2.0
2.0.5-alpha was still 64MB
In any case it's just a default, it is often raised on production
Le 22/02/2015 20:51, Ted Yu a écrit :
> As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
> https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
>
> Cheers
>
> On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <gotomypc27@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>
>
Re: Default Block Size in HDFS
Posted by Ulul <ha...@ulul.org>.
Sorry forgot that "as of" meant "starting with" :-)
Actually 128 MB started around 2.2.0
2.0.5-alpha was still 64MB
In any case it's just a default, it is often raised on production
Le 22/02/2015 20:51, Ted Yu a écrit :
> As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
> https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
>
> Cheers
>
> On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <gotomypc27@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>
>
Re: Default Block Size in HDFS
Posted by Ted Yu <yu...@gmail.com>.
As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
Cheers
On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <go...@gmail.com> wrote:
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>
Re: Default Block Size in HDFS
Posted by Ted Yu <yu...@gmail.com>.
As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
Cheers
On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <go...@gmail.com> wrote:
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>
Re: Default Block Size in HDFS
Posted by Ted Yu <yu...@gmail.com>.
As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
Cheers
On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <go...@gmail.com> wrote:
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>
Re: Default Block Size in HDFS
Posted by Ted Yu <yu...@gmail.com>.
As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
Cheers
On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald <go...@gmail.com> wrote:
> Hi,
>
> I have read somewhere that default block size in Hadoop 2.4 is 256MB .
> Is it correct ?
> In which version default block size was 128MB ?
>
> Thanks
> Krish
>