You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jack Levin <ma...@gmail.com> on 2010/09/26 23:34:30 UTC
hdfs => larger blocks.
How do I make Hbase to write larger hdfs blocks? I have my
hdfs-site.xml adjusted, and everything restarted, but my region files
still get 64MB allocation.
-Jack
Re: hdfs => larger blocks.
Posted by Andrew Purtell <ap...@apache.org>.
Yes. The DFS client sets the parameter when the file is created. (In this case HBase.) So the setting needs to be changed in hbase-site.xml or you should symlink your hdfs-site.xml into hbase/conf/.
Best regards,
--- On Sun, 9/26/10, Jack Levin <ma...@gmail.com> wrote:
> From: Jack Levin <ma...@gmail.com>
> Subject: Re: hdfs => larger blocks.
> To: user@hbase.apache.org
> Date: Sunday, September 26, 2010, 2:53 PM
> I did that in hdfs-site.xml, do I
> need to do it under hbase-site.xml too?
>
> On Sun, Sep 26, 2010 at 2:42 PM, Ted Yu <yu...@gmail.com>
> wrote:
> > You need to set dfs.block.size which is hadoop
> parameter.
> >
> > On Sun, Sep 26, 2010 at 2:34 PM, Jack Levin <ma...@gmail.com>
> wrote:
> >
> >> How do I make Hbase to write larger hdfs blocks?
> I have my
> >> hdfs-site.xml adjusted, and everything restarted,
> but my region files
> >> still get 64MB allocation.
> >>
> >> -Jack
> >>
> >
>
Re: hdfs => larger blocks.
Posted by Jack Levin <ma...@gmail.com>.
I did that in hdfs-site.xml, do I need to do it under hbase-site.xml too?
On Sun, Sep 26, 2010 at 2:42 PM, Ted Yu <yu...@gmail.com> wrote:
> You need to set dfs.block.size which is hadoop parameter.
>
> On Sun, Sep 26, 2010 at 2:34 PM, Jack Levin <ma...@gmail.com> wrote:
>
>> How do I make Hbase to write larger hdfs blocks? I have my
>> hdfs-site.xml adjusted, and everything restarted, but my region files
>> still get 64MB allocation.
>>
>> -Jack
>>
>
Re: hdfs => larger blocks.
Posted by Ted Yu <yu...@gmail.com>.
You need to set dfs.block.size which is hadoop parameter.
On Sun, Sep 26, 2010 at 2:34 PM, Jack Levin <ma...@gmail.com> wrote:
> How do I make Hbase to write larger hdfs blocks? I have my
> hdfs-site.xml adjusted, and everything restarted, but my region files
> still get 64MB allocation.
>
> -Jack
>