You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hbase.apache.org by yanivG <ya...@gmail.com> on 2014/02/12 17:21:10 UTC

memStore flush

Hi,
I have read that hbase keep a MemStore per each CF. When one of them reaches
the flush threshold, it flushes all MemStore. Is that true in version
0.94.6?

Also, is this new hStoreFile is immutable or is append enabled?

Thanks,
Yaniv



--
View this message in context: http://apache-hbase.679495.n3.nabble.com/memStore-flush-tp4055911.html
Sent from the HBase User mailing list archive at Nabble.com.

Re: memStore flush

Posted by ramkrishna vasudevan <ra...@gmail.com>.

>>is this new hStoreFile is immutable or is append enabled?
HStoreFile is immutable.

Regards
Ram


On Thu, Feb 13, 2014 at 12:15 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Hi Yaniv,
>
> Yes, it's true in version 0.94.6.
>
> Can you please confirm that you use 0.94.6.1 and not 0.94.6? The former is
> a fix of the later which had a defect.
>
> JM
>
>
> 2014-02-12 11:21 GMT-05:00 yanivG <ya...@gmail.com>:
>
> > Hi,
> > I have read that hbase keep a MemStore per each CF. When one of them
> > reaches
> > the flush threshold, it flushes all MemStore. Is that true in version
> > 0.94.6?
> >
> > Also, is this new hStoreFile is immutable or is append enabled?
> >
> > Thanks,
> > Yaniv
> >
> >
> >
> > --
> > View this message in context:
> > http://apache-hbase.679495.n3.nabble.com/memStore-flush-tp4055911.html
> > Sent from the HBase User mailing list archive at Nabble.com.
> >
>

Re: memStore flush

Posted by Ted Yu <yu...@gmail.com>.

bq. What defect?

You can find the defect in this announcement:

http://search-hadoop.com/m/uFya22NivK42/0.94.6.1+download&subj=+ANNOUNCE+HBase+0+94+6+1+is+available+for+download

Cheers


On Thu, Feb 13, 2014 at 8:12 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Hi Yaniv,
>
> CDH4.5.0 comes with HBase 0.94.6.1 so you are correct.
>
> JM
>
>
> 2014-02-13 3:33 GMT-05:00 yanivG <ya...@gmail.com>:
>
> > Hi,
> > I am using Version 0.94.6-cdh4.5.0. The version which comes from
> Cloudera.
> > What defect? In which area? Memstore flush?
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-hbase.679495.n3.nabble.com/memStore-flush-tp4055911p4055958.html
> > Sent from the HBase User mailing list archive at Nabble.com.
> >
>

Re: memStore flush

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.

Hi Yaniv,

CDH4.5.0 comes with HBase 0.94.6.1 so you are correct.

JM


2014-02-13 3:33 GMT-05:00 yanivG <ya...@gmail.com>:

> Hi,
> I am using Version 0.94.6-cdh4.5.0. The version which comes from Cloudera.
> What defect? In which area? Memstore flush?
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/memStore-flush-tp4055911p4055958.html
> Sent from the HBase User mailing list archive at Nabble.com.
>

Re: memStore flush

Posted by yanivG <ya...@gmail.com>.

Hi,
I am using Version 0.94.6-cdh4.5.0. The version which comes from Cloudera.
What defect? In which area? Memstore flush?



--
View this message in context: http://apache-hbase.679495.n3.nabble.com/memStore-flush-tp4055911p4055958.html
Sent from the HBase User mailing list archive at Nabble.com.

Re: memStore flush

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.

Hi Yaniv,

Yes, it's true in version 0.94.6.

Can you please confirm that you use 0.94.6.1 and not 0.94.6? The former is
a fix of the later which had a defect.

JM


2014-02-12 11:21 GMT-05:00 yanivG <ya...@gmail.com>:

> Hi,
> I have read that hbase keep a MemStore per each CF. When one of them
> reaches
> the flush threshold, it flushes all MemStore. Is that true in version
> 0.94.6?
>
> Also, is this new hStoreFile is immutable or is append enabled?
>
> Thanks,
> Yaniv
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/memStore-flush-tp4055911.html
> Sent from the HBase User mailing list archive at Nabble.com.
>

Re: memStore flush

Posted by Ted Yu <yu...@gmail.com>.

Currently the flush decision is made using the aggregate size of all column
families. When large and small column families co-exist, this causes many
small flushes of the smaller CF.

Cheers

On Wed, Feb 12, 2014 at 8:21 AM, yanivG <ya...@gmail.com> wrote:

> Hi,
> I have read that hbase keep a MemStore per each CF. When one of them
> reaches
> the flush threshold, it flushes all MemStore. Is that true in version
> 0.94.6?
>
> Also, is this new hStoreFile is immutable or is append enabled?
>
> Thanks,
> Yaniv
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/memStore-flush-tp4055911.html
> Sent from the HBase User mailing list archive at Nabble.com.
>