You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Adrien Mogenet <ad...@gmail.com> on 2013/08/15 23:29:31 UTC

Get the latest timestamp of a Storefile

Hi there,

I'm currently trying to get the latest timestamp among StoreFile's
KeyValues; there is a method to get the earliest one, but not an explicit
method to get the latest.

I've found a `TIMERANGE_KEY`, is it the right key to use to retrieve such
information within the metadata map?

Thanks,

-- 
Adrien Mogenet
http://www.borntosegfault.com

Re: Get the latest timestamp of a Storefile

Posted by Ted Yu <yu...@gmail.com>.
Interesting.

Have you see HBASE-5199: Delete out of TTL store files before compaction
selection ?


On Sun, Aug 18, 2013 at 5:42 AM, Adrien Mogenet <ad...@gmail.com>wrote:

> Alright, then I've opened a ticket to put what I have in mind (
> https://issues.apache.org/jira/browse/HBASE-9260)
>
> I did some basic code changes and tests to see/check if it's really
> relevant...
>
>
> On Fri, Aug 16, 2013 at 11:48 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > That is Okay.
> > Feel free to share with us your new feature.
> >
> > Just a reminder that the maximum time stamp may not correspond to Put.
> >
> > On Aug 15, 2013, at 11:45 PM, Adrien Mogenet <ad...@gmail.com>
> > wrote:
> >
> > > Thanks Ted,
> > >
> > > Sorry for my beginner's question, I've just started diving into the
> > > internals to add some features, and I was probably tired... (basic
> excuse
> > > ;-))
> > >
> > >
> > > On Fri, Aug 16, 2013 at 12:12 AM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > >> From TimeRangeTracker.java javadoc:
> > >>
> > >> * Stores the minimum and maximum timestamp values (both are
> inclusive).
> > >>
> > >> * Can be used to find if any given time range overlaps with its time
> > range
> > >>
> > >>
> > >> FYI
> > >>
> > >>
> > >> On Thu, Aug 15, 2013 at 2:29 PM, Adrien Mogenet <
> > adrien.mogenet@gmail.com
> > >>> wrote:
> > >>
> > >>> Hi there,
> > >>>
> > >>> I'm currently trying to get the latest timestamp among StoreFile's
> > >>> KeyValues; there is a method to get the earliest one, but not an
> > explicit
> > >>> method to get the latest.
> > >>>
> > >>> I've found a `TIMERANGE_KEY`, is it the right key to use to retrieve
> > such
> > >>> information within the metadata map?
> > >>>
> > >>> Thanks,
> > >>>
> > >>> --
> > >>> Adrien Mogenet
> > >>> http://www.borntosegfault.com
> > >
> > >
> > >
> > > --
> > > Adrien Mogenet
> > > http://www.borntosegfault.com
> >
>
>
>
> --
> Adrien Mogenet
> http://www.borntosegfault.com
>

Re: Get the latest timestamp of a Storefile

Posted by Adrien Mogenet <ad...@gmail.com>.
Alright, then I've opened a ticket to put what I have in mind (
https://issues.apache.org/jira/browse/HBASE-9260)

I did some basic code changes and tests to see/check if it's really
relevant...


On Fri, Aug 16, 2013 at 11:48 AM, Ted Yu <yu...@gmail.com> wrote:

> That is Okay.
> Feel free to share with us your new feature.
>
> Just a reminder that the maximum time stamp may not correspond to Put.
>
> On Aug 15, 2013, at 11:45 PM, Adrien Mogenet <ad...@gmail.com>
> wrote:
>
> > Thanks Ted,
> >
> > Sorry for my beginner's question, I've just started diving into the
> > internals to add some features, and I was probably tired... (basic excuse
> > ;-))
> >
> >
> > On Fri, Aug 16, 2013 at 12:12 AM, Ted Yu <yu...@gmail.com> wrote:
> >
> >> From TimeRangeTracker.java javadoc:
> >>
> >> * Stores the minimum and maximum timestamp values (both are inclusive).
> >>
> >> * Can be used to find if any given time range overlaps with its time
> range
> >>
> >>
> >> FYI
> >>
> >>
> >> On Thu, Aug 15, 2013 at 2:29 PM, Adrien Mogenet <
> adrien.mogenet@gmail.com
> >>> wrote:
> >>
> >>> Hi there,
> >>>
> >>> I'm currently trying to get the latest timestamp among StoreFile's
> >>> KeyValues; there is a method to get the earliest one, but not an
> explicit
> >>> method to get the latest.
> >>>
> >>> I've found a `TIMERANGE_KEY`, is it the right key to use to retrieve
> such
> >>> information within the metadata map?
> >>>
> >>> Thanks,
> >>>
> >>> --
> >>> Adrien Mogenet
> >>> http://www.borntosegfault.com
> >
> >
> >
> > --
> > Adrien Mogenet
> > http://www.borntosegfault.com
>



-- 
Adrien Mogenet
http://www.borntosegfault.com

Re: Get the latest timestamp of a Storefile

Posted by Ted Yu <yu...@gmail.com>.
That is Okay. 
Feel free to share with us your new feature. 

Just a reminder that the maximum time stamp may not correspond to Put. 

On Aug 15, 2013, at 11:45 PM, Adrien Mogenet <ad...@gmail.com> wrote:

> Thanks Ted,
> 
> Sorry for my beginner's question, I've just started diving into the
> internals to add some features, and I was probably tired... (basic excuse
> ;-))
> 
> 
> On Fri, Aug 16, 2013 at 12:12 AM, Ted Yu <yu...@gmail.com> wrote:
> 
>> From TimeRangeTracker.java javadoc:
>> 
>> * Stores the minimum and maximum timestamp values (both are inclusive).
>> 
>> * Can be used to find if any given time range overlaps with its time range
>> 
>> 
>> FYI
>> 
>> 
>> On Thu, Aug 15, 2013 at 2:29 PM, Adrien Mogenet <adrien.mogenet@gmail.com
>>> wrote:
>> 
>>> Hi there,
>>> 
>>> I'm currently trying to get the latest timestamp among StoreFile's
>>> KeyValues; there is a method to get the earliest one, but not an explicit
>>> method to get the latest.
>>> 
>>> I've found a `TIMERANGE_KEY`, is it the right key to use to retrieve such
>>> information within the metadata map?
>>> 
>>> Thanks,
>>> 
>>> --
>>> Adrien Mogenet
>>> http://www.borntosegfault.com
> 
> 
> 
> -- 
> Adrien Mogenet
> http://www.borntosegfault.com

Re: Get the latest timestamp of a Storefile

Posted by Adrien Mogenet <ad...@gmail.com>.
Thanks Ted,

Sorry for my beginner's question, I've just started diving into the
internals to add some features, and I was probably tired... (basic excuse
;-))


On Fri, Aug 16, 2013 at 12:12 AM, Ted Yu <yu...@gmail.com> wrote:

> From TimeRangeTracker.java javadoc:
>
>  * Stores the minimum and maximum timestamp values (both are inclusive).
>
>  * Can be used to find if any given time range overlaps with its time range
>
>
> FYI
>
>
> On Thu, Aug 15, 2013 at 2:29 PM, Adrien Mogenet <adrien.mogenet@gmail.com
> >wrote:
>
> > Hi there,
> >
> > I'm currently trying to get the latest timestamp among StoreFile's
> > KeyValues; there is a method to get the earliest one, but not an explicit
> > method to get the latest.
> >
> > I've found a `TIMERANGE_KEY`, is it the right key to use to retrieve such
> > information within the metadata map?
> >
> > Thanks,
> >
> > --
> > Adrien Mogenet
> > http://www.borntosegfault.com
> >
>



-- 
Adrien Mogenet
http://www.borntosegfault.com

Re: Get the latest timestamp of a Storefile

Posted by Ted Yu <yu...@gmail.com>.
>From TimeRangeTracker.java javadoc:

 * Stores the minimum and maximum timestamp values (both are inclusive).

 * Can be used to find if any given time range overlaps with its time range


FYI


On Thu, Aug 15, 2013 at 2:29 PM, Adrien Mogenet <ad...@gmail.com>wrote:

> Hi there,
>
> I'm currently trying to get the latest timestamp among StoreFile's
> KeyValues; there is a method to get the earliest one, but not an explicit
> method to get the latest.
>
> I've found a `TIMERANGE_KEY`, is it the right key to use to retrieve such
> information within the metadata map?
>
> Thanks,
>
> --
> Adrien Mogenet
> http://www.borntosegfault.com
>