Re: Timerange scan

[Andrew Purtell <ap...@apache.org>]

> Proving it to yourself is sometimes the hardest part!
​Yes!​


On Mon, Mar 2, 2015 at 2:17 PM, Gary Helmling <gh...@gmail.com> wrote:

> Proving it to yourself is sometimes the hardest part!
>
> On Mon, Mar 2, 2015 at 2:11 PM Nick Dimiduk <nd...@gmail.com> wrote:
>
> > Gary to the rescue! Does it still count as being right even if you cannot
> > prove it for yourself? ;)
> >
> > On Mon, Mar 2, 2015 at 2:06 PM, Gary Helmling <gh...@gmail.com>
> wrote:
> >
> > > >
> > > > Sorry Kristoffer, but I believe my previous statement was mistaken. I
> > > > cannot find a location where the timestamp is taken into account at
> the
> > > > StoreFile level. I thought the above statement about metadata from
> the
> > > > HFile headers was correct, but I cannot locate the code that takes
> such
> > > > information into consideration.
> > > >
> > >
> > > I believe the filtering happens in StoreScanner.selectScannersFrom(),
> > which
> > > calls StoreFileScanner.shouldUseScanner() for each store file.  See
> also
> > > StoreFile.passesTimerangeFilter(), which does the check that the Scan's
> > > time range is included in the time range from the store file metadata.
> > >
> > > So store files which fall completely outside of the Scan's min/max
> > > timestamps should be excluded.
> > >
> >
>



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)