You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Nicholas Knize (JIRA)" <ji...@apache.org> on 2015/01/20 19:48:35 UTC

[jira] [Comment Edited] (LUCENE-6191) Spatial 2D faceting (heatmaps)

    [ https://issues.apache.org/jira/browse/LUCENE-6191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284191#comment-14284191 ] 

Nicholas Knize edited comment on LUCENE-6191 at 1/20/15 6:47 PM:
-----------------------------------------------------------------

That seems like an acceptable compromise. I'm a big fan of test coverage. In this case that we have test coverage for validating whether the grid cells returned are the expected cells contained within the shape (testing with rectangles here is easy for a quick proof of concept). Unexpected failures in the grid logic would result in incorrect facet counts, no?  Might also be a worthwhile endeavor for assessing/documenting the accuracy of the spatial faceting results at the various grid levels (though if I understand your approach your level estimation will _sort of_ help mitigate the resolution issue?)  


was (Author: nknize):
That seems like an acceptable compromise. I'm a big fan of test coverage. In this case that we have test coverage for validating whether the grid cells returned are the expected cells contained within the shape (testing with rectangles here is easy for a quick proof of concept). Unexpected failures in the grid logic would result in incorrect facet counts, no?  Might also be a worthwhile endeavor for assessing/documenting the accuracy of the spatial faceting results at the various grid levels (though if I understand your approach you're level estimation will _sort of_ help mitigate the resolution issue?)  

> Spatial 2D faceting (heatmaps)
> ------------------------------
>
>                 Key: LUCENE-6191
>                 URL: https://issues.apache.org/jira/browse/LUCENE-6191
>             Project: Lucene - Core
>          Issue Type: New Feature
>          Components: modules/spatial
>            Reporter: David Smiley
>            Assignee: David Smiley
>             Fix For: 5.1
>
>         Attachments: LUCENE-6191__Spatial_heatmap.patch
>
>
> Lucene spatial's PrefixTree (grid) based strategies index data in a way highly amenable to faceting on grids cells to compute a so-called _heatmap_. The underlying code in this patch uses the PrefixTreeFacetCounter utility class which was recently refactored out of faceting for NumberRangePrefixTree LUCENE-5735.  At a low level, the terms (== grid cells) are navigated per-segment, forward only with TermsEnum.seek, so it's pretty quick and furthermore requires no extra caches & no docvalues.  Ideally you should use QuadPrefixTree (or Flex once it comes out) to maximize the number grid levels which in turn maximizes the fidelity of choices when you ask for a grid covering a region.  Conveniently, the provided capability returns the data in a 2-D grid of counts, so the caller needn't know a thing about how the data is encoded in the prefix tree.  Well almost... at this point they need to provide a grid level, but I'll soon provide a means of deriving the grid level based on a min/max cell count.
> I recommend QuadPrefixTree with geo=false so that you can provide a square world-bounds (360x360 degrees), which means square grid cells which are more desirable to display than rectangular cells.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org