You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Joey Surls (JIRA)" <ji...@apache.org> on 2009/11/05 22:23:32 UTC

[jira] Created: (LUCENE-2036) Underlying Spatial Logic does not work in Remote Settings

Underlying Spatial Logic does not work in Remote Settings
---------------------------------------------------------

                 Key: LUCENE-2036
                 URL: https://issues.apache.org/jira/browse/LUCENE-2036
             Project: Lucene - Java
          Issue Type: Bug
          Components: contrib/spatial
    Affects Versions: 2.9
            Reporter: Joey Surls


I am using Lucene in a distributed setup.

I have a remote Searcher on another machine executing the methods in Searcher. For regular text searches I have no problem. For the Spatial contrib (according to examples provided) there is underlying logic that is lost when the Filter and Sort get serialized. I've attached a junit test case that shows when I mimic Java RMI (by serializing the objects and read it back) I get a null pointer exception. I believe it has to do with the Sort (or Filter) referencing objects in the other  class Filter (or Sort)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-2036) Underlying Spatial Logic does not work in Remote Settings

Posted by "Joey Surls (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joey Surls updated LUCENE-2036:
-------------------------------

    Attachment: LuceneSpatialTest.java

JUnit test illustrating the problem

> Underlying Spatial Logic does not work in Remote Settings
> ---------------------------------------------------------
>
>                 Key: LUCENE-2036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2036
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/spatial
>    Affects Versions: 2.9
>            Reporter: Joey Surls
>         Attachments: LuceneSpatialTest.java
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am using Lucene in a distributed setup.
> I have a remote Searcher on another machine executing the methods in Searcher. For regular text searches I have no problem. For the Spatial contrib (according to examples provided) there is underlying logic that is lost when the Filter and Sort get serialized. I've attached a junit test case that shows when I mimic Java RMI (by serializing the objects and read it back) I get a null pointer exception. I believe it has to do with the Sort (or Filter) referencing objects in the other  class Filter (or Sort)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-2036) Underlying Spatial Logic does not work in Remote Settings

Posted by "Simon Willnauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774326#action_12774326 ] 

Simon Willnauer commented on LUCENE-2036:
-----------------------------------------

bq. Is there any idea as to when the spatial code is going to be rewritten?
To be honest I have no idea. But patches are very very welcome as always! You can just go ahead and try fixing things, open an issue and we will take care of it together. 
My other impression is that remote / RMI might go away before spatial gets the love it needs too so you might better go another direction and change the way you search your distributed indexes though.



> Underlying Spatial Logic does not work in Remote Settings
> ---------------------------------------------------------
>
>                 Key: LUCENE-2036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2036
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/spatial
>    Affects Versions: 2.9
>            Reporter: Joey Surls
>         Attachments: LuceneSpatialTest.java
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am using Lucene in a distributed setup.
> I have a remote Searcher on another machine executing the methods in Searcher. For regular text searches I have no problem. For the Spatial contrib (according to examples provided) there is underlying logic that is lost when the Filter and Sort get serialized. I've attached a junit test case that shows when I mimic Java RMI (by serializing the objects and read it back) I get a null pointer exception. I believe it has to do with the Sort (or Filter) referencing objects in the other  class Filter (or Sort)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-2036) Underlying Spatial Logic does not work in Remote Settings

Posted by "Simon Willnauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774142#action_12774142 ] 

Simon Willnauer commented on LUCENE-2036:
-----------------------------------------

This is a tricky one. The DistanceFilter and its derivatives fill a distance map for each document in the index. the FieldComparator you use for sorting depends on the filter you pass to the search method. in the local environment they are the same instances but in the remote scenario those instances are not the same. In turn, the distance map is not filled so you get a null value which is then auto boxed into a double value on sorting. This scenario is just not gonna work with remote searchable. 

I guess we won't fix this until spatial is cleaned up / rewritten. 
Anyway, what are you using remote searchable for, what is your usecase? Did you think about solving you problem with some other technology?



> Underlying Spatial Logic does not work in Remote Settings
> ---------------------------------------------------------
>
>                 Key: LUCENE-2036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2036
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/spatial
>    Affects Versions: 2.9
>            Reporter: Joey Surls
>         Attachments: LuceneSpatialTest.java
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am using Lucene in a distributed setup.
> I have a remote Searcher on another machine executing the methods in Searcher. For regular text searches I have no problem. For the Spatial contrib (according to examples provided) there is underlying logic that is lost when the Filter and Sort get serialized. I've attached a junit test case that shows when I mimic Java RMI (by serializing the objects and read it back) I get a null pointer exception. I believe it has to do with the Sort (or Filter) referencing objects in the other  class Filter (or Sort)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Resolved: (LUCENE-2036) Underlying Spatial Logic does not work in Remote Settings

Posted by "Simon Willnauer (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Simon Willnauer resolved LUCENE-2036.
-------------------------------------

    Resolution: Won't Fix

> Underlying Spatial Logic does not work in Remote Settings
> ---------------------------------------------------------
>
>                 Key: LUCENE-2036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2036
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/spatial
>    Affects Versions: 2.9
>            Reporter: Joey Surls
>         Attachments: LuceneSpatialTest.java
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am using Lucene in a distributed setup.
> I have a remote Searcher on another machine executing the methods in Searcher. For regular text searches I have no problem. For the Spatial contrib (according to examples provided) there is underlying logic that is lost when the Filter and Sort get serialized. I've attached a junit test case that shows when I mimic Java RMI (by serializing the objects and read it back) I get a null pointer exception. I believe it has to do with the Sort (or Filter) referencing objects in the other  class Filter (or Sort)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-2036) Underlying Spatial Logic does not work in Remote Settings

Posted by "Joey Surls (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774187#action_12774187 ] 

Joey Surls commented on LUCENE-2036:
------------------------------------

This is unfortunate.

The use case is the following: I am working with a large index that doesn't fit on a single machine. I can split it into multiple indexes on various machines. I can then use ParallelMultiSearcher to query across the indexes and aggregate the results. Making this a remote ParallelMultiSearcher is pretty trivial b/c of the well designed Lucene APIs.

I do not want to have to go back and change code to be aware of the remote protocol. Instead I should be able to implement a Searcher that has some smarts built in it to know how to find the right remote Searcher to query. Then b/c of inversion of control I could then swap out the remote searcher with the local one in my spring app context xml.


Is there any idea as to when the spatial code is going to be rewritten?

> Underlying Spatial Logic does not work in Remote Settings
> ---------------------------------------------------------
>
>                 Key: LUCENE-2036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2036
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/spatial
>    Affects Versions: 2.9
>            Reporter: Joey Surls
>         Attachments: LuceneSpatialTest.java
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am using Lucene in a distributed setup.
> I have a remote Searcher on another machine executing the methods in Searcher. For regular text searches I have no problem. For the Spatial contrib (according to examples provided) there is underlying logic that is lost when the Filter and Sort get serialized. I've attached a junit test case that shows when I mimic Java RMI (by serializing the objects and read it back) I get a null pointer exception. I believe it has to do with the Sort (or Filter) referencing objects in the other  class Filter (or Sort)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org