You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lenya.apache.org by Renaud Richardet <re...@wyona.com> on 2005/11/07 07:30:10 UTC
[1.4] state of search
Hello Dev's
What is the state of the search functionality (Lucene) in 1.4?
Has Robert's code [1] been integrated in Lenya?
Thanks for a hint,
Renaud
[1] http://wiki.apache.org/general/RobertGoene/SummerOfCode2005Proposal
--
Renaud Richardet
COO America
Wyona Inc. - Open Source Content Management - Apache Lenya
office +1 857 776-3195 mobile +1 617 230 9112
renaud.richardet@wyona.com http://www.wyona.com
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Michael Wechner <mi...@wyona.com>.
Robert Goene wrote:
> Michael Wechner wrote:
>
>> Renaud Richardet wrote:
>>
>>> Hello Dev's
>>>
>>> What is the state of the search functionality (Lucene) in 1.4?
>>> Has Robert's code [1] been integrated in Lenya?
>>>
>>>
>>
>> no, but I am working on it and hope that I can finish it today.
>> Last week I had some trouble getting the search screen, although
>> indexing
>> seemed to work. But before I can integrate it I need to finish the
>> review.
>>
>> Michi
>>
>>> Thanks for a hint,
>>> Renaud
>>>
>>> [1] http://wiki.apache.org/general/RobertGoene/SummerOfCode2005Proposal
>>>
>
> If you need help integrating (after the review) i could of course help
> you out.
>
> I am planning some improvements that i like to discuss on the list
> after this integration. It would be nice if i got some responses on my
> work and further plans!
re future plans I think we should put the indexing into the repo layer
resp. JCR, because it basically means
that every time content is being changed it will be indexed.
Michi
>
> Regards, Robert
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
> For additional commands, e-mail: dev-help@lenya.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Doug Chestnut <dh...@virginia.edu>.
Robert Goene wrote:
> [...]
>>> Hi Robert, I had a look at your search code a month or two back. I
>>> like the incremental update of the index (as docs are edited,
>>> published, deactivated, ...), good stuff.
>>>
>>> I was wondering if you had any ideas of how to index and serve
>>> "restricted documents". In 1.4, one can restrict access to a live
>>> version of a page by using the "AC Live" tab. How could we restrict
>>> access to the search result snippets (or exclude the result) for the
>>> results that the current user doesn't have access to view.
>
>
> Hmm. Not sure. I will look into it...
>
Since we are reindexing documents as edits are made, workflow events are
triggered, we could also reindex a doc (or group of docs) when
permissions are changed. We could add search fields to the index for a
doc that holds the users, groups, and ipranges that have visit role on
the doc.
We could then use a filter in our search usecase to only get results
that the current user has access to.
--Doug
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Robert Goene <ro...@goene.nl>.
Doug Chestnut wrote:
>
>
> Robert Goene wrote:
>
>> [...]
>> I am not sure if i should combine the results with ajax or in cocoon.
>> It would be fairly easy to have an aggregate of the search engine
>> results and then combine it in xslt.
>
> Response delays wouldn't be as annoying with ajax
>
>> The only thing i am wondering is how this can be configured easily,
>> for instance in the publication.xconf file.
>
>
> Well, I guess a list of opensearch engines could be listed in the
> publication.xconf file. For my needs (University Library), it would be
> handy to have the list of opensearch engines managed by a search
> resource type document.
>
> One of my subject librarians can create a "New Search Document" in their
> site, Then "edit -> Included Databases/Journals" to include the search
> engines suited to the subject (science, art, religion, etc).
>
> A listing of available opensearch engines might possibly live in the
> Search Module configuration.
>
> Just thinking out loud :), I need to take a look at this soon.
>
Yeah, me too. It would be great to manage the search engines per
publication. I don't see the surplus of an even more specific search
engine configuration. I was thinking of an extra tab in the admin
section or something like that.
BTW: are there many academic resources that support opensearch yet?
Regards, Robert
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Doug Chestnut <dh...@virginia.edu>.
Robert Goene wrote:
> [...]
> I am not sure if i should combine the results with ajax or in cocoon. It
> would be fairly easy to have an aggregate of the search engine results
> and then combine it in xslt.
Response delays wouldn't be as annoying with ajax
> The only thing i am wondering is how this
> can be configured easily, for instance in the publication.xconf file.
Well, I guess a list of opensearch engines could be listed in the
publication.xconf file. For my needs (University Library), it would be
handy to have the list of opensearch engines managed by a search
resource type document.
One of my subject librarians can create a "New Search Document" in their
site, Then "edit -> Included Databases/Journals" to include the search
engines suited to the subject (science, art, religion, etc).
A listing of available opensearch engines might possibly live in the
Search Module configuration.
Just thinking out loud :), I need to take a look at this soon.
--Doug
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Robert Goene <ro...@goene.nl>.
>>> I am planning some improvements that i like to discuss on the list
>>> after this integration. It would be nice if i got some responses on
>>> my work and further plans!
>>
>> Hi Robert, I had a look at your search code a month or two back. I
>> like the incremental update of the index (as docs are edited,
>> published, deactivated, ...), good stuff.
>>
>> I was wondering if you had any ideas of how to index and serve
>> "restricted documents". In 1.4, one can restrict access to a live
>> version of a page by using the "AC Live" tab. How could we restrict
>> access to the search result snippets (or exclude the result) for the
>> results that the current user doesn't have access to view.
Hmm. Not sure. I will look into it...
>>
>> I like the nutch addition, and would like to see the results combined
>> in some way (instead of either lucene or nutch search). I could see
>> this turn into some sort of "multi-search" where all one has to do is
>> add some sort of transformer to opensearch rss to add another search
>> engine (google, amazon, etc...) to the results.
>
> Well, bad example, these of course already have opensearch rss access :).
>
>> Would be cool to use ajax to build the results page as various search
>> engines are returning results.
I am glad you liked it!
I am not sure if i should combine the results with ajax or in cocoon. It
would be fairly easy to have an aggregate of the search engine results
and then combine it in xslt. The only thing i am wondering is how this
can be configured easily, for instance in the publication.xconf file.
I am planning to look into the scheduling of nutch crawls from lenya as
well. Do you have any ideas concerning this topic?
Robert
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Doug Chestnut <dh...@virginia.edu>.
Doug Chestnut wrote:
>
>
> Robert Goene wrote:
>
>> [...]
>>
>> I am planning some improvements that i like to discuss on the list
>> after this integration. It would be nice if i got some responses on my
>> work and further plans!
>
>
> Hi Robert, I had a look at your search code a month or two back. I like
> the incremental update of the index (as docs are edited, published,
> deactivated, ...), good stuff.
>
> I was wondering if you had any ideas of how to index and serve
> "restricted documents". In 1.4, one can restrict access to a live
> version of a page by using the "AC Live" tab. How could we restrict
> access to the search result snippets (or exclude the result) for the
> results that the current user doesn't have access to view.
>
> I like the nutch addition, and would like to see the results combined in
> some way (instead of either lucene or nutch search). I could see this
> turn into some sort of "multi-search" where all one has to do is add
> some sort of transformer to opensearch rss to add another search engine
> (google, amazon, etc...) to the results.
Well, bad example, these of course already have opensearch rss access :).
> Would be cool to use ajax to
> build the results page as various search engines are returning results.
>
> Thanks,
> --Doug
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
> For additional commands, e-mail: dev-help@lenya.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Doug Chestnut <dh...@virginia.edu>.
Robert Goene wrote:
> [...]
>
> I am planning some improvements that i like to discuss on the list after
> this integration. It would be nice if i got some responses on my work
> and further plans!
Hi Robert, I had a look at your search code a month or two back. I like
the incremental update of the index (as docs are edited, published,
deactivated, ...), good stuff.
I was wondering if you had any ideas of how to index and serve
"restricted documents". In 1.4, one can restrict access to a live
version of a page by using the "AC Live" tab. How could we restrict
access to the search result snippets (or exclude the result) for the
results that the current user doesn't have access to view.
I like the nutch addition, and would like to see the results combined in
some way (instead of either lucene or nutch search). I could see this
turn into some sort of "multi-search" where all one has to do is add
some sort of transformer to opensearch rss to add another search engine
(google, amazon, etc...) to the results. Would be cool to use ajax to
build the results page as various search engines are returning results.
Thanks,
--Doug
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Robert Goene <ro...@goene.nl>.
Michael Wechner wrote:
> Renaud Richardet wrote:
>
>> Hello Dev's
>>
>> What is the state of the search functionality (Lucene) in 1.4?
>> Has Robert's code [1] been integrated in Lenya?
>>
>>
>
> no, but I am working on it and hope that I can finish it today.
> Last week I had some trouble getting the search screen, although indexing
> seemed to work. But before I can integrate it I need to finish the review.
>
> Michi
>
>> Thanks for a hint,
>> Renaud
>>
>> [1] http://wiki.apache.org/general/RobertGoene/SummerOfCode2005Proposal
>>
If you need help integrating (after the review) i could of course help
you out.
I am planning some improvements that i like to discuss on the list after
this integration. It would be nice if i got some responses on my work
and further plans!
Regards, Robert
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org
Re: [1.4] state of search
Posted by Michael Wechner <mi...@wyona.com>.
Renaud Richardet wrote:
>Hello Dev's
>
>What is the state of the search functionality (Lucene) in 1.4?
>Has Robert's code [1] been integrated in Lenya?
>
>
no, but I am working on it and hope that I can finish it today.
Last week I had some trouble getting the search screen, although indexing
seemed to work. But before I can integrate it I need to finish the review.
Michi
>Thanks for a hint,
>Renaud
>
>[1] http://wiki.apache.org/general/RobertGoene/SummerOfCode2005Proposal
>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lenya.apache.org
For additional commands, e-mail: dev-help@lenya.apache.org