You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by prasen <pr...@bea.com> on 2004/03/05 04:58:44 UTC

using lucene to search in a 1 huge file. (aka "grep -n")

Hi guys,
   I am relatively new to Lucene. Can lucene be used to speed-up search 
for a string in one huge file( ~  TerraBytes ) based on its libe 
numbers.  Something like "grep -n <pattern> <filename>" where the 
indexing will be done only on one file and based on either 
line-numbers/blocks.

prasen




---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: using lucene to search in a 1 huge file. (aka "grep -n")

Posted by Erik Hatcher <er...@ehatchersolutions.com>.
On Mar 6, 2004, at 1:17 AM, prasen wrote:
> Any tutorial/samples on how to use indices, and use them in your 
> search  ?

Sure, tons.  See the articles/resources section of the Lucene website.

Otis has written several.  I've written a few articles at java.net on 
Lucene.  And there are a handful of others as well.

	Erik


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: using lucene to search in a 1 huge file. (aka "grep -n")

Posted by prasen <pr...@bea.com>.
Any tutorial/samples on how to use indices, and use them in your search  ?

thanks-n-appreciate a lot,
prasen

Otis Gospodnetic wrote:

>In order for this to make sense, you would have to split your huge file
>into either lines or blocks, whichever you want to be your indexing and
>search/hit unit, and convert those to Lucene Documents, which you would
>then index.
>Searching would then return the line/block where matches are found.
>
>Otis
>
>
>--- prasen <pr...@bea.com> wrote:
>  
>
>>Hi guys,
>>   I am relatively new to Lucene. Can lucene be used to speed-up
>>search 
>>for a string in one huge file( ~  TerraBytes ) based on its libe 
>>numbers.  Something like "grep -n <pattern> <filename>" where the 
>>indexing will be done only on one file and based on either 
>>line-numbers/blocks.
>>
>>prasen
>>
>>
>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>
>>    
>>
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
>  
>

Re: using lucene to search in a 1 huge file. (aka "grep -n")

Posted by Otis Gospodnetic <ot...@yahoo.com>.
In order for this to make sense, you would have to split your huge file
into either lines or blocks, whichever you want to be your indexing and
search/hit unit, and convert those to Lucene Documents, which you would
then index.
Searching would then return the line/block where matches are found.

Otis


--- prasen <pr...@bea.com> wrote:
> Hi guys,
>    I am relatively new to Lucene. Can lucene be used to speed-up
> search 
> for a string in one huge file( ~  TerraBytes ) based on its libe 
> numbers.  Something like "grep -n <pattern> <filename>" where the 
> indexing will be done only on one file and based on either 
> line-numbers/blocks.
> 
> prasen
> 
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org