You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@lucenenet.apache.org by George Aroush <ge...@aroush.net> on 2007/02/27 04:05:51 UTC
[VOTE] Release of Apache Lucene.Net 2.0.0
Hi folks,
To follow the proper release process of ASF, please take a moment to cast
your vote to release Lucene.Net 2.0.0. I have placed both the release
candidate of source code and binary here: http://people.apache.org/~aroush/
The change history for this release can be found here:
https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
.txt
In addition to Lucene.Net release, this release also contains ported code in
"contrib".
Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
this coming Saturday.
[ ] +1 Approve release
[ ] -1 Veto release (please give reason)
Regards,
-- George Aroush
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by th...@gmail.com.
I vote for approve release.
-----Original Message-----
From: "George Aroush" <ge...@aroush.net>
Date: Mon, 26 Feb 2007 22:05:51
To:<lu...@incubator.apache.org>
Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi folks,
To follow the proper release process of ASF, please take a moment to cast
your vote to release Lucene.Net 2.0.0. I have placed both the release
candidate of source code and binary here: http://people.apache.org/~aroush/
The change history for this release can be found here:
https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
.txt
In addition to Lucene.Net release, this release also contains ported code in
"contrib".
Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
this coming Saturday.
[ ] +1 Approve release
[ ] -1 Veto release (please give reason)
Regards,
-- George Aroush
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Michael Garski <mg...@mac.com>.
[x] +1 Approve release
[ ] -1 Veto release (please give reason)
- Michael Garski
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Jokin Cuadrado <jo...@gmail.com>.
On 2/27/07, George Aroush <ge...@aroush.net> wrote:
> Hi folks,
>
> To follow the proper release process of ASF, please take a moment to cast
> your vote to release Lucene.Net 2.0.0. I have placed both the release
> candidate of source code and binary here: http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains ported code in
> "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
> this coming Saturday.
>
> [ X] +1 Approve release
--
Jokin
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by zoolette <ga...@gmail.com>.
2007/2/27, George Aroush <ge...@aroush.net>:
>
> Hi folks,
>
> To follow the proper release process of ASF, please take a moment to cast
> your vote to release Lucene.Net 2.0.0. I have placed both the release
> candidate of source code and binary here:
> http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
>
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains ported code
> in
> "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
> this coming Saturday.
>
> [ x] +1 Approve release
> [ ] -1 Veto release (please give reason)
>
> Regards,
>
> -- George Aroush
>
>
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Olivier Aboilard <ol...@marmiton.org>.
[x] +1 Approve release
Excellent work, btw !
Olivier
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Derrick Okundaye <De...@thomastelford.com>.
[x]
-----Original Message-----
From: René de Vries [mailto:rene.de.vries@howardshome.com]
Sent: 27 February 2007 08:02
To: lucene-net-user@incubator.apache.org
Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
-----Original Message-----
From: George Aroush [mailto:george@aroush.net]
Sent: dinsdag 27 februari 2007 4:06
To: lucene-net-user@incubator.apache.org; lucene-net-dev@incubator.apache.org
Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi folks,
To follow the proper release process of ASF, please take a moment to cast
your vote to release Lucene.Net 2.0.0. I have placed both the release
candidate of source code and binary here: http://people.apache.org/~aroush/
The change history for this release can be found here:
https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
.txt
In addition to Lucene.Net release, this release also contains ported code in
"contrib".
Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
this coming Saturday.
[x] +1 Approve release
[ ] -1 Veto release (please give reason)
Regards,
-- George Aroush
________________________________________________________________________
This email has been scanned for all viruses by the MessageLabs SkyScan
service on behalf of the Institution of Civil Engineers. For more information on a proactive anti-virus service working
around the clock, around the globe, visit http://www.messagelabs.com
________________________________________________________________________
_______________________________________________________________________
This communication, and the information it contains: (a) is intended for the person(s) or organisation(s) named above and for no other persons or organisations and (b) may be confidential and protected by law. Unauthorised use, copying or disclosure of any of it may be unlawful.
Thomas Telford Ltd
Company Registration No: 2556636
Registered Office: 1-7 Great George Street, London SW1P 3AA.
This email has been scanned for all viruses by the MessageLabs SkyScan
service on behalf of the Institution of Civil Engineers. For more information on a proactive anti-virus service working
around the clock, around the globe, visit http://www.messagelabs.com
________________________________________________________________________
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by René de Vries <re...@howardshome.com>.
-----Original Message-----
From: George Aroush [mailto:george@aroush.net]
Sent: dinsdag 27 februari 2007 4:06
To: lucene-net-user@incubator.apache.org; lucene-net-dev@incubator.apache.org
Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi folks,
To follow the proper release process of ASF, please take a moment to cast
your vote to release Lucene.Net 2.0.0. I have placed both the release
candidate of source code and binary here: http://people.apache.org/~aroush/
The change history for this release can be found here:
https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
.txt
In addition to Lucene.Net release, this release also contains ported code in
"contrib".
Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
this coming Saturday.
[x] +1 Approve release
[ ] -1 Veto release (please give reason)
Regards,
-- George Aroush
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by zoolette <ga...@gmail.com>.
2007/2/27, George Aroush <ge...@aroush.net>:
>
> Hi folks,
>
> To follow the proper release process of ASF, please take a moment to cast
> your vote to release Lucene.Net 2.0.0. I have placed both the release
> candidate of source code and binary here:
> http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
>
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains ported code
> in
> "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
> this coming Saturday.
>
> [ x] +1 Approve release
> [ ] -1 Veto release (please give reason)
>
> Regards,
>
> -- George Aroush
>
>
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Vincent DARON <vd...@ask.be>.
+1
George Aroush wrote:
> Hi folks,
>
> To follow the proper release process of ASF, please take a moment to cast
> your vote to release Lucene.Net 2.0.0. I have placed both the release
> candidate of source code and binary here: http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains ported code in
> "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later then
> this coming Saturday.
>
> [ ] +1 Approve release
> [ ] -1 Veto release (please give reason)
>
> Regards,
>
> -- George Aroush
>
>
Re: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Jokin Cuadrado <jo...@gmail.com>.
could you share your fixes in form of a patch?
On 3/1/07, Erich Eichinger <E....@diamonddogs.cc> wrote:
> Since I have to deal almost 100% with web-applications, for me these leaks are definitely a showstopper. Depending on the application's traffic I experienced OutOfMemoryExceptions every few hours. After applying the fixes I described, everything is running smooth.
>
> cheers,
> Erich
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Thursday, March 01, 2007 2:19 AM
> > To: lucene-net-dev@incubator.apache.org;
> > lucene-net-user@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi Erich,
> >
> > In my opinion, none of those issues are critical to stop this release.
> >
> > The memory and resource leaks that you mentioned, have you
> > observed them or do you think they exist? Do you have sample
> > code that demonstrates them? I ask this because you said
> > "possible". Yes, I am aware of a leak issue during sorting
> > when Lucene.Net is compiled using .NET 1.1, but with .NET
> > 2.0, it disappears.
> >
> > As for your WeakHashtable suggestion and the use of
> > NHibernate, this isn't possible. This release is supporting
> > .NET 1.1 so we are somewhat limited with what we have. No, I
> > can't use NHibernate as it's a 3rd party artifact and none ASF.
> >
> > Regards,
> >
> > -- George
> >
> >
> > -----Original Message-----
> > From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> > Sent: Tuesday, February 27, 2007 9:04 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi,
> >
> > there are some resource leaks that lead to really nasty
> > problems in highloaded webapplications. I summed up the most
> > required changes:
> >
> > *)
> > Index/CompoundFileReader.cs:260:
> > Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't
> > close underlying IndexInput (possible resource leak)
> >
> >
> > *)
> > Index/TermInfosReader.cs
> > Index/SegmentReader.cs
> >
> > Usage of System.Threading.Thread.GetData()/.SetData() may
> > result in memory leaks in web-applications. Using
> > System.Runtime.Remoting.Messaging.CallContext is a much better choice.
> >
> >
> > *)
> > Search/FieldCacheImpl.cs
> >
> > cache should be a "WeakHashtable" instead of Hashtable.
> > Otherwise cached readers can't ever be collected and cause
> > memory/resource leaks.
> >
> > *)
> > FieldSortedHitQueue.cs
> >
> > the same problem as in FieldCacheImpl but with "Comparators" table.
> >
> > Asfaik a possible implementation of a "WeakHashtable" can be
> > found in the NHibernate project.
> >
> >
> > cheers,
> > Erich
> >
> >
> > > -----Original Message-----
> > > From: George Aroush [mailto:george@aroush.net]
> > > Sent: Tuesday, February 27, 2007 4:06 AM
> > > To: lucene-net-user@incubator.apache.org;
> > > lucene-net-dev@incubator.apache.org
> > > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> > >
> > > Hi folks,
> > >
> > > To follow the proper release process of ASF, please take a
> > moment to
> > > cast your vote to release Lucene.Net 2.0.0. I have placed both the
> > > release candidate of source code and binary
> > > here: http://people.apache.org/~aroush/
> > >
> > > The change history for this release can be found here:
> > > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > > 23/src/HISTORY
> > > .txt
> > >
> > > In addition to Lucene.Net release, this release also
> > contains ported
> > > code in "contrib".
> > >
> > > Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later
> > > then this coming Saturday.
> > >
> > > [ ] +1 Approve release
> > > [x] -1 Veto release (please give reason)
> > >
> > > Regards,
> > >
> > > -- George Aroush
> > >
> > >
> >
> >
>
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Thanks a lot Digy and Jon and the group, I seem to have started pulling in results, with the name change. I am about stepping out, I'd query deeper into the code on monday.
Thanks again
Tony
Digy <di...@gmail.com> wrote:
Hi Tony
Field Names are case sensitive. So i meant
"FileName" <> "Filename" (see the "N")
And not
filename <> filename
DIGY
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Saturday, March 10, 2007 1:29 AM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hi DIGY,
What did you mean filename <> filename.
I tried writing the code to show me the hits, with
----------------------------------------------------------------------------
-------------
"Response.Write("I found " & hits.Length & " values")"
----------------------------------------------------------------------------
------------
And that also came out, not finding anything on the search results. I am
aware my problem is with the indexing and search display but I cant point my
finger on it. the c # code is below.
----------------------------------------------------------------------------
------------------------------------------------------
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex, Field.Store.YES,
Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
----------------------------------------------------------------------------
--------------------------------------------------------
I was wondering if the problem could be .txt files I had attached, if
there is a specific format, I am to put text on the text files.
one of the files named 5.txt has these contents
----------------------------------------------------------------------------
------------------------------------------------------
day see the night
day please
day where
2) casinos in bombay
3) too much test
4) another line
Day one is far
day two rolls
----------------------------------------------------------------------------
-----------------------------------------------------
And the c# search code is
----------------------------------------------------------------------------
-------------------------------------------------
protected void searched(object sender, System.EventArgs e)
{
string Indexpath = "C:\\lucenex\\dump\\blabla\\";
string test = "day";
Search1(Indexpath, test);
}
private void Search1(string path, string TextToSearch)
{
bool createANewIndex = false;
IndexSearcher searcher = new IndexSearcher(path);
QueryParser queryParser = new QueryParser("text", new StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
int i = 0;
Response.Write("I found " + hits.Length + " values");
while (i < hits.Length) {
s += hits.Doc(i).GetField("Filename").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "";
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1);
Response.Write(s);
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "");
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "");
}
----------------------------------------------------------------------------
-------------------------------------------------
I am not sure if the the problem is, the search is not reading the text
file.
I truly am confused how to go about this.
Anthony
Digy wrote:
Hi Tony
"FileName" <> "Filename"
See indexing and searching codes
I: Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
S: Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
DIGY
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Thursday, March 08, 2007 10:51 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hello everyone,
I built a test VB.Net code based on a template DIGY gave me and it works.
The only problem I have is, I am unable to get hits from the search, when I
use repeated terms. I did the search and I the results keeps coming back
empty. I am pasting my code below, please could anyone help me find what's
wrong with my code. I am also attaching the text files I used.
============Code Behind==========================================
Imports Lucene.Net.Index
Imports Lucene.Net.Documents
Imports Lucene.Net.Analysis
Imports Lucene.Net.Analysis.Standard
Imports Lucene.Net.Search
Imports Lucene.Net.QueryParsers
Imports System.IO
Partial Class lucenex
Inherits System.Web.UI.Page
Protected Sub Page_Load(ByVal sender As Object, ByVal e As System.EventArgs)
Handles Me.Load
Dim Indexpath As String = "C:\lucenex\dump\blabla"
Dim createANewIndex As Boolean = True
Dim writer As IndexWriter = New IndexWriter(Indexpath, New StandardAnalyzer,
createANewIndex)
'New Code from digy starts here
IndexDocument(writer, "C:\lucenex\dump\3.txt")
IndexDocument(writer, "C:\lucenex\dump\5.txt")
IndexDocument(writer, "C:\lucenex\dump\1.txt")
writer.Close()
' Search(Indexpath, "day")
End Sub
Sub IndexDocument(ByVal writer As IndexWriter, ByVal DocumentPathToIndex As
String)
Dim rd As StreamReader = New StreamReader(DocumentPathToIndex)
Dim doc As Document = New Document
Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
Dim f2 As Field = New Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED)
doc.Add(f1)
doc.Add(f2)
writer.AddDocument(doc)
rd.Close()
End Sub
Private Sub Search(ByVal path As String, ByVal TextToSearch As String)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
Lucene.Net.Analysis.Standard.StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
'ant(i) = s
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
Protected Sub searched(ByVal sender As Object, ByVal e As System.EventArgs)
Handles sch.Click
Dim Indexpath As String = "C:\lucenex\dump\blabla\"
Search1(Indexpath, "day")
End Sub
Private Sub Search1(ByVal path As String, ByVal TextToSearch As String)
Dim createANewIndex As Boolean = False
'Dim wtx As IndexWriter = New IndexWriter(path, New
Lucene.Net.Analysis.Standard.StandardAnalyzer, createANewIndex)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
Response.Write("I found " & hits.Length & " values")
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
Response.Write(s)
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
End Class
===================Presentation page ================================
Inherits="lucenex" %>
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
Thank You all.
Tony
Digy wrote:
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Digy <di...@gmail.com>.
Hi Tony
Field Names are case sensitive. So i meant
"FileName" <> "Filename" (see the "N")
And not
filename <> filename
DIGY
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Saturday, March 10, 2007 1:29 AM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hi DIGY,
What did you mean filename <> filename.
I tried writing the code to show me the hits, with
----------------------------------------------------------------------------
-------------
"Response.Write("I found " & hits.Length & " values")"
----------------------------------------------------------------------------
------------
And that also came out, not finding anything on the search results. I am
aware my problem is with the indexing and search display but I cant point my
finger on it. the c # code is below.
----------------------------------------------------------------------------
------------------------------------------------------
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex, Field.Store.YES,
Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
----------------------------------------------------------------------------
--------------------------------------------------------
I was wondering if the problem could be .txt files I had attached, if
there is a specific format, I am to put text on the text files.
one of the files named 5.txt has these contents
----------------------------------------------------------------------------
------------------------------------------------------
day see the night
day please
day where
2) casinos in bombay
3) too much test
4) another line
Day one is far
day two rolls
----------------------------------------------------------------------------
-----------------------------------------------------
And the c# search code is
----------------------------------------------------------------------------
-------------------------------------------------
protected void searched(object sender, System.EventArgs e)
{
string Indexpath = "C:\\lucenex\\dump\\blabla\\";
string test = "day";
Search1(Indexpath, test);
}
private void Search1(string path, string TextToSearch)
{
bool createANewIndex = false;
IndexSearcher searcher = new IndexSearcher(path);
QueryParser queryParser = new QueryParser("text", new StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
int i = 0;
Response.Write("I found " + hits.Length + " values");
while (i < hits.Length) {
s += hits.Doc(i).GetField("Filename").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "";
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1);
Response.Write(s);
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "");
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "");
}
----------------------------------------------------------------------------
-------------------------------------------------
I am not sure if the the problem is, the search is not reading the text
file.
I truly am confused how to go about this.
Anthony
Digy <di...@gmail.com> wrote:
Hi Tony
"FileName" <> "Filename"
See indexing and searching codes
I: Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
S: Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
DIGY
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Thursday, March 08, 2007 10:51 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hello everyone,
I built a test VB.Net code based on a template DIGY gave me and it works.
The only problem I have is, I am unable to get hits from the search, when I
use repeated terms. I did the search and I the results keeps coming back
empty. I am pasting my code below, please could anyone help me find what's
wrong with my code. I am also attaching the text files I used.
============Code Behind==========================================
Imports Lucene.Net.Index
Imports Lucene.Net.Documents
Imports Lucene.Net.Analysis
Imports Lucene.Net.Analysis.Standard
Imports Lucene.Net.Search
Imports Lucene.Net.QueryParsers
Imports System.IO
Partial Class lucenex
Inherits System.Web.UI.Page
Protected Sub Page_Load(ByVal sender As Object, ByVal e As System.EventArgs)
Handles Me.Load
Dim Indexpath As String = "C:\lucenex\dump\blabla"
Dim createANewIndex As Boolean = True
Dim writer As IndexWriter = New IndexWriter(Indexpath, New StandardAnalyzer,
createANewIndex)
'New Code from digy starts here
IndexDocument(writer, "C:\lucenex\dump\3.txt")
IndexDocument(writer, "C:\lucenex\dump\5.txt")
IndexDocument(writer, "C:\lucenex\dump\1.txt")
writer.Close()
' Search(Indexpath, "day")
End Sub
Sub IndexDocument(ByVal writer As IndexWriter, ByVal DocumentPathToIndex As
String)
Dim rd As StreamReader = New StreamReader(DocumentPathToIndex)
Dim doc As Document = New Document
Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
Dim f2 As Field = New Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED)
doc.Add(f1)
doc.Add(f2)
writer.AddDocument(doc)
rd.Close()
End Sub
Private Sub Search(ByVal path As String, ByVal TextToSearch As String)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
Lucene.Net.Analysis.Standard.StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
'ant(i) = s
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
Protected Sub searched(ByVal sender As Object, ByVal e As System.EventArgs)
Handles sch.Click
Dim Indexpath As String = "C:\lucenex\dump\blabla\"
Search1(Indexpath, "day")
End Sub
Private Sub Search1(ByVal path As String, ByVal TextToSearch As String)
Dim createANewIndex As Boolean = False
'Dim wtx As IndexWriter = New IndexWriter(path, New
Lucene.Net.Analysis.Standard.StandardAnalyzer, createANewIndex)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
Response.Write("I found " & hits.Length & " values")
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
Response.Write(s)
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
End Class
===================Presentation page ================================
Inherits="lucenex" %>
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
Thank You all.
Tony
Digy wrote:
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Jon Palmer <jp...@contactnetworks.com>.
The fieldnames are case sensitive, read Digy's mail carefully,
Its true that
"fieldname" == "fieldname"
But
"FieldName" <> "Fieldname"
I've found that Luke, http://www.getopt.org/luke/ is a great tool for
figuring out indexing your index and really understanding what is in the
index without having to write code to debug it.
JP
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 09, 2007 6:29 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hi DIGY,
What did you mean filename <> filename.
I tried writing the code to show me the hits, with
------------------------------------------------------------------------
-----------------
"Response.Write("I found " & hits.Length & " values")"
------------------------------------------------------------------------
----------------
And that also came out, not finding anything on the search results. I
am aware my problem is with the indexing and search display but I cant
point my finger on it. the c # code is below.
------------------------------------------------------------------------
----------------------------------------------------------
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex, Field.Store.YES,
Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
------------------------------------------------------------------------
------------------------------------------------------------
I was wondering if the problem could be .txt files I had attached, if
there is a specific format, I am to put text on the text files.
one of the files named 5.txt has these contents
------------------------------------------------------------------------
----------------------------------------------------------
day see the night
day please
day where
2) casinos in bombay
3) too much test
4) another line
Day one is far
day two rolls
------------------------------------------------------------------------
---------------------------------------------------------
And the c# search code is
------------------------------------------------------------------------
-----------------------------------------------------
protected void searched(object sender, System.EventArgs e)
{
string Indexpath = "C:\\lucenex\\dump\\blabla\\";
string test = "day";
Search1(Indexpath, test);
}
private void Search1(string path, string TextToSearch)
{
bool createANewIndex = false;
IndexSearcher searcher = new IndexSearcher(path);
QueryParser queryParser = new QueryParser("text", new
StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
int i = 0;
Response.Write("I found " + hits.Length + " values");
while (i < hits.Length) {
s += hits.Doc(i).GetField("Filename").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "";
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1);
Response.Write(s);
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "");
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" +
Microsoft.VisualBasic.Chr(10) + "");
}
------------------------------------------------------------------------
-----------------------------------------------------
I am not sure if the the problem is, the search is not reading the
text file.
I truly am confused how to go about this.
Anthony
Digy <di...@gmail.com> wrote:
Hi Tony
"FileName" <> "Filename"
See indexing and searching codes
I: Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
S: Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
DIGY
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Thursday, March 08, 2007 10:51 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hello everyone,
I built a test VB.Net code based on a template DIGY gave me and it
works.
The only problem I have is, I am unable to get hits from the search,
when I
use repeated terms. I did the search and I the results keeps coming back
empty. I am pasting my code below, please could anyone help me find
what's
wrong with my code. I am also attaching the text files I used.
============Code Behind==========================================
Imports Lucene.Net.Index
Imports Lucene.Net.Documents
Imports Lucene.Net.Analysis
Imports Lucene.Net.Analysis.Standard
Imports Lucene.Net.Search
Imports Lucene.Net.QueryParsers
Imports System.IO
Partial Class lucenex
Inherits System.Web.UI.Page
Protected Sub Page_Load(ByVal sender As Object, ByVal e As
System.EventArgs)
Handles Me.Load
Dim Indexpath As String = "C:\lucenex\dump\blabla"
Dim createANewIndex As Boolean = True
Dim writer As IndexWriter = New IndexWriter(Indexpath, New
StandardAnalyzer,
createANewIndex)
'New Code from digy starts here
IndexDocument(writer, "C:\lucenex\dump\3.txt")
IndexDocument(writer, "C:\lucenex\dump\5.txt")
IndexDocument(writer, "C:\lucenex\dump\1.txt")
writer.Close()
' Search(Indexpath, "day")
End Sub
Sub IndexDocument(ByVal writer As IndexWriter, ByVal DocumentPathToIndex
As
String)
Dim rd As StreamReader = New StreamReader(DocumentPathToIndex)
Dim doc As Document = New Document
Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
Dim f2 As Field = New Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED)
doc.Add(f1)
doc.Add(f2)
writer.AddDocument(doc)
rd.Close()
End Sub
Private Sub Search(ByVal path As String, ByVal TextToSearch As String)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
Lucene.Net.Analysis.Standard.StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
'ant(i) = s
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
Protected Sub searched(ByVal sender As Object, ByVal e As
System.EventArgs)
Handles sch.Click
Dim Indexpath As String = "C:\lucenex\dump\blabla\"
Search1(Indexpath, "day")
End Sub
Private Sub Search1(ByVal path As String, ByVal TextToSearch As String)
Dim createANewIndex As Boolean = False
'Dim wtx As IndexWriter = New IndexWriter(path, New
Lucene.Net.Analysis.Standard.StandardAnalyzer, createANewIndex)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
Response.Write("I found " & hits.Length & " values")
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
Response.Write(s)
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
End Class
===================Presentation page ================================
Inherits="lucenex" %>
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
Thank You all.
Tony
Digy wrote:
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Hi DIGY,
What did you mean filename <> filename.
I tried writing the code to show me the hits, with
-----------------------------------------------------------------------------------------
"Response.Write("I found " & hits.Length & " values")"
----------------------------------------------------------------------------------------
And that also came out, not finding anything on the search results. I am aware my problem is with the indexing and search display but I cant point my finger on it. the c # code is below.
----------------------------------------------------------------------------------------------------------------------------------
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex, Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd, Field.Store.NO, Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
------------------------------------------------------------------------------------------------------------------------------------
I was wondering if the problem could be .txt files I had attached, if there is a specific format, I am to put text on the text files.
one of the files named 5.txt has these contents
----------------------------------------------------------------------------------------------------------------------------------
day see the night
day please
day where
2) casinos in bombay
3) too much test
4) another line
Day one is far
day two rolls
---------------------------------------------------------------------------------------------------------------------------------
And the c# search code is
-----------------------------------------------------------------------------------------------------------------------------
protected void searched(object sender, System.EventArgs e)
{
string Indexpath = "C:\\lucenex\\dump\\blabla\\";
string test = "day";
Search1(Indexpath, test);
}
private void Search1(string path, string TextToSearch)
{
bool createANewIndex = false;
IndexSearcher searcher = new IndexSearcher(path);
QueryParser queryParser = new QueryParser("text", new StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
int i = 0;
Response.Write("I found " + hits.Length + " values");
while (i < hits.Length) {
s += hits.Doc(i).GetField("Filename").StringValue + "" + Microsoft.VisualBasic.Chr(10) + "";
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1);
Response.Write(s);
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" + Microsoft.VisualBasic.Chr(10) + "");
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" + Microsoft.VisualBasic.Chr(10) + "");
}
-----------------------------------------------------------------------------------------------------------------------------
I am not sure if the the problem is, the search is not reading the text file.
I truly am confused how to go about this.
Anthony
Digy <di...@gmail.com> wrote:
Hi Tony
"FileName" <> "Filename"
See indexing and searching codes
I: Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
S: Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
DIGY
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Thursday, March 08, 2007 10:51 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hello everyone,
I built a test VB.Net code based on a template DIGY gave me and it works.
The only problem I have is, I am unable to get hits from the search, when I
use repeated terms. I did the search and I the results keeps coming back
empty. I am pasting my code below, please could anyone help me find what's
wrong with my code. I am also attaching the text files I used.
============Code Behind==========================================
Imports Lucene.Net.Index
Imports Lucene.Net.Documents
Imports Lucene.Net.Analysis
Imports Lucene.Net.Analysis.Standard
Imports Lucene.Net.Search
Imports Lucene.Net.QueryParsers
Imports System.IO
Partial Class lucenex
Inherits System.Web.UI.Page
Protected Sub Page_Load(ByVal sender As Object, ByVal e As System.EventArgs)
Handles Me.Load
Dim Indexpath As String = "C:\lucenex\dump\blabla"
Dim createANewIndex As Boolean = True
Dim writer As IndexWriter = New IndexWriter(Indexpath, New StandardAnalyzer,
createANewIndex)
'New Code from digy starts here
IndexDocument(writer, "C:\lucenex\dump\3.txt")
IndexDocument(writer, "C:\lucenex\dump\5.txt")
IndexDocument(writer, "C:\lucenex\dump\1.txt")
writer.Close()
' Search(Indexpath, "day")
End Sub
Sub IndexDocument(ByVal writer As IndexWriter, ByVal DocumentPathToIndex As
String)
Dim rd As StreamReader = New StreamReader(DocumentPathToIndex)
Dim doc As Document = New Document
Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
Dim f2 As Field = New Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED)
doc.Add(f1)
doc.Add(f2)
writer.AddDocument(doc)
rd.Close()
End Sub
Private Sub Search(ByVal path As String, ByVal TextToSearch As String)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
Lucene.Net.Analysis.Standard.StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
'ant(i) = s
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
Protected Sub searched(ByVal sender As Object, ByVal e As System.EventArgs)
Handles sch.Click
Dim Indexpath As String = "C:\lucenex\dump\blabla\"
Search1(Indexpath, "day")
End Sub
Private Sub Search1(ByVal path As String, ByVal TextToSearch As String)
Dim createANewIndex As Boolean = False
'Dim wtx As IndexWriter = New IndexWriter(path, New
Lucene.Net.Analysis.Standard.StandardAnalyzer, createANewIndex)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
Response.Write("I found " & hits.Length & " values")
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
Response.Write(s)
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
End Class
===================Presentation page ================================
Inherits="lucenex" %>
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
Thank You all.
Tony
Digy wrote:
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Digy <di...@gmail.com>.
Hi Tony
"FileName" <> "Filename"
See indexing and searching codes
I: Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
S: Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
DIGY
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Thursday, March 08, 2007 10:51 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hello everyone,
I built a test VB.Net code based on a template DIGY gave me and it works.
The only problem I have is, I am unable to get hits from the search, when I
use repeated terms. I did the search and I the results keeps coming back
empty. I am pasting my code below, please could anyone help me find what's
wrong with my code. I am also attaching the text files I used.
============Code Behind==========================================
Imports Lucene.Net.Index
Imports Lucene.Net.Documents
Imports Lucene.Net.Analysis
Imports Lucene.Net.Analysis.Standard
Imports Lucene.Net.Search
Imports Lucene.Net.QueryParsers
Imports System.IO
Partial Class lucenex
Inherits System.Web.UI.Page
Protected Sub Page_Load(ByVal sender As Object, ByVal e As System.EventArgs)
Handles Me.Load
Dim Indexpath As String = "C:\lucenex\dump\blabla"
Dim createANewIndex As Boolean = True
Dim writer As IndexWriter = New IndexWriter(Indexpath, New StandardAnalyzer,
createANewIndex)
'New Code from digy starts here
IndexDocument(writer, "C:\lucenex\dump\3.txt")
IndexDocument(writer, "C:\lucenex\dump\5.txt")
IndexDocument(writer, "C:\lucenex\dump\1.txt")
writer.Close()
' Search(Indexpath, "day")
End Sub
Sub IndexDocument(ByVal writer As IndexWriter, ByVal DocumentPathToIndex As
String)
Dim rd As StreamReader = New StreamReader(DocumentPathToIndex)
Dim doc As Document = New Document
Dim f1 As Field = New Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO)
Dim f2 As Field = New Field("Text", rd.ReadToEnd, Field.Store.NO,
Field.Index.TOKENIZED)
doc.Add(f1)
doc.Add(f2)
writer.AddDocument(doc)
rd.Close()
End Sub
Private Sub Search(ByVal path As String, ByVal TextToSearch As String)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
Lucene.Net.Analysis.Standard.StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
'ant(i) = s
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
Protected Sub searched(ByVal sender As Object, ByVal e As System.EventArgs)
Handles sch.Click
Dim Indexpath As String = "C:\lucenex\dump\blabla\"
Search1(Indexpath, "day")
End Sub
Private Sub Search1(ByVal path As String, ByVal TextToSearch As String)
Dim createANewIndex As Boolean = False
'Dim wtx As IndexWriter = New IndexWriter(path, New
Lucene.Net.Analysis.Standard.StandardAnalyzer, createANewIndex)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New
StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
Response.Write("I found " & hits.Length & " values")
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
Response.Write(s)
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" &
Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
End Class
===================Presentation page ================================
<%@ Page Language="VB" AutoEventWireup="false" CodeFile="Default.aspx.vb"
Inherits="lucenex" %>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" >
<head runat="server">
<title>Untitled Page</title>
</head>
<body>
<form id="form1" runat="server">
<div>
<asp:label ID="s" runat="server"></asp:label>
</div><br />
<div>
<asp:Button ID="sch" Text="search" runat="server" />
</div>
</form>
</body>
</html>
Thank You all.
Tony
Digy <di...@gmail.com> wrote:
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
DIGY,
Thanks a lot, this is truly appreciated. I'd try the code out.
Tony
Digy <di...@gmail.com> wrote:
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Hello everyone,
I built a test VB.Net code based on a template DIGY gave me and it works. The only problem I have is, I am unable to get hits from the search, when I use repeated terms. I did the search and I the results keeps coming back empty. I am pasting my code below, please could anyone help me find what's wrong with my code. I am also attaching the text files I used.
============Code Behind==========================================
Imports Lucene.Net.Index
Imports Lucene.Net.Documents
Imports Lucene.Net.Analysis
Imports Lucene.Net.Analysis.Standard
Imports Lucene.Net.Search
Imports Lucene.Net.QueryParsers
Imports System.IO
Partial Class lucenex
Inherits System.Web.UI.Page
Protected Sub Page_Load(ByVal sender As Object, ByVal e As System.EventArgs) Handles Me.Load
Dim Indexpath As String = "C:\lucenex\dump\blabla"
Dim createANewIndex As Boolean = True
Dim writer As IndexWriter = New IndexWriter(Indexpath, New StandardAnalyzer, createANewIndex)
'New Code from digy starts here
IndexDocument(writer, "C:\lucenex\dump\3.txt")
IndexDocument(writer, "C:\lucenex\dump\5.txt")
IndexDocument(writer, "C:\lucenex\dump\1.txt")
writer.Close()
' Search(Indexpath, "day")
End Sub
Sub IndexDocument(ByVal writer As IndexWriter, ByVal DocumentPathToIndex As String)
Dim rd As StreamReader = New StreamReader(DocumentPathToIndex)
Dim doc As Document = New Document
Dim f1 As Field = New Field("FileName", DocumentPathToIndex, Field.Store.YES, Field.Index.NO)
Dim f2 As Field = New Field("Text", rd.ReadToEnd, Field.Store.NO, Field.Index.TOKENIZED)
doc.Add(f1)
doc.Add(f2)
writer.AddDocument(doc)
rd.Close()
End Sub
Private Sub Search(ByVal path As String, ByVal TextToSearch As String)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New Lucene.Net.Analysis.Standard.StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" & Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
'ant(i) = s
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" & Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" & Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
Protected Sub searched(ByVal sender As Object, ByVal e As System.EventArgs) Handles sch.Click
Dim Indexpath As String = "C:\lucenex\dump\blabla\"
Search1(Indexpath, "day")
End Sub
Private Sub Search1(ByVal path As String, ByVal TextToSearch As String)
Dim createANewIndex As Boolean = False
'Dim wtx As IndexWriter = New IndexWriter(path, New Lucene.Net.Analysis.Standard.StandardAnalyzer, createANewIndex)
Dim searcher As IndexSearcher = New IndexSearcher(path)
Dim queryParser As QueryParser = New QueryParser("text", New StandardAnalyzer)
Dim query As Query = queryParser.Parse(TextToSearch)
Dim hits As Hits = searcher.Search(query)
Dim s As String = ""
Dim i As Integer = 0
'Dim ant() As Array
Response.Write("I found " & hits.Length & " values")
While i < hits.Length
s += hits.Doc(i).GetField("Filename").StringValue + "" & Microsoft.VisualBasic.Chr(10) & ""
System.Math.Min(System.Threading.Interlocked.Increment(i), i - 1)
Response.Write(s)
Response.Write(hits.Doc(i).GetField("Filename").StringValue + "" & Microsoft.VisualBasic.Chr(10) & "")
Response.Write(hits.Doc(i).GetField("Text").StringValue + "" & Microsoft.VisualBasic.Chr(10) & "")
End While
searcher.Close()
Me.s.Text = s
' MsgBox1.alert(s)
'MessageBox.Show(s)
End Sub
End Class
===================Presentation page ================================
<%@ Page Language="VB" AutoEventWireup="false" CodeFile="Default.aspx.vb" Inherits="lucenex" %>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" >
<head runat="server">
<title>Untitled Page</title>
</head>
<body>
<form id="form1" runat="server">
<div>
<asp:label ID="s" runat="server"></asp:label>
</div><br />
<div>
<asp:Button ID="sch" Text="search" runat="server" />
</div>
</form>
</body>
</html>
Thank You all.
Tony
Digy <di...@gmail.com> wrote:
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Digy <di...@gmail.com>.
Hi Tony
No diff. whether coding in WinForms or ASP.NET
I prepared a simple example for you.
DIGY
private void Form1_Load(object sender, EventArgs e)
{
string IndexPath=@"c:\temp\blabla";
bool createANewIndex = true; //true:"New index" false:"use
existing index"
IndexWriter wr = new IndexWriter(IndexPath, new
Lucene.Net.Analysis.Standard.StandardAnalyzer(), createANewIndex);
IndexDocument(wr, @"c:\temp\somedoc1.txt");
IndexDocument(wr, @"c:\temp\somedoc2.txt");
wr.Close();
Search(IndexPath, "hakuna matata");
}
void IndexDocument(IndexWriter wr,string DocumentPathToIndex)
{
StreamReader rd = new StreamReader(DocumentPathToIndex);
Document doc = new Document();
Field f1 = new Field("FileName", DocumentPathToIndex,
Field.Store.YES, Field.Index.NO);
Field f2 = new Field("Text", rd.ReadToEnd(), Field.Store.NO,
Field.Index.TOKENIZED);
doc.Add(f1);
doc.Add(f2);
wr.AddDocument(doc);
rd.Close();
}
private void Search(string Path,string TextToSearch)
{
IndexSearcher searcher = new IndexSearcher(Path);
QueryParser queryParser = new QueryParser("Text", new
Lucene.Net.Analysis.Standard.StandardAnalyzer());
Query query = queryParser.Parse(TextToSearch);
Hits hits = searcher.Search(query);
string s = "";
for (int i = 0; i < hits.Length(); i++)
{
s += hits.Doc(i).GetField("FileName").StringValue() + "\n";
}
searcher.Close();
MessageBox.Show(s);
}
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Monday, March 05, 2007 10:11 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching
in ASP.net.
I went through the code I downloaded from the site and the code for
indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Good Morning guys,
I hope you all had a good weekend.
I wanted to ask if anyone had a simple example of indexing and searching in ASP.net.
I went through the code I downloaded from the site and the code for indexing and searching kept getting me confused.
Thanks all, and please forgive my naive questions.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Hi Ed,
Sorry, I wasn't by my computer so I couldn't reply earlier, thanks, I have downloaded the dll file.
Thank you
Tony
Ed Jones <Ed...@warc.com> wrote:
Hi Tony,
I've emailed that to you. I've zipped it up as yahoo may block a dll.
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 23:32
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hi Ed,
I downloaded all the zip file downloads on that page and unzipped and
searched every single folder for the dll files and I was unable to find
it. I dont know what if, the dll files were recently taken from the zip
or something.
Is it possible to forward the dll files to me.
Tony
Ed Jones wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Ed Jones <Ed...@warc.com>.
Hi Tony,
I've emailed that to you. I've zipped it up as yahoo may block a dll.
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 23:32
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hi Ed,
I downloaded all the zip file downloads on that page and unzipped and
searched every single folder for the dll files and I was unable to find
it. I dont know what if, the dll files were recently taken from the zip
or something.
Is it possible to forward the dll files to me.
Tony
Ed Jones <Ed...@warc.com> wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by George Aroush <ge...@aroush.net>.
Hi Tony and all,
First few comments. http://www.dotlucene.net/ is not the official
Lucene.Net site. Please use http://incubator.apache.org/lucene.net/
>From the Lucene.Net, if you follow the download link you will see a
README.txt which will explain why you can't find the files you are looking
for. Hopefully, by end of next week, those files will come back as an
official release.
If you can't wait, you can get the source code off SVN (again, see the
official site) and build the DLL yourself. Once you have the DLL, you can
use it with VS.NET just like any other DLL. Many folks have done this
without any problem.
As for a demo on how to index and search using Lucene.Net, in addition to
what other folks already pointed out, you should also look in the source
code -- there is a "Demo" folder which has two working examples in C#.
Given VB.NET being somewhat similar to C#, you should be able to convert the
C# demo to VB.NET -- Google the net, maybe someone already posted such an
example in VB.NET.
Regards,
-- George Aroush
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 6:32 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Hi Ed,
I downloaded all the zip file downloads on that page and unzipped and
searched every single folder for the dll files and I was unable to find it.
I dont know what if, the dll files were recently taken from the zip or
something.
Is it possible to forward the dll files to me.
Tony
Ed Jones <Ed...@warc.com> wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here http://www.dotlucene.net/tutorial/
, they are in c# but you can use an online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with Lucene
I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a test
document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd be
better off including the .Net dll and leaving it in its original state. You
should not need Java at all, unless you want to use the Lucene Index
Explorer for debugging (which is nice). What is the next step you're trying
to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Hi Ed,
I downloaded all the zip file downloads on that page and unzipped and searched every single folder for the dll files and I was unable to find it. I dont know what if, the dll files were recently taken from the zip or something.
Is it possible to forward the dll files to me.
Tony
Ed Jones <Ed...@warc.com> wrote:
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Ed Jones <Ed...@warc.com>.
Tony,
Try downloading the files from http://www.dotlucene.net/download/ simply
download the ZIP file and look for the dll I the bin directory. Add as a
reference in your VS.net project.
Then take a look at the 5 tutorials here
http://www.dotlucene.net/tutorial/ , they are in c# but you can use an
online converter like this one:
http://www.developerfusion.co.uk/utilities/convertcsharptovb.aspx
I had the same learning curve as you and although I only dabbled with
Lucene I got an indexer and searching system working quite quickly.
Hope that helps
Ed
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: 02 March 2007 20:05
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
Regarding the lucene.net.dll, am I to compile my files and get the .dll
files or its provided on the website.
And the first step, I would like to make is, indexing and building a
test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene
environment.
Thank you
Anthony
Max Metral <ma...@artsalliancelabs.com> wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Regarding the lucene.net.dll, am I to compile my files and get the .dll files or its provided on the website.
And the first step, I would like to make is, indexing and building a test document I can search with.
I am sorry for my elementary questions, I am very new to the lucene environment.
Thank you
Anthony
Max Metral <ma...@artsalliancelabs.com> wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Thats good to know about not needing Java, I read the build file and it mentioned that I needed both Java and Ant 1.6.
I searched the files I downloaded from the site and I was unable to find any dll files. Where on the site are the dll files stored.
Thanks
Anthony
Max Metral <ma...@artsalliancelabs.com> wrote:
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Max Metral <ma...@artsalliancelabs.com>.
Sorry, my respose was leading but not informative. I would think you'd
be better off including the .Net dll and leaving it in its original
state. You should not need Java at all, unless you want to use the
Lucene Index Explorer for debugging (which is nice). What is the next
step you're trying to do? Index something? Build a test document?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:24 PM
To: lucene-net-dev@incubator.apache.org
Subject: RE: New to Apache Lucene.Net 2.0.0
The website I work on, is set up in VB and not C#
Max Metral <ma...@artsalliancelabs.com> wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
The website I work on, is set up in VB and not C#
Max Metral <ma...@artsalliancelabs.com> wrote: Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
RE: New to Apache Lucene.Net 2.0.0
Posted by Max Metral <ma...@artsalliancelabs.com>.
Why did you convert them?
-----Original Message-----
From: tony njedeh [mailto:njedeh@yahoo.com]
Sent: Friday, March 02, 2007 2:10 PM
To: lucene-net-dev@incubator.apache.org
Subject: New to Apache Lucene.Net 2.0.0
Hi everyone,
I am new to lucene and I wanted to use the search engine in my
VB.net(web application). I have converted the C# files I downloaded from
the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB
files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to
make, because I am seriously out of my element here.
Thank you
AW: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Erich Eichinger <E....@diamonddogs.cc>.
Hi,
I attached code containing some tests for memoryleaks. Unlike Lucene.NET 1.4.3, the current 2.0 codebase from SVN passes these tests without problems.
cheers,
Erich
________________________________
Von: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
Gesendet: Mi 2007-03-07 21:53
An: lucene-net-user@incubator.apache.org; lucene-net-dev@incubator.apache.org
Betreff: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi all,
I attached the patch for 1.4.3-final-004. It fixes a couple of memory-/resource leaks and some bugs in GermanStemmer. I have this version in use for over 1 year now in the "wilderness" and never had any problems (at least with Lucene) since then.
Unfortunately I didn't have time to look into 2.0 more detailed yet.
hope this helps,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Thursday, March 01, 2007 4:00 PM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi Erich,
>
> Now that you mentioned the version you are using, I believe
> those are fixed in 2.0 -- not necessarily in the same way as
> your fix. Can you:
>
> 1) Try Lucene.Net 1.9.1 and see if you are still seeing the
> leaks. I rather have you try 2.0 but some API's have changed in 2.0.
>
> 2) Share with us the patch you used for 1.4.3 -- others may
> find it useful.
>
> Regards,
>
> -- George Aroush
>
> -----Original Message-----
> From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> Sent: Thursday, March 01, 2007 4:12 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
>
> Hi George,
>
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist?
>
> Yes, I experienced them in a couple of high loaded
> web-applications and the
> fixes I mentioned took me 2 weeks to find them. TBH I
> experienced them using
> Lucene.NET 1.4.3 but checking the codebase showed, that the
> respective code
> didn't change to 2.0.
>
> > Do you have sample code that demonstrates them?
> > I ask this because you said "possible".
>
> This is misleading. I said "possible" because the underlying
> IndexInput
> might be a RAMDirectory. In case of FileDirectory (or the
> DBDirectory I
> mentioned in my private email) there is almost certainly a
> leak because of
> unclosed file-handles or db-connections.
> I can write some sample code to show up the leaks if you
> like. Btw: I found
> and fixed the leaks in v1.4.3 using SciTech's ".NET Memory
> Profiler" (don't
> want to ad here, but it has been the only useful tool I found for this
> purpose)
>
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible.
>
> Another misunderstanding ;-). I didn't want you to link Lucene.NET to
> NHibernate. I just wanted to point you to an implementation I
> am aware of.
>
>
> > In my opinion, none of those issues are critical to stop
> this release.
>
> Since I have to deal almost 100% with web-applications, for
> me these leaks
> are definitely a showstopper. Depending on the application's traffic I
> experienced OutOfMemoryExceptions every few hours. After
> applying the fixes
> I described, everything is running smooth.
>
> cheers,
> Erich
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Thursday, March 01, 2007 2:19 AM
> > To: lucene-net-dev@incubator.apache.org;
> > lucene-net-user@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi Erich,
> >
> > In my opinion, none of those issues are critical to stop
> this release.
> >
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist? Do you have sample code that
> > demonstrates them? I ask this because you said "possible".
> Yes, I am
> > aware of a leak issue during sorting when Lucene.Net is
> compiled using
> > .NET 1.1, but with .NET 2.0, it disappears.
> >
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible. This release is supporting .NET 1.1 so we are
> > somewhat limited with what we have. No, I can't use NHibernate as
> > it's a 3rd party artifact and none ASF.
> >
> > Regards,
> >
> > -- George
> >
> >
> > -----Original Message-----
> > From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> > Sent: Tuesday, February 27, 2007 9:04 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi,
> >
> > there are some resource leaks that lead to really nasty problems in
> > highloaded webapplications. I summed up the most required changes:
> >
> > *)
> > Index/CompoundFileReader.cs:260:
> > Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close
> > underlying IndexInput (possible resource leak)
> >
> >
> > *)
> > Index/TermInfosReader.cs
> > Index/SegmentReader.cs
> >
> > Usage of System.Threading.Thread.GetData()/.SetData() may result in
> > memory leaks in web-applications. Using
> > System.Runtime.Remoting.Messaging.CallContext is a much
> better choice.
> >
> >
> > *)
> > Search/FieldCacheImpl.cs
> >
> > cache should be a "WeakHashtable" instead of Hashtable.
> > Otherwise cached readers can't ever be collected and cause
> > memory/resource leaks.
> >
> > *)
> > FieldSortedHitQueue.cs
> >
> > the same problem as in FieldCacheImpl but with "Comparators" table.
> >
> > Asfaik a possible implementation of a "WeakHashtable" can
> be found in
> > the NHibernate project.
> >
> >
> > cheers,
> > Erich
> >
> >
> > > -----Original Message-----
> > > From: George Aroush [mailto:george@aroush.net]
> > > Sent: Tuesday, February 27, 2007 4:06 AM
> > > To: lucene-net-user@incubator.apache.org;
> > > lucene-net-dev@incubator.apache.org
> > > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> > >
> > > Hi folks,
> > >
> > > To follow the proper release process of ASF, please take a
> > moment to
> > > cast your vote to release Lucene.Net 2.0.0. I have
> placed both the
> > > release candidate of source code and binary
> > > here: http://people.apache.org/~aroush/
> > >
> > > The change history for this release can be found here:
> > > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > > 23/src/HISTORY
> > > .txt
> > >
> > > In addition to Lucene.Net release, this release also
> > contains ported
> > > code in "contrib".
> > >
> > > Please cast your vote on releasing Apache Lucene.Net
> 2.0.0 no later
> > > then this coming Saturday.
> > >
> > > [ ] +1 Approve release
> > > [x] -1 Veto release (please give reason)
> > >
> > > Regards,
> > >
> > > -- George Aroush
> > >
> > >
> >
> >
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Erich Eichinger <E....@diamonddogs.cc>.
Hi all,
I attached the patch for 1.4.3-final-004. It fixes a couple of memory-/resource leaks and some bugs in GermanStemmer. I have this version in use for over 1 year now in the "wilderness" and never had any problems (at least with Lucene) since then.
Unfortunately I didn't have time to look into 2.0 more detailed yet.
hope this helps,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Thursday, March 01, 2007 4:00 PM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi Erich,
>
> Now that you mentioned the version you are using, I believe
> those are fixed in 2.0 -- not necessarily in the same way as
> your fix. Can you:
>
> 1) Try Lucene.Net 1.9.1 and see if you are still seeing the
> leaks. I rather have you try 2.0 but some API's have changed in 2.0.
>
> 2) Share with us the patch you used for 1.4.3 -- others may
> find it useful.
>
> Regards,
>
> -- George Aroush
>
> -----Original Message-----
> From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> Sent: Thursday, March 01, 2007 4:12 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
>
> Hi George,
>
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist?
>
> Yes, I experienced them in a couple of high loaded
> web-applications and the
> fixes I mentioned took me 2 weeks to find them. TBH I
> experienced them using
> Lucene.NET 1.4.3 but checking the codebase showed, that the
> respective code
> didn't change to 2.0.
>
> > Do you have sample code that demonstrates them?
> > I ask this because you said "possible".
>
> This is misleading. I said "possible" because the underlying
> IndexInput
> might be a RAMDirectory. In case of FileDirectory (or the
> DBDirectory I
> mentioned in my private email) there is almost certainly a
> leak because of
> unclosed file-handles or db-connections.
> I can write some sample code to show up the leaks if you
> like. Btw: I found
> and fixed the leaks in v1.4.3 using SciTech's ".NET Memory
> Profiler" (don't
> want to ad here, but it has been the only useful tool I found for this
> purpose)
>
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible.
>
> Another misunderstanding ;-). I didn't want you to link Lucene.NET to
> NHibernate. I just wanted to point you to an implementation I
> am aware of.
>
>
> > In my opinion, none of those issues are critical to stop
> this release.
>
> Since I have to deal almost 100% with web-applications, for
> me these leaks
> are definitely a showstopper. Depending on the application's traffic I
> experienced OutOfMemoryExceptions every few hours. After
> applying the fixes
> I described, everything is running smooth.
>
> cheers,
> Erich
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Thursday, March 01, 2007 2:19 AM
> > To: lucene-net-dev@incubator.apache.org;
> > lucene-net-user@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi Erich,
> >
> > In my opinion, none of those issues are critical to stop
> this release.
> >
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist? Do you have sample code that
> > demonstrates them? I ask this because you said "possible".
> Yes, I am
> > aware of a leak issue during sorting when Lucene.Net is
> compiled using
> > .NET 1.1, but with .NET 2.0, it disappears.
> >
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible. This release is supporting .NET 1.1 so we are
> > somewhat limited with what we have. No, I can't use NHibernate as
> > it's a 3rd party artifact and none ASF.
> >
> > Regards,
> >
> > -- George
> >
> >
> > -----Original Message-----
> > From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> > Sent: Tuesday, February 27, 2007 9:04 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi,
> >
> > there are some resource leaks that lead to really nasty problems in
> > highloaded webapplications. I summed up the most required changes:
> >
> > *)
> > Index/CompoundFileReader.cs:260:
> > Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close
> > underlying IndexInput (possible resource leak)
> >
> >
> > *)
> > Index/TermInfosReader.cs
> > Index/SegmentReader.cs
> >
> > Usage of System.Threading.Thread.GetData()/.SetData() may result in
> > memory leaks in web-applications. Using
> > System.Runtime.Remoting.Messaging.CallContext is a much
> better choice.
> >
> >
> > *)
> > Search/FieldCacheImpl.cs
> >
> > cache should be a "WeakHashtable" instead of Hashtable.
> > Otherwise cached readers can't ever be collected and cause
> > memory/resource leaks.
> >
> > *)
> > FieldSortedHitQueue.cs
> >
> > the same problem as in FieldCacheImpl but with "Comparators" table.
> >
> > Asfaik a possible implementation of a "WeakHashtable" can
> be found in
> > the NHibernate project.
> >
> >
> > cheers,
> > Erich
> >
> >
> > > -----Original Message-----
> > > From: George Aroush [mailto:george@aroush.net]
> > > Sent: Tuesday, February 27, 2007 4:06 AM
> > > To: lucene-net-user@incubator.apache.org;
> > > lucene-net-dev@incubator.apache.org
> > > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> > >
> > > Hi folks,
> > >
> > > To follow the proper release process of ASF, please take a
> > moment to
> > > cast your vote to release Lucene.Net 2.0.0. I have
> placed both the
> > > release candidate of source code and binary
> > > here: http://people.apache.org/~aroush/
> > >
> > > The change history for this release can be found here:
> > > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > > 23/src/HISTORY
> > > .txt
> > >
> > > In addition to Lucene.Net release, this release also
> > contains ported
> > > code in "contrib".
> > >
> > > Please cast your vote on releasing Apache Lucene.Net
> 2.0.0 no later
> > > then this coming Saturday.
> > >
> > > [ ] +1 Approve release
> > > [x] -1 Veto release (please give reason)
> > >
> > > Regards,
> > >
> > > -- George Aroush
> > >
> > >
> >
> >
>
>
New to Apache Lucene.Net 2.0.0
Posted by tony njedeh <nj...@yahoo.com>.
Hi everyone,
I am new to lucene and I wanted to use the search engine in my VB.net(web application). I have converted the C# files I downloaded from the lucene.net 1.9.0.7 in the url http://www.dotlucene.net/ to VB files. I also downloaded Java 5.
I was hoping, if you guys could guide me through the next steps to make, because I am seriously out of my element here.
Thank you
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Erich Eichinger <E....@diamonddogs.cc>.
Hi all,
I'm unfortunately quite busy atm - that's why I wrote the quick summary of required changes. I'll recheck and try to create a patch as soon as I've got some time left.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Thursday, March 01, 2007 4:00 PM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi Erich,
>
> Now that you mentioned the version you are using, I believe
> those are fixed in 2.0 -- not necessarily in the same way as
> your fix. Can you:
>
> 1) Try Lucene.Net 1.9.1 and see if you are still seeing the
> leaks. I rather have you try 2.0 but some API's have changed in 2.0.
>
> 2) Share with us the patch you used for 1.4.3 -- others may
> find it useful.
>
> Regards,
>
> -- George Aroush
>
> -----Original Message-----
> From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> Sent: Thursday, March 01, 2007 4:12 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
>
> Hi George,
>
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist?
>
> Yes, I experienced them in a couple of high loaded
> web-applications and the
> fixes I mentioned took me 2 weeks to find them. TBH I
> experienced them using
> Lucene.NET 1.4.3 but checking the codebase showed, that the
> respective code
> didn't change to 2.0.
>
> > Do you have sample code that demonstrates them?
> > I ask this because you said "possible".
>
> This is misleading. I said "possible" because the underlying
> IndexInput
> might be a RAMDirectory. In case of FileDirectory (or the
> DBDirectory I
> mentioned in my private email) there is almost certainly a
> leak because of
> unclosed file-handles or db-connections.
> I can write some sample code to show up the leaks if you
> like. Btw: I found
> and fixed the leaks in v1.4.3 using SciTech's ".NET Memory
> Profiler" (don't
> want to ad here, but it has been the only useful tool I found for this
> purpose)
>
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible.
>
> Another misunderstanding ;-). I didn't want you to link Lucene.NET to
> NHibernate. I just wanted to point you to an implementation I
> am aware of.
>
>
> > In my opinion, none of those issues are critical to stop
> this release.
>
> Since I have to deal almost 100% with web-applications, for
> me these leaks
> are definitely a showstopper. Depending on the application's traffic I
> experienced OutOfMemoryExceptions every few hours. After
> applying the fixes
> I described, everything is running smooth.
>
> cheers,
> Erich
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Thursday, March 01, 2007 2:19 AM
> > To: lucene-net-dev@incubator.apache.org;
> > lucene-net-user@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi Erich,
> >
> > In my opinion, none of those issues are critical to stop
> this release.
> >
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist? Do you have sample code that
> > demonstrates them? I ask this because you said "possible".
> Yes, I am
> > aware of a leak issue during sorting when Lucene.Net is
> compiled using
> > .NET 1.1, but with .NET 2.0, it disappears.
> >
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible. This release is supporting .NET 1.1 so we are
> > somewhat limited with what we have. No, I can't use NHibernate as
> > it's a 3rd party artifact and none ASF.
> >
> > Regards,
> >
> > -- George
> >
> >
> > -----Original Message-----
> > From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> > Sent: Tuesday, February 27, 2007 9:04 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi,
> >
> > there are some resource leaks that lead to really nasty problems in
> > highloaded webapplications. I summed up the most required changes:
> >
> > *)
> > Index/CompoundFileReader.cs:260:
> > Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close
> > underlying IndexInput (possible resource leak)
> >
> >
> > *)
> > Index/TermInfosReader.cs
> > Index/SegmentReader.cs
> >
> > Usage of System.Threading.Thread.GetData()/.SetData() may result in
> > memory leaks in web-applications. Using
> > System.Runtime.Remoting.Messaging.CallContext is a much
> better choice.
> >
> >
> > *)
> > Search/FieldCacheImpl.cs
> >
> > cache should be a "WeakHashtable" instead of Hashtable.
> > Otherwise cached readers can't ever be collected and cause
> > memory/resource leaks.
> >
> > *)
> > FieldSortedHitQueue.cs
> >
> > the same problem as in FieldCacheImpl but with "Comparators" table.
> >
> > Asfaik a possible implementation of a "WeakHashtable" can
> be found in
> > the NHibernate project.
> >
> >
> > cheers,
> > Erich
> >
> >
> > > -----Original Message-----
> > > From: George Aroush [mailto:george@aroush.net]
> > > Sent: Tuesday, February 27, 2007 4:06 AM
> > > To: lucene-net-user@incubator.apache.org;
> > > lucene-net-dev@incubator.apache.org
> > > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> > >
> > > Hi folks,
> > >
> > > To follow the proper release process of ASF, please take a
> > moment to
> > > cast your vote to release Lucene.Net 2.0.0. I have
> placed both the
> > > release candidate of source code and binary
> > > here: http://people.apache.org/~aroush/
> > >
> > > The change history for this release can be found here:
> > > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > > 23/src/HISTORY
> > > .txt
> > >
> > > In addition to Lucene.Net release, this release also
> > contains ported
> > > code in "contrib".
> > >
> > > Please cast your vote on releasing Apache Lucene.Net
> 2.0.0 no later
> > > then this coming Saturday.
> > >
> > > [ ] +1 Approve release
> > > [x] -1 Veto release (please give reason)
> > >
> > > Regards,
> > >
> > > -- George Aroush
> > >
> > >
> >
> >
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Erich Eichinger <E....@diamonddogs.cc>.
Hi all,
I attached the patch for 1.4.3-final-004. It fixes a couple of memory-/resource leaks and some bugs in GermanStemmer. I have this version in use for over 1 year now in the "wilderness" and never had any problems (at least with Lucene) since then.
Unfortunately I didn't have time to look into 2.0 more detailed yet.
hope this helps,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Thursday, March 01, 2007 4:00 PM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi Erich,
>
> Now that you mentioned the version you are using, I believe
> those are fixed in 2.0 -- not necessarily in the same way as
> your fix. Can you:
>
> 1) Try Lucene.Net 1.9.1 and see if you are still seeing the
> leaks. I rather have you try 2.0 but some API's have changed in 2.0.
>
> 2) Share with us the patch you used for 1.4.3 -- others may
> find it useful.
>
> Regards,
>
> -- George Aroush
>
> -----Original Message-----
> From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> Sent: Thursday, March 01, 2007 4:12 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
>
> Hi George,
>
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist?
>
> Yes, I experienced them in a couple of high loaded
> web-applications and the
> fixes I mentioned took me 2 weeks to find them. TBH I
> experienced them using
> Lucene.NET 1.4.3 but checking the codebase showed, that the
> respective code
> didn't change to 2.0.
>
> > Do you have sample code that demonstrates them?
> > I ask this because you said "possible".
>
> This is misleading. I said "possible" because the underlying
> IndexInput
> might be a RAMDirectory. In case of FileDirectory (or the
> DBDirectory I
> mentioned in my private email) there is almost certainly a
> leak because of
> unclosed file-handles or db-connections.
> I can write some sample code to show up the leaks if you
> like. Btw: I found
> and fixed the leaks in v1.4.3 using SciTech's ".NET Memory
> Profiler" (don't
> want to ad here, but it has been the only useful tool I found for this
> purpose)
>
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible.
>
> Another misunderstanding ;-). I didn't want you to link Lucene.NET to
> NHibernate. I just wanted to point you to an implementation I
> am aware of.
>
>
> > In my opinion, none of those issues are critical to stop
> this release.
>
> Since I have to deal almost 100% with web-applications, for
> me these leaks
> are definitely a showstopper. Depending on the application's traffic I
> experienced OutOfMemoryExceptions every few hours. After
> applying the fixes
> I described, everything is running smooth.
>
> cheers,
> Erich
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Thursday, March 01, 2007 2:19 AM
> > To: lucene-net-dev@incubator.apache.org;
> > lucene-net-user@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi Erich,
> >
> > In my opinion, none of those issues are critical to stop
> this release.
> >
> > The memory and resource leaks that you mentioned, have you observed
> > them or do you think they exist? Do you have sample code that
> > demonstrates them? I ask this because you said "possible".
> Yes, I am
> > aware of a leak issue during sorting when Lucene.Net is
> compiled using
> > .NET 1.1, but with .NET 2.0, it disappears.
> >
> > As for your WeakHashtable suggestion and the use of
> NHibernate, this
> > isn't possible. This release is supporting .NET 1.1 so we are
> > somewhat limited with what we have. No, I can't use NHibernate as
> > it's a 3rd party artifact and none ASF.
> >
> > Regards,
> >
> > -- George
> >
> >
> > -----Original Message-----
> > From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> > Sent: Tuesday, February 27, 2007 9:04 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi,
> >
> > there are some resource leaks that lead to really nasty problems in
> > highloaded webapplications. I summed up the most required changes:
> >
> > *)
> > Index/CompoundFileReader.cs:260:
> > Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close
> > underlying IndexInput (possible resource leak)
> >
> >
> > *)
> > Index/TermInfosReader.cs
> > Index/SegmentReader.cs
> >
> > Usage of System.Threading.Thread.GetData()/.SetData() may result in
> > memory leaks in web-applications. Using
> > System.Runtime.Remoting.Messaging.CallContext is a much
> better choice.
> >
> >
> > *)
> > Search/FieldCacheImpl.cs
> >
> > cache should be a "WeakHashtable" instead of Hashtable.
> > Otherwise cached readers can't ever be collected and cause
> > memory/resource leaks.
> >
> > *)
> > FieldSortedHitQueue.cs
> >
> > the same problem as in FieldCacheImpl but with "Comparators" table.
> >
> > Asfaik a possible implementation of a "WeakHashtable" can
> be found in
> > the NHibernate project.
> >
> >
> > cheers,
> > Erich
> >
> >
> > > -----Original Message-----
> > > From: George Aroush [mailto:george@aroush.net]
> > > Sent: Tuesday, February 27, 2007 4:06 AM
> > > To: lucene-net-user@incubator.apache.org;
> > > lucene-net-dev@incubator.apache.org
> > > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> > >
> > > Hi folks,
> > >
> > > To follow the proper release process of ASF, please take a
> > moment to
> > > cast your vote to release Lucene.Net 2.0.0. I have
> placed both the
> > > release candidate of source code and binary
> > > here: http://people.apache.org/~aroush/
> > >
> > > The change history for this release can be found here:
> > > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > > 23/src/HISTORY
> > > .txt
> > >
> > > In addition to Lucene.Net release, this release also
> > contains ported
> > > code in "contrib".
> > >
> > > Please cast your vote on releasing Apache Lucene.Net
> 2.0.0 no later
> > > then this coming Saturday.
> > >
> > > [ ] +1 Approve release
> > > [x] -1 Veto release (please give reason)
> > >
> > > Regards,
> > >
> > > -- George Aroush
> > >
> > >
> >
> >
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by George Aroush <ge...@aroush.net>.
Hi Erich,
Now that you mentioned the version you are using, I believe those are fixed
in 2.0 -- not necessarily in the same way as your fix. Can you:
1) Try Lucene.Net 1.9.1 and see if you are still seeing the leaks. I rather
have you try 2.0 but some API's have changed in 2.0.
2) Share with us the patch you used for 1.4.3 -- others may find it useful.
Regards,
-- George Aroush
-----Original Message-----
From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
Sent: Thursday, March 01, 2007 4:12 AM
To: lucene-net-user@incubator.apache.org;
lucene-net-dev@incubator.apache.org
Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi George,
> The memory and resource leaks that you mentioned, have you observed
> them or do you think they exist?
Yes, I experienced them in a couple of high loaded web-applications and the
fixes I mentioned took me 2 weeks to find them. TBH I experienced them using
Lucene.NET 1.4.3 but checking the codebase showed, that the respective code
didn't change to 2.0.
> Do you have sample code that demonstrates them?
> I ask this because you said "possible".
This is misleading. I said "possible" because the underlying IndexInput
might be a RAMDirectory. In case of FileDirectory (or the DBDirectory I
mentioned in my private email) there is almost certainly a leak because of
unclosed file-handles or db-connections.
I can write some sample code to show up the leaks if you like. Btw: I found
and fixed the leaks in v1.4.3 using SciTech's ".NET Memory Profiler" (don't
want to ad here, but it has been the only useful tool I found for this
purpose)
> As for your WeakHashtable suggestion and the use of NHibernate, this
> isn't possible.
Another misunderstanding ;-). I didn't want you to link Lucene.NET to
NHibernate. I just wanted to point you to an implementation I am aware of.
> In my opinion, none of those issues are critical to stop this release.
Since I have to deal almost 100% with web-applications, for me these leaks
are definitely a showstopper. Depending on the application's traffic I
experienced OutOfMemoryExceptions every few hours. After applying the fixes
I described, everything is running smooth.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Thursday, March 01, 2007 2:19 AM
> To: lucene-net-dev@incubator.apache.org;
> lucene-net-user@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi Erich,
>
> In my opinion, none of those issues are critical to stop this release.
>
> The memory and resource leaks that you mentioned, have you observed
> them or do you think they exist? Do you have sample code that
> demonstrates them? I ask this because you said "possible". Yes, I am
> aware of a leak issue during sorting when Lucene.Net is compiled using
> .NET 1.1, but with .NET 2.0, it disappears.
>
> As for your WeakHashtable suggestion and the use of NHibernate, this
> isn't possible. This release is supporting .NET 1.1 so we are
> somewhat limited with what we have. No, I can't use NHibernate as
> it's a 3rd party artifact and none ASF.
>
> Regards,
>
> -- George
>
>
> -----Original Message-----
> From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> Sent: Tuesday, February 27, 2007 9:04 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi,
>
> there are some resource leaks that lead to really nasty problems in
> highloaded webapplications. I summed up the most required changes:
>
> *)
> Index/CompoundFileReader.cs:260:
> Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close
> underlying IndexInput (possible resource leak)
>
>
> *)
> Index/TermInfosReader.cs
> Index/SegmentReader.cs
>
> Usage of System.Threading.Thread.GetData()/.SetData() may result in
> memory leaks in web-applications. Using
> System.Runtime.Remoting.Messaging.CallContext is a much better choice.
>
>
> *)
> Search/FieldCacheImpl.cs
>
> cache should be a "WeakHashtable" instead of Hashtable.
> Otherwise cached readers can't ever be collected and cause
> memory/resource leaks.
>
> *)
> FieldSortedHitQueue.cs
>
> the same problem as in FieldCacheImpl but with "Comparators" table.
>
> Asfaik a possible implementation of a "WeakHashtable" can be found in
> the NHibernate project.
>
>
> cheers,
> Erich
>
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Tuesday, February 27, 2007 4:06 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi folks,
> >
> > To follow the proper release process of ASF, please take a
> moment to
> > cast your vote to release Lucene.Net 2.0.0. I have placed both the
> > release candidate of source code and binary
> > here: http://people.apache.org/~aroush/
> >
> > The change history for this release can be found here:
> > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > 23/src/HISTORY
> > .txt
> >
> > In addition to Lucene.Net release, this release also
> contains ported
> > code in "contrib".
> >
> > Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later
> > then this coming Saturday.
> >
> > [ ] +1 Approve release
> > [x] -1 Veto release (please give reason)
> >
> > Regards,
> >
> > -- George Aroush
> >
> >
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by George Aroush <ge...@aroush.net>.
Hi Erich,
Now that you mentioned the version you are using, I believe those are fixed
in 2.0 -- not necessarily in the same way as your fix. Can you:
1) Try Lucene.Net 1.9.1 and see if you are still seeing the leaks. I rather
have you try 2.0 but some API's have changed in 2.0.
2) Share with us the patch you used for 1.4.3 -- others may find it useful.
Regards,
-- George Aroush
-----Original Message-----
From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
Sent: Thursday, March 01, 2007 4:12 AM
To: lucene-net-user@incubator.apache.org;
lucene-net-dev@incubator.apache.org
Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi George,
> The memory and resource leaks that you mentioned, have you observed
> them or do you think they exist?
Yes, I experienced them in a couple of high loaded web-applications and the
fixes I mentioned took me 2 weeks to find them. TBH I experienced them using
Lucene.NET 1.4.3 but checking the codebase showed, that the respective code
didn't change to 2.0.
> Do you have sample code that demonstrates them?
> I ask this because you said "possible".
This is misleading. I said "possible" because the underlying IndexInput
might be a RAMDirectory. In case of FileDirectory (or the DBDirectory I
mentioned in my private email) there is almost certainly a leak because of
unclosed file-handles or db-connections.
I can write some sample code to show up the leaks if you like. Btw: I found
and fixed the leaks in v1.4.3 using SciTech's ".NET Memory Profiler" (don't
want to ad here, but it has been the only useful tool I found for this
purpose)
> As for your WeakHashtable suggestion and the use of NHibernate, this
> isn't possible.
Another misunderstanding ;-). I didn't want you to link Lucene.NET to
NHibernate. I just wanted to point you to an implementation I am aware of.
> In my opinion, none of those issues are critical to stop this release.
Since I have to deal almost 100% with web-applications, for me these leaks
are definitely a showstopper. Depending on the application's traffic I
experienced OutOfMemoryExceptions every few hours. After applying the fixes
I described, everything is running smooth.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Thursday, March 01, 2007 2:19 AM
> To: lucene-net-dev@incubator.apache.org;
> lucene-net-user@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi Erich,
>
> In my opinion, none of those issues are critical to stop this release.
>
> The memory and resource leaks that you mentioned, have you observed
> them or do you think they exist? Do you have sample code that
> demonstrates them? I ask this because you said "possible". Yes, I am
> aware of a leak issue during sorting when Lucene.Net is compiled using
> .NET 1.1, but with .NET 2.0, it disappears.
>
> As for your WeakHashtable suggestion and the use of NHibernate, this
> isn't possible. This release is supporting .NET 1.1 so we are
> somewhat limited with what we have. No, I can't use NHibernate as
> it's a 3rd party artifact and none ASF.
>
> Regards,
>
> -- George
>
>
> -----Original Message-----
> From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> Sent: Tuesday, February 27, 2007 9:04 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi,
>
> there are some resource leaks that lead to really nasty problems in
> highloaded webapplications. I summed up the most required changes:
>
> *)
> Index/CompoundFileReader.cs:260:
> Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close
> underlying IndexInput (possible resource leak)
>
>
> *)
> Index/TermInfosReader.cs
> Index/SegmentReader.cs
>
> Usage of System.Threading.Thread.GetData()/.SetData() may result in
> memory leaks in web-applications. Using
> System.Runtime.Remoting.Messaging.CallContext is a much better choice.
>
>
> *)
> Search/FieldCacheImpl.cs
>
> cache should be a "WeakHashtable" instead of Hashtable.
> Otherwise cached readers can't ever be collected and cause
> memory/resource leaks.
>
> *)
> FieldSortedHitQueue.cs
>
> the same problem as in FieldCacheImpl but with "Comparators" table.
>
> Asfaik a possible implementation of a "WeakHashtable" can be found in
> the NHibernate project.
>
>
> cheers,
> Erich
>
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Tuesday, February 27, 2007 4:06 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi folks,
> >
> > To follow the proper release process of ASF, please take a
> moment to
> > cast your vote to release Lucene.Net 2.0.0. I have placed both the
> > release candidate of source code and binary
> > here: http://people.apache.org/~aroush/
> >
> > The change history for this release can be found here:
> > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > 23/src/HISTORY
> > .txt
> >
> > In addition to Lucene.Net release, this release also
> contains ported
> > code in "contrib".
> >
> > Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later
> > then this coming Saturday.
> >
> > [ ] +1 Approve release
> > [x] -1 Veto release (please give reason)
> >
> > Regards,
> >
> > -- George Aroush
> >
> >
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Erich Eichinger <E....@diamonddogs.cc>.
Hi George,
> The memory and resource leaks that you mentioned, have you
> observed them or do you think they exist?
Yes, I experienced them in a couple of high loaded web-applications and the fixes I mentioned took me 2 weeks to find them. TBH I experienced them using Lucene.NET 1.4.3 but checking the codebase showed, that the respective code didn't change to 2.0.
> Do you have sample code that demonstrates them?
> I ask this because you said "possible".
This is misleading. I said "possible" because the underlying IndexInput might be a RAMDirectory. In case of FileDirectory (or the DBDirectory I mentioned in my private email) there is almost certainly a leak because of unclosed file-handles or db-connections.
I can write some sample code to show up the leaks if you like. Btw: I found and fixed the leaks in v1.4.3 using SciTech's ".NET Memory Profiler" (don't want to ad here, but it has been the only useful tool I found for this purpose)
> As for your WeakHashtable suggestion and the use of
> NHibernate, this isn't possible.
Another misunderstanding ;-). I didn't want you to link Lucene.NET to NHibernate. I just wanted to point you to an implementation I am aware of.
> In my opinion, none of those issues are critical to stop this release.
Since I have to deal almost 100% with web-applications, for me these leaks are definitely a showstopper. Depending on the application's traffic I experienced OutOfMemoryExceptions every few hours. After applying the fixes I described, everything is running smooth.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Thursday, March 01, 2007 2:19 AM
> To: lucene-net-dev@incubator.apache.org;
> lucene-net-user@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi Erich,
>
> In my opinion, none of those issues are critical to stop this release.
>
> The memory and resource leaks that you mentioned, have you
> observed them or do you think they exist? Do you have sample
> code that demonstrates them? I ask this because you said
> "possible". Yes, I am aware of a leak issue during sorting
> when Lucene.Net is compiled using .NET 1.1, but with .NET
> 2.0, it disappears.
>
> As for your WeakHashtable suggestion and the use of
> NHibernate, this isn't possible. This release is supporting
> .NET 1.1 so we are somewhat limited with what we have. No, I
> can't use NHibernate as it's a 3rd party artifact and none ASF.
>
> Regards,
>
> -- George
>
>
> -----Original Message-----
> From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
> Sent: Tuesday, February 27, 2007 9:04 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi,
>
> there are some resource leaks that lead to really nasty
> problems in highloaded webapplications. I summed up the most
> required changes:
>
> *)
> Index/CompoundFileReader.cs:260:
> Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't
> close underlying IndexInput (possible resource leak)
>
>
> *)
> Index/TermInfosReader.cs
> Index/SegmentReader.cs
>
> Usage of System.Threading.Thread.GetData()/.SetData() may
> result in memory leaks in web-applications. Using
> System.Runtime.Remoting.Messaging.CallContext is a much better choice.
>
>
> *)
> Search/FieldCacheImpl.cs
>
> cache should be a "WeakHashtable" instead of Hashtable.
> Otherwise cached readers can't ever be collected and cause
> memory/resource leaks.
>
> *)
> FieldSortedHitQueue.cs
>
> the same problem as in FieldCacheImpl but with "Comparators" table.
>
> Asfaik a possible implementation of a "WeakHashtable" can be
> found in the NHibernate project.
>
>
> cheers,
> Erich
>
>
> > -----Original Message-----
> > From: George Aroush [mailto:george@aroush.net]
> > Sent: Tuesday, February 27, 2007 4:06 AM
> > To: lucene-net-user@incubator.apache.org;
> > lucene-net-dev@incubator.apache.org
> > Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
> >
> > Hi folks,
> >
> > To follow the proper release process of ASF, please take a
> moment to
> > cast your vote to release Lucene.Net 2.0.0. I have placed both the
> > release candidate of source code and binary
> > here: http://people.apache.org/~aroush/
> >
> > The change history for this release can be found here:
> > https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> > 23/src/HISTORY
> > .txt
> >
> > In addition to Lucene.Net release, this release also
> contains ported
> > code in "contrib".
> >
> > Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later
> > then this coming Saturday.
> >
> > [ ] +1 Approve release
> > [x] -1 Veto release (please give reason)
> >
> > Regards,
> >
> > -- George Aroush
> >
> >
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by George Aroush <ge...@aroush.net>.
Hi Erich,
In my opinion, none of those issues are critical to stop this release.
The memory and resource leaks that you mentioned, have you observed them or
do you think they exist? Do you have sample code that demonstrates them? I
ask this because you said "possible". Yes, I am aware of a leak issue
during sorting when Lucene.Net is compiled using .NET 1.1, but with .NET
2.0, it disappears.
As for your WeakHashtable suggestion and the use of NHibernate, this isn't
possible. This release is supporting .NET 1.1 so we are somewhat limited
with what we have. No, I can't use NHibernate as it's a 3rd party artifact
and none ASF.
Regards,
-- George
-----Original Message-----
From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
Sent: Tuesday, February 27, 2007 9:04 AM
To: lucene-net-user@incubator.apache.org;
lucene-net-dev@incubator.apache.org
Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi,
there are some resource leaks that lead to really nasty problems in
highloaded webapplications. I summed up the most required changes:
*)
Index/CompoundFileReader.cs:260:
Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close underlying
IndexInput (possible resource leak)
*)
Index/TermInfosReader.cs
Index/SegmentReader.cs
Usage of System.Threading.Thread.GetData()/.SetData() may result in memory
leaks in web-applications. Using
System.Runtime.Remoting.Messaging.CallContext is a much better choice.
*)
Search/FieldCacheImpl.cs
cache should be a "WeakHashtable" instead of Hashtable. Otherwise cached
readers can't ever be collected and cause memory/resource leaks.
*)
FieldSortedHitQueue.cs
the same problem as in FieldCacheImpl but with "Comparators" table.
Asfaik a possible implementation of a "WeakHashtable" can be found in the
NHibernate project.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Tuesday, February 27, 2007 4:06 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi folks,
>
> To follow the proper release process of ASF, please take a moment to
> cast your vote to release Lucene.Net 2.0.0. I have placed both the
> release candidate of source code and binary
> here: http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> 23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains ported
> code in "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later
> then this coming Saturday.
>
> [ ] +1 Approve release
> [x] -1 Veto release (please give reason)
>
> Regards,
>
> -- George Aroush
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by George Aroush <ge...@aroush.net>.
Hi Erich,
In my opinion, none of those issues are critical to stop this release.
The memory and resource leaks that you mentioned, have you observed them or
do you think they exist? Do you have sample code that demonstrates them? I
ask this because you said "possible". Yes, I am aware of a leak issue
during sorting when Lucene.Net is compiled using .NET 1.1, but with .NET
2.0, it disappears.
As for your WeakHashtable suggestion and the use of NHibernate, this isn't
possible. This release is supporting .NET 1.1 so we are somewhat limited
with what we have. No, I can't use NHibernate as it's a 3rd party artifact
and none ASF.
Regards,
-- George
-----Original Message-----
From: Erich Eichinger [mailto:E.Eichinger@diamonddogs.cc]
Sent: Tuesday, February 27, 2007 9:04 AM
To: lucene-net-user@incubator.apache.org;
lucene-net-dev@incubator.apache.org
Subject: RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Hi,
there are some resource leaks that lead to really nasty problems in
highloaded webapplications. I summed up the most required changes:
*)
Index/CompoundFileReader.cs:260:
Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close underlying
IndexInput (possible resource leak)
*)
Index/TermInfosReader.cs
Index/SegmentReader.cs
Usage of System.Threading.Thread.GetData()/.SetData() may result in memory
leaks in web-applications. Using
System.Runtime.Remoting.Messaging.CallContext is a much better choice.
*)
Search/FieldCacheImpl.cs
cache should be a "WeakHashtable" instead of Hashtable. Otherwise cached
readers can't ever be collected and cause memory/resource leaks.
*)
FieldSortedHitQueue.cs
the same problem as in FieldCacheImpl but with "Comparators" table.
Asfaik a possible implementation of a "WeakHashtable" can be found in the
NHibernate project.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Tuesday, February 27, 2007 4:06 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi folks,
>
> To follow the proper release process of ASF, please take a moment to
> cast your vote to release Lucene.Net 2.0.0. I have placed both the
> release candidate of source code and binary
> here: http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> 23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains ported
> code in "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no later
> then this coming Saturday.
>
> [ ] +1 Approve release
> [x] -1 Veto release (please give reason)
>
> Regards,
>
> -- George Aroush
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Erich Eichinger <E....@diamonddogs.cc>.
Hi,
there are some resource leaks that lead to really nasty problems in highloaded webapplications. I summed up the most required changes:
*)
Index/CompoundFileReader.cs:260:
Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close underlying IndexInput (possible resource leak)
*)
Index/TermInfosReader.cs
Index/SegmentReader.cs
Usage of System.Threading.Thread.GetData()/.SetData() may result in memory leaks in web-applications. Using System.Runtime.Remoting.Messaging.CallContext is a much better choice.
*)
Search/FieldCacheImpl.cs
cache should be a "WeakHashtable" instead of Hashtable. Otherwise cached readers can't ever be collected and cause memory/resource leaks.
*)
FieldSortedHitQueue.cs
the same problem as in FieldCacheImpl but with "Comparators" table.
Asfaik a possible implementation of a "WeakHashtable" can be found in the NHibernate project.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Tuesday, February 27, 2007 4:06 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi folks,
>
> To follow the proper release process of ASF, please take a
> moment to cast your vote to release Lucene.Net 2.0.0. I have
> placed both the release candidate of source code and binary
> here: http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> 23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains
> ported code in "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no
> later then this coming Saturday.
>
> [ ] +1 Approve release
> [x] -1 Veto release (please give reason)
>
> Regards,
>
> -- George Aroush
>
>
RE: [VOTE] Release of Apache Lucene.Net 2.0.0
Posted by Erich Eichinger <E....@diamonddogs.cc>.
Hi,
there are some resource leaks that lead to really nasty problems in highloaded webapplications. I summed up the most required changes:
*)
Index/CompoundFileReader.cs:260:
Lucene.Net.Index.Compound.FileReader.CSIndexInput doesn't close underlying IndexInput (possible resource leak)
*)
Index/TermInfosReader.cs
Index/SegmentReader.cs
Usage of System.Threading.Thread.GetData()/.SetData() may result in memory leaks in web-applications. Using System.Runtime.Remoting.Messaging.CallContext is a much better choice.
*)
Search/FieldCacheImpl.cs
cache should be a "WeakHashtable" instead of Hashtable. Otherwise cached readers can't ever be collected and cause memory/resource leaks.
*)
FieldSortedHitQueue.cs
the same problem as in FieldCacheImpl but with "Comparators" table.
Asfaik a possible implementation of a "WeakHashtable" can be found in the NHibernate project.
cheers,
Erich
> -----Original Message-----
> From: George Aroush [mailto:george@aroush.net]
> Sent: Tuesday, February 27, 2007 4:06 AM
> To: lucene-net-user@incubator.apache.org;
> lucene-net-dev@incubator.apache.org
> Subject: [VOTE] Release of Apache Lucene.Net 2.0.0
>
> Hi folks,
>
> To follow the proper release process of ASF, please take a
> moment to cast your vote to release Lucene.Net 2.0.0. I have
> placed both the release candidate of source code and binary
> here: http://people.apache.org/~aroush/
>
> The change history for this release can be found here:
> https://svn.apache.org/repos/asf/incubator/lucene.net/trunk/C%
> 23/src/HISTORY
> .txt
>
> In addition to Lucene.Net release, this release also contains
> ported code in "contrib".
>
> Please cast your vote on releasing Apache Lucene.Net 2.0.0 no
> later then this coming Saturday.
>
> [ ] +1 Approve release
> [x] -1 Veto release (please give reason)
>
> Regards,
>
> -- George Aroush
>
>