fieldNorm and fieldValueUniqueness

[Cam Bazz <ca...@gmail.com>]

Hello,

When you look at the fields of a document with Luke, there is a norm column.
I have not been able to figure out what that is.

The reason I am asking is that I am trying to build a uniqueness model. My
Index is structured as follows:

classID, textID, K, V

classID is a given class. textID is a document ID. each document is formed
by multiple K,V pairs.

I want to measure uniqueness of V, with both inter classID and inter textID.
In other words, given a document (K,V pair) I would like to know how unique
is the V both inside the classID, and textID.

Any ideas/recomendations/help greatly appreciated.

Best.
-C.B.

Re: fieldNorm and fieldValueUniqueness

[Cam Bazz <ca...@gmail.com>]

yes, figured it out. thanks.

how about checking for uniqueness?

Best.

On Wed, Jun 11, 2008 at 5:39 PM, Karl Wettin <ka...@gmail.com> wrote:

>
> 11 jun 2008 kl. 16.04 skrev Cam Bazz:
>
>>
>> When you look at the fields of a document with Luke, there is a norm
>> column.
>> I have not been able to figure out what that is.
>>
>
> Norms is the 8 bit discretization of length normalization and field boost
> combined.
>
> See IndexReader#norms, Similarity#lengthNorm and Field#omitNorms
>
>
>        karl
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Re: fieldNorm and fieldValueUniqueness

[Karl Wettin <ka...@gmail.com>]

11 jun 2008 kl. 16.04 skrev Cam Bazz:
>
> When you look at the fields of a document with Luke, there is a norm  
> column.
> I have not been able to figure out what that is.

Norms is the 8 bit discretization of length normalization and field  
boost combined.

See IndexReader#norms, Similarity#lengthNorm and Field#omitNorms


         karl

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org