You are viewing a plain text version of this content. The canonical link for it is here.

Posted to java-user@lucene.apache.org by pravesh <su...@yahoo.com> on 2014/01/10 11:38:17 UTC

Lucene Token Attributes internal data structure

After going through all lucene api docs, im still confused over one thing:

How does a TokenStream/AttributeSource actually stores the attributes. Does
it maintains a list of all attributes, like:

List<CharTermAttribute> termAttList;
List<PositionIncrementAttribute> posnAttList;
........
........

Since, it is mentioned all over the API javadocs that all AttributeSources
maintain a single instance of an Attribute, then, how does a stream of
tokens(CharTermAttribute better),positions,offsets is stored internally.


Any pointers?


Regards
Pravesh



--
View this message in context: http://lucene.472066.n3.nabble.com/Lucene-Token-Attributes-internal-data-structure-tp4110668.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Re: Lucene Token Attributes internal data structure

Posted by pravesh <su...@yahoo.com>.

Just figured out myself by debugging the Lucene source code.


Regards
Pravesh



--
View this message in context: http://lucene.472066.n3.nabble.com/Lucene-Token-Attributes-internal-data-structure-tp4110668p4110875.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org