You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucenenet.apache.org by "Steven (Created) (JIRA)" <ji...@apache.org> on 2012/01/04 15:45:39 UTC
[Lucene.Net] [jira] [Created] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
----------------------------------------------------------------------------------
Key: LUCENENET-463
URL: https://issues.apache.org/jira/browse/LUCENENET-463
Project: Lucene.Net
Issue Type: New Feature
Components: Lucene.Net Contrib
Reporter: Steven
Priority: Minor
This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[Lucene.Net] [jira] [Updated] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Posted by "Christopher Currens (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Currens updated LUCENENET-463:
------------------------------------------
Fix Version/s: Lucene.Net 3.0.3
> Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
> ----------------------------------------------------------------------------------
>
> Key: LUCENENET-463
> URL: https://issues.apache.org/jira/browse/LUCENENET-463
> Project: Lucene.Net
> Issue Type: New Feature
> Components: Lucene.Net Contrib
> Reporter: Steven
> Priority: Minor
> Fix For: Lucene.Net 3.0.3
>
>
> This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Posted by "Christopher Currens (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237204#comment-13237204 ]
Christopher Currens commented on LUCENENET-463:
-----------------------------------------------
I pushed some changes already, namely porting these files:
{noformat}
/incubator/lucene.net/trunk/src/contrib/Highlighter/Contrib.Highlighter.csproj
/incubator/lucene.net/trunk/src/contrib/Highlighter/DefaultEncoder.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/Encoder.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/Formatter.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/Fragmenter.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/GradientFormatter.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/Highlighter.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/IEncoder.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/InvalidTokenOffsetsException.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/NullFragmenter.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/Package.html
/incubator/lucene.net/trunk/src/contrib/Highlighter/QueryScorer.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/QueryTermExtractor.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/QueryTermScorer.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/Scorer.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/SimpleFragmenter.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/SimpleHTMLEncoder.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/SimpleHTMLFormatter.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/WeightedSpanTerm.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/WeightedSpanTermExtractor.cs
/incubator/lucene.net/trunk/src/contrib/Highlighter/WeightedTerm.cs
{noformat}
It's all a moot point though, because the real problem is that Highlighter relies on another contrib project we've never ported: MemoryIndex. In theory it shouldn't be too bad, it's only one file (46KB, though...yikes!). I've actually had to comment out parts of the ported Highlighter because it relies on this and we don't have it. So until we port that, Highlighter can't really be done.
> Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
> ----------------------------------------------------------------------------------
>
> Key: LUCENENET-463
> URL: https://issues.apache.org/jira/browse/LUCENENET-463
> Project: Lucene.Net
> Issue Type: New Feature
> Components: Lucene.Net Contrib
> Reporter: Steven
> Priority: Minor
> Fix For: Lucene.Net 3.0.3
>
>
> This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[Lucene.Net] [jira] [Commented] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Posted by "Digy (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180965#comment-13180965 ]
Digy commented on LUCENENET-463:
--------------------------------
My guess:
Either it is not widely used as you think, or no one is willing to port it :)
DIGY
> Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
> ----------------------------------------------------------------------------------
>
> Key: LUCENENET-463
> URL: https://issues.apache.org/jira/browse/LUCENENET-463
> Project: Lucene.Net
> Issue Type: New Feature
> Components: Lucene.Net Contrib
> Reporter: Steven
> Priority: Minor
>
> This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[Lucene.Net] [jira] [Commented] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Posted by "Christopher Currens (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191897#comment-13191897 ]
Christopher Currens commented on LUCENENET-463:
-----------------------------------------------
This is, at least, on my list of things to include in 3.0.3, but only if I can find the time to do it. The entire Highlighter project has a lot of changes between what is in it now and what needs to be for it to be the same as Java's highlighter in 3.0.3. This isn't a *top* priority for 3.0.3. If you'd like to port it yourself or parts of it to help make sure it's in the next release, we'd welcome it and include it, otherwise, we'll try and get it in ourselves, time permitting.
> Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
> ----------------------------------------------------------------------------------
>
> Key: LUCENENET-463
> URL: https://issues.apache.org/jira/browse/LUCENENET-463
> Project: Lucene.Net
> Issue Type: New Feature
> Components: Lucene.Net Contrib
> Reporter: Steven
> Priority: Minor
> Fix For: Lucene.Net 3.0.3
>
>
> This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Posted by "Christopher Currens (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Currens reassigned LUCENENET-463:
---------------------------------------------
Assignee: Christopher Currens
> Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
> ----------------------------------------------------------------------------------
>
> Key: LUCENENET-463
> URL: https://issues.apache.org/jira/browse/LUCENENET-463
> Project: Lucene.Net
> Issue Type: New Feature
> Components: Lucene.Net Contrib
> Reporter: Steven
> Assignee: Christopher Currens
> Priority: Minor
> Fix For: Lucene.Net 3.0.3
>
>
> This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Posted by "Prescott Nasser (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237189#comment-13237189 ]
Prescott Nasser commented on LUCENENET-463:
-------------------------------------------
I'll try to take a look at this over the weekend.
> Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
> ----------------------------------------------------------------------------------
>
> Key: LUCENENET-463
> URL: https://issues.apache.org/jira/browse/LUCENENET-463
> Project: Lucene.Net
> Issue Type: New Feature
> Components: Lucene.Net Contrib
> Reporter: Steven
> Priority: Minor
> Fix For: Lucene.Net 3.0.3
>
>
> This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (LUCENENET-463) Would like to be able to use a
SimpleSpanFragmenter for extrcting whole sentances
Posted by "Christopher Currens (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Currens resolved LUCENENET-463.
-------------------------------------------
Resolution: Fixed
Ported this and the tests. It's actually quite fast.
For some reason the FVH is considerably slower than this (even with the PhraseLimit). It might not be an issue with FVH, since we're using a far different version than java is at 3.0.3, but we should probably look it over just in case.
> Would like to be able to use a SimpleSpanFragmenter for extrcting whole sentances
> ----------------------------------------------------------------------------------
>
> Key: LUCENENET-463
> URL: https://issues.apache.org/jira/browse/LUCENENET-463
> Project: Lucene.Net
> Issue Type: New Feature
> Components: Lucene.Net Contrib
> Reporter: Steven
> Assignee: Christopher Currens
> Priority: Minor
> Fix For: Lucene.Net 3.0.3
>
>
> This is described in the Java version, but it does not seem to be in the dot.net port, is there a reason for this as I would have imagined lots of people doing document work would want it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira