You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@stanbol.apache.org by "Olivier Grisel (JIRA)" <ji...@apache.org> on 2011/05/16 14:16:47 UTC
[jira] [Created] (STANBOL-201) Integrate pignlproc outpout (TSV or
other format) with the Stanbol indexing tools
Integrate pignlproc outpout (TSV or other format) with the Stanbol indexing tools
---------------------------------------------------------------------------------
Key: STANBOL-201
URL: https://issues.apache.org/jira/browse/STANBOL-201
Project: Stanbol
Issue Type: Sub-task
Reporter: Olivier Grisel
Assignee: Olivier Grisel
Either make pignlproc able to output ntriples or extend the Stanbol indexing tools to be able to index data expressed in a TSV format (e.g. using the solr UpdateCSV handler which is problably well optimized and does not require loading the data into a temporaray TDB store).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (STANBOL-201) Integrate pignlproc outpout (TSV
or other format) with the Stanbol indexing tools
Posted by "Olivier Grisel (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/STANBOL-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034311#comment-13034311 ]
Olivier Grisel commented on STANBOL-201:
----------------------------------------
"After a short look at the source of CSVRequestHandler and CSVLoader (internal class) I do not think that using the Solr Implementation is an option."
Why not? I used it successfully several times and it's really fast.
> Integrate pignlproc outpout (TSV or other format) with the Stanbol indexing tools
> ---------------------------------------------------------------------------------
>
> Key: STANBOL-201
> URL: https://issues.apache.org/jira/browse/STANBOL-201
> Project: Stanbol
> Issue Type: Sub-task
> Components: Enhancer, Entity Hub
> Reporter: Olivier Grisel
> Assignee: Olivier Grisel
>
> Either make pignlproc able to output ntriples or extend the Stanbol indexing tools to be able to index data expressed in a TSV format (e.g. using the solr UpdateCSV handler which is problably well optimized and does not require loading the data into a temporaray TDB store).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (STANBOL-201) Integrate pignlproc outpout (TSV
or other format) with the Stanbol indexing tools
Posted by "Rupert Westenthaler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/STANBOL-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034300#comment-13034300 ]
Rupert Westenthaler commented on STANBOL-201:
---------------------------------------------
After a short look at the source of CSVRequestHandler and CSVLoader (internal class) I do not think that using the Solr Implementation is an option. However while looking at the source I found out that Solr actually uses "http://commons.apache.org/sandbox/csv/" for parsing.
As for all commons modules that are in sandbox there is no distribution however Solr manages an artifact
<dependency>
<groupId>org.apache.solr</groupId>
<artifactId>solr-commons-csv</artifactId>
<version>3.1.0</version>
</dependency>
> Integrate pignlproc outpout (TSV or other format) with the Stanbol indexing tools
> ---------------------------------------------------------------------------------
>
> Key: STANBOL-201
> URL: https://issues.apache.org/jira/browse/STANBOL-201
> Project: Stanbol
> Issue Type: Sub-task
> Components: Enhancer, Entity Hub
> Reporter: Olivier Grisel
> Assignee: Olivier Grisel
>
> Either make pignlproc able to output ntriples or extend the Stanbol indexing tools to be able to index data expressed in a TSV format (e.g. using the solr UpdateCSV handler which is problably well optimized and does not require loading the data into a temporaray TDB store).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (STANBOL-201) Integrate pignlproc outpout (TSV or
other format) with the Stanbol indexing tools
Posted by "Olivier Grisel (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/STANBOL-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olivier Grisel reopened STANBOL-201:
------------------------------------
I reopen this issue as the generated topic index quality is not good enough for accurate text classification (according to test performed on a direct Solr instance).
Also work is under way on the pignlproc project to improve this by following a hierarchy of "interesting topics" so as to get rid of most of the noisy output. However the ntriples serialization need to be extended to be able to export the materialized category paths (from the root topics) for each index topic so as to make the classifier more efficient. This part is not implement yet.
> Integrate pignlproc outpout (TSV or other format) with the Stanbol indexing tools
> ---------------------------------------------------------------------------------
>
> Key: STANBOL-201
> URL: https://issues.apache.org/jira/browse/STANBOL-201
> Project: Stanbol
> Issue Type: Sub-task
> Components: Enhancer, Entity Hub
> Reporter: Olivier Grisel
> Assignee: Olivier Grisel
>
> Either make pignlproc able to output ntriples or extend the Stanbol indexing tools to be able to index data expressed in a TSV format (e.g. using the solr UpdateCSV handler which is problably well optimized and does not require loading the data into a temporaray TDB store).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (STANBOL-201) Integrate pignlproc outpout (TSV or
other format) with the Stanbol indexing tools
Posted by "Olivier Grisel (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/STANBOL-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olivier Grisel resolved STANBOL-201.
------------------------------------
Resolution: Fixed
Done at: https://github.com/ogrisel/pignlproc/tree/master/examples/topic-corpus
(Now outputs .nt files along with .tsv files).
Precomputed topic abstracts available at:
http://dl.dropbox.com/u/5743203/IKS/dbpedia/3.6/topics_merged_abstracts.nt.bz2
> Integrate pignlproc outpout (TSV or other format) with the Stanbol indexing tools
> ---------------------------------------------------------------------------------
>
> Key: STANBOL-201
> URL: https://issues.apache.org/jira/browse/STANBOL-201
> Project: Stanbol
> Issue Type: Sub-task
> Components: Enhancer, Entity Hub
> Reporter: Olivier Grisel
> Assignee: Olivier Grisel
>
> Either make pignlproc able to output ntriples or extend the Stanbol indexing tools to be able to index data expressed in a TSV format (e.g. using the solr UpdateCSV handler which is problably well optimized and does not require loading the data into a temporaray TDB store).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (STANBOL-201) Integrate pignlproc outpout (TSV
or other format) with the Stanbol indexing tools
Posted by "Olivier Grisel (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/STANBOL-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036740#comment-13036740 ]
Olivier Grisel commented on STANBOL-201:
----------------------------------------
I will do the update nlrpoc to dump valid NTriples outputs as this seems like the most flexible solution.
> Integrate pignlproc outpout (TSV or other format) with the Stanbol indexing tools
> ---------------------------------------------------------------------------------
>
> Key: STANBOL-201
> URL: https://issues.apache.org/jira/browse/STANBOL-201
> Project: Stanbol
> Issue Type: Sub-task
> Components: Enhancer, Entity Hub
> Reporter: Olivier Grisel
> Assignee: Olivier Grisel
>
> Either make pignlproc able to output ntriples or extend the Stanbol indexing tools to be able to index data expressed in a TSV format (e.g. using the solr UpdateCSV handler which is problably well optimized and does not require loading the data into a temporaray TDB store).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira