You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Chris A. Mattmann (JIRA)" <ji...@apache.org> on 2015/05/25 02:58:17 UTC
[jira] [Resolved] (TIKA-1614) Geo Topic Parser
[ https://issues.apache.org/jira/browse/TIKA-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris A. Mattmann resolved TIKA-1614.
-------------------------------------
Resolution: Fixed
Fix Version/s: 1.9
Committed to trunk. Thanks [~diefunction] for your initial work!
{noformat}
[chipotle:~/tmp/tika-geotopicparser] mattmann% svn commit -m "fix for TIKA-1614 Geo Topic Parser contributed by aranyali <ar...@gmail.com> and modified and updated by Chris Mattmann thi closes #43."
Sending tika-app/pom.xml
Sending tika-bundle/pom.xml
Sending tika-parsers/pom.xml
Adding tika-parsers/src/main/java/org/apache/tika/parser/geo
Adding tika-parsers/src/main/java/org/apache/tika/parser/geo/topic
Adding tika-parsers/src/main/java/org/apache/tika/parser/geo/topic/GeoParser.java
Adding tika-parsers/src/main/java/org/apache/tika/parser/geo/topic/GeoParserConfig.java
Adding tika-parsers/src/main/java/org/apache/tika/parser/geo/topic/GeoTag.java
Adding tika-parsers/src/main/java/org/apache/tika/parser/geo/topic/NameEntityExtractor.java
Sending tika-parsers/src/main/resources/META-INF/services/org.apache.tika.parser.Parser
Adding tika-parsers/src/test/java/org/apache/tika/parser/geo
Adding tika-parsers/src/test/java/org/apache/tika/parser/geo/topic
Adding tika-parsers/src/test/java/org/apache/tika/parser/geo/topic/GeoParserTest.java
Transmitting file data .........
Committed revision 1681541.
{noformat}
> Geo Topic Parser
> ----------------
>
> Key: TIKA-1614
> URL: https://issues.apache.org/jira/browse/TIKA-1614
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Reporter: Anya Yun Li
> Assignee: Chris A. Mattmann
> Labels: memex
> Fix For: 1.9
>
> Attachments: TIKA-1614.Mattmann.Li.052405.patch.txt
>
>
> ##Description
> This program aims to provide the support to identify geonames for any unstructured text data in the project NSF polar research. https://github.com/NSF-Polar-Cyberinfrastructure/datavis-hackathon/issues/1
> This project is a content-based geotagging solution, made of a variaty of NLP tools and could be used for any geotagging purposes.
> ##Workingflow
> 1. Plain text input is passed to geoparser
> 2. Location names are extracted from the text using OpenNLP NER
> 3. Provide two roles:
> * The most frequent location name choosed as the best match for the input text
> * Other extracted locations are treated as alternatives (equal)
> 4. location extracted above, search the best GeoName object and return the resloved objects with fields (name in gazetteer, longitude, latitude)
> ##How to Use
> *Cautions*: This program requires at least 1.2 GB disk space for building Lucene Index
> ```Java
> function A(stream){
> Metadata metadata = new Metadata();
> ParseContext context=new ParseContext();
> GeoParserConfig config= new GeoParserConfig();
> config.setGazetterPath(gazetteerPath);
> config.setNERModelPath(nerPath);
> context.set(GeoParserConfig.class, config);
>
> geoparser.parse(
> stream,
> new BodyContentHandler(),
> metadata,
> context);
>
> for(String name: metadata.names()){
> String value=metadata.get(name);
> System.out.println(name +" " + value);
> }
> }
> ```
> This parser generates useful geographical information to Tika's Metadata Object.
> Fields for best matched location:
> ```
> Geographic_NAME
> Geographic_LONGTITUDE
> Geographic_LATITUDE
> ```
> Fields for alternatives:
> ```
> Geographic_NAME1
> Geographic_LONGTITUDE1
> Geographic_LATITUDE1
> Geographic_NAME2
> Geographic_LONGTITUDE2
> Geographic_LATITUDE2
> ...
> ```
> If you have any questions, contact me: anyayunli@gmail.com
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)