You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/04/23 04:26:38 UTC
[jira] [Commented] (TIKA-1614) Geo Topic Parser
[ https://issues.apache.org/jira/browse/TIKA-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508325#comment-14508325 ]
ASF GitHub Bot commented on TIKA-1614:
--------------------------------------
GitHub user AranyaLi opened a pull request:
https://github.com/apache/tika/pull/43
TIKA-1614 Geo Topic Parser
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/AranyaLi/tika trunk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tika/pull/43.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #43
----
commit c6c402451c7133769aa94cdb6bbe075687e7c519
Author: aranyali <ar...@gmail.com>
Date: 2015-04-23T02:23:18Z
add geo topic parser
commit 51ef0cde472f3b7bd1e38318a1036af596135689
Author: aranyali <ar...@gmail.com>
Date: 2015-04-23T02:23:52Z
delete ~
----
> Geo Topic Parser
> ----------------
>
> Key: TIKA-1614
> URL: https://issues.apache.org/jira/browse/TIKA-1614
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Reporter: Anya Yun Li
>
> ##Description
> This program aims to provide the support to identify geonames for any unstructured text data in the project NSF polar research. https://github.com/NSF-Polar-Cyberinfrastructure/datavis-hackathon/issues/1
> This project is a content-based geotagging solution, made of a variaty of NLP tools and could be used for any geotagging purposes.
> ##Workingflow
> 1. Plain text input is passed to geoparser
> 2. Location names are extracted from the text using OpenNLP NER
> 3. Provide two roles:
> * The most frequent location name choosed as the best match for the input text
> * Other extracted locations are treated as alternatives (equal)
> 4. location extracted above, search the best GeoName object and return the resloved objects with fields (name in gazetteer, longitude, latitude)
> ##How to Use
> *Cautions*: This program requires at least 1.2 GB disk space for building Lucene Index
> ```Java
> function A(stream){
> Metadata metadata = new Metadata();
> ParseContext context=new ParseContext();
> GeoParserConfig config= new GeoParserConfig();
> config.setGazetterPath(gazetteerPath);
> config.setNERModelPath(nerPath);
> context.set(GeoParserConfig.class, config);
>
> geoparser.parse(
> stream,
> new BodyContentHandler(),
> metadata,
> context);
>
> for(String name: metadata.names()){
> String value=metadata.get(name);
> System.out.println(name +" " + value);
> }
> }
> ```
> This parser generates useful geographical information to Tika's Metadata Object.
> Fields for best matched location:
> ```
> Geographic_NAME
> Geographic_LONGTITUDE
> Geographic_LATITUDE
> ```
> Fields for alternatives:
> ```
> Geographic_NAME1
> Geographic_LONGTITUDE1
> Geographic_LATITUDE1
> Geographic_NAME2
> Geographic_LONGTITUDE2
> Geographic_LATITUDE2
> ...
> ```
> If you have any questions, contact me: anyayunli@gmail.com
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)