You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Ray Gauss II (Created) (JIRA)" <ji...@apache.org> on 2011/11/06 20:07:52 UTC
[jira] [Created] (TIKA-774) ExifTool Parser
ExifTool Parser
---------------
Key: TIKA-774
URL: https://issues.apache.org/jira/browse/TIKA-774
Project: Tika
Issue Type: New Feature
Components: parser
Affects Versions: 1.0
Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
Reporter: Ray Gauss II
Fix For: 1.0
Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
In the core project:
An ExifTool interface is added which contains Property objects that define the metadata fields available.
An additional Property constructor for internalTextBag type.
In the parsers project:
An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (TIKA-774) ExifTool Parser
Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris A. Mattmann updated TIKA-774:
-----------------------------------
Fix Version/s: (was: 1.2)
1.3
- push to 1.3
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.3
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TIKA-774) ExifTool Parser
Posted by "Jukka Zitting (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147342#comment-13147342 ]
Jukka Zitting commented on TIKA-774:
------------------------------------
Some notes:
* We already have existing places for metadata schemas like Dublin Core and XMPDM. It would be better if the new metadata properties you're adding were located next to the already existing similar properties instead of in the separate new ExifTool interface.
* We already have parsers for JPEG, PNG and TIFF. Instead of adding a conflicting new parser for the same formats, it would be better if the existing parsers could be extended with this new functionality.
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.1
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TIKA-774) ExifTool Parser
Posted by "Ray Gauss II (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148026#comment-13148026 ]
Ray Gauss II commented on TIKA-774:
-----------------------------------
Indeed a tighter integration of the Property definitions would be ideal, but there could be the potential for namespace collisions for tika metadata constants that aren't prefixed so having the prefixed Properties in ExifTool allows users to explicitly fetch the field they need and optionally map those to existing fields like DublinCore via the ExiftoolTikaMapper. As a noob to the project and with so many new properties I thought a separate interface might be the best approach but I'm happy to move them elsewhere.
I also agree that the ExiftoolMetadataExtractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser since the absence of ExifTool in the environment should just fail silently, but again, as a noob, I didn't want to bust through the door with sweeping changes right off the bat.
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.1
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (TIKA-774) ExifTool Parser
Posted by "Chris A. Mattmann (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris A. Mattmann updated TIKA-774:
-----------------------------------
Fix Version/s: (was: 1.1)
1.2
- push out to 1.2
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.2
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (TIKA-774) ExifTool Parser
Posted by "Michael McCandless (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael McCandless updated TIKA-774:
------------------------------------
Fix Version/s: (was: 1.0)
1.1
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.1
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (TIKA-774) ExifTool Parser
Posted by "Ray Gauss II (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ray Gauss II updated TIKA-774:
------------------------------
Attachment: testJPEG_IPTC_EXT.jpg
tika-parsers-exiftool-parser-patch.txt
tika-core-exiftool-parser-patch.txt
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.0
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TIKA-774) ExifTool Parser
Posted by "Ray Gauss II (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251089#comment-13251089 ]
Ray Gauss II commented on TIKA-774:
-----------------------------------
The code for the ExifTool parser has been moved to https://github.com/Alfresco/tika-exiftool which contains versions of tika-core and tika-parsers patched with TIKA-842 and TIKA-859.
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.2
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (TIKA-774) ExifTool Parser
Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris A. Mattmann updated TIKA-774:
-----------------------------------
- push to 1.3
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.3
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TIKA-774) ExifTool Parser
Posted by "Ray Gauss II (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TIKA-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13187062#comment-13187062 ]
Ray Gauss II commented on TIKA-774:
-----------------------------------
I've refactored much of this and will be splitting some of it out to submit as separate, smaller issues.
> ExifTool Parser
> ---------------
>
> Key: TIKA-774
> URL: https://issues.apache.org/jira/browse/TIKA-774
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 1.0
> Environment: Requires be installed (http://www.sno.phy.queensu.ca/~phil/exiftool/)
> Reporter: Ray Gauss II
> Labels: features, newbie, patch,
> Fix For: 1.1
>
> Attachments: testJPEG_IPTC_EXT.jpg, tika-core-exiftool-parser-patch.txt, tika-parsers-exiftool-parser-patch.txt
>
>
> Adds an external parser that calls ExifTool to extract extended metadata fields from images and other content types.
> In the core project:
> An ExifTool interface is added which contains Property objects that define the metadata fields available.
> An additional Property constructor for internalTextBag type.
> In the parsers project:
> An ExiftoolMetadataExtractor is added which does the work of calling ExifTool on the command line and mapping the response to tika metadata fields. This extractor could be called instead of or in addition to the existing ImageMetadataExtractor and JempboxExtractor under TiffParser and/or JpegParser but those have not been changed at this time.
> An ExiftoolParser is added which calls only the ExiftoolMetadataExtractor.
> An ExiftoolTikaMapper is added which is responsible for mapping the ExifTool metadata fields to existing tika and Drew Noakes metadata fields if enabled.
> An ElementRdfBagMetadataHandler is added for extracting multi-valued RDF Bag implementations in XML files.
> An ExifToolParserTest is added which tests several expected XMP and IPTC metadata values in testJPEG_IPTC_EXT.jpg.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira