You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tika.apache.org by ni...@apache.org on 2017/05/08 18:13:50 UTC
svn commit: r1794436 - /tika/site/publish/1.15/formats.html
Author: nick
Date: Mon May 8 18:13:50 2017
New Revision: 1794436
URL: http://svn.apache.org/viewvc?rev=1794436&view=rev
Log:
Republish
Modified:
tika/site/publish/1.15/formats.html
Modified: tika/site/publish/1.15/formats.html
URL: http://svn.apache.org/viewvc/tika/site/publish/1.15/formats.html?rev=1794436&r1=1794435&r2=1794436&view=diff
==============================================================================
--- tika/site/publish/1.15/formats.html (original)
+++ tika/site/publish/1.15/formats.html Mon May 8 18:13:50 2017
@@ -96,6 +96,7 @@
<li><a href="#Microsoft_Office_document_formats">Microsoft Office document formats</a></li>
<li><a href="#OpenDocument_Format">OpenDocument Format</a></li>
<li><a href="#iWorks_document_formats">iWorks document formats</a></li>
+<li><a href="#WordPerfect_document_formats">WordPerfect document formats</a></li>
<li><a href="#Portable_Document_Format">Portable Document Format</a></li>
<li><a href="#Electronic_Publication_Format">Electronic Publication Format</a></li>
<li><a href="#Rich_Text_Format">Rich Text Format</a></li>
@@ -114,7 +115,9 @@
<li><a href="#Scientific_formats">Scientific formats</a></li>
<li><a href="#Executable_programs_and_libraries">Executable programs and libraries</a></li>
<li><a href="#Crypto_formats">Crypto formats</a></li>
-<li><a href="#Database_formats">Database formats</a></li></ul></li>
+<li><a href="#Database_formats">Database formats</a></li>
+<li><a href="#Natural_Language_Processing">Natural Language Processing</a></li>
+<li><a href="#Image_and_Video_object_recognition">Image and Video object recognition</a></li></ul></li>
<li><a href="#Full_list_of_Supported_Formats">Full list of Supported Formats</a></li></ul>
<div class="section">
<h3><a name="HyperText_Markup_Language">HyperText Markup Language</a></h3>
@@ -125,7 +128,9 @@
<div class="section">
<h3><a name="Microsoft_Office_document_formats">Microsoft Office document formats</a></h3>
<p>Microsoft Office and some related applications produce documents in the generic OLE 2 Compound Document and Office Open XML (OOXML) formats. The older OLE 2 format was introduced in Microsoft Office version 97 and was the default format until Office version 2007 and the new XML-based OOXML format. The <a href="./api/org/apache/tika/parser/microsoft/OfficeParser.html">OfficeParser</a> and <a href="./api/org/apache/tika/parser/microsoft/ooxml/OOXMLParser.html">OOXMLParser</a> classes use <a class="externalLink" href="http://poi.apache.org/">Apache POI</a> libraries to support text and metadata extraction from both OLE2 and OOXML documents.</p>
-<p>Old, pre-OLE2 Excel files (Excel 2, 3 and 4) are handled by the <a href="./api/org/apache/tika/parser/microsoft/OldExcelParser.html">OldExcelParser</a>.</p></div>
+<p>Old, pre-OLE2 Excel files (Excel 2, 3 and 4) are handled by the <a href="./api/org/apache/tika/parser/microsoft/OldExcelParser.html">OldExcelParser</a>.</p>
+<p>The older, pre-OOXML pure-XML, office file formats are handled by <a href="./api/org/apache/tika/parser/microsoft/xml/SpreadsheetMLParser.html">SpreadsheetMLParser</a>, <a href="./api/org/apache/tika/parser/microsoft/xml/WordMLParser.html">WordMLParser</a> and <a href="./api/org/apache/tika/parser/microsoft/ooxml/xwpf/ml2006/Word2006MLParser.html">Word2006MLParser</a>.</p>
+<p>Temporary Office lock files (owner files) are supported for basic metadata extraction by <a href="./api/org/apache/tika/parser/microsoft/MSOwnerFileParser.html">MSOwnerFileParser</a>.</p></div>
<div class="section">
<h3><a name="OpenDocument_Format">OpenDocument Format</a></h3>
<p>The OpenDocument format (ODF) is used most notably as the default format of the OpenOffice.org office suite. The <a href="./api/org/apache/tika/parser/odf/OpenDocumentParser.html">OpenDocumentParser</a> class supports this format and the earlier OpenOffice 1.0 format on which ODF is based.</p></div>
@@ -133,6 +138,9 @@
<h3><a name="iWorks_document_formats">iWorks document formats</a></h3>
<p>The various iWorks document formats (Numbers, Pages, Keynote) are supported by the <a href="./api/org/apache/tika/parser/iwork/IWorkPackageParser.html">IWorkPackageParser</a> class, which extracts text and metadata.</p></div>
<div class="section">
+<h3><a name="WordPerfect_document_formats">WordPerfect document formats</a></h3>
+<p>The Corel WordPerfect Office Suite formats are supported by <a href="./api/org/apache/tika/parser/wordperfect/WordPerfectParser.html">WordPerfectParser</a>, supporting WordPerfect WP6+ files, and <a href="./api/org/apache/tika/parser/wordperfect/QuattroProParser.html">QuattroProParser</a>, supporting QuattroPro QPW v9+ files.</p></div>
+<div class="section">
<h3><a name="Portable_Document_Format">Portable Document Format</a></h3>
<p>The <a href="./api/org/apache/tika/parser/pdf/PDFParser.html">PDFParser</a> class parsers Portable Document Format (PDF) documents using the <a class="externalLink" href="http://pdfbox.apache.org/">Apache PDFBox</a> library.</p></div>
<div class="section">
@@ -144,8 +152,9 @@
<p>The <a href="./api/org/apache/tika/parser/rtf/RTFParser.html">RTFParser</a> class uses the standard javax.swing.text.rtf feature to extract text content from Rich Text Format (RTF) documents.</p></div>
<div class="section">
<h3><a name="Compression_and_packaging_formats">Compression and packaging formats</a></h3>
-<p>Tika uses the <a class="externalLink" href="http://commons.apache.org/compress/">Commons Compress</a> library to support various compression and packaging formats. The <a href="./api/org/apache/tika/parser/pkg/CompressorParser.html">CompressorParser</a> class handles parsing of the top level compression formats, then <a href="./api/org/apache/tika/parser/pkg/PackageParser.html">PackageParser</a> class and its subclasses parse the packaging formats and then pass the unpacked document streams to a second parsing stage using the parser instance specified in the parse context. Formats supported include Tar, AR, CPIO, Zip, 7Zip, Gzip, BZip2, XZ and Pack200.</p>
-<p>Additionally, the <a href="./api/org/apache/tika/parser/pkg/RARParser.html">RARParser</a> class supports the RAR archive format, which isn't supported by Commons Compress.</p></div>
+<p>Tika uses the <a class="externalLink" href="http://commons.apache.org/compress/">Commons Compress</a> library to support various compression and packaging formats. The <a href="./api/org/apache/tika/parser/pkg/CompressorParser.html">CompressorParser</a> class handles parsing of the top level compression formats, then <a href="./api/org/apache/tika/parser/pkg/PackageParser.html">PackageParser</a> class and its subclasses parse the packaging formats and then pass the unpacked document streams to a second parsing stage using the parser instance specified in the parse context. Formats supported include Tar, AR, ARJ, CPIO, Dump, Zip, 7Zip, Gzip, BZip2, XZ, LZMA, Z and Pack200.</p>
+<p>Additionally, the <a href="./api/org/apache/tika/parser/pkg/RarParser.html">RarParser</a> class supports the RAR archive format, which isn't supported by Commons Compress.</p>
+<p>The <a href="./api/org/apache/tika/parser/apple/AppleSingleFileParser.html">AppleSingleFileParser</a> class supports resources packaged within AppleSingle and AppleDouble files.</p></div>
<div class="section">
<h3><a name="Text_formats">Text formats</a></h3>
<p>Extracting text content from plain text files seems like a simple task until you start thinking of all the possible character encodings. The <a href="./api/org/apache/tika/parser/txt/TXTParser.html">TXTParser</a> class uses encoding detection code from the <a class="externalLink" href="http://site.icu-project.org/">ICU</a> project to automatically detect the character encoding of a text document.</p></div>
@@ -162,7 +171,8 @@
<div class="section">
<h3><a name="Image_formats">Image formats</a></h3>
<p>The <a href="./api/org/apache/tika/parser/image/ImageParser.html">ImageParser</a> class uses the standard javax.imageio feature to extract simple metadata from image formats supported by the Java platform, such as PNG, GIF and BMP. More complex image metadata is available through the <a href="./api/org/apache/tika/parser/jpeg/JpegParser.html">JpegParser</a> class and <a href="./api/org/apache/tika/parser/image/TiffParser.html">TiffParser</a> classes that uses the metadata-extractor library to supports Exif metadata extraction from Jpeg and Tiff images. The <a href="./api/org/apache/tika/parser/image/PSDParser.html">PSDParser</a> class extracts metadata from PSD images. The <a href="./api/org/apache/tika/parser/image/BPGParser.html">BPGParser</a> class extracts simple metadata from BPG (Better Portable Graphics) images. The <a href="./api/org/apache/tika/parser/image/WebPParser.html">WebPParser</a> class extracts simple metadata from WebP image format. The <a href="./api/org/apach
e/tika/parser/image/ICNSParser.html">ICNSParser</a> class extracts simple metadata from the Apple ICNS icon image format.</p>
-<p>When extracting from images, it is also possible to chain in Tesseract via the <a href="./api/org/apache/tika/parser/ocr/TesseractOCRParser.html">TesseractOCRParser</a> to have OCR performed on the contents of the image.</p></div>
+<p>When extracting from images, it is also possible to chain in Tesseract, via the <a href="./api/org/apache/tika/parser/ocr/TesseractOCRParser.html">TesseractOCRParser</a>, to have OCR performed on the contents of the image.</p>
+<p>The <a href="./api/org/apache/tika/parser/microsoft/WMFParser.html">WMFParser</a> class extracts simple text from Microsoft WMF drawings. The <a href="./api/org/apache/tika/parser/microsoft/EMFParser.html">EMFParser</a> class extracts simple text from Microsoft EMF drawings, along with exposing any embedded other resources / files.</p></div>
<div class="section">
<h3><a name="Video_formats">Video formats</a></h3>
<p>Tika supports the Flash video format using a simple parsing algorithm implemented in the <a href="./api/org/apache/tika/parser/video/FLVParser">FLVParser</a> class.</p>
@@ -180,7 +190,7 @@
<p>The <a href="./api/org/apache/tika/parser/mbox/MboxParser.html">MboxParser</a> can extract email messages from the mbox format used by many email archives and Unix-style mailboxes.</p>
<p>The <a href="./api/org/apache/tika/parser/mail/RFC822Parser.html">RFC822Parser</a> can process single email messages in the RFC 822 format used by many email clients in their archives / exports.</p>
<p>The <a href="./api/org/apache/tika/parser/mbox/OutlookPSTParser.html">OutlookPSTParser</a> can extract email messages from the Microsoft Outlook PST email format.</p>
-<p>The <a href="./api/org/apache/tika/parser/microsoft/OutlookExtractor.html">OutlookExtractor</a> (part of <a href="./api/org/apache/tika/parser/microsoft/OfficeParser">OfficeParser</a>) is able to extract email messages from the Microsoft Outlook MSG email format.</p>
+<p>The <a href="./api/org/apache/tika/parser/microsoft/OutlookExtractor.html">OutlookExtractor</a> (part of <a href="./api/org/apache/tika/parser/microsoft/OfficeParser.html">OfficeParser</a>) is able to extract email messages from the Microsoft Outlook MSG email format.</p>
<p>The <a href="./api/org/apache/tika/parser/microsoft/TNEFParser.html">TNEFParser</a> can extract email attachments from the Microsoft TNEF (Transport Neutral Encoding Format, aka Winmail.dat) used with some Microsoft email clients.</p></div>
<div class="section">
<h3><a name="CAD_formats">CAD formats</a></h3>
@@ -204,12 +214,23 @@
<p>The <a href="./api/org/apache/tika/parser/executable/ExecutableParser.html">ExecutableParser</a> can extract metadata information on platforms, architectures and types from a range of executable formats and libraries, such as Windows Executables and Linux / BSD programs and libraries.</p></div>
<div class="section">
<h3><a name="Crypto_formats">Crypto formats</a></h3>
-<p>The <a href="./api/org/apache/tika/parser/crypto/Pkcs7Parser.html">Pkcs7Parser</a> is able to parse the contents of PKCS7 signed messages, but doesn't include any information from the outer PKCS7 wrapper.</p></div>
+<p>The <a href="./api/org/apache/tika/parser/crypto/Pkcs7Parser.html">Pkcs7Parser</a> is able to parse the contents of PKCS7 signed messages, but doesn't include any information from the outer PKCS7 wrapper.</p>
+<p>The <a href="./api/org/apache/tika/parser/crypto/TSDParser.html">TSDParser</a> class processes metadata from Time Stamped Data Envelope files, as well as exposing the contents stored within the TSD wrapper.</p></div>
<div class="section">
<h3><a name="Database_formats">Database formats</a></h3>
<p>The <a href="./api/org/apache/tika/parser/jdbc/SQLite3Parser.html">SQLite3Parser</a> is able to extract content from SQLite3 files, in a tabular form. However, it requires that the <a class="externalLink" href="http://xerial.org/software/">org.xerial sqlite-jdbc jar</a> is manually added to the classpath first, as that binary jar isn't shipped as standard.</p>
<p>The <a href="./api/org/apache/tika/parser/microsoft/JackcessParser.html">JackcessParser</a> is able to extract metadata and content in a tabular form, from Microsoft Access database files.</p>
-<p>The <a href="./api/org/apache/tika/parser/dbf/DBFParser.html">DBFParser</a> currently supports versions of dBase files (dbf) before version 7. dBase formats are used in many legacy database systems, including dBase, FoxBASE, FoxPRO and in ESRI's Shapefile format. See <a class="externalLink" href="http://www.digitalpreservation.gov/formats/fdd/fdd000325.shtml"> digitalpreservation.gov</a> for background on this format.</p></div></div>
+<p>The <a href="./api/org/apache/tika/parser/dbf/DBFParser.html">DBFParser</a> currently supports versions of dBase files (dbf) before version 7. dBase formats are used in many legacy database systems, including dBase, FoxBASE, FoxPRO and in ESRI's Shapefile format. See <a class="externalLink" href="http://www.digitalpreservation.gov/formats/fdd/fdd000325.shtml"> digitalpreservation.gov</a> for background on this format.</p></div>
+<div class="section">
+<h3><a name="Natural_Language_Processing">Natural Language Processing</a></h3>
+<p>Tika supports calling out to a number of Natural Language Processing and Named Entity Recognition frameworks, tools and libraries. </p>
+<p>These can be used to support additional formats, or to gain extra information on existing formats. In many cases, additional tools or REST services or training datasets are required to enable or power this support.</p>
+<p>Details on the requirements and setup steps are generally given either in the parser's javadocs, or on the <a class="externalLink" href="https://wiki.apache.org/tika/">Tika wiki</a>.</p>
+<p>The <a href="./api/org/apache/tika/parser/sentiment/analysis/SentimentParser.html">SentimentParser</a> class classifies documents based on the sentiment of document, powered by Apache OpenNLP's Maximum Entropy Classifier.</p>
+<p><a href="./api/org/apache/tika/parser/journal/JournalParser.html">JournalParser</a> uses Grobid (via RESTful server) to extract additional metadata from the text of journal publications. A number of other NLP and NER parsers are available in the <a href="./api/org/apache/tika/parser/ner/">ner package</a></p></div>
+<div class="section">
+<h3><a name="Image_and_Video_object_recognition">Image and Video object recognition</a></h3>
+<p>Tika supports calling out to a number of Object Recognition frameworks to analyse the contents of images and videos. Large training datasets and or frameworks are generally required, often accessed via REST services. The <a href="./api/org/apache/tika/parser/recognition/">recognition package</a> contains most of these. Details on the requirements and setup steps are generally given on the <a class="externalLink" href="https://wiki.apache.org/tika/">Tika wiki</a>.</p></div></div>
<div class="section">
<h2><a name="Full_list_of_Supported_Formats"></a>Full list of Supported Formats</h2>
<p>TODO Populate this at release time</p></div>
@@ -410,7 +431,7 @@
</div>
<div id="footer">
<p>
- Copyright © 2016
+ Copyright © 2017
<a href="http://www.apache.org/">The Apache Software Foundation</a>.
Site powered by <a href="http://maven.apache.org/">Apache Maven</a>.
Search powered by