You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Edwin Yeo Zheng Lin (JIRA)" <ji...@apache.org> on 2019/01/15 11:49:00 UTC

[jira] [Created] (TIKA-2815) Priority of processing EML file should be TEXT_PLAIN instead of TEXT_HTML

Edwin Yeo Zheng Lin created TIKA-2815:
-----------------------------------------

             Summary: Priority of processing EML file should be TEXT_PLAIN instead of TEXT_HTML
                 Key: TIKA-2815
                 URL: https://issues.apache.org/jira/browse/TIKA-2815
             Project: Tika
          Issue Type: Bug
          Components: parser
    Affects Versions: 1.18, 1.17
         Environment: Source code MailContentHandler.java, function handleInlineBodyPart()
            Reporter: Edwin Yeo Zheng Lin


From the source code MailContentHandler.java, handleInlineBodyPart() function, we notice that in the processing of the EML files, the priority is to get the TEXT_HTML, followed by application/rtf, and finally TEXT_PLAIN.

However, as per my explanation in TIKA-2814, the content in TEXT_HTML is not cleaned, whereas the content in TEXT_PLAIN is clean and readable. 

As such, we should set the priority to be getting from TEXT_PLAIN as the first priority. This will prevent all the unwanted words like "*FONT-SIZE: 9pt; FONT-FAMILY: arial*" to be extracted out, and it could even lead to faster processing speed,

I have uploaded a sample EML file here: [https://drive.google.com/file/d/1z1gujv4SiacFeganLkdb0DhfZsNeGD2a/view?usp=sharing]

It has both the text/html section and text/plain section, and you can see that the text/plain section is way much cleaner and readable, as compared to text/html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)