You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tika.apache.org by ta...@apache.org on 2019/11/19 16:18:42 UTC
[tika] branch branch_1x updated (a0f773b -> 6e53324)
This is an automated email from the ASF dual-hosted git repository.
tallison pushed a change to branch branch_1x
in repository https://gitbox.apache.org/repos/asf/tika.git.
from a0f773b update changelog
new 1a2453e Test HEIF file, generated with https://compare.rokka.io/_compare on testJPEG_GEO.jpg
new 152145d Test file uses the HEVC codec, so switch to the more specific extension
new 9311f89 Add mimetypes for the HEIF (High Efficiency Image File) format family - TIKA-2942
new dc7bf6c HEIF detection unit test. When tooling improves, should ideally create another HEIF test file with another codec too
new b92c5ab TIKA-2988 -- add mime detection for digilite fdf files
new 6e53324 update changes
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGES.txt | 3 +-
.../org/apache/tika/mime/tika-mimetypes.xml | 49 +++++++++++++++++++++
.../java/org/apache/tika/mime/TestMimeTypes.java | 21 +++++++++
.../test/resources/test-documents/testDigilite.fdf | 1 +
.../test/resources/test-documents/testHEIF.heic | Bin 0 -> 13706 bytes
5 files changed, 73 insertions(+), 1 deletion(-)
create mode 100644 tika-parsers/src/test/resources/test-documents/testDigilite.fdf
create mode 100644 tika-parsers/src/test/resources/test-documents/testHEIF.heic
[tika] 05/06: TIKA-2988 -- add mime detection for digilite fdf files
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tallison pushed a commit to branch branch_1x
in repository https://gitbox.apache.org/repos/asf/tika.git
commit b92c5ab188ab9e7e2170974146e2f1c7f5b7b916
Author: tballison <ta...@apache.org>
AuthorDate: Tue Nov 19 10:59:24 2019 -0500
TIKA-2988 -- add mime detection for digilite fdf files
---
.../src/main/resources/org/apache/tika/mime/tika-mimetypes.xml | 9 +++++++++
.../src/test/java/org/apache/tika/mime/TestMimeTypes.java | 9 +++++++++
tika-parsers/src/test/resources/test-documents/testDigilite.fdf | 1 +
3 files changed, 19 insertions(+)
diff --git a/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml b/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
index 2b5feae..d8a8d47 100644
--- a/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
+++ b/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
@@ -1103,6 +1103,15 @@
<mime-type type="application/vnd.denovo.fcselayout-link">
<glob pattern="*.fe_launch"/>
</mime-type>
+ <mime-type type="application/vnd.digilite.prolights">
+ <tika:link>http://support.digilite.eu/?digilite=library</tika:link>
+ <_comment>digilite.eu Prolights configuration file</_comment>
+ <_comment>Note glob clash with Adobe's .fdf</_comment>
+ <!--<glob pattern="*.fdf"/>-->
+ <magic priority="50">
+ <match value="0x7F0C442B" type="string" offset="0"/>
+ </magic>
+ </mime-type>
<mime-type type="application/vnd.dir-bi.plate-dl-nosuffix"/>
<mime-type type="application/vnd.dna">
<glob pattern="*.dna"/>
diff --git a/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java b/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java
index b4eb338..2e82e99 100644
--- a/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java
+++ b/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java
@@ -178,6 +178,15 @@ public class TestMimeTypes {
}
@Test
+ public void testDigiliteFDF() throws Exception {
+ //not to be confused with Adobe's .fdf!
+ assertTypeByData("application/vnd.digilite.prolights",
+ "testDigilite.fdf");
+ assertTypeByNameAndData("application/vnd.digilite.prolights",
+ "testDigilite.fdf");
+ }
+
+ @Test
public void testHFATypes() throws Exception {
assertTypeByData("application/x-erdas-hfa","testHFA.hfa");
}
diff --git a/tika-parsers/src/test/resources/test-documents/testDigilite.fdf b/tika-parsers/src/test/resources/test-documents/testDigilite.fdf
new file mode 100644
index 0000000..64828b4
--- /dev/null
+++ b/tika-parsers/src/test/resources/test-documents/testDigilite.fdf
@@ -0,0 +1 @@
+ D+
\ No newline at end of file
[tika] 03/06: Add mimetypes for the HEIF (High Efficiency Image
File) format family - TIKA-2942
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tallison pushed a commit to branch branch_1x
in repository https://gitbox.apache.org/repos/asf/tika.git
commit 9311f895e8ba29fe28fca28558098353cf2400b0
Author: Nick Burch <ni...@gagravarr.org>
AuthorDate: Mon Nov 18 14:55:45 2019 +0000
Add mimetypes for the HEIF (High Efficiency Image File) format family - TIKA-2942
---
.../org/apache/tika/mime/tika-mimetypes.xml | 40 ++++++++++++++++++++++
1 file changed, 40 insertions(+)
diff --git a/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml b/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
index d3dceb7..2b5feae 100644
--- a/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
+++ b/tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
@@ -5133,6 +5133,46 @@
<glob pattern="*.gif"/>
</mime-type>
+ <mime-type type="image/heif">
+ <_comment>HEIF - High Efficiency Image File</_comment>
+ <acronym>HEIF</acronym>
+ <tika:link>https://en.wikipedia.org/wiki/High_Efficiency_Image_File_Format</tika:link>
+ <magic priority="60">
+ <match value="ftypmif1" type="string" offset="4"/>
+ </magic>
+ <glob pattern="*.heif"/>
+ <sub-class-of type="video/quicktime" />
+ </mime-type>
+ <mime-type type="image/heif-sequence">
+ <_comment>HEIF Sequence - High Efficiency Image Sequence</_comment>
+ <magic priority="60">
+ <match value="ftypmsf1" type="string" offset="4"/>
+ </magic>
+ <sub-class-of type="video/quicktime" />
+ </mime-type>
+
+ <mime-type type="image/heic">
+ <alias type="image/hevc"/>
+ <_comment>HEIF Image using HEVC Codec</_comment>
+ <acronym>HEIC</acronym>
+ <magic priority="60">
+ <match value="ftypheic" type="string" offset="4"/>
+ <match value="ftypheix" type="string" offset="4"/>
+ </magic>
+ <glob pattern="*.heic"/>
+ <sub-class-of type="image/heif" />
+ </mime-type>
+ <mime-type type="image/heic-sequence">
+ <alias type="image/hevc-sequence"/>
+ <_comment>HEIF Sequence using HEVC Codec</_comment>
+ <acronym>HEVC</acronym>
+ <magic priority="60">
+ <match value="ftyphevc" type="string" offset="4"/>
+ <match value="ftyphevx" type="string" offset="4"/>
+ </magic>
+ <sub-class-of type="image/heif-sequence" />
+ </mime-type>
+
<mime-type type="image/icns">
<_comment>Apple Icon Image Format</_comment>
<magic priority="50">
[tika] 04/06: HEIF detection unit test. When tooling improves,
should ideally create another HEIF test file with another codec too
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tallison pushed a commit to branch branch_1x
in repository https://gitbox.apache.org/repos/asf/tika.git
commit dc7bf6c09455abd9e44ccf2dbae97c032712d967
Author: Nick Burch <ni...@gagravarr.org>
AuthorDate: Mon Nov 18 14:57:09 2019 +0000
HEIF detection unit test. When tooling improves, should ideally create another HEIF test file with another codec too
---
.../src/test/java/org/apache/tika/mime/TestMimeTypes.java | 12 ++++++++++++
1 file changed, 12 insertions(+)
diff --git a/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java b/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java
index 131dd23..b4eb338 100644
--- a/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java
+++ b/tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.java
@@ -407,6 +407,18 @@ public class TestMimeTypes {
}
@Test
+ public void testHeifDetection() throws Exception {
+ // HEIF image using the HEVC Codec == HEIC
+ // created using https://compare.rokka.io/_compare on testJPEG_GEO.jpg
+ assertType("image/heic", "testHEIF.heic");
+ assertTypeByData("image/heic", "testHEIF.heic");
+ assertTypeByName("image/heic", "testHEIF.heic");
+
+ // TODO Create a HEIF using another codec, to test .heif data
+ assertTypeByName("image/heif", "testHEIF.heif");
+ }
+
+ @Test
public void testJpegDetection() throws Exception {
assertType("image/jpeg", "testJPEG.jpg");
assertTypeByData("image/jpeg", "testJPEG.jpg");
[tika] 06/06: update changes
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tallison pushed a commit to branch branch_1x
in repository https://gitbox.apache.org/repos/asf/tika.git
commit 6e5332441f66c82d9835f9017dd2246e9b31effb
Author: tballison <ta...@apache.org>
AuthorDate: Tue Nov 19 11:18:30 2019 -0500
update changes
---
CHANGES.txt | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/CHANGES.txt b/CHANGES.txt
index 2062d3e..a16de98 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -13,7 +13,8 @@ Release 1.23 - ??/??/???
* Add parser for XLIFF v1.2 files (TIKA-2975).
- * Add mime type detection support for WebAssembly (TIKA-2894).
+ * Add mime type detection support for WebAssembly (TIKA-2894),
+ HEIF / HEIC images (TIKA-2942) and Digilite FDF (TIKA-2988).
* Add an XLZ Parser (TIKA-2976).
[tika] 02/06: Test file uses the HEVC codec,
so switch to the more specific extension
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tallison pushed a commit to branch branch_1x
in repository https://gitbox.apache.org/repos/asf/tika.git
commit 152145d2aa131b1294b809ff54328b24c30a3723
Author: Nick Burch <ni...@gagravarr.org>
AuthorDate: Mon Nov 18 14:54:42 2019 +0000
Test file uses the HEVC codec, so switch to the more specific extension
---
.../test-documents/{testHEIF.heif => testHEIF.heic} | Bin
1 file changed, 0 insertions(+), 0 deletions(-)
diff --git a/tika-parsers/src/test/resources/test-documents/testHEIF.heif b/tika-parsers/src/test/resources/test-documents/testHEIF.heic
similarity index 100%
rename from tika-parsers/src/test/resources/test-documents/testHEIF.heif
rename to tika-parsers/src/test/resources/test-documents/testHEIF.heic
[tika] 01/06: Test HEIF file,
generated with https://compare.rokka.io/_compare on testJPEG_GEO.jpg
Posted by ta...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tallison pushed a commit to branch branch_1x
in repository https://gitbox.apache.org/repos/asf/tika.git
commit 1a2453e128aec416d76cb9bd15960d676cb3b308
Author: Nick Burch <ni...@gagravarr.org>
AuthorDate: Mon Nov 18 14:39:35 2019 +0000
Test HEIF file, generated with https://compare.rokka.io/_compare on testJPEG_GEO.jpg
---
.../src/test/resources/test-documents/testHEIF.heif | Bin 0 -> 13706 bytes
1 file changed, 0 insertions(+), 0 deletions(-)
diff --git a/tika-parsers/src/test/resources/test-documents/testHEIF.heif b/tika-parsers/src/test/resources/test-documents/testHEIF.heif
new file mode 100644
index 0000000..3d1893a
Binary files /dev/null and b/tika-parsers/src/test/resources/test-documents/testHEIF.heif differ