You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tika.apache.org by "Tim Allison (Jira)" <ji...@apache.org> on 2024/02/16 14:27:00 UTC

[jira] [Commented] (TIKA-4198) Skip blob fields in geopkg files

    [ https://issues.apache.org/jira/browse/TIKA-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817981#comment-17817981 ] 

Tim Allison commented on TIKA-4198:
-----------------------------------

Turns out there's a "geom" field and also a "data" field that are blobs. We can skip both of these or maybe all blobs in geopkg?

> Skip blob fields in geopkg files
> --------------------------------
>
>                 Key: TIKA-4198
>                 URL: https://issues.apache.org/jira/browse/TIKA-4198
>             Project: Tika
>          Issue Type: Improvement
>            Reporter: Tim Allison
>            Priority: Minor
>
> Some geopkg tables store "geom" information in blob fields, starting with magic: 47 50 00...
> By default Tika handles blobs as embedded files. This can cause serious resource waste on geopkg files that contain hundreds of thousands of rows with a geom field.
> We should create a new parser for geopkg that subclasses the sqlite parser and skips blobs from the geom fields by default.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)