You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by Emil Zegers <e....@upcmail.nl.INVALID> on 2024/04/26 09:59:28 UTC

Question about tika-pipes FileSystemFetcher configuration options

Hi,

I'm looking for information if it is possible to configure FileSystemFetcher for tika-pipes to only process certain files, e.g. based on extension, match on file name/path or similar pattern.

This way it would be possible to point to a specific root folder and only process matching files like certain extensions, names (e.g. for GIS files like shapefiles there is same name with multiple extensions) etc.

Something like:

<properties>
  <fetchers>
    <fetcher class="org.apache.tika.pipes.fetcher.fs.FileSystemFetcher">
      <params>
        <name>fsf</name>
        <basePath>/my/base/path1</basePath>
        <pattern>myshapefilename.*</pattern>
      </params>
    </fetcher>
  </fetchers>
</properties>

Or:

        <pattern>*.doc*,*.pdf</pattern>

Regards,

Emil

Re: Question about tika-pipes FileSystemFetcher configuration options

Posted by Tim Allison <ta...@apache.org>.
That's not possible yet. Please open an issue on our JIRA...you may need to
request an account(?).

On Fri, Apr 26, 2024 at 6:01 AM Emil Zegers <e....@upcmail.nl.invalid>
wrote:

> Hi,
>
> I'm looking for information if it is possible to configure
> FileSystemFetcher for tika-pipes to only process certain files, e.g. based
> on extension, match on file name/path or similar pattern.
>
> This way it would be possible to point to a specific root folder and only
> process matching files like certain extensions, names (e.g. for GIS files
> like shapefiles there is same name with multiple extensions) etc.
>
> Something like:
>
> <properties>
>   <fetchers>
>     <fetcher class="org.apache.tika.pipes.fetcher.fs.FileSystemFetcher">
>       <params>
>         <name>fsf</name>
>         <basePath>/my/base/path1</basePath>
>         <pattern>myshapefilename.*</pattern>
>       </params>
>     </fetcher>
>   </fetchers>
> </properties>
>
> Or:
>
>         <pattern>*.doc*,*.pdf</pattern>
>
> Regards,
>
> Emil
>
>
>