[jira] [Comment Edited] (TIKA-4181) Tika Grpc Server using Tika Pipes

["Tilman Hausherr (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TIKA-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17861075#comment-17861075 ] 

Tilman Hausherr edited comment on TIKA-4181 at 7/1/24 7:02 AM:
---------------------------------------------------------------

Is this
{code:xml}
    <protobuf.version>3.24.0</protobuf.version>
    <protoc.version>3.24.0</protoc.version>
{code}
intended? This is an older version of protobuf than the one we're using. It's also preventing this PR to work:
https://github.com/apache/tika/pull/1849

{noformat}
2024-07-01T06:17:39.8130959Z [WARNING] Rule 0: org.apache.maven.plugins.enforcer.DependencyConvergence failed with message:
2024-07-01T06:17:39.8132291Z Failed while enforcing releasability the error(s) are [
2024-07-01T06:17:39.8133867Z Dependency convergence error for com.google.protobuf:protobuf-java-util:3.25.1 paths to dependency are:
2024-07-01T06:17:39.8135252Z +-org.apache.tika:tika-grpc:3.0.0-SNAPSHOT
2024-07-01T06:17:39.8136080Z   +-io.grpc:grpc-services:1.65.0
2024-07-01T06:17:39.8136947Z     +-com.google.protobuf:protobuf-java-util:3.25.1
2024-07-01T06:17:39.8137737Z and
2024-07-01T06:17:39.8138366Z +-org.apache.tika:tika-grpc:3.0.0-SNAPSHOT
2024-07-01T06:17:39.8139307Z   +-com.google.protobuf:protobuf-java-util:3.24.0
{noformat}



was (Author: tilman):
Is this
{code:xml}
    <protobuf.version>3.24.0</protobuf.version>
    <protoc.version>3.24.0</protoc.version>
{code}
intended? This is an older version of protobuf than the one we're using. It's also preventing this PR to work:
https://github.com/apache/tika/pull/1849

> Tika Grpc Server using Tika Pipes
> ---------------------------------
>
>                 Key: TIKA-4181
>                 URL: https://issues.apache.org/jira/browse/TIKA-4181
>             Project: Tika
>          Issue Type: New Feature
>          Components: tika-pipes
>            Reporter: Nicholas DiPiazza
>            Priority: Major
>         Attachments: image-2024-02-06-07-54-50-116.png
>
>
> Create a Tika Grpc server.
> You should be able to create Tike Pipes fetchers, then use those fetchers. 
> You can then use those fetchers to FetchAndParse in 3 ways:
>  * synchronous fashion - you send a single request to fetch a file, and get a single FetchAndParse response tuple.
>  * streaming output - you send a single request and stream back the FetchAndParse response tuple.
>  * bi-directional streaming - You stream in 1 or more Fetch requests and stream back FetchAndParse response tuples.
> Requires we create a service contract that specifies the inputs we require from each method.
> Then we will need to implement the different components with a grpc client generated using the contract.
> This would enable developers to run tika-pipes as a persistently running daemon instead of just a single batch app, because it can continue to stream out more inputs.
> !image-2024-02-06-07-54-50-116.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)