[GitHub] [jena] afs commented on issue #1633: optional streaming construct?

[GitBox <gi...@apache.org>]

afs commented on issue #1633:
URL: https://github.com/apache/jena/issues/1633#issuecomment-1326277317

   > I don't remember if there is a registry for streaming writers
   
   There is. `StreamRDFWriter`.
   
   _opt-in behaviour_
   
   Yes.
   
   It could be a new (custom) service delivered as a Fuseki module. Simplest case - a server that calls `constructTriples` and streams back N-triples or one of the Turtle formats that is streaming.
   
   This can be done as a split between a SELECT query stream returning the WHERE clause and a client side processing to apply the template. 
   
   That gives the caller a way to control the potentially very large stream that "disappears" in the set semantics of CONSTRUCT.
   
   If they don't care about everything, just the streaming, `SELECT REDUCED` (or with LATERAL, limited per results). There are options here so a pushing all work to Fuseki may not that helpful.
   
   The stream could be chunks - or return results to the application in certain orders like same subject - via a combination of SELECT query and chunking results in the client side processing.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@jena.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@jena.apache.org
For additional commands, e-mail: issues-help@jena.apache.org