You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Marc Pellmann (Jira)" <ji...@apache.org> on 2022/08/04 10:45:00 UTC

[jira] [Created] (NIFI-10314) Processing big data with the WebSocket processors

Marc Pellmann created NIFI-10314:
------------------------------------

             Summary: Processing big data with the WebSocket processors
                 Key: NIFI-10314
                 URL: https://issues.apache.org/jira/browse/NIFI-10314
             Project: Apache NiFi
          Issue Type: Improvement
    Affects Versions: 1.17.0
            Reporter: Marc Pellmann


I would like to transfer large messages via WebSockets, which potentially do not fit into the memory or NiFi should not be heavily loaded with them. 
 
In the processors an implementation is currently chosen that works with byte arrays. 
 
It could either be derived from WebSocketPartialListener instead of WebSocketListener to stream large messages (https://www.eclipse.org/jetty/documentation/jetty-11/programming-guide/index.html#pg-message-streaming-reads). 
 
Or the JSR-356 interface could be used and work directly with an InputStream (https://github.com/eclipse/jetty.project/tree/jetty-9.4.x/jetty-websocket/javax-websocket-server-impl). However, this will block the thread.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)