[GitHub] cbickel opened a new pull request #2878: Streamingly read user-logs.

[GitBox <gi...@apache.org>]

cbickel opened a new pull request #2878: Streamingly read user-logs.
URL: https://github.com/apache/incubator-openwhisk/pull/2878
 
 
   Reading the user logs with synchronous APIs is cumbersome and not very efficient.
   
   This uses akka-streams and its various connectors to read a user's log file in a streaming fashion.
   
   **Note:** `Sink.seq` of course still needs to read the whole log-lines upon the user's limit into memory. This is a limitation of our current logs API where we store all logs inside a JsObject. In the future this will likely change so this can be seen as a step towards true streaming of those logs.
   
   **Note 2:** The limit calculation is altered in this PR in that the user's limit *includes* any metadata from the logs (timestamp and stream) vs. only taking the message into account.
   
   **TODO:**
   
   - [ ] Tests (of course ? )

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services