You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by Philipp Zehnder <ze...@apache.org> on 2020/02/10 14:23:59 UTC

[DISCUSS] Store images in datalake

Hi all,

I am currently working on a solution to store images in the data lake.
Currently we persist all data in an influx db. But I do not think that it makes sense to store base64 encoded images in a time-series database.
So my suggestion would be to check the domain property of events and store images in files stored in a Docker volume and add a reference to this file in the event stored in influx.

To browse through the images, we also have to extend the data lake API.

I will provide a first prototype for this feature that we can evaluate. Please write if you have any further suggestions or ideas.

Cheers,
Philipp