[D] Removing support for different messaging formats?

["dominikriemer (via GitHub)" <gi...@apache.org>]

GitHub user dominikriemer created a discussion: Removing support for different messaging formats?

Hi,
while looking at ways for further simplifying our data model, I was asking myself if we should remove support for different transport formats.
Currently, pipeline elements can define their own supported transport formats and StreamPipes currently supports the formats defined in the `streampipes-dataformat-x`modules.
I don't think there is currently much value in letting users define the internally used data format. So I suggest to simplify this and only support a single data format. This would also ease things in the future if we decide to go for another format such as protobufs to better handle our various client implementations.

What do you think - are there any arguments to keep the existing approach?

GitHub link: https://github.com/apache/streampipes/discussions/3149

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org

Re: [D] Removing support for different messaging formats?

["dominikriemer (via GitHub)" <gi...@apache.org>]

GitHub user dominikriemer added a comment to the discussion: Removing support for different messaging formats?

I'd suggest to keep plain JSON for now since it's the default format we've used in the past. In the mid-term future I'd personally like to switch over to some binary representation.

GitHub link: https://github.com/apache/streampipes/discussions/3149#discussioncomment-10387422

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org

Re: [D] Removing support for different messaging formats?

["bossenti (via GitHub)" <gi...@apache.org>]

GitHub user bossenti added a comment to the discussion: Removing support for different messaging formats?

Hi,

I'm also in favor of simplifying StreamPipes to that extent. I currently can't think of any real downside for end users by supporting only a single messaging format :) 

Do you already have a preference for which messaging format to keep?

GitHub link: https://github.com/apache/streampipes/discussions/3149#discussioncomment-10360932

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org

Re: [D] Removing support for different messaging formats?

["tenthe (via GitHub)" <gi...@apache.org>]

GitHub user tenthe added a comment to the discussion: Removing support for different messaging formats?

Hi @dominikriemer,

thanks a lot for starting the discussion.
I am in favor of this idea. Simplifying the model by supporting a single data format will reduce complexity without sacrificing any essential functionality. 

Cheers,
Philipp

GitHub link: https://github.com/apache/streampipes/discussions/3149#discussioncomment-10355761

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org