Streaming topology tests to use CollectionEnvironment

[Hermann Gábor <re...@gmail.com>]

Hey all,

Currently streaming topology tests use TestStreamEnvironment and static
collections as sinks for assertion. I see that that the batch API tests use
CollectionEnvironment for this purpose.

Is there any reason streaming do not have something like that?
I think it would be more compact and safe to implement and use a similar
environment in streaming too.

If there is no objection, I'll open a JIRA ticket for this.

Cheers,
Gabor

Re: Streaming topology tests to use CollectionEnvironment

[Stephan Ewen <se...@apache.org>]

The CollectionsEnvironment is a different execution backend for the Batch
API - based entirely on Java Collections. The use case for this backend is
to embed Flink programs into other programs in an extremely lightweight
fashion, without threading overheads, serialization, anything.

The tests are simply executed twice - once against a local flink test
cluster, once against the collection execution backend.

Since the collection execution is really collections and batch strictly,
there is no simple way to apply this to the streaming API.

Stephan


On Mon, Mar 16, 2015 at 4:53 PM, Hermann Gábor <re...@gmail.com> wrote:

> Hey all,
>
> Currently streaming topology tests use TestStreamEnvironment and static
> collections as sinks for assertion. I see that that the batch API tests use
> CollectionEnvironment for this purpose.
>
> Is there any reason streaming do not have something like that?
> I think it would be more compact and safe to implement and use a similar
> environment in streaming too.
>
> If there is no objection, I'll open a JIRA ticket for this.
>
> Cheers,
> Gabor
>