Cannot run Storm WordCountLocal

["Matthias J. Sax" <mj...@apache.org>]

Hi,

I cannot run WordCountLocal example of flink-storm-example in Eclipse.
The ITCase for it works, but it is using a test environment. If I start
WordCountLocal directly it uses FlinkMiniCluster and I get the following
exception:

> org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Not enough free slots available to run the job. You can decrease the operator parallelism or increase the number of slots per TaskManager in the configuration. Task to schedule: < Attempt #0 (tokenizer (2/4)) @ (unassigned) - [SCHEDULED] > with groupID < e86ddd0aa99173f6781be2bce861e897 > in sharing group < SlotSharingGroup [d740211315a07b8e0ee58abb480ee0c4, 6031cd5b189d5a0f46afdc1913660dad, 94b1c37969b9bb3d66e5c09099fa04a2, e86ddd0aa99173f6781be2bce861e897] >. Resources available to scheduler: Number of instances=1, total number of slots=1, available slots=0

I have no idea how to fix this. Any help on this, would be great.


-Matthias

Re: Cannot run Storm WordCountLocal

[Stephan Ewen <se...@apache.org>]

The mini cluster is started with not enough slots. I would guess that it is
luck that the IT case works because the test environment probably uses a
simple default of 4 slots or so for the mini cluster.

The LocalEnvironment in the DataSet API actually makes a pass over the
operators to see how many operators are executed and how they share the
slots, to compute how many slots are needed when the mini cluster is
started. I assume you need something similar here.

On Thu, Oct 8, 2015 at 1:18 AM, Matthias J. Sax <mj...@apache.org> wrote:

> Hi,
>
> I cannot run WordCountLocal example of flink-storm-example in Eclipse.
> The ITCase for it works, but it is using a test environment. If I start
> WordCountLocal directly it uses FlinkMiniCluster and I get the following
> exception:
>
> >
> org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException:
> Not enough free slots available to run the job. You can decrease the
> operator parallelism or increase the number of slots per TaskManager in the
> configuration. Task to schedule: < Attempt #0 (tokenizer (2/4)) @
> (unassigned) - [SCHEDULED] > with groupID <
> e86ddd0aa99173f6781be2bce861e897 > in sharing group < SlotSharingGroup
> [d740211315a07b8e0ee58abb480ee0c4, 6031cd5b189d5a0f46afdc1913660dad,
> 94b1c37969b9bb3d66e5c09099fa04a2, e86ddd0aa99173f6781be2bce861e897] >.
> Resources available to scheduler: Number of instances=1, total number of
> slots=1, available slots=0
>
> I have no idea how to fix this. Any help on this, would be great.
>
>
> -Matthias
>
>