You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by Gyula Fóra <gy...@apache.org> on 2015/03/01 17:03:10 UTC

Taskmanager memory error in Eclipse

Hey All,

I am getting a weird error in Eclipse when trying to run local flink
programs for example any batch or streaming example program. I tried
cleaning, rebuilding reimporting etc that didnt help.

Please see the log and stack trace:

....

16:55:04,965 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Using *17592186044414* MB for Flink managed memory.
16:55:04,965 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Messages between TaskManager and JobManager have a max timeout of
100000 milliseconds
16:55:04,978 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager
- I/O manager uses directory
/var/folders/4y/dpsxf3jx5dbgcvc04cv2cnyw0000gn/T/flink-io-3077a345-52c3-423b-886a-ca3aeb8e37cc
for spill files.

16:55:04,983 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Starting task manager at akka://flink/user/taskmanager_1.
16:55:04,986 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Creating 8 task slot(s).

16:55:04,986 INFO org.apache.flink.runtime.taskmanager.TaskManager
- TaskManager connection information localhost (dataPort=58284).
16:55:04,990 ERROR akka.actor.OneForOneStrategy
- exception during creation

...

And the relevant part of the stack trace:

Caused by: java.lang.IllegalArgumentException: Size of total memory must be
positive.
at org.apache.flink.runtime.memorymanager.DefaultMemoryManager.<init>(
DefaultMemoryManager.java:101)
at org.apache.flink.runtime.taskmanager.TaskManager.<init>(
TaskManager.scala:114)
... 18 more

So it seems that the task managers want to allocate too much memory.

Regards,

Gyula

Re: Taskmanager memory error in Eclipse

Posted by Stephan Ewen <se...@apache.org>.

Seems like an overflow/underflow Problem. I'm working on the TaskManager
startup atm. Can take a look...
Am 01.03.2015 19:10 schrieb "Gyula Fóra" <gy...@apache.org>:

> Setting the JVM heap larger solves this issue, but I still think that this
> is a misleading error.
>
> With -Xmx256m it works.
>
> On Sun, Mar 1, 2015 at 5:03 PM, Gyula Fóra <gy...@apache.org> wrote:
>
> > Hey All,
> >
> > I am getting a weird error in Eclipse when trying to run local flink
> > programs for example any batch or streaming example program. I tried
> > cleaning, rebuilding reimporting etc that didnt help.
> >
> > Please see the log and stack trace:
> >
> > ....
> >
> > 16:55:04,965 INFO  org.apache.flink.runtime.taskmanager.TaskManager
> >       - Using *17592186044414* MB for Flink managed memory.
> > 16:55:04,965 INFO  org.apache.flink.runtime.taskmanager.TaskManager
> >       - Messages between TaskManager and JobManager have a max timeout of
> > 100000 milliseconds
> > 16:55:04,978 INFO  org.apache.flink.runtime.io.disk.iomanager.IOManager
> >       - I/O manager uses directory
> >
> /var/folders/4y/dpsxf3jx5dbgcvc04cv2cnyw0000gn/T/flink-io-3077a345-52c3-423b-886a-ca3aeb8e37cc
> > for spill files.
> >
> > 16:55:04,983 INFO  org.apache.flink.runtime.taskmanager.TaskManager
> >       - Starting task manager at akka://flink/user/taskmanager_1.
> > 16:55:04,986 INFO  org.apache.flink.runtime.taskmanager.TaskManager
> >       - Creating 8 task slot(s).
> >
> > 16:55:04,986 INFO  org.apache.flink.runtime.taskmanager.TaskManager
> >       - TaskManager connection information localhost (dataPort=58284).
> > 16:55:04,990 ERROR akka.actor.OneForOneStrategy
> >        - exception during creation
> >
> > ...
> >
> > And the relevant part of the stack trace:
> >
> > Caused by: java.lang.IllegalArgumentException: Size of total memory must
> > be positive.
> > at org.apache.flink.runtime.memorymanager.DefaultMemoryManager.<init>(
> > DefaultMemoryManager.java:101)
> > at org.apache.flink.runtime.taskmanager.TaskManager.<init>(
> > TaskManager.scala:114)
> > ... 18 more
> >
> >
> > So it seems that the task managers want to allocate too much memory.
> >
> > Regards,
> >
> > Gyula
> >
>

Re: Taskmanager memory error in Eclipse

Posted by Gyula Fóra <gy...@apache.org>.

Setting the JVM heap larger solves this issue, but I still think that this
is a misleading error.

With -Xmx256m it works.

On Sun, Mar 1, 2015 at 5:03 PM, Gyula Fóra <gy...@apache.org> wrote:

> Hey All,
>
> I am getting a weird error in Eclipse when trying to run local flink
> programs for example any batch or streaming example program. I tried
> cleaning, rebuilding reimporting etc that didnt help.
>
> Please see the log and stack trace:
>
> ....
>
> 16:55:04,965 INFO  org.apache.flink.runtime.taskmanager.TaskManager
>       - Using *17592186044414* MB for Flink managed memory.
> 16:55:04,965 INFO  org.apache.flink.runtime.taskmanager.TaskManager
>       - Messages between TaskManager and JobManager have a max timeout of
> 100000 milliseconds
> 16:55:04,978 INFO  org.apache.flink.runtime.io.disk.iomanager.IOManager
>       - I/O manager uses directory
> /var/folders/4y/dpsxf3jx5dbgcvc04cv2cnyw0000gn/T/flink-io-3077a345-52c3-423b-886a-ca3aeb8e37cc
> for spill files.
>
> 16:55:04,983 INFO  org.apache.flink.runtime.taskmanager.TaskManager
>       - Starting task manager at akka://flink/user/taskmanager_1.
> 16:55:04,986 INFO  org.apache.flink.runtime.taskmanager.TaskManager
>       - Creating 8 task slot(s).
>
> 16:55:04,986 INFO  org.apache.flink.runtime.taskmanager.TaskManager
>       - TaskManager connection information localhost (dataPort=58284).
> 16:55:04,990 ERROR akka.actor.OneForOneStrategy
>        - exception during creation
>
> ...
>
> And the relevant part of the stack trace:
>
> Caused by: java.lang.IllegalArgumentException: Size of total memory must
> be positive.
> at org.apache.flink.runtime.memorymanager.DefaultMemoryManager.<init>(
> DefaultMemoryManager.java:101)
> at org.apache.flink.runtime.taskmanager.TaskManager.<init>(
> TaskManager.scala:114)
> ... 18 more
>
>
> So it seems that the task managers want to allocate too much memory.
>
> Regards,
>
> Gyula
>