You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by karuppayya <ka...@gmail.com> on 2018/02/20 03:00:27 UTC

Errors when running unit tests

Hi ,
I get errors like below when trying to run the spark unit tests

zipPartitions(test.org.apache.spark.Java8RDDAPISuite)  Time elapsed: 2.212
> sec  <<< ERROR!
> java.lang.IllegalStateException: failed to create a child event loop
> at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54)
> Caused by: io.netty.channel.ChannelException: failed to open a new
> selector
> at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54)
> Caused by: java.io.IOException:* Too many open files*
> at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54)


I am running unit tests from version 2.2.1 with following system config

> $ sysctl fs.file-max
> fs.file-max = 100000
> $ ulimit -u
> 65536


Command line used:

>  build/mvn -Phadoop-2.6 -Pyarn -Phive -Phive-thriftserver -Pkinesis-asl
> -Pmesos --fail-at-end test


 Any pointers on this will be helpful

Thanks
Karuppayya