You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by karuppayya <ka...@gmail.com> on 2018/02/20 03:00:27 UTC
Errors when running unit tests
Hi ,
I get errors like below when trying to run the spark unit tests
zipPartitions(test.org.apache.spark.Java8RDDAPISuite) Time elapsed: 2.212
> sec <<< ERROR!
> java.lang.IllegalStateException: failed to create a child event loop
> at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54)
> Caused by: io.netty.channel.ChannelException: failed to open a new
> selector
> at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54)
> Caused by: java.io.IOException:* Too many open files*
> at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54)
I am running unit tests from version 2.2.1 with following system config
> $ sysctl fs.file-max
> fs.file-max = 100000
> $ ulimit -u
> 65536
Command line used:
> build/mvn -Phadoop-2.6 -Pyarn -Phive -Phive-thriftserver -Pkinesis-asl
> -Pmesos --fail-at-end test
Any pointers on this will be helpful
Thanks
Karuppayya