You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2020/03/03 04:12:00 UTC
[jira] [Comment Edited] (SPARK-31011) Failed to register signal
handler for PWR
[ https://issues.apache.org/jira/browse/SPARK-31011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049880#comment-17049880 ]
Jungtaek Lim edited comment on SPARK-31011 at 3/3/20 4:11 AM:
--------------------------------------------------------------
[https://en.wikipedia.org/wiki/Signal_(IPC)]
According to the wikipedia, SIGPWR is NOT listed in the POSIX specification, so we may need to handle such case, at least provide better message instead of random message.
But in anyway, looks like it should just leave warn message and doesn't break functionality other than effectively disabling decommission. If the application is failed, that's something we should take a look. (Please add OS version as well.)
was (Author: kabhwan):
According to the wikipedia, SIGPWR is NOT listed in the POSIX specification, so we may need to handle such case, at least provide better message instead of random message.
But in anyway, looks like it should just leave warn message and doesn't break functionality other than effectively disabling decommission. If the application is failed, that's something we should take a look. (Please add OS version as well.)
> Failed to register signal handler for PWR
> -----------------------------------------
>
> Key: SPARK-31011
> URL: https://issues.apache.org/jira/browse/SPARK-31011
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: Gabor Somogyi
> Priority: Major
>
> I've just tried to test something on standalone mode but the application fails.
> Environment:
> * Scala 2.12.10
> * Java 1.8.0_241-b07
> Steps to reproduce:
> * Compile Spark
> * ./sbin/start-master.sh
> * ./sbin/start-slave.sh spark://host:7077
> * submit an empty application
> Error:
> {code:java}
> 20/03/02 14:25:44 INFO SignalUtils: Registering signal handler for PWR
> 20/03/02 14:25:44 WARN SignalUtils: Failed to register signal handler for PWR
> java.lang.IllegalArgumentException: Unknown signal: PWR
> at sun.misc.Signal.<init>(Signal.java:143)
> at org.apache.spark.util.SignalUtils$.$anonfun$register$1(SignalUtils.scala:64)
> at scala.collection.mutable.HashMap.getOrElseUpdate(HashMap.scala:86)
> at org.apache.spark.util.SignalUtils$.register(SignalUtils.scala:62)
> at org.apache.spark.executor.CoarseGrainedExecutorBackend.onStart(CoarseGrainedExecutorBackend.scala:85)
> at org.apache.spark.rpc.netty.Inbox.$anonfun$process$1(Inbox.scala:120)
> at org.apache.spark.rpc.netty.Inbox.safelyCall(Inbox.scala:203)
> at org.apache.spark.rpc.netty.Inbox.process(Inbox.scala:100)
> at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:75)
> at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org