[jira] [Created] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image

["Richard Kugler (JIRA)" <ji...@apache.org>]

Richard Kugler created SPARK-25516:
--------------------------------------

             Summary: spark-history and spark-shuffle-service scripts can not run in docker image
                 Key: SPARK-25516
                 URL: https://issues.apache.org/jira/browse/SPARK-25516
             Project: Spark
          Issue Type: Bug
          Components: Kubernetes
    Affects Versions: 2.3.1
         Environment: Docker 18.06
            Reporter: Richard Kugler


When attempting to run ./sbin/start-shuffle-service.sh the image errors with the following output:
{noformat}
ps: unrecognized option: p
{noformat}
Adding the {{procps}} package fixes this issue.


After correcting the issue with {{ps}}, the code will then error with:
{{}}
{noformat}
nohup: can't execute '--': No such file or directory{noformat}
This is remedied with the inclusion of {{coreutils}} to the apk add statement.

 

 

The ./sbin/start-history-server.sh also requires the added packages to successfully start.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org