You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Matthew Goodman (JIRA)" <ji...@apache.org> on 2015/06/01 20:19:18 UTC

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

    [ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567685#comment-14567685 ] 

Matthew Goodman commented on SPARK-7909:
----------------------------------------

Awesome, thanks for all the help on this.  There is one (possibly unrelated) issue remains, which is that httpd seems to fail to startup, giving the following traceback:

{code:title=HTTPD Failure Traceback|borderStyle=solid}
Starting httpd: httpd: Syntax error on line 154 of /etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object file: No such file or directory
{code}

Should I send in a PR [for this change|https://github.com/3Scan/spark-ec2/commit/3416dd07c492b0cddcc98c4fa83f9e4284ed8fc9]?  

> spark-ec2 and associated tools not py3 ready
> --------------------------------------------
>
>                 Key: SPARK-7909
>                 URL: https://issues.apache.org/jira/browse/SPARK-7909
>             Project: Spark
>          Issue Type: Improvement
>          Components: EC2
>         Environment: ec2 python3
>            Reporter: Matthew Goodman
>
> At present there is not a possible permutation of tools that supports Python3 on both the launching computer and running cluster.  There are a couple problems involved:
>  - There is no prebuilt spark binary with python3 support.
>  - spark-ec2/spark/init.sh contains inline py3 unfriendly print statements
>  - Config files for cluster processes don't seem to make it to all nodes in a working format.
> I have fixes for some of this, but the config and running context debugging remains elusive to me.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org