You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/10/18 02:24:00 UTC

[jira] [Commented] (SPARK-22302) Remove manual backports for subprocess.check_output and check_call

    [ https://issues.apache.org/jira/browse/SPARK-22302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208722#comment-16208722 ] 

Apache Spark commented on SPARK-22302:
--------------------------------------

User 'HyukjinKwon' has created a pull request for this issue:
https://github.com/apache/spark/pull/19524

> Remove manual backports for subprocess.check_output and check_call
> ------------------------------------------------------------------
>
>                 Key: SPARK-22302
>                 URL: https://issues.apache.org/jira/browse/SPARK-22302
>             Project: Spark
>          Issue Type: Improvement
>          Components: Project Infra
>    Affects Versions: 2.3.0
>            Reporter: Hyukjin Kwon
>            Priority: Trivial
>
> This JIRA is loosely related with SPARK-21573. Python 2.6 could be used in Jenkins given the past cases and investigations up to my knowledge and it looks failing to execute some other scripts.
> In this particular case, it was:
> {code}
> cd dev && python2.6
> {code}
> {code}
> >>> from sparktestsupport import shellutils
> >>> shellutils.subprocess_check_call("ls")
> Traceback (most recent call last):
>   File "<stdin>", line 1, in <module>
>   File "sparktestsupport/shellutils.py", line 46, in subprocess_check_call
>     retcode = call(*popenargs, **kwargs)
> NameError: global name 'call' is not defined
> {code}
> Please see https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3950/console
> Since we dropped the Python 2.6.x support, looks better we remove those workarounds and print out explicit error messages in order to duplicate the efforts to find out the root causes for such cases.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org