You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Loki Coyote (Jira)" <ji...@apache.org> on 2020/01/30 16:02:00 UTC

[jira] [Commented] (SPARK-30683) Validating sha512 files for releases does not comply with Apache Project documentation

    [ https://issues.apache.org/jira/browse/SPARK-30683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17026785#comment-17026785 ] 

Loki Coyote commented on SPARK-30683:
-------------------------------------

This command seems like it would work for conversion and validation on most linux distros:
{code:bash}
cat spark-2.4.4-bin-hadoop2.7.tgz.sha512 | tr '\n' ' '| tr -d ' ' | awk -F ':' '{ print $2 "\t" $1 }'| sha512sum -c -
{code}

> Validating sha512 files for releases does not comply with Apache Project documentation
> --------------------------------------------------------------------------------------
>
>                 Key: SPARK-30683
>                 URL: https://issues.apache.org/jira/browse/SPARK-30683
>             Project: Spark
>          Issue Type: Improvement
>          Components: Project Infra
>    Affects Versions: 2.3.0, 2.4.0, 2.4.4
>            Reporter: Loki Coyote
>            Priority: Minor
>
> Spark release artifacts currently use gpg generated sha512 files.  These are not in the same format as ones generated via sha512sum, and can not be validated easily using sha512sum.  As the [Apache Project instructions|https://www.apache.org/info/verification.html] for how to validate a release explicitly instructs the use of sha512sum compatible tools, there is no documentation for successfully validating a downloaded release using the sha512 file.
>  
> This subject has been [brought up before|https://www.mail-archive.com/dev@spark.apache.org/msg20140.html] and an issue to change to using sha512sum compatible formats was closed as WontFix with little discussion; even if switching isn't warranted, at the least instructions for validating using the sha512 files should be documented.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org