You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by "MrAsanjar ." <af...@gmail.com> on 2014/06/24 03:37:36 UTC

apache spark 1.0.0 sha1 & md5 checksum fails

source : http://www.apache.org/dist/spark/spark-1.0.0/
looks like spark-1.0.0-bin-hadoop2.tgz.sha content is not valid. Am I using
wrong checksum tool?

==> sha1sum  spark-1.0.0-bin-hadoop2.tgz
804fe9a0caff941fb791e15ea1cda45a7c2b7608  spark-1.0.0-bin-hadoop2.tgz

===> cat spark-1.0.0-bin-hadoop2.tgz.sha
spark-1.0.0-bin-hadoop2.tgz: C1CB5541 94660B15 4536AD32 F5090820 48CB31D2
                             5FB45EEC A17F0CBE 087127C1 AC205F20 46D3C96B
                             169262D8 460EDA83 6BA080D8 F9431DCE 1372265C
                             F730A02C


sha1sum -c spark-1.0.0-bin-hadoop2.tgz.sha
sha1sum: spark-1.0.0-bin-hadoop2.tgz.sha: no properly formatted SHA1
checksum lines found

same with md5

Re: apache spark 1.0.0 sha1 & md5 checksum fails

Posted by Sean Owen <so...@cloudera.com>.
I ran into this before. The algorithm is SHA-512, not SHA-1. On OS X,
for example, try:

shasum -a 512 spark-1.0.0-bin-hadoop2.tgz

... and you will get the right answer. The .sha file is not quite
formatted in the way shasum expects to read it, I find. It expects

c1cb554194660b154536ad32f509082048cb31d25fb45eeca17f0cbe087127c1ac205f2046d3c96b169262d8460eda836ba080d8f9431dce1372265cf730a02c
 spark-1.0.0-bin-hadoop2.tgz

But the file is like

spark-1.0.0-bin-hadoop2.tgz: C1CB5541 94660B15 4536AD32 F5090820 48CB31D2
                             5FB45EEC A17F0CBE 087127C1 AC205F20 46D3C96B
                             169262D8 460EDA83 6BA080D8 F9431DCE 1372265C
                             F730A02C

On Tue, Jun 24, 2014 at 2:37 AM, MrAsanjar . <af...@gmail.com> wrote:
> source : http://www.apache.org/dist/spark/spark-1.0.0/
> looks like spark-1.0.0-bin-hadoop2.tgz.sha content is not valid. Am I using
> wrong checksum tool?
>
> ==> sha1sum  spark-1.0.0-bin-hadoop2.tgz
> 804fe9a0caff941fb791e15ea1cda45a7c2b7608  spark-1.0.0-bin-hadoop2.tgz
>
> ===> cat spark-1.0.0-bin-hadoop2.tgz.sha
> spark-1.0.0-bin-hadoop2.tgz: C1CB5541 94660B15 4536AD32 F5090820 48CB31D2
>                              5FB45EEC A17F0CBE 087127C1 AC205F20 46D3C96B
>                              169262D8 460EDA83 6BA080D8 F9431DCE 1372265C
>                              F730A02C
>
>
> sha1sum -c spark-1.0.0-bin-hadoop2.tgz.sha
> sha1sum: spark-1.0.0-bin-hadoop2.tgz.sha: no properly formatted SHA1
> checksum lines found
>
> same with md5