You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@systemds.apache.org by Matthias Boehm <mb...@gmail.com> on 2022/01/23 14:38:24 UTC

Latest Spark and Hadoop Versions on Windows

Hi all,

a recent change eagerly set the spark and hadoop versions to the latest 
minor versions. If you face problems on windows, please remember to 
update your winutils setup (e.g., system-wide installation of 
pre-compiled artifacts). Trustworthy sources [1] do not yet provide the 
hadoop 3.3 utils but the 3.2 utils seem to work as well.

[1] https://github.com/cdarlint/winutils/tree/master/hadoop-3.2.2/bin

Regards,
Matthias