Hadoop is not working in dev environment on windows [since 2.7.7 update]. Thanks.

[Janardhan <ja...@gmail.com>]

Hi,

Since 2.7.7 update, my hadoop and winutils [prebuilt winutils.exe not
available] is not working because of file permissions.

As a workaround I have changed hadoop source locally to bypass the access
check.

But, is there any way one could run the tests without hadoop. spark-submit
is working fine for me.

Thanks,
Janardhan

Re: Hadoop is not working in dev environment on windows [since 2.7.7 update]. Thanks.

[Berthold Reinwald <re...@us.ibm.com>]

Please take a look at our setup instructions for windows that we created a 
while back for our KDD Tutorial. You may need to download a newer version 
of winutils from https://github.com/steveloughran/winutils, and don't 
forget to chmod the permissions.

The attached instructions are from 2017, so you need to adjust your 
versions.





From:   Janardhan <ja...@gmail.com>
To:     Niketan Pansare <np...@us.ibm.com>, dev@systemml.apache.org, 
Matthias Boehm <mb...@gmail.com>
Date:   03/05/2019 07:54 PM
Subject:        Hadoop is not working in dev environment on windows [since 
2.7.7 update]. Thanks.



Hi,

Since 2.7.7 update, my hadoop and winutils [prebuilt winutils.exe not
available] is not working because of file permissions.

As a workaround I have changed hadoop source locally to bypass the access
check.

But, is there any way one could run the tests without hadoop. spark-submit
is working fine for me.

Thanks,
Janardhan