You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "mark pettovello (Jira)" <ji...@apache.org> on 2020/01/21 01:24:00 UTC

[jira] [Created] (HADOOP-16816) Please remove or minimize need for native libraries "winutils" to run Spark locally on Windows.

mark pettovello created HADOOP-16816:
----------------------------------------

             Summary: Please remove or minimize need for native libraries "winutils" to run Spark locally on Windows.
                 Key: HADOOP-16816
                 URL: https://issues.apache.org/jira/browse/HADOOP-16816
             Project: Hadoop Common
          Issue Type: Improvement
          Components: auth, bin, common, native
    Affects Versions: 3.1.3, 3.2.1
         Environment: Windows
            Reporter: mark pettovello


Please remove the need for building and using custom native libraries "winutils" to run Spark on Windows systems just to run Spark & similar.

Reference: [https://github.com/steveloughran/winutils]

If native libraries are needed for performance benefits then please try to load the native libraries and then if not found then provide and use a functional equivalent Java implementation such that Spark will build and run applications using only Java. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org