[jira] [Commented] (TEZ-2718) Issue while running the Tez in Local Mode on Windows

["Bikas Saha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695703#comment-14695703 ] 

Bikas Saha commented on TEZ-2718:
---------------------------------

The stack trace you are showing is not Tez local mode. This is running the MiniDFSCluster which is Hadoop code. In order to run Hadoop code on Windows there are some pre-requisites like having some native code (e.g. winutils.exe/hadoop.dll) on the Windows path. Please ensure that the native code is available on the path. You will get the native code from the Hadoop build on windows. Please follow the instructions in the Windows section of Hadoop building.txt in case you are building it from scratch.

> Issue while running the Tez in Local Mode on Windows
> ----------------------------------------------------
>
>                 Key: TEZ-2718
>                 URL: https://issues.apache.org/jira/browse/TEZ-2718
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.6.1
>         Environment: Windows 7 (32 bit)
>            Reporter: Sanjay Maurya
>            Priority: Minor
>
> what pre-requisites are needed to run the tez in Local Mode? Do I need to have the local hadoop setup when runnning Tez in Local mode? I assumption is the local mode will build its own hadoop prototype setup.
> I built the tez 0.6.1 on my local environment (OS: windows ) and trying run the test org.apache.tez.test.TestTezJobs and got the following error:
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> Running org.apache.tez.test.TestTezJobs
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.105 sec <<< FAILURE!
> org.apache.tez.test.TestTezJobs  Time elapsed: 4.104 sec  <<< ERROR!
> java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
>         at org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Native Method)
>         at org.apache.hadoop.io.nativeio.NativeIO$Windows.access(NativeIO.java:557)
>         at org.apache.hadoop.fs.FileUtil.canWrite(FileUtil.java:996)
>         at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:490)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:308)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:202)
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1020)
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:739)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:536)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:595)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:762)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:746)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1107)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:978)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:807)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:467)
>         at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:426)
>         at org.apache.tez.test.TestTezJobs.setup(TestTezJobs.java:114)
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)