You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Xiao Liang (JIRA)" <ji...@apache.org> on 2018/05/10 09:58:00 UTC
[jira] [Commented] (HADOOP-15454)
TestRollingFileSystemSinkWithLocal fails on Windows
[ https://issues.apache.org/jira/browse/HADOOP-15454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470169#comment-16470169 ]
Xiao Liang commented on HADOOP-15454:
-------------------------------------
Current test result on Windows(before patch):
{color:#d04437}[INFO] Results:{color}
{color:#d04437}[INFO]{color}
{color:#d04437}[ERROR] Failures:{color}
{color:#d04437}[ERROR] TestRollingFileSystemSinkWithLocal.testSilentFailedWrite:145 An exception was generated while writing metrics when the target directory was not writable, even though the sink is set to ignore errors{color}
{color:#d04437}[ERROR] Errors:{color}
{color:#d04437}[ERROR] TestRollingFileSystemSinkWithLocal.testExistingWrite:67->RollingFileSystemSinkTestBase.doAppendTest:389->RollingFileSystemSinkTestBase.preCreateLogFile:412->RollingFileSystemSinkTestBase.preCreateLogFile:434 » URISyntax{color}
{color:#d04437}[ERROR] TestRollingFileSystemSinkWithLocal.testExistingWrite2:81->RollingFileSystemSinkTestBase.preCreateLogFile:434 » URISyntax{color}
{color:#d04437}[ERROR] TestRollingFileSystemSinkWithLocal.testSilentExistingWrite:96->RollingFileSystemSinkTestBase.doAppendTest:389->RollingFileSystemSinkTestBase.preCreateLogFile:412->RollingFileSystemSinkTestBase.preCreateLogFile:434 » URISyntax{color}
{color:#d04437}[ERROR] TestRollingFileSystemSinkWithLocal.testSilentWrite:55->RollingFileSystemSinkTestBase.doWriteTest:231->RollingFileSystemSinkTestBase.readLogFile:250 » URISyntax{color}
{color:#d04437}[ERROR] TestRollingFileSystemSinkWithLocal.testWrite:42->RollingFileSystemSinkTestBase.doWriteTest:231->RollingFileSystemSinkTestBase.readLogFile:250 » URISyntax{color}
{color:#d04437}[INFO]{color}
{color:#d04437}[ERROR] Tests run: 7, Failures: 1, Errors: 5, Skipped: 0{color}
With the patch:
{color:#14892c}[INFO] -------------------------------------------------------{color}
{color:#14892c}[INFO] T E S T S{color}
{color:#14892c}[INFO] -------------------------------------------------------{color}
{color:#14892c}[INFO] Running org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal{color}
{color:#14892c}[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.032 s - in org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO] Results:{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0{color}
> TestRollingFileSystemSinkWithLocal fails on Windows
> ---------------------------------------------------
>
> Key: HADOOP-15454
> URL: https://issues.apache.org/jira/browse/HADOOP-15454
> Project: Hadoop Common
> Issue Type: Test
> Reporter: Xiao Liang
> Assignee: Xiao Liang
> Priority: Major
> Labels: windows
> Attachments: HADOOP-15454-branch-2.000.patch, HADOOP-15454.000.patch
>
>
> org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal fails on Windows,
> *Error message:*
> Illegal character in opaque part at index 2: D:\_work\8\s\hadoop-common-project\hadoop-common\target\test\data\4\RollingFileSystemSinkTest\testSilentExistingWrite
> *Stack trace:*
> java.io.IOException: All datanodes [DatanodeInfoWithStorage[127.0.0.1:53235,DS-4d6119ac-31cc-4f48-8a5b-7f35b36a1c55,DISK]] are bad. Aborting... at org.apache.hadoop.hdfs.DataStreamer.handleBadDatanode(DataStreamer.java:1538) at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1472) at org.apache.hadoop.hdfs.DataStreamer.processDatanodeError(DataStreamer.java:1244) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:663)
> Drive letter in absolute path in Windows will fail the underlying URI check.
> Another issue is that for the failed write test case java.io.File#setWritable(boolean, boolean) is used, which does not work as expected on Windows and should be replaced by org.apache.hadoop.fs.FileUtil#setWritable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org