You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by "Josh Wills (JIRA)" <ji...@apache.org> on 2017/10/27 04:30:00 UTC

[jira] [Resolved] (CRUNCH-652) SourceTargetHelperTest became flaky when upgrading to hadoop 3.0.0

     [ https://issues.apache.org/jira/browse/CRUNCH-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills resolved CRUNCH-652.
-------------------------------
       Resolution: Fixed
         Assignee: Josh Wills
    Fix Version/s: 1.0.0

Pushed to master; seems like a good thing to have regardless of when we upgrade. Thanks Gergo!

> SourceTargetHelperTest became flaky when upgrading to hadoop 3.0.0
> ------------------------------------------------------------------
>
>                 Key: CRUNCH-652
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-652
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Gergo Repas
>            Assignee: Josh Wills
>            Priority: Minor
>             Fix For: 1.0.0
>
>         Attachments: CRUNCH-652_v01.patch
>
>
> Problem description: org.apache.crunch.io.SourceTargetHelperTest became flaky - it failed when its testGetNonExistentPathSize_NonExistantPath() method ran first
> Root cause: due to upgrading the hadoop version to 3.0.0, the org.apache.hadoop.fs.FsTracer singleton has been pulled in, which throws an NPE when initialized with a filesystem that has null configuration. SourceTargetHelperTest.MockFileSystem.fs has null configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)