[jira] [Commented] (IGNITE-9473) InvalidPathException when localizing resources for Tez job

["Rob Gibbon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IGNITE-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604613#comment-16604613 ] 

Rob Gibbon commented on IGNITE-9473:
------------------------------------

I was able to get past this by modifying the file:

 

modules/hadoop/src/main/java/org/apache/ignite/hadoop/fs/v1/IgniteHadoopFileSystem.java

 

I changed the method checkPath so that it just calls super.checkPath and removed the rest of the content. Probably the method could be removed altogether.

 

I now appear to be able to get the resources to download to the tez container.

 

Will upload a patch a bit later because I also had to slightly change one of the test classes to comply with Hadoop 3.1.1.

> InvalidPathException when localizing resources for Tez job
> ----------------------------------------------------------
>
>                 Key: IGNITE-9473
>                 URL: https://issues.apache.org/jira/browse/IGNITE-9473
>             Project: Ignite
>          Issue Type: Bug
>          Components: igfs
>    Affects Versions: 2.6
>         Environment: Hadoop 3.1.1
> Ignite 2.6
>            Reporter: Rob Gibbon
>            Priority: Major
>
> When running a Hive on Tez job with an IGFS backend, I get an error:
>  
> InvalidPathException: Invalid path name Wrong path authority [expected=igfs@, actual=null]
>  
> The path is interpreted by the Yarn resource localizer as igfs:/apps/tez/tez.tar.gz. 
>  
> The path is configured in tez.lib.uris as /apps/tez/tez.tar.gz
>  
> The defaultFS is configured as igfs://igfs@/
>  
> The system works for everything else.
> exact error message logged:
> localizer.ResourceLocalizationService: Failed to download resource \{ { igfs:/apps/tez/tez.tar.gz, 1536087125000, ARCHIVE, null },pending,[(container_1536139312517_0016_01_000001)],592502389438828,DOWNLOADING}
>  
> Need help with this...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)