[jira] [Updated] (PIG-2783) Fix Iterator_1 e2e test for Hadoop 23

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy updated PIG-2783:
------------------------------------

    Attachment: PIG-2783.patch

Comments from the hadoop team on Hadoop 23 copy command behaviour:

Many commands used to auto-create non-existent paths. This behavior is most commonly relied upon in the copy commands. The target directory path will no longer be created. Please use "mkdir" or "mkdir -p" to create the target directory path prior to the copy. The "-p" flag will avoid an error if the directory already exists. If other commands are still auto-creating paths, do not rely upon that behavior. 
                
> Fix Iterator_1 e2e test for Hadoop 23
> -------------------------------------
>
>                 Key: PIG-2783
>                 URL: https://issues.apache.org/jira/browse/PIG-2783
>             Project: Pig
>          Issue Type: Bug
>          Components: e2e harness
>    Affects Versions: 0.10.0
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>            Priority: Minor
>         Attachments: PIG-2783.patch
>
>
> Iterator_1 e2e test is failing because the script tries to copy output to a directory that does not exist. From Hadoop 23, the copy commands do not auto-create non-existent paths anymore.
> +Pig.fs("-mkdir :OUTPATH:")
>  Pig.fs("-copyFromLocal :TMP:/iterator_output.txt :OUTPATH:/part-m-00000")

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira