You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2012/07/02 18:27:23 UTC
[jira] [Created] (PIG-2783) Fix Iterator_1 e2e test for Hadoop 23
Rohini Palaniswamy created PIG-2783:
---------------------------------------
Summary: Fix Iterator_1 e2e test for Hadoop 23
Key: PIG-2783
URL: https://issues.apache.org/jira/browse/PIG-2783
Project: Pig
Issue Type: Bug
Components: e2e harness
Affects Versions: 0.10.0
Reporter: Rohini Palaniswamy
Assignee: Rohini Palaniswamy
Priority: Minor
Iterator_1 e2e test is failing because the script tries to copy output to a directory that does not exist. From Hadoop 23, the copy commands do not auto-create non-existent paths anymore.
+Pig.fs("-mkdir :OUTPATH:")
Pig.fs("-copyFromLocal :TMP:/iterator_output.txt :OUTPATH:/part-m-00000")
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2783) Fix Iterator_1 e2e test for Hadoop 23
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2783:
------------------------------------
Status: Patch Available (was: Open)
> Fix Iterator_1 e2e test for Hadoop 23
> -------------------------------------
>
> Key: PIG-2783
> URL: https://issues.apache.org/jira/browse/PIG-2783
> Project: Pig
> Issue Type: Bug
> Components: e2e harness
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Priority: Minor
> Attachments: PIG-2783.patch
>
>
> Iterator_1 e2e test is failing because the script tries to copy output to a directory that does not exist. From Hadoop 23, the copy commands do not auto-create non-existent paths anymore.
> +Pig.fs("-mkdir :OUTPATH:")
> Pig.fs("-copyFromLocal :TMP:/iterator_output.txt :OUTPATH:/part-m-00000")
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2783) Fix Iterator_1 e2e test for Hadoop 23
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2783:
----------------------------
Resolution: Fixed
Fix Version/s: 0.10.1
0.11
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Patch committed to 0.10/trunk. Thanks Rohini!
> Fix Iterator_1 e2e test for Hadoop 23
> -------------------------------------
>
> Key: PIG-2783
> URL: https://issues.apache.org/jira/browse/PIG-2783
> Project: Pig
> Issue Type: Bug
> Components: e2e harness
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Priority: Minor
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2783.patch
>
>
> Iterator_1 e2e test is failing because the script tries to copy output to a directory that does not exist. From Hadoop 23, the copy commands do not auto-create non-existent paths anymore.
> +Pig.fs("-mkdir :OUTPATH:")
> Pig.fs("-copyFromLocal :TMP:/iterator_output.txt :OUTPATH:/part-m-00000")
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2783) Fix Iterator_1 e2e test for Hadoop 23
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2783:
------------------------------------
Attachment: PIG-2783.patch
Comments from the hadoop team on Hadoop 23 copy command behaviour:
Many commands used to auto-create non-existent paths. This behavior is most commonly relied upon in the copy commands. The target directory path will no longer be created. Please use "mkdir" or "mkdir -p" to create the target directory path prior to the copy. The "-p" flag will avoid an error if the directory already exists. If other commands are still auto-creating paths, do not rely upon that behavior.
> Fix Iterator_1 e2e test for Hadoop 23
> -------------------------------------
>
> Key: PIG-2783
> URL: https://issues.apache.org/jira/browse/PIG-2783
> Project: Pig
> Issue Type: Bug
> Components: e2e harness
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Priority: Minor
> Attachments: PIG-2783.patch
>
>
> Iterator_1 e2e test is failing because the script tries to copy output to a directory that does not exist. From Hadoop 23, the copy commands do not auto-create non-existent paths anymore.
> +Pig.fs("-mkdir :OUTPATH:")
> Pig.fs("-copyFromLocal :TMP:/iterator_output.txt :OUTPATH:/part-m-00000")
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira