You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Thiruvalluvan M. G. (Created) (JIRA)" <ji...@apache.org> on 2011/10/06 11:50:30 UTC
[jira] [Created] (AVRO-912) Mapreduce tether test fails on Windows
Mapreduce tether test fails on Windows
--------------------------------------
Key: AVRO-912
URL: https://issues.apache.org/jira/browse/AVRO-912
Project: Avro
Issue Type: Bug
Reporter: Thiruvalluvan M. G.
Assignee: Thiruvalluvan M. G.
The problems are:
1. The executable filename is passed around as a URL. Windows filenames are valid URLs.
2. Typical windows user's home directory is {{c:\Documents and Settings\username}}. Maven puts the downloaded jar files under {{$HOME/.m2}}. So the classpath has several directories with space in their names. Splitting command line arguments using space generates invalid classpath.
3. Hadoop's {{TaskLog.captureOutAndError()}} generates command line for unix systems using bash.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-912) Mapreduce tether test fails on Windows
Posted by "Thiruvalluvan M. G. (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-912:
-------------------------------------
Status: Patch Available (was: Open)
> Mapreduce tether test fails on Windows
> --------------------------------------
>
> Key: AVRO-912
> URL: https://issues.apache.org/jira/browse/AVRO-912
> Project: Avro
> Issue Type: Bug
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-912.patch
>
>
> The problems are:
> 1. The executable filename is passed around as a URL. Windows filenames are valid URLs.
> 2. Typical windows user's home directory is {{c:\Documents and Settings\username}}. Maven puts the downloaded jar files under {{$HOME/.m2}}. So the classpath has several directories with space in their names. Splitting command line arguments using space generates invalid classpath.
> 3. Hadoop's {{TaskLog.captureOutAndError()}} generates command line for unix systems using bash.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-912) Mapreduce tether test fails on
Windows
Posted by "Doug Cutting (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122121#comment-13122121 ]
Doug Cutting commented on AVRO-912:
-----------------------------------
+1 Changes look good to me and tests pass on Linux.
> Mapreduce tether test fails on Windows
> --------------------------------------
>
> Key: AVRO-912
> URL: https://issues.apache.org/jira/browse/AVRO-912
> Project: Avro
> Issue Type: Bug
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-912.patch
>
>
> The problems are:
> 1. The executable filename is passed around as a URL. Windows filenames are valid URLs.
> 2. Typical windows user's home directory is {{c:\Documents and Settings\username}}. Maven puts the downloaded jar files under {{$HOME/.m2}}. So the classpath has several directories with space in their names. Splitting command line arguments using space generates invalid classpath.
> 3. Hadoop's {{TaskLog.captureOutAndError()}} generates command line for unix systems using bash.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-912) Mapreduce tether test fails on Windows
Posted by "Thiruvalluvan M. G. (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-912:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed revision 1179946.
Thank you Doug for reviewing.
> Mapreduce tether test fails on Windows
> --------------------------------------
>
> Key: AVRO-912
> URL: https://issues.apache.org/jira/browse/AVRO-912
> Project: Avro
> Issue Type: Bug
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-912.patch
>
>
> The problems are:
> 1. The executable filename is passed around as a URL. Windows filenames are valid URLs.
> 2. Typical windows user's home directory is {{c:\Documents and Settings\username}}. Maven puts the downloaded jar files under {{$HOME/.m2}}. So the classpath has several directories with space in their names. Splitting command line arguments using space generates invalid classpath.
> 3. Hadoop's {{TaskLog.captureOutAndError()}} generates command line for unix systems using bash.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-912) Mapreduce tether test fails on Windows
Posted by "Thiruvalluvan M. G. (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-912:
-------------------------------------
Attachment: AVRO-912.patch
The attached patch addresses problems 1 and 2 by:
1. Using {{File}} instead of URL for passing executable filename.
2. Uses a {{List<String>}} instead of {{String}} to pass command arguments. While serializing the commands arguments into {{JobConf}}, it uses {{\n}} as delimiter.
The patch does not address the problem 3. Java 6's {{ProcessBuilder}} does not have a mechanism to redirect output or error. ({{ProcessBuilder}} in Java 7 has a platform independent solution, though). But the current thing using bash works if the windows machine has {{cygwin}}.
> Mapreduce tether test fails on Windows
> --------------------------------------
>
> Key: AVRO-912
> URL: https://issues.apache.org/jira/browse/AVRO-912
> Project: Avro
> Issue Type: Bug
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-912.patch
>
>
> The problems are:
> 1. The executable filename is passed around as a URL. Windows filenames are valid URLs.
> 2. Typical windows user's home directory is {{c:\Documents and Settings\username}}. Maven puts the downloaded jar files under {{$HOME/.m2}}. So the classpath has several directories with space in their names. Splitting command line arguments using space generates invalid classpath.
> 3. Hadoop's {{TaskLog.captureOutAndError()}} generates command line for unix systems using bash.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira