You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Jeremy Lewi (Updated) (JIRA)" <ji...@apache.org> on 2011/11/07 00:05:52 UTC
[jira] [Updated] (AVRO-570) python implementation of mapreduce
connector
[ https://issues.apache.org/jira/browse/AVRO-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeremy Lewi updated AVRO-570:
-----------------------------
Attachment: AVRO-570.patch
This an updated patch that resolves subversion conflicts. Unfortunately, not all unittests are passing yet.
TestWordCountTether fails when using the HTTP Protocol. The problem appears to be the following. After the mapper finishes, TetherMapRunner sends a "complete" message to the tethered process and the tethered process sends back a "complete" message and then exits. Based on the log messages, the messages are getting sent and received. However, TetherMapRunner's sending of "complete" results in a connection refused exception. This appears to only happen with the HTTP Protocol and not the SASL protocol.
The python code which is also using the HTTP protocol works just fine.
Any help or ideas would be appreciated.
> python implementation of mapreduce connector
> --------------------------------------------
>
> Key: AVRO-570
> URL: https://issues.apache.org/jira/browse/AVRO-570
> Project: Avro
> Issue Type: New Feature
> Components: python
> Affects Versions: 1.6.0
> Reporter: Doug Cutting
> Assignee: Jeremy Lewi
> Priority: Critical
> Labels: hadoop
> Fix For: 1.7.0
>
> Attachments: AVRO-570.patch, AVRO-570.patch, AVRO-570.patch, AVRO-570.patch, AVRO-570.patch
>
>
> AVRO-512 defines protocols for implementing mapreduce tasks. It would be good to have a Python implementation of this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira