You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Richard Ding (JIRA)" <ji...@apache.org> on 2009/12/16 19:36:18 UTC
[jira] Updated: (PIG-1141) Make streaming work with the new
load-store interfaces
[ https://issues.apache.org/jira/browse/PIG-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1141:
------------------------------
Attachment: PIG-1141.patch
This patch implemented the proposed changes to streaming with the following modification:
* PigToStream interface:
{code}
package org.apache.pig.impl.streaming;
public interface PigToStream {
/**
* Given a tuple, produce an array of bytes to be passed to the streaming
* executable.
*/
public byte[] serialize(Tuple t) throws IOException;
}
{code}
* StreamToPig interface:
{code}
package org.apache.pig.impl.streaming;
public interface StreamToPig {
/**
* Given a byte array from a streaming executable, produce a tuple.
*/
public Tuple deserialize(byte[] bytes) throws IOException;
/**
* This will be called on the front end during planning and not on the back
* end during execution.
*
* @return the {@link LoadCaster} associated with this object.
* @throws IOException if there is an exception during LoadCaster
*/
public LoadCaster getLoadCaster() throws IOException;
}
{code}
* The class that provides the default implementation of these interfaces:
{code}
org.apache.pig.impl.streaming.PigStreaming
{code}
> Make streaming work with the new load-store interfaces
> -------------------------------------------------------
>
> Key: PIG-1141
> URL: https://issues.apache.org/jira/browse/PIG-1141
> Project: Pig
> Issue Type: Sub-task
> Reporter: Richard Ding
> Assignee: Richard Ding
> Attachments: PIG-1141.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.