You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Richard Ding (JIRA)" <ji...@apache.org> on 2009/12/16 19:36:18 UTC

[jira] Updated: (PIG-1141) Make streaming work with the new load-store interfaces

     [ https://issues.apache.org/jira/browse/PIG-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Richard Ding updated PIG-1141:
------------------------------

    Attachment: PIG-1141.patch

This patch implemented the proposed changes to streaming with the following modification:

* PigToStream interface:

{code}
package org.apache.pig.impl.streaming;

public interface PigToStream {
    
    /**
     * Given a tuple, produce an array of bytes to be passed to the streaming
     * executable.
     */
    public byte[] serialize(Tuple t) throws IOException;

}
{code}

* StreamToPig interface:

{code}
package org.apache.pig.impl.streaming;

public interface StreamToPig {
    /**
     *  Given a byte array from a streaming executable, produce a tuple.
     */
    public Tuple deserialize(byte[] bytes) throws IOException;

    /**
     * This will be called on the front end during planning and not on the back 
     * end during execution.
     * 
     * @return the {@link LoadCaster} associated with this object. 
     * @throws IOException if there is an exception during LoadCaster 
     */
    public LoadCaster getLoadCaster() throws IOException;

}

{code}

* The class that provides the default implementation of these interfaces: 

{code}

org.apache.pig.impl.streaming.PigStreaming

{code} 


> Make streaming work with the new load-store interfaces 
> -------------------------------------------------------
>
>                 Key: PIG-1141
>                 URL: https://issues.apache.org/jira/browse/PIG-1141
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: Richard Ding
>            Assignee: Richard Ding
>         Attachments: PIG-1141.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.