You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Minh Lê (JIRA)" <ji...@apache.org> on 2012/12/03 21:35:59 UTC

[jira] [Commented] (PIG-2653) Precompile option in PIG (Ability to store the plan for queries which are run multiple times)

    [ https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509022#comment-13509022 ] 

Minh Lê commented on PIG-2653:
------------------------------

Isn't it better to store the compiled jar file? Eventually, this file will be distributed to each node so we can save even more time if we keep it in the node to run several times.
                
> Precompile option in PIG (Ability to store the plan for queries which are run multiple times)
> ---------------------------------------------------------------------------------------------
>
>                 Key: PIG-2653
>                 URL: https://issues.apache.org/jira/browse/PIG-2653
>             Project: Pig
>          Issue Type: Improvement
>          Components: parser
>            Reporter: Rajesh Balamohan
>
> Based on the size of the PIG script, it takes 1 or 2 minutes in certain cases for PIG compiler to create the MR plan. If the same script has to be run later point in time, it has to go through this process again. 
> It would be nice, if PIG can store the result (execution plan) which can be reused when the same script is run again. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira