You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Praveen Rachabattuni (JIRA)" <ji...@apache.org> on 2015/03/30 08:32:56 UTC

[jira] [Updated] (PIG-4059) Pig on Spark

     [ https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Praveen Rachabattuni updated PIG-4059:
--------------------------------------
    Description: 
Setting up your development environment:

1. Check out Pig Spark branch.

2. Build Pig by running "ant jar" and "ant -Dhadoopversion=23 jar" for hadoop-2.x versions

3. Configure these environmental variables:
    export HADOOP_USER_CLASSPATH_FIRST="true"
    export SPARK_MASTER=local

4. Run Pig with "-x spark" option.



  was:
Setting up your development environment:

1. Check out Pig Spark branch.

2. Build Pig by running "ant jar".

3. Configure these environmental variables:
    export HADOOP_USER_CLASSPATH_FIRST="true"
    export SPARK_MASTER=local

4. Run Pig with "-x spark" option.




> Pig on Spark
> ------------
>
>                 Key: PIG-4059
>                 URL: https://issues.apache.org/jira/browse/PIG-4059
>             Project: Pig
>          Issue Type: New Feature
>          Components: spark
>            Reporter: Rohini Palaniswamy
>            Assignee: Praveen Rachabattuni
>              Labels: spork
>             Fix For: spark-branch
>
>         Attachments: Pig-on-Spark-Design-Doc.pdf
>
>
> Setting up your development environment:
> 1. Check out Pig Spark branch.
> 2. Build Pig by running "ant jar" and "ant -Dhadoopversion=23 jar" for hadoop-2.x versions
> 3. Configure these environmental variables:
>     export HADOOP_USER_CLASSPATH_FIRST="true"
>     export SPARK_MASTER=local
> 4. Run Pig with "-x spark" option.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)