You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "liyunzhang_intel (JIRA)" <ji...@apache.org> on 2014/10/16 10:46:34 UTC
[jira] [Updated] (PIG-4168) Initial implementation of unit tests
for Pig on Spark
[ https://issues.apache.org/jira/browse/PIG-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liyunzhang_intel updated PIG-4168:
----------------------------------
Attachment: PIG-4168_4.patch
> Initial implementation of unit tests for Pig on Spark
> -----------------------------------------------------
>
> Key: PIG-4168
> URL: https://issues.apache.org/jira/browse/PIG-4168
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: Praveen Rachabattuni
> Assignee: liyunzhang_intel
> Attachments: PIG-4168.patch, PIG-4168_1.patch, PIG-4168_2.patch, PIG-4168_3.patch, PIG-4168_4.patch
>
>
> 1.ant clean jar; pig-0.14.0-SNAPSHOT-core-h1.jar will be generated by the command
> 2.export SPARK_PIG_JAR=$PIG_HOME/pig-0.14.0-SNAPSHOT-core-h1.jar
> 3.build hadoop1 and spark env.spark run in local mode
> jps:
> 11647 Master #spark master runs
> 6457 DataNode #hadoop datanode runs
> 22374 Jps
> 11705 Worker# spark worker runs
> 27009 JobTracker #hadoop jobtracker runs
> 26602 NameNode #hadoop namenode runs
> 29486 org.eclipse.equinox.launcher_1.3.0.v20120522-1813.jar
> 19692 Main
>
> 4.ant test-spark
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)