You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2016/12/20 06:35:58 UTC

[jira] [Created] (PIG-5080) Support store alias as spark table

Jeff Zhang created PIG-5080:
-------------------------------

             Summary: Support store alias as spark table
                 Key: PIG-5080
                 URL: https://issues.apache.org/jira/browse/PIG-5080
             Project: Pig
          Issue Type: New Feature
          Components: spark
    Affects Versions: 0.16.0
            Reporter: Jeff Zhang


The purpose is that I'd like to take advantage of both pig and hive. Pig-latin has powerful data flow expression ability which is useful for ETL while hive is good at query. 

The scenario is that I'd like to store pig alias as spark temporary table (cache can be optional). And I have an another spark engine which share the same SparkContext (in the same JVM) to query the table.

Please close this ticket if it is already supported. I didn't go through all the features of pig-spark.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)