You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Amit Kumar (Jira)" <ji...@apache.org> on 2019/11/04 21:02:00 UTC

[jira] [Updated] (OOZIE-3556) Add capture-output to Spark actions

     [ https://issues.apache.org/jira/browse/OOZIE-3556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amit Kumar updated OOZIE-3556:
------------------------------
    Description: 
It is very common to want to reuse the result of a Spark Action in another action. 
 It will be useful if we can capture output of a Spark action the same way we do for Java Action. 

  was:
It is very common to want to reuse the result of a Hive query in another action.  
It will be useful if we can capture output of a Hive action the same way we do for shell actions - if the output is in the format of "key=value" use it for capture output.

Even more useful:
* Parse "key \t value" as "key=value" - this will allow capturing result of "describe table"
* Possibly capture all results as "Hive=<result>", up to maximum length. This will require user parsing but will give maximum flexibility.



> Add capture-output to Spark actions
> -----------------------------------
>
>                 Key: OOZIE-3556
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3556
>             Project: Oozie
>          Issue Type: New Feature
>            Reporter: Amit Kumar
>            Priority: Major
>
> It is very common to want to reuse the result of a Spark Action in another action. 
>  It will be useful if we can capture output of a Spark action the same way we do for Java Action. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)