You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Amit Kumar (Jira)" <ji...@apache.org> on 2019/11/04 21:02:00 UTC
[jira] [Updated] (OOZIE-3556) Add capture-output to Spark actions
[ https://issues.apache.org/jira/browse/OOZIE-3556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amit Kumar updated OOZIE-3556:
------------------------------
Description:
It is very common to want to reuse the result of a Spark Action in another action.
It will be useful if we can capture output of a Spark action the same way we do for Java Action.
was:
It is very common to want to reuse the result of a Hive query in another action.
It will be useful if we can capture output of a Hive action the same way we do for shell actions - if the output is in the format of "key=value" use it for capture output.
Even more useful:
* Parse "key \t value" as "key=value" - this will allow capturing result of "describe table"
* Possibly capture all results as "Hive=<result>", up to maximum length. This will require user parsing but will give maximum flexibility.
> Add capture-output to Spark actions
> -----------------------------------
>
> Key: OOZIE-3556
> URL: https://issues.apache.org/jira/browse/OOZIE-3556
> Project: Oozie
> Issue Type: New Feature
> Reporter: Amit Kumar
> Priority: Major
>
> It is very common to want to reuse the result of a Spark Action in another action.
> It will be useful if we can capture output of a Spark action the same way we do for Java Action.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)