You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Mageswaran (JIRA)" <ji...@apache.org> on 2018/03/08 07:33:00 UTC
[jira] [Created] (NIFI-4946) nifi-spark-bundle : Adding support for
pyfiles, file, jars options
Mageswaran created NIFI-4946:
--------------------------------
Summary: nifi-spark-bundle : Adding support for pyfiles, file, jars options
Key: NIFI-4946
URL: https://issues.apache.org/jira/browse/NIFI-4946
Project: Apache NiFi
Issue Type: New Feature
Components: Extensions
Affects Versions: 1.6.0
Environment: Ubuntu 16.04, IntelliJ
Reporter: Mageswaran
Fix For: 1.6.0
Adding support for submitting PySpark based Sparks jobs (which is normally structured as modules) over Livy on existing "ExecuteSparkInteractive" processor.
This is done by reading file paths for pyfiles and file and an option from user whether the processor should trigger a batch job or not.
[https://livy.incubator.apache.org/docs/latest/rest-api.html]
More details will be posted in the Git link.
Thanks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)