You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Mageswaran (JIRA)" <ji...@apache.org> on 2018/03/08 07:33:00 UTC

[jira] [Created] (NIFI-4946) nifi-spark-bundle : Adding support for pyfiles, file, jars options

Mageswaran created NIFI-4946:
--------------------------------

             Summary: nifi-spark-bundle : Adding support for pyfiles, file, jars options
                 Key: NIFI-4946
                 URL: https://issues.apache.org/jira/browse/NIFI-4946
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Extensions
    Affects Versions: 1.6.0
         Environment: Ubuntu 16.04, IntelliJ
            Reporter: Mageswaran
             Fix For: 1.6.0


Adding support for submitting PySpark based Sparks jobs (which is normally structured as modules) over Livy on existing "ExecuteSparkInteractive" processor.

This is done by reading file paths for pyfiles and file and an option from user whether the processor should trigger a batch job or not.

[https://livy.incubator.apache.org/docs/latest/rest-api.html]

 

More details will be posted in the Git link.

 

Thanks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)