[incubator-amaterasu] 27/36: Installing action requirements inside the driver and shipping them to the executors

[ya...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

yaniv pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git

commit 59c4c1ca96379725cc08916dad28ac4d0f1879b7
Merge: 886541c 2e7904d
Author: Nadav Har Tzvi <na...@apache.org>
AuthorDate: Sat Apr 27 12:28:27 2019 +0300

    Installing action requirements inside the driver and shipping them to the executors

 .../dispatcher/runners/providers/PySparkRunnerProvider.scala     | 9 +++++++--
 sdk_python/amaterasu/pyspark/runtime.py                          | 1 -
 2 files changed, 7 insertions(+), 3 deletions(-)

diff --cc sdk_python/amaterasu/pyspark/runtime.py
index c51382d,da69205..a8fbe3c
--- a/sdk_python/amaterasu/pyspark/runtime.py
+++ b/sdk_python/amaterasu/pyspark/runtime.py
@@@ -18,8 -18,6 +18,7 @@@ from pyspark import SparkContext, Spark
  from pyspark.sql import SparkSession, DataFrame
  from amaterasu.base import BaseAmaContextBuilder, LoaderAmaContext
  from .datasets import DatasetManager
 +from pip._internal import main as pip_main
- import zipfile
  import os
  import sys