You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Pruthveej Reddy Kasarla (JIRA)" <ji...@apache.org> on 2016/09/29 21:57:21 UTC

[jira] [Created] (SPARK-17737) cannot import name accumulators error

Pruthveej Reddy Kasarla created SPARK-17737:
-----------------------------------------------

             Summary: cannot import name accumulators error
                 Key: SPARK-17737
                 URL: https://issues.apache.org/jira/browse/SPARK-17737
             Project: Spark
          Issue Type: Question
          Components: PySpark
         Environment: unix
python 2.7
            Reporter: Pruthveej Reddy Kasarla


Hi I am trying to setup my sparkcontext using the below code

import sys
sys.path.append('/opt/cloudera/parcels/CDH/lib/spark/python/build')
sys.path.append('/opt/cloudera/parcels/CDH/lib/spark/python')
from pyspark import SparkConf, SparkContext
sconf = SparkConf()
sc = SparkContext(conf=sconf)
print sc


got below error


ImportError                               Traceback (most recent call last)
<ipython-input-21-65fcb5ca9b52> in <module>()
      2 sys.path.append('/opt/cloudera/parcels/CDH/lib/spark/python/build')
      3 sys.path.append('/opt/cloudera/parcels/CDH/lib/spark/python')
----> 4 from pyspark import SparkConf, SparkContext
      5 sconf = SparkConf()
      6 sc = SparkContext(conf=sconf)

/opt/cloudera/parcels/CDH/lib/spark/python/pyspark/__init__.py in <module>()
     39 
     40 from pyspark.conf import SparkConf
---> 41 from pyspark.context import SparkContext
     42 from pyspark.rdd import RDD
     43 from pyspark.files import SparkFiles

/opt/cloudera/parcels/CDH/lib/spark/python/pyspark/context.py in <module>()
     26 from tempfile import NamedTemporaryFile
     27 
---> 28 from pyspark import accumulators
     29 from pyspark.accumulators import Accumulator
     30 from pyspark.broadcast import Broadcast

ImportError: cannot import name accumulators



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org