You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Samuel Alexander (JIRA)" <ji...@apache.org> on 2015/09/25 11:17:04 UTC

[jira] [Created] (ZEPPELIN-323) Paragraph execution is very slow for remote Spark

Samuel Alexander created ZEPPELIN-323:
-----------------------------------------

             Summary: Paragraph execution is very slow for remote Spark 
                 Key: ZEPPELIN-323
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-323
             Project: Zeppelin
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.6.0
         Environment: EC2
            Reporter: Samuel Alexander


I've built EC2 from github in one of EC2 instance. I've running my spark cluster running in EC2 instance as well.

I've configured zeppelin to use Spark cluster in EC2 by providing spark master URL in spark interpreter. 

I loaded the sample "bank" table. Now the below sql code takes atleast 10 minutes to complete

%sql 
select age, count(1) value 
from bank 
where age < ${maxAge=30} 
group by age 
order by age

Whereas when I use the local[*] spark it takes only few seconds.

Do I need to do any other configuration in zeppelin to execute the paragraph faster using external Spark cluster?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)