You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "GOURAV (JIRA)" <ji...@apache.org> on 2016/08/30 03:01:20 UTC
[jira] [Created] (ZEPPELIN-1394) Unknown Command
GOURAV created ZEPPELIN-1394:
--------------------------------
Summary: Unknown Command
Key: ZEPPELIN-1394
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1394
Project: Zeppelin
Issue Type: Bug
Components: GUI
Affects Versions: 0.6.1
Environment: CentOs
Reporter: GOURAV
Fix For: 0.6.2
Hello Team,
I have just installed Zeppelin to my machine, I have just created my first Note and trying to run first tutorial.
1. Tutorial with Local File
webhdfs/v1 these two folders, I have created on my hadoop and uploaded file bank-full.csv
val bankText = sc.textFile("/webhdfs/v1/bank/bank-full.csv")
case class Bank(age:Integer, job:String, marital : String, education : String, balance : Integer)
// split each line, filter out header (starts with "age"), and map it into Bank case class
val bank = bankText.map(s=>s.split(";")).filter(s=>s(0)!="\"age\"").map(
s=>Bank(s(0).toInt,
s(1).replaceAll("\"", ""),
s(2).replaceAll("\"", ""),
s(3).replaceAll("\"", ""),
s(5).replaceAll("\"", "").toInt
)
)
// convert to DataFrame and create temporal table
bank.toDF().registerTempTable("bank")
2. Sql I am running is : %sql select age, count(1) from bank where age < 30 group by age order by age
3. Logs I found is
i)
INFO [2016-08-29 19:58:20,768] ({pool-2-thread-3} SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1472525900765 started by scheduler org.apache.zeppelin.file.FileInterpreter886899013
INFO [2016-08-29 19:58:20,782] ({pool-2-thread-3} FileInterpreter.java[interpret]:105) - Run File command 'val bankText = sc.textFile("/webhdfs/v1/bank-full.csv")
case class Bank(age:Integer, job:String, marital : String, education : String, balance : Integer)
// split each line, filter out header (starts with "age"), and map it into Bank case class
val bank = bankText.map(s=>s.split(";")).filter(s=>s(0)!="\"age\"").map(
s=>Bank(s(0).toInt,
s(1).replaceAll("\"", ""),
s(2).replaceAll("\"", ""),
s(3).replaceAll("\"", ""),
s(5).replaceAll("\"", "").toInt
)
)
// convert to DataFrame and create temporal table
bank.toDF().registerTempTable("bank")'
INFO [2016-08-29 19:58:20,785] ({pool-2-thread-3} SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1472525900765 finished by scheduler org.apache.zeppelin.file.FileInterpreter886899013
ii)
INFO [2016-08-29 19:58:21,036] ({pool-2-thread-4} RemoteInterpreterManagedProcess.java[start]:116) - Run interpreter process [/home/cloudera/Documents/zeppelin/zeppelin-master2/zeppelin-master/bin/interpreter.sh, -d, /home/cloudera/Documents/zeppelin/zeppelin-master2/zeppelin-master/interpreter/spark, -p, 35469, -l, /home/cloudera/Documents/zeppelin/zeppelin-master2/zeppelin-master/local-repo/2BTSP4KGQ]
ERROR [2016-08-29 19:58:21,126] ({qtp1244404508-13} ResourcePoolUtils.java[getAllResourcesExcept]:64) -
java.lang.NullPointerException
at org.apache.zeppelin.resource.ResourcePoolUtils.getAllResourcesExcept(ResourcePoolUtils.java:58)
at org.apache.zeppelin.resource.ResourcePoolUtils.getAllResources(ResourcePoolUtils.java:36)
at org.apache.zeppelin.helium.Helium.suggestApp(Helium.java:153)
at org.apache.zeppelin.rest.HeliumRestApi.suggest(HeliumRestApi.java:83)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)
at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:100)
at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:57)
at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:93)
at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
iii) INFO [2016-08-29 19:31:01,671] ({pool-2-thread-4} SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1472524261671 started by scheduler org.apache.zeppelin.spark.SparkInterpreter571003972
INFO [2016-08-29 19:31:03,469] ({pool-2-thread-4} SparkInterpreter.java[createSparkSession]:299) - ------ Create new SparkContext local[*] -------
ERROR [2016-08-29 19:31:03,469] ({pool-2-thread-4} Job.java[run]:182) - Job failed
java.lang.NullPointerException
at org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:303)
at org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:218)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:743)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at org.apache.zeppelin.spark.SparkSqlInterpreter.getSparkInterpreter(SparkSqlInterpreter.java:77)
at org.apache.zeppelin.spark.SparkSqlInterpreter.interpret(SparkSqlInterpreter.java:92)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:61
2. I am unable to generate graph.
3. Stuck..
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)