You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@predictionio.apache.org by SUDHANSHU KAUSHIK <su...@gmail.com> on 2017/06/07 04:42:59 UTC

Sparkling Water-Deep Learning Energy Forecasting template

Hi,

I am using Sparkling Water-Deep Learning Energy Forecasting template of
predictionio. I am able to build, train and deploy the engine. But when I
query the engine, I am getting following error :
Cannot call methods on a stopped SparkContext

Stack Trace: java.lang.IllegalStateException: Cannot call methods on a
stopped SparkContext atorg.apache.spark.SparkContext.org
<http://org.apache.spark.sparkcontext.org/>$apache$spark$SparkContext$
$assertNotStopped(SparkContext.scala:104) at org.apache.spark.SparkContext.
defaultParallelism(SparkContext.scala:2061) at
org.apache.spark.SparkContext.parallelize$default$2(SparkContext.scala:723)
at Algorithm.predict(Algorithm.scala:56) at
Algorithm.predict(Algorithm.scala:9)
at io.prediction.controller.P2LAlgorithm.predictBase(P2LAlgorithm.scala:70)
at io.prediction.workflow.ServerActor$$anonfun$24$$
anonfun$25.apply(CreateServer.scala:536) at io.prediction.workflow.
ServerActor$$anonfun$24$$anonfun$25.apply(CreateServer.scala:535) at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
at scala.collection.TraversableLike$$anonfun$map$
1.apply(TraversableLike.scala:244) at
scala.collection.immutable.List.foreach(List.scala:318)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) at
scala.collection.AbstractTraversable.map(Traversable.scala:105) at
io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:535)
at io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:513)
at spray.routing.ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(
ApplyConverterInstances.scala:25) at spray.routing.
ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(
ApplyConverterInstances.scala:24) at spray.routing.
ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$anonfun$apply$1.apply(Directive.scala:38)
at spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$
anonfun$apply$1.apply(Directive.scala:37) at spray.routing.directives.
BasicDirectives$$anon$1.happly(BasicDirectives.scala:26) at spray.routing.
ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:37)
at spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:36)
at spray.routing.directives.BasicDirectives$$anon$2.
happly(BasicDirectives.scala:79) at spray.routing.Directive$$anon$
7$$anonfun$happly$4.apply(Directive.scala:86) at
spray.routing.Directive$$anon$7$$anonfun$happly$4.apply(Directive.scala:86)
at spray.routing.directives.BasicDirectives$$anon$3$$anonfun$happly$1.apply(BasicDirectives.scala:92)
at spray.routing.directives.BasicDirectives$$anon$3$$anonfun$happly$1.apply(BasicDirectives.scala:92)
at spray.routing.directives.ExecutionDirectives$$anonfun$
detach$1$$anonfun$apply$7$$anonfun$apply$3.apply$mcV$sp(ExecutionDirectives.scala:89)
at spray.routing.directives.ExecutionDirectives$$anonfun$
detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
at spray.routing.directives.ExecutionDirectives$$anonfun$
detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$$anon$3.
exec(ExecutionContextImpl.scala:107) at scala.concurrent.forkjoin.
ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.
ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(
ForkJoinWorkerThread.java:107)

So, please help me to resolve this bug.

Thanks and Regards,
Sudhanshu kaushik

Re: Sparkling Water-Deep Learning Energy Forecasting template

Posted by SUDHANSHU KAUSHIK <su...@gmail.com>.
Hi Donald,

I am running on PredictionIO-0.10.0-incubating, spark-1.5.1, and
sparkling-water-assembly-0.2.103-all.jar .

Thanks and Regards,
Sudhanshu kaushik

On Thu, Jun 8, 2017 at 9:13 PM, Donald Szeto <do...@apache.org> wrote:

> Hi Sudhanshu,
>
> What versions of Spark, Sparkling Water, PredictionIO are you running on?
> The community might not have tested the template on the latest versions of
> these technologies.
>
> Regards,
> Donald
>
> On Tue, Jun 6, 2017 at 9:43 PM SUDHANSHU KAUSHIK <sudhanshukaushik1.61803@
> gmail.com> wrote:
>
>> Hi,
>>
>> I am using Sparkling Water-Deep Learning Energy Forecasting template of
>> predictionio. I am able to build, train and deploy the engine. But when I
>> query the engine, I am getting following error :
>> Cannot call methods on a stopped SparkContext
>>
>> Stack Trace: java.lang.IllegalStateException: Cannot call methods on a
>> stopped SparkContext atorg.apache.spark.SparkContext.org
>> <http://org.apache.spark.sparkcontext.org/>$apache$spark$SparkContext$$
>> assertNotStopped(SparkContext.scala:104) at
>> org.apache.spark.SparkContext.defaultParallelism(SparkContext.scala:2061)
>> at org.apache.spark.SparkContext.parallelize$default$2(SparkContext.scala:723)
>> at Algorithm.predict(Algorithm.scala:56) at Algorithm.predict(Algorithm.scala:9)
>> at io.prediction.controller.P2LAlgorithm.predictBase(P2LAlgorithm.scala:70)
>> at io.prediction.workflow.ServerActor$$anonfun$24$$
>> anonfun$25.apply(CreateServer.scala:536) at io.prediction.workflow.
>> ServerActor$$anonfun$24$$anonfun$25.apply(CreateServer.scala:535) at
>> scala.collection.TraversableLike$$anonfun$map$
>> 1.apply(TraversableLike.scala:244) at scala.collection.
>> TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) at
>> scala.collection.immutable.List.foreach(List.scala:318) at
>> scala.collection.TraversableLike$class.map(TraversableLike.scala:244) at
>> scala.collection.AbstractTraversable.map(Traversable.scala:105) at
>> io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:535)
>> at io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:513)
>> at spray.routing.ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(
>> ApplyConverterInstances.scala:25) at spray.routing.
>> ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(
>> ApplyConverterInstances.scala:24) at spray.routing.
>> ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$
>> anonfun$apply$1.apply(Directive.scala:38) at spray.routing.
>> ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$
>> anonfun$apply$1.apply(Directive.scala:37) at spray.routing.directives.
>> BasicDirectives$$anon$1.happly(BasicDirectives.scala:26) at
>> spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:37)
>> at spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:36)
>> at spray.routing.directives.BasicDirectives$$anon$2.
>> happly(BasicDirectives.scala:79) at spray.routing.Directive$$anon$
>> 7$$anonfun$happly$4.apply(Directive.scala:86) at
>> spray.routing.Directive$$anon$7$$anonfun$happly$4.apply(Directive.scala:86)
>> at spray.routing.directives.BasicDirectives$$anon$3$$
>> anonfun$happly$1.apply(BasicDirectives.scala:92) at
>> spray.routing.directives.BasicDirectives$$anon$3$$anonfun$happly$1.apply(BasicDirectives.scala:92)
>> at spray.routing.directives.ExecutionDirectives$$anonfun$
>> detach$1$$anonfun$apply$7$$anonfun$apply$3.apply$mcV$sp(ExecutionDirectives.scala:89)
>> at spray.routing.directives.ExecutionDirectives$$anonfun$
>> detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
>> at spray.routing.directives.ExecutionDirectives$$anonfun$
>> detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
>> at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
>> at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
>> at scala.concurrent.impl.ExecutionContextImpl$$anon$3.
>> exec(ExecutionContextImpl.scala:107) at scala.concurrent.forkjoin.
>> ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.
>> ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at
>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(
>> ForkJoinWorkerThread.java:107)
>>
>> So, please help me to resolve this bug.
>>
>> Thanks and Regards,
>> Sudhanshu kaushik
>>
>

Re: Sparkling Water-Deep Learning Energy Forecasting template

Posted by Donald Szeto <do...@apache.org>.
Hi Sudhanshu,

What versions of Spark, Sparkling Water, PredictionIO are you running on?
The community might not have tested the template on the latest versions of
these technologies.

Regards,
Donald

On Tue, Jun 6, 2017 at 9:43 PM SUDHANSHU KAUSHIK <
sudhanshukaushik1.61803@gmail.com> wrote:

> Hi,
>
> I am using Sparkling Water-Deep Learning Energy Forecasting template of
> predictionio. I am able to build, train and deploy the engine. But when I
> query the engine, I am getting following error :
> Cannot call methods on a stopped SparkContext
>
> Stack Trace: java.lang.IllegalStateException: Cannot call methods on a
> stopped SparkContext atorg.apache.spark.SparkContext.org
> <http://org.apache.spark.sparkcontext.org/>$apache$spark$SparkContext$$assertNotStopped(SparkContext.scala:104)
> at
> org.apache.spark.SparkContext.defaultParallelism(SparkContext.scala:2061)
> at
> org.apache.spark.SparkContext.parallelize$default$2(SparkContext.scala:723)
> at Algorithm.predict(Algorithm.scala:56) at
> Algorithm.predict(Algorithm.scala:9) at
> io.prediction.controller.P2LAlgorithm.predictBase(P2LAlgorithm.scala:70) at
> io.prediction.workflow.ServerActor$$anonfun$24$$anonfun$25.apply(CreateServer.scala:536)
> at
> io.prediction.workflow.ServerActor$$anonfun$24$$anonfun$25.apply(CreateServer.scala:535)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at scala.collection.immutable.List.foreach(List.scala:318) at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:244) at
> scala.collection.AbstractTraversable.map(Traversable.scala:105) at
> io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:535)
> at
> io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:513)
> at
> spray.routing.ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(ApplyConverterInstances.scala:25)
> at
> spray.routing.ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(ApplyConverterInstances.scala:24)
> at
> spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$anonfun$apply$1.apply(Directive.scala:38)
> at
> spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$anonfun$apply$1.apply(Directive.scala:37)
> at
> spray.routing.directives.BasicDirectives$$anon$1.happly(BasicDirectives.scala:26)
> at
> spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:37)
> at
> spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:36)
> at
> spray.routing.directives.BasicDirectives$$anon$2.happly(BasicDirectives.scala:79)
> at
> spray.routing.Directive$$anon$7$$anonfun$happly$4.apply(Directive.scala:86)
> at
> spray.routing.Directive$$anon$7$$anonfun$happly$4.apply(Directive.scala:86)
> at
> spray.routing.directives.BasicDirectives$$anon$3$$anonfun$happly$1.apply(BasicDirectives.scala:92)
> at
> spray.routing.directives.BasicDirectives$$anon$3$$anonfun$happly$1.apply(BasicDirectives.scala:92)
> at
> spray.routing.directives.ExecutionDirectives$$anonfun$detach$1$$anonfun$apply$7$$anonfun$apply$3.apply$mcV$sp(ExecutionDirectives.scala:89)
> at
> spray.routing.directives.ExecutionDirectives$$anonfun$detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
> at
> spray.routing.directives.ExecutionDirectives$$anonfun$detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
> at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
> at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
> at
> scala.concurrent.impl.ExecutionContextImpl$$anon$3.exec(ExecutionContextImpl.scala:107)
> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
>
> So, please help me to resolve this bug.
>
> Thanks and Regards,
> Sudhanshu kaushik
>