You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@predictionio.apache.org by Pat Ferrel <pa...@actionml.com> on 2017/04/01 21:29:28 UTC
Re: I m getting error in stage 33 while using pio train.
That is an old template that does not work with Apache PIO
Look on the Apache PIO template gallery for compatible templates including this one: https://github.com/actionml/universal-recommender
I can’t understand how the old one got through `pio build` with Apache PIO 0.10.0. Something is not right in the docker image you mention, if the template you linked to runs. the docker image must use the old Prediction.io from before moving to Apache
On Apr 1, 2017, at 12:23 PM, Ayush Goel <ay...@gmail.com> wrote:
The template i m using sir is this template <https://github.com/PredictionIO/template-scala-parallel-universal-recommendation>Sir i m using docker image of predictionio. The docker image is steveny/predictionio/ <https://hub.docker.com/r/steveny/predictionio/>.
The predictionio version is 0.10.0
Apache spark version is 1.5.1
One thing sir i would like to mention is that it is running fine for small datasets but on using a largedataset i m facing this issue
Sir i googled this error one of the fixes available was to upgrade the spark version to 1.6
And the other fix is in this link stackoverflow <http://stackoverflow.com/questions/32667068/save-spark-dataframe-into-elasticsearch-can-t-handle-type-exception>. I am unable to understand where(i mean which files) i have to add the said classes in the link.
Sir i am also unable to understand how to upgrade spark in the docker image.
On Sat, Apr 1, 2017 at 11:30 PM, Pat Ferrel <pat@actionml.com <ma...@actionml.com>> wrote:
Can you give more of the stack trace? I assume you are running the UR, which version and what version of PIO?
Off hand it looks like a problem with installation of Spark. What version of that do you have?
On Apr 1, 2017, at 7:34 AM, Ayush Goel <ayush10294@gmail.com <ma...@gmail.com>> wrote:
this is the error
[ERROR] [TaskResultGetter] Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@1877ab81
[ERROR] [TaskResultGetter] Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@1877ab81
--
You received this message because you are subscribed to the Google Groups "actionml-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to actionml-user+unsubscribe@googlegroups.com <ma...@googlegroups.com>.
To post to this group, send email to actionml-user@googlegroups.com <ma...@googlegroups.com>.
To view this discussion on the web visit https://groups.google.com/d/msgid/actionml-user/aa4b03cc-ba47-4770-9eee-c53d4dec1fb4%40googlegroups.com <https://groups.google.com/d/msgid/actionml-user/aa4b03cc-ba47-4770-9eee-c53d4dec1fb4%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.
Re: I m getting error in stage 33 while using pio train.
Posted by Pat Ferrel <pa...@actionml.com>.
Do not use `pio template get` it is being deprecated. Just use git like this:
git clone https://github.com/actionml/universal-recommender.git ur
cd ur
# edit engine.json to meet your needs, start from engine.json.minimum not engine.json, which is for the integration tests.
pio build
If you are using the docker container mentioned below we cannot guarantee it is correct and do not support it. See the maintainer for questions about it’s use.
On Apr 1, 2017, at 9:57 PM, Ayush Goel <ay...@gmail.com> wrote:
Sir i was getting this error when i was trying to use the command pio template get actionml/universal-recommender myrecommender
Exception in thread "main" java.nio.charset.MalformedInputException: Input length = 1
at java.nio.charset.CoderResult.throwException(CoderResult.java:281)
at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:339)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
at java.io.InputStreamReader.read(InputStreamReader.java:184)
at java.io.BufferedReader.fill(BufferedReader.java:161)
at java.io.BufferedReader.readLine(BufferedReader.java:324)
at java.io.BufferedReader.readLine(BufferedReader.java:389)
at scala.io.BufferedSource$BufferedLineIterator.hasNext(BufferedSource.scala:67)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.TraversableOnce$class.addString(TraversableOnce.scala:320)
at scala.collection.AbstractIterator.addString(Iterator.scala:1157)
at scala.collection.TraversableOnce$class.mkString(TraversableOnce.scala:286)
at scala.collection.AbstractIterator.mkString(Iterator.scala:1157)
at scala.collection.TraversableOnce$class.mkString(TraversableOnce.scala:288)
at scala.collection.AbstractIterator.mkString(Iterator.scala:1157)
at org.apache.predictionio.tools.console.Template$$anonfun$get$4$$anonfun$apply$9.apply(Template.scala:405)
at org.apache.predictionio.tools.console.Template$$anonfun$get$4$$anonfun$apply$9.apply(Template.scala:398)
at scala.collection.immutable.List.foreach(List.scala:318)
at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32)
at scala.collection.mutable.ListBuffer.foreach(ListBuffer.scala:45)
at org.apache.predictionio.tools.console.Template$$anonfun$get$4.apply(Template.scala:398)
at org.apache.predictionio.tools.console.Template$$anonfun$get$4.apply(Template.scala:394)
at scala.Option.map(Option.scala:145)
at org.apache.predictionio.tools.console.Template$.get(Template.scala:394)
at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:762)
at org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:696)
at scala.Option.map(Option.scala:145)
at org.apache.predictionio.tools.console.Console$.main(Console.scala:696)
at org.apache.predictionio.tools.console.Console.main(Console.scala)
Thats why i opted for other template which i mentioned before. I was not able to find much on this error.
Sir i wanted to ask one more question how to run pio build behind a proxy server with authentication
On Sun, Apr 2, 2017 at 2:59 AM, Pat Ferrel <pat@actionml.com <ma...@actionml.com>> wrote:
That is an old template that does not work with Apache PIO
Look on the Apache PIO template gallery for compatible templates including this one: https://github.com/actionml/universal-recommender <https://github.com/actionml/universal-recommender>
I can’t understand how the old one got through `pio build` with Apache PIO 0.10.0. Something is not right in the docker image you mention, if the template you linked to runs. the docker image must use the old Prediction.io <http://prediction.io/> from before moving to Apache
On Apr 1, 2017, at 12:23 PM, Ayush Goel <ayush10294@gmail.com <ma...@gmail.com>> wrote:
The template i m using sir is this template <https://github.com/PredictionIO/template-scala-parallel-universal-recommendation>Sir i m using docker image of predictionio. The docker image is steveny/predictionio/ <https://hub.docker.com/r/steveny/predictionio/>.
The predictionio version is 0.10.0
Apache spark version is 1.5.1
One thing sir i would like to mention is that it is running fine for small datasets but on using a largedataset i m facing this issue
Sir i googled this error one of the fixes available was to upgrade the spark version to 1.6
And the other fix is in this link stackoverflow <http://stackoverflow.com/questions/32667068/save-spark-dataframe-into-elasticsearch-can-t-handle-type-exception>. I am unable to understand where(i mean which files) i have to add the said classes in the link.
Sir i am also unable to understand how to upgrade spark in the docker image.
On Sat, Apr 1, 2017 at 11:30 PM, Pat Ferrel <pat@actionml.com <ma...@actionml.com>> wrote:
Can you give more of the stack trace? I assume you are running the UR, which version and what version of PIO?
Off hand it looks like a problem with installation of Spark. What version of that do you have?
On Apr 1, 2017, at 7:34 AM, Ayush Goel <ayush10294@gmail.com <ma...@gmail.com>> wrote:
this is the error
[ERROR] [TaskResultGetter] Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@1877ab81
[ERROR] [TaskResultGetter] Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@1877ab81
--
You received this message because you are subscribed to the Google Groups "actionml-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to actionml-user+unsubscribe@googlegroups.com <ma...@googlegroups.com>.
To post to this group, send email to actionml-user@googlegroups.com <ma...@googlegroups.com>.
To view this discussion on the web visit https://groups.google.com/d/msgid/actionml-user/aa4b03cc-ba47-4770-9eee-c53d4dec1fb4%40googlegroups.com <https://groups.google.com/d/msgid/actionml-user/aa4b03cc-ba47-4770-9eee-c53d4dec1fb4%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.