You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@predictionio.apache.org by shoaib hussain <sh...@gmail.com> on 2019/03/13 09:13:39 UTC

PredictionIO 0.14 | error during pio train

Following is my build.sbt

scalaVersion := "2.11.12"
libraryDependencies ++= Seq(
   "org.apache.predictionio" %% "apache-predictionio-core" % "0.14.0"
% "provided",
   "org.apache.spark"        %% "spark-core"               % "2.4.0" %
"provided",
   "org.apache.spark"        %% "spark-mllib"              % "2.4.0" %
"provided",
   "org.apache.lucene"        % "lucene-core"              % "6.5.1",
   "org.apache.lucene"        % "lucene-analyzers-common"  % "6.5.1",
   "org.xerial.snappy"        % "snappy-java"              % "1.1.1.7",
   "com.esotericsoftware"     % "kryo"                     % "4.0.1",
   "org.json4s"               % "json4s-core_2.11"         % "3.6.5",
   "org.json4s"               % "json4s-native_2.11"       % "3.6.5",
   "org.json4s"               % "json4s-jackson_2.11"      % "3.6.5")

and I'm getting this error when I run "pio train".

Exception in thread "main" java.lang.NoSuchMethodError:
org.json4s.ParserUtil$.quote(Ljava/lang/String;)Ljava/lang/String;

I tried with different versions of json4s, but no luck. getting same error
all the time.


-- 
Thank you.

Regards,

Shoaib Hussain

Re: PredictionIO 0.14 | error during pio train

Posted by takako shimamoto <ch...@gmail.com>.
Also, we are working on upgrading docker images to PIO 0.14.0.
Probably docker images will be built with Spark version 2.4.0.

On Thu, Mar 14, 2019 at 1:36 PM takako shimamoto <ch...@gmail.com> wrote:
>
> How did you install your environment on which you ran "pio train"? Did
> you build PredictionIO to support Spark 2.4.0?
> https://predictionio.apache.org/install/install-sourcecode/
>
> On Wed, Mar 13, 2019 at 7:28 PM shoaib hussain <sh...@gmail.com> wrote:
> >
> > I downloaded the PIO 0.14 jar, isn't it build with Spark 2.4?
> >
> > On Wed, Mar 13, 2019 at 2:59 PM takako shimamoto <ch...@gmail.com> wrote:
> >>
> >> If you want to use Spark 2.4, you need to build PredictionIO against
> >> Spark 2.4 (json4s 3.5.3).
> >>
> >> On Wed, Mar 13, 2019 at 6:23 PM shoaib hussain <sh...@gmail.com> wrote:
> >> >
> >> > Following is my build.sbt
> >> >
> >> > scalaVersion := "2.11.12"
> >> > libraryDependencies ++= Seq(
> >> >    "org.apache.predictionio" %% "apache-predictionio-core" % "0.14.0" % "provided",
> >> >    "org.apache.spark"        %% "spark-core"               % "2.4.0" % "provided",
> >> >    "org.apache.spark"        %% "spark-mllib"              % "2.4.0" % "provided",
> >> >    "org.apache.lucene"        % "lucene-core"              % "6.5.1",
> >> >    "org.apache.lucene"        % "lucene-analyzers-common"  % "6.5.1",
> >> >    "org.xerial.snappy"        % "snappy-java"              % "1.1.1.7",
> >> >    "com.esotericsoftware"     % "kryo"                     % "4.0.1",
> >> >    "org.json4s"               % "json4s-core_2.11"         % "3.6.5",
> >> >    "org.json4s"               % "json4s-native_2.11"       % "3.6.5",
> >> >    "org.json4s"               % "json4s-jackson_2.11"      % "3.6.5"
> >> > )
> >> >
> >> > and I'm getting this error when I run "pio train".
> >> >
> >> > Exception in thread "main" java.lang.NoSuchMethodError: org.json4s.ParserUtil$.quote(Ljava/lang/String;)Ljava/lang/String;
> >> >
> >> > I tried with different versions of json4s, but no luck. getting same error all the time.
> >> >
> >> >
> >> >
> >> > --
> >> > Thank you.
> >> >
> >> > Regards,
> >> >
> >> > Shoaib Hussain

Re: PredictionIO 0.14 | error during pio train

Posted by shoaib hussain <sh...@gmail.com>.
No, I didn't compiled it from source code, I actually downloaded binary
distribution from
https://www.apache.org/dyn/closer.lua/predictionio/0.14.0/apache-predictionio-0.14.0-bin.tar.gz

On Thu, Mar 14, 2019 at 9:36 AM takako shimamoto <ch...@gmail.com>
wrote:

> How did you install your environment on which you ran "pio train"? Did
> you build PredictionIO to support Spark 2.4.0?
> https://predictionio.apache.org/install/install-sourcecode/
>
> On Wed, Mar 13, 2019 at 7:28 PM shoaib hussain <sh...@gmail.com>
> wrote:
> >
> > I downloaded the PIO 0.14 jar, isn't it build with Spark 2.4?
> >
> > On Wed, Mar 13, 2019 at 2:59 PM takako shimamoto <ch...@gmail.com>
> wrote:
> >>
> >> If you want to use Spark 2.4, you need to build PredictionIO against
> >> Spark 2.4 (json4s 3.5.3).
> >>
> >> On Wed, Mar 13, 2019 at 6:23 PM shoaib hussain <sh...@gmail.com>
> wrote:
> >> >
> >> > Following is my build.sbt
> >> >
> >> > scalaVersion := "2.11.12"
> >> > libraryDependencies ++= Seq(
> >> >    "org.apache.predictionio" %% "apache-predictionio-core" % "0.14.0"
> % "provided",
> >> >    "org.apache.spark"        %% "spark-core"               % "2.4.0"
> % "provided",
> >> >    "org.apache.spark"        %% "spark-mllib"              % "2.4.0"
> % "provided",
> >> >    "org.apache.lucene"        % "lucene-core"              % "6.5.1",
> >> >    "org.apache.lucene"        % "lucene-analyzers-common"  % "6.5.1",
> >> >    "org.xerial.snappy"        % "snappy-java"              %
> "1.1.1.7",
> >> >    "com.esotericsoftware"     % "kryo"                     % "4.0.1",
> >> >    "org.json4s"               % "json4s-core_2.11"         % "3.6.5",
> >> >    "org.json4s"               % "json4s-native_2.11"       % "3.6.5",
> >> >    "org.json4s"               % "json4s-jackson_2.11"      % "3.6.5"
> >> > )
> >> >
> >> > and I'm getting this error when I run "pio train".
> >> >
> >> > Exception in thread "main" java.lang.NoSuchMethodError:
> org.json4s.ParserUtil$.quote(Ljava/lang/String;)Ljava/lang/String;
> >> >
> >> > I tried with different versions of json4s, but no luck. getting same
> error all the time.
> >> >
> >> >
> >> >
> >> > --
> >> > Thank you.
> >> >
> >> > Regards,
> >> >
> >> > Shoaib Hussain
>

Re: PredictionIO 0.14 | error during pio train

Posted by takako shimamoto <ch...@gmail.com>.
How did you install your environment on which you ran "pio train"? Did
you build PredictionIO to support Spark 2.4.0?
https://predictionio.apache.org/install/install-sourcecode/

On Wed, Mar 13, 2019 at 7:28 PM shoaib hussain <sh...@gmail.com> wrote:
>
> I downloaded the PIO 0.14 jar, isn't it build with Spark 2.4?
>
> On Wed, Mar 13, 2019 at 2:59 PM takako shimamoto <ch...@gmail.com> wrote:
>>
>> If you want to use Spark 2.4, you need to build PredictionIO against
>> Spark 2.4 (json4s 3.5.3).
>>
>> On Wed, Mar 13, 2019 at 6:23 PM shoaib hussain <sh...@gmail.com> wrote:
>> >
>> > Following is my build.sbt
>> >
>> > scalaVersion := "2.11.12"
>> > libraryDependencies ++= Seq(
>> >    "org.apache.predictionio" %% "apache-predictionio-core" % "0.14.0" % "provided",
>> >    "org.apache.spark"        %% "spark-core"               % "2.4.0" % "provided",
>> >    "org.apache.spark"        %% "spark-mllib"              % "2.4.0" % "provided",
>> >    "org.apache.lucene"        % "lucene-core"              % "6.5.1",
>> >    "org.apache.lucene"        % "lucene-analyzers-common"  % "6.5.1",
>> >    "org.xerial.snappy"        % "snappy-java"              % "1.1.1.7",
>> >    "com.esotericsoftware"     % "kryo"                     % "4.0.1",
>> >    "org.json4s"               % "json4s-core_2.11"         % "3.6.5",
>> >    "org.json4s"               % "json4s-native_2.11"       % "3.6.5",
>> >    "org.json4s"               % "json4s-jackson_2.11"      % "3.6.5"
>> > )
>> >
>> > and I'm getting this error when I run "pio train".
>> >
>> > Exception in thread "main" java.lang.NoSuchMethodError: org.json4s.ParserUtil$.quote(Ljava/lang/String;)Ljava/lang/String;
>> >
>> > I tried with different versions of json4s, but no luck. getting same error all the time.
>> >
>> >
>> >
>> > --
>> > Thank you.
>> >
>> > Regards,
>> >
>> > Shoaib Hussain

Re: PredictionIO 0.14 | error during pio train

Posted by shoaib hussain <sh...@gmail.com>.
I downloaded the PIO 0.14 jar, isn't it build with Spark 2.4?

On Wed, Mar 13, 2019 at 2:59 PM takako shimamoto <ch...@gmail.com>
wrote:

> If you want to use Spark 2.4, you need to build PredictionIO against
> Spark 2.4 (json4s 3.5.3).
>
> On Wed, Mar 13, 2019 at 6:23 PM shoaib hussain <sh...@gmail.com>
> wrote:
> >
> > Following is my build.sbt
> >
> > scalaVersion := "2.11.12"
> > libraryDependencies ++= Seq(
> >    "org.apache.predictionio" %% "apache-predictionio-core" % "0.14.0" %
> "provided",
> >    "org.apache.spark"        %% "spark-core"               % "2.4.0" %
> "provided",
> >    "org.apache.spark"        %% "spark-mllib"              % "2.4.0" %
> "provided",
> >    "org.apache.lucene"        % "lucene-core"              % "6.5.1",
> >    "org.apache.lucene"        % "lucene-analyzers-common"  % "6.5.1",
> >    "org.xerial.snappy"        % "snappy-java"              % "1.1.1.7",
> >    "com.esotericsoftware"     % "kryo"                     % "4.0.1",
> >    "org.json4s"               % "json4s-core_2.11"         % "3.6.5",
> >    "org.json4s"               % "json4s-native_2.11"       % "3.6.5",
> >    "org.json4s"               % "json4s-jackson_2.11"      % "3.6.5"
> > )
> >
> > and I'm getting this error when I run "pio train".
> >
> > Exception in thread "main" java.lang.NoSuchMethodError:
> org.json4s.ParserUtil$.quote(Ljava/lang/String;)Ljava/lang/String;
> >
> > I tried with different versions of json4s, but no luck. getting same
> error all the time.
> >
> >
> >
> > --
> > Thank you.
> >
> > Regards,
> >
> > Shoaib Hussain
>

Re: PredictionIO 0.14 | error during pio train

Posted by takako shimamoto <ch...@gmail.com>.
If you want to use Spark 2.4, you need to build PredictionIO against
Spark 2.4 (json4s 3.5.3).

On Wed, Mar 13, 2019 at 6:23 PM shoaib hussain <sh...@gmail.com> wrote:
>
> Following is my build.sbt
>
> scalaVersion := "2.11.12"
> libraryDependencies ++= Seq(
>    "org.apache.predictionio" %% "apache-predictionio-core" % "0.14.0" % "provided",
>    "org.apache.spark"        %% "spark-core"               % "2.4.0" % "provided",
>    "org.apache.spark"        %% "spark-mllib"              % "2.4.0" % "provided",
>    "org.apache.lucene"        % "lucene-core"              % "6.5.1",
>    "org.apache.lucene"        % "lucene-analyzers-common"  % "6.5.1",
>    "org.xerial.snappy"        % "snappy-java"              % "1.1.1.7",
>    "com.esotericsoftware"     % "kryo"                     % "4.0.1",
>    "org.json4s"               % "json4s-core_2.11"         % "3.6.5",
>    "org.json4s"               % "json4s-native_2.11"       % "3.6.5",
>    "org.json4s"               % "json4s-jackson_2.11"      % "3.6.5"
> )
>
> and I'm getting this error when I run "pio train".
>
> Exception in thread "main" java.lang.NoSuchMethodError: org.json4s.ParserUtil$.quote(Ljava/lang/String;)Ljava/lang/String;
>
> I tried with different versions of json4s, but no luck. getting same error all the time.
>
>
>
> --
> Thank you.
>
> Regards,
>
> Shoaib Hussain