You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@predictionio.apache.org by Barthe van Doorn <ba...@gmail.com> on 2017/05/02 00:17:21 UTC

[ERROR] [Engine$] No engine found. Your build might have failed. Aborting. - using PredictionIO-0.11.0-incubating scala.version=2.11.6 spark.version=2.1.0 elasticsearch.version=2.3.3

PredictionIO-0.11.0-incubating
scala.version=2.11.6
spark.version=2.1.0
elasticsearch.version=2.3.3

When I try to build an engine, I get error [INFO] [Engine$] Looking for an
engine...

[ERROR] [Engine$] No engine found. Your build might have failed. Aborting.

I see that the build process created engine jar but they are in
target/scala-2.10 and should have created them in target/scala-2.11.

Why is the engine building for scala-2.10 instead of scala-2.11?

How can I tell pio build to build for scala-2.11?

I use the following to handle my environment:
./make-distribution.sh -Dscala.version=2.11.6 -Dspark.version=2.1.0
-Delasticsearch.version=2.3.3

Here are results of pio build:

ubuntu1604vm:~/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template$
pio build --verbose
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
[INFO] [Engine$] Using command
'/home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt' at
/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template
to build.
[INFO] [Engine$] If the path above is incorrect, this process will fail.
[INFO] [Engine$] Uber JAR disabled. Making sure
lib/pio-assembly-0.11.0-incubating.jar is absent.
[INFO] [Engine$] Going to run:
/home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt  package
assemblyPackageDependency in
/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template
[INFO] [Engine$] [info] Loading project definition from
/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/project
[INFO] [Engine$] [info] Set current project to
SantimentAnalysis_BagOfWords_Model (in build
file:/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/)
[INFO] [Engine$] [success] Total time: 0 s, completed Apr 30, 2017 7:53:12 PM
[INFO] [Engine$] [info] Including from cache: scala-library-2.10.5.jar
[INFO] [Engine$] [info] Checking every *.class/*.jar file's SHA-1.
[INFO] [Engine$] [info] Merging files...
[INFO] [Engine$] [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
[INFO] [Engine$] [warn] Strategy 'discard' was applied to a file
[INFO] [Engine$] [info] Assembly up to date:
/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/target/scala-2.10/SantimentAnalysis_BagOfWords_Model-assembly-1.0-deps.jar
[INFO] [Engine$] [success] Total time: 1 s, completed Apr 30, 2017 7:53:13 PM
[INFO] [Engine$] Compilation finished successfully.
[INFO] [Engine$] Looking for an engine...
[ERROR] [Engine$] No engine found. Your build might have failed. Aborting.



results of pio status

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/i

mpl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLogger
                                               Binder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
[INFO] [Management$] Inspecting PredictionIO...
[INFO] [Management$] PredictionIO 0.11.0-incubating is installed at
/home/mnt/PredictionIO-0.11.0-incubating
[INFO] [Management$] Inspecting Apache Spark...
[INFO] [Management$] Apache Spark is installed at
/home/mnt/PredictionIO-0.11.0-incubating/vendors/spark-2.1.0-bin-hadoop2.7
[INFO] [Management$] Apache Spark 2.1.0 detected (meets minimum
requirement of 1.3.0)
[INFO] [Management$] Inspecting storage backend connections...
[INFO] [Storage$] Verifying Meta Data Backend (Source: PGSQL)...
[INFO] [Storage$] Verifying Model Data Backend (Source: PGSQL)...
[INFO] [Storage$] Verifying Event Data Backend (Source: PGSQL)...
[INFO] [Storage$] Test writing to Event Store (App Id 0)...
[INFO] [Management$] Your system is all ready to go.

env

PIO_SCALA_VERSION=2.11.6
PIO_FS_BASEDIR=/home/tmp/.pio_store
PIO_ELASTICSEARCH_VERSION=2.3.3
PIO_HADOOP_VERSION=2.7
PIO_SPARK_VERSION=2.1.0
PIO_HOME=/home/mnt/PredictionIO-0.11.0-incubating

Re: [ERROR] [Engine$] No engine found. Your build might have failed. Aborting. - using PredictionIO-0.11.0-incubating scala.version=2.11.6 spark.version=2.1.0 elasticsearch.version=2.3.3

Posted by Barthe van Doorn <ba...@gmail.com>.
Donald.. thanks.  genius and so simple.  I didn't understand your
suggestion yesterday when I opened the issue.  It worked
for incubator-predictionio-template-attribute-based-classifier.  I'm still
working to get the old LDA engine working.. suspect that's going to take a
little more work.

Here is the build.sbt that worked for
incubator-predictionio-template-attribute-based-classifier

import AssemblyKeys._

assemblySettings

name := "template-scala-parallel-classification"

organization := "org.apache.predictionio"

scalaVersion := "2.11.6"

libraryDependencies ++= Seq(
  "org.apache.predictionio" %% "apache-predictionio-core" %
"0.11.0-incubating" % "provided",
  "org.apache.spark"        %% "spark-core"               % "1.3.1" %
"provided",
  "org.apache.spark"        %% "spark-mllib"              % "1.3.1" %
"provided")

Barthe.


On Mon, May 1, 2017 at 8:25 PM, Donald Szeto <do...@apache.org> wrote:

> Hi,
>
> Can you try changing scalaVersion in the template's build.sbt?
>
> Regards,
> Donald
>
> On Mon, May 1, 2017 at 5:17 PM Barthe van Doorn <ba...@gmail.com>
> wrote:
>
>> PredictionIO-0.11.0-incubating
>> scala.version=2.11.6
>> spark.version=2.1.0
>> elasticsearch.version=2.3.3
>>
>> When I try to build an engine, I get error [INFO] [Engine$] Looking for
>> an engine...
>>
>> [ERROR] [Engine$] No engine found. Your build might have failed. Aborting.
>>
>> I see that the build process created engine jar but they are in
>> target/scala-2.10 and should have created them in target/scala-2.11.
>>
>> Why is the engine building for scala-2.10 instead of scala-2.11?
>>
>> How can I tell pio build to build for scala-2.11?
>>
>> I use the following to handle my environment:
>> ./make-distribution.sh -Dscala.version=2.11.6 -Dspark.version=2.1.0
>> -Delasticsearch.version=2.3.3
>>
>> Here are results of pio build:
>>
>> ubuntu1604vm:~/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template$ pio build --verbose
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in [jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in [jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>> [INFO] [Engine$] Using command '/home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt' at /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template to build.
>> [INFO] [Engine$] If the path above is incorrect, this process will fail.
>> [INFO] [Engine$] Uber JAR disabled. Making sure lib/pio-assembly-0.11.0-incubating.jar is absent.
>> [INFO] [Engine$] Going to run: /home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt  package assemblyPackageDependency in /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template
>> [INFO] [Engine$] [info] Loading project definition from /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/project
>> [INFO] [Engine$] [info] Set current project to SantimentAnalysis_BagOfWords_Model (in build file:/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/)
>> [INFO] [Engine$] [success] Total time: 0 s, completed Apr 30, 2017 7:53:12 PM
>> [INFO] [Engine$] [info] Including from cache: scala-library-2.10.5.jar
>> [INFO] [Engine$] [info] Checking every *.class/*.jar file's SHA-1.
>> [INFO] [Engine$] [info] Merging files...
>> [INFO] [Engine$] [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
>> [INFO] [Engine$] [warn] Strategy 'discard' was applied to a file
>> [INFO] [Engine$] [info] Assembly up to date: /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/target/scala-2.10/SantimentAnalysis_BagOfWords_Model-assembly-1.0-deps.jar
>> [INFO] [Engine$] [success] Total time: 1 s, completed Apr 30, 2017 7:53:13 PM
>> [INFO] [Engine$] Compilation finished successfully.
>> [INFO] [Engine$] Looking for an engine...
>> [ERROR] [Engine$] No engine found. Your build might have failed. Aborting.
>>
>>
>>
>> results of pio status
>>
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in [jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/i                                                mpl/StaticLoggerBinder.class]
>> SLF4J: Found binding in [jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLogger                                                Binder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>> [INFO] [Management$] Inspecting PredictionIO...
>> [INFO] [Management$] PredictionIO 0.11.0-incubating is installed at /home/mnt/PredictionIO-0.11.0-incubating
>> [INFO] [Management$] Inspecting Apache Spark...
>> [INFO] [Management$] Apache Spark is installed at /home/mnt/PredictionIO-0.11.0-incubating/vendors/spark-2.1.0-bin-hadoop2.7
>> [INFO] [Management$] Apache Spark 2.1.0 detected (meets minimum requirement of 1.3.0)
>> [INFO] [Management$] Inspecting storage backend connections...
>> [INFO] [Storage$] Verifying Meta Data Backend (Source: PGSQL)...
>> [INFO] [Storage$] Verifying Model Data Backend (Source: PGSQL)...
>> [INFO] [Storage$] Verifying Event Data Backend (Source: PGSQL)...
>> [INFO] [Storage$] Test writing to Event Store (App Id 0)...
>> [INFO] [Management$] Your system is all ready to go.
>>
>> env
>>
>> PIO_SCALA_VERSION=2.11.6
>> PIO_FS_BASEDIR=/home/tmp/.pio_store
>> PIO_ELASTICSEARCH_VERSION=2.3.3
>> PIO_HADOOP_VERSION=2.7
>> PIO_SPARK_VERSION=2.1.0
>> PIO_HOME=/home/mnt/PredictionIO-0.11.0-incubating
>>
>>


-- 
______________
Barthe van Doorn  |  Barthe.vanDoorn@gmail.com  |  703.662.3781

Re: [ERROR] [Engine$] No engine found. Your build might have failed. Aborting. - using PredictionIO-0.11.0-incubating scala.version=2.11.6 spark.version=2.1.0 elasticsearch.version=2.3.3

Posted by Donald Szeto <do...@apache.org>.
Hi,

Can you try changing scalaVersion in the template's build.sbt?

Regards,
Donald

On Mon, May 1, 2017 at 5:17 PM Barthe van Doorn <ba...@gmail.com>
wrote:

> PredictionIO-0.11.0-incubating
> scala.version=2.11.6
> spark.version=2.1.0
> elasticsearch.version=2.3.3
>
> When I try to build an engine, I get error [INFO] [Engine$] Looking for an
> engine...
>
> [ERROR] [Engine$] No engine found. Your build might have failed. Aborting.
>
> I see that the build process created engine jar but they are in
> target/scala-2.10 and should have created them in target/scala-2.11.
>
> Why is the engine building for scala-2.10 instead of scala-2.11?
>
> How can I tell pio build to build for scala-2.11?
>
> I use the following to handle my environment:
> ./make-distribution.sh -Dscala.version=2.11.6 -Dspark.version=2.1.0
> -Delasticsearch.version=2.3.3
>
> Here are results of pio build:
>
> ubuntu1604vm:~/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template$ pio build --verbose
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> [INFO] [Engine$] Using command '/home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt' at /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template to build.
> [INFO] [Engine$] If the path above is incorrect, this process will fail.
> [INFO] [Engine$] Uber JAR disabled. Making sure lib/pio-assembly-0.11.0-incubating.jar is absent.
> [INFO] [Engine$] Going to run: /home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt  package assemblyPackageDependency in /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template
> [INFO] [Engine$] [info] Loading project definition from /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/project
> [INFO] [Engine$] [info] Set current project to SantimentAnalysis_BagOfWords_Model (in build file:/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/)
> [INFO] [Engine$] [success] Total time: 0 s, completed Apr 30, 2017 7:53:12 PM
> [INFO] [Engine$] [info] Including from cache: scala-library-2.10.5.jar
> [INFO] [Engine$] [info] Checking every *.class/*.jar file's SHA-1.
> [INFO] [Engine$] [info] Merging files...
> [INFO] [Engine$] [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> [INFO] [Engine$] [warn] Strategy 'discard' was applied to a file
> [INFO] [Engine$] [info] Assembly up to date: /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/target/scala-2.10/SantimentAnalysis_BagOfWords_Model-assembly-1.0-deps.jar
> [INFO] [Engine$] [success] Total time: 1 s, completed Apr 30, 2017 7:53:13 PM
> [INFO] [Engine$] Compilation finished successfully.
> [INFO] [Engine$] Looking for an engine...
> [ERROR] [Engine$] No engine found. Your build might have failed. Aborting.
>
>
>
> results of pio status
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/i                                                mpl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLogger                                                Binder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> [INFO] [Management$] Inspecting PredictionIO...
> [INFO] [Management$] PredictionIO 0.11.0-incubating is installed at /home/mnt/PredictionIO-0.11.0-incubating
> [INFO] [Management$] Inspecting Apache Spark...
> [INFO] [Management$] Apache Spark is installed at /home/mnt/PredictionIO-0.11.0-incubating/vendors/spark-2.1.0-bin-hadoop2.7
> [INFO] [Management$] Apache Spark 2.1.0 detected (meets minimum requirement of 1.3.0)
> [INFO] [Management$] Inspecting storage backend connections...
> [INFO] [Storage$] Verifying Meta Data Backend (Source: PGSQL)...
> [INFO] [Storage$] Verifying Model Data Backend (Source: PGSQL)...
> [INFO] [Storage$] Verifying Event Data Backend (Source: PGSQL)...
> [INFO] [Storage$] Test writing to Event Store (App Id 0)...
> [INFO] [Management$] Your system is all ready to go.
>
> env
>
> PIO_SCALA_VERSION=2.11.6
> PIO_FS_BASEDIR=/home/tmp/.pio_store
> PIO_ELASTICSEARCH_VERSION=2.3.3
> PIO_HADOOP_VERSION=2.7
> PIO_SPARK_VERSION=2.1.0
> PIO_HOME=/home/mnt/PredictionIO-0.11.0-incubating
>
>