You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Maximilian Alber <al...@gmail.com> on 2015/06/10 15:38:19 UTC
Flink-ML as Dependency
Hi Flinksters,
I would like to test FlinkML. Unfortunately, I get an error when including
it to my project. It might be my error as I'm not experienced with Gradle,
but with Google I got any wiser.
My build.gradle looks as follows:
apply plugin: 'java'
apply plugin: 'scala'
//sourceCompatibility = 1.5
version = '1.0'
jar {
manifest {
attributes 'Implementation-Title': 'Test Project',
'Implementation-Version': 1.0
}
}
repositories {
mavenCentral()
mavenLocal()
}
dependencies {
compile 'org.scala-lang:scala-library:2.10.5'
compile 'org.scala-lang:scala-compiler:2.10.5'
compile 'org.scalanlp:breeze_2.10:0.11.2'
compile group: 'org.apache.flink', name: 'flink-clients', version:
'0.9-SNAPSHOT'
compile group: 'org.apache.flink', name: 'flink-scala', version:
'0.9-SNAPSHOT'
compile group: 'org.apache.flink', name: 'flink-ml', version:
'0.9-SNAPSHOT'
}
And I get the following error:
alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
FAILURE: Build failed with an exception.
* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
Required by:
:test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
> Illegal character in path at index 51:
http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or
--debug option to get more log output.
BUILD FAILED
Total time: 7.113 secs
I'm thankful for any ideas!
Cheers,
Max
Re: Flink-ML as Dependency
Posted by Maximilian Alber <al...@gmail.com>.
Well then, I should update ;-)
On Thu, Jun 11, 2015 at 4:01 PM, Till Rohrmann <ti...@gmail.com>
wrote:
> Hmm then I assume that version 2 can properly handle maven property
> variables.
>
>
> On Thu, Jun 11, 2015 at 3:05 PM Maximilian Alber <
> alber.maximilian@gmail.com> wrote:
>
>> Hi Till,
>>
>> I use the standard one for Ubuntu 15.04, which is 1.5.
>>
>> That did not make any difference.
>>
>> Thanks and Cheers,
>> Max
>>
>> On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann <tr...@apache.org>
>> wrote:
>>
>>> Hi Max,
>>>
>>> I just tested a build using gradle (with your build.gradle file) and
>>> some flink-ml algorithms. And it was completed without the problem of the
>>> unresolved breeze dependency.
>>>
>>> I use the version 2.2.1 of Gradle. Which version are you using?
>>>
>>> Since you’re using Flink’s snapshots and have specified only the local
>>> maven repository, can you re-install flink again and check whether the
>>> error still occurs? Simple call mvn clean install -DskipTests
>>> -Dmaven.javadoc.skip=true from the root directory of Flink.
>>>
>>> Cheers,
>>> Till
>>>
>>> On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber
>>> alber.maximilian@gmail.com <ht...@gmail.com>
>>> wrote:
>>>
>>> Hi Flinksters,
>>>>
>>>> I would like to test FlinkML. Unfortunately, I get an error when
>>>> including it to my project. It might be my error as I'm not experienced
>>>> with Gradle, but with Google I got any wiser.
>>>>
>>>> My build.gradle looks as follows:
>>>>
>>>> apply plugin: 'java'
>>>> apply plugin: 'scala'
>>>>
>>>> //sourceCompatibility = 1.5
>>>> version = '1.0'
>>>> jar {
>>>> manifest {
>>>> attributes 'Implementation-Title': 'Test Project',
>>>> 'Implementation-Version': 1.0
>>>> }
>>>> }
>>>>
>>>> repositories {
>>>> mavenCentral()
>>>> mavenLocal()
>>>> }
>>>>
>>>> dependencies {
>>>> compile 'org.scala-lang:scala-library:2.10.5'
>>>> compile 'org.scala-lang:scala-compiler:2.10.5'
>>>>
>>>> compile 'org.scalanlp:breeze_2.10:0.11.2'
>>>>
>>>> compile group: 'org.apache.flink', name: 'flink-clients', version:
>>>> '0.9-SNAPSHOT'
>>>> compile group: 'org.apache.flink', name: 'flink-scala', version:
>>>> '0.9-SNAPSHOT'
>>>> compile group: 'org.apache.flink', name: 'flink-ml', version:
>>>> '0.9-SNAPSHOT'
>>>> }
>>>>
>>>> And I get the following error:
>>>>
>>>> alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle
>>>> compileScala
>>>> Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
>>>>
>>>> FAILURE: Build failed with an exception.
>>>>
>>>> * What went wrong:
>>>> Could not resolve all dependencies for configuration ':compile'.
>>>> > Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
>>>> Required by:
>>>> :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
>>>> > Illegal character in path at index 51:
>>>> http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom
>>>>
>>>> * Try:
>>>> Run with --stacktrace option to get the stack trace. Run with --info or
>>>> --debug option to get more log output.
>>>>
>>>> BUILD FAILED
>>>>
>>>> Total time: 7.113 secs
>>>>
>>>>
>>>> I'm thankful for any ideas!
>>>>
>>>> Cheers,
>>>> Max
>>>>
>>>
>>>
>>
>>
Re: Flink-ML as Dependency
Posted by Till Rohrmann <ti...@gmail.com>.
Hmm then I assume that version 2 can properly handle maven property
variables.
On Thu, Jun 11, 2015 at 3:05 PM Maximilian Alber <al...@gmail.com>
wrote:
> Hi Till,
>
> I use the standard one for Ubuntu 15.04, which is 1.5.
>
> That did not make any difference.
>
> Thanks and Cheers,
> Max
>
> On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann <tr...@apache.org>
> wrote:
>
>> Hi Max,
>>
>> I just tested a build using gradle (with your build.gradle file) and some
>> flink-ml algorithms. And it was completed without the problem of the
>> unresolved breeze dependency.
>>
>> I use the version 2.2.1 of Gradle. Which version are you using?
>>
>> Since you’re using Flink’s snapshots and have specified only the local
>> maven repository, can you re-install flink again and check whether the
>> error still occurs? Simple call mvn clean install -DskipTests
>> -Dmaven.javadoc.skip=true from the root directory of Flink.
>>
>> Cheers,
>> Till
>>
>> On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber
>> alber.maximilian@gmail.com <ht...@gmail.com>
>> wrote:
>>
>> Hi Flinksters,
>>>
>>> I would like to test FlinkML. Unfortunately, I get an error when
>>> including it to my project. It might be my error as I'm not experienced
>>> with Gradle, but with Google I got any wiser.
>>>
>>> My build.gradle looks as follows:
>>>
>>> apply plugin: 'java'
>>> apply plugin: 'scala'
>>>
>>> //sourceCompatibility = 1.5
>>> version = '1.0'
>>> jar {
>>> manifest {
>>> attributes 'Implementation-Title': 'Test Project',
>>> 'Implementation-Version': 1.0
>>> }
>>> }
>>>
>>> repositories {
>>> mavenCentral()
>>> mavenLocal()
>>> }
>>>
>>> dependencies {
>>> compile 'org.scala-lang:scala-library:2.10.5'
>>> compile 'org.scala-lang:scala-compiler:2.10.5'
>>>
>>> compile 'org.scalanlp:breeze_2.10:0.11.2'
>>>
>>> compile group: 'org.apache.flink', name: 'flink-clients', version:
>>> '0.9-SNAPSHOT'
>>> compile group: 'org.apache.flink', name: 'flink-scala', version:
>>> '0.9-SNAPSHOT'
>>> compile group: 'org.apache.flink', name: 'flink-ml', version:
>>> '0.9-SNAPSHOT'
>>> }
>>>
>>> And I get the following error:
>>>
>>> alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle
>>> compileScala
>>> Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
>>>
>>> FAILURE: Build failed with an exception.
>>>
>>> * What went wrong:
>>> Could not resolve all dependencies for configuration ':compile'.
>>> > Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
>>> Required by:
>>> :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
>>> > Illegal character in path at index 51:
>>> http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom
>>>
>>> * Try:
>>> Run with --stacktrace option to get the stack trace. Run with --info or
>>> --debug option to get more log output.
>>>
>>> BUILD FAILED
>>>
>>> Total time: 7.113 secs
>>>
>>>
>>> I'm thankful for any ideas!
>>>
>>> Cheers,
>>> Max
>>>
>>
>>
>
>
Re: Flink-ML as Dependency
Posted by Maximilian Alber <al...@gmail.com>.
Hi Till,
I use the standard one for Ubuntu 15.04, which is 1.5.
That did not make any difference.
Thanks and Cheers,
Max
On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann <tr...@apache.org>
wrote:
> Hi Max,
>
> I just tested a build using gradle (with your build.gradle file) and some
> flink-ml algorithms. And it was completed without the problem of the
> unresolved breeze dependency.
>
> I use the version 2.2.1 of Gradle. Which version are you using?
>
> Since you’re using Flink’s snapshots and have specified only the local
> maven repository, can you re-install flink again and check whether the
> error still occurs? Simple call mvn clean install -DskipTests
> -Dmaven.javadoc.skip=true from the root directory of Flink.
>
> Cheers,
> Till
>
> On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber
> alber.maximilian@gmail.com <ht...@gmail.com>
> wrote:
>
> Hi Flinksters,
>>
>> I would like to test FlinkML. Unfortunately, I get an error when
>> including it to my project. It might be my error as I'm not experienced
>> with Gradle, but with Google I got any wiser.
>>
>> My build.gradle looks as follows:
>>
>> apply plugin: 'java'
>> apply plugin: 'scala'
>>
>> //sourceCompatibility = 1.5
>> version = '1.0'
>> jar {
>> manifest {
>> attributes 'Implementation-Title': 'Test Project',
>> 'Implementation-Version': 1.0
>> }
>> }
>>
>> repositories {
>> mavenCentral()
>> mavenLocal()
>> }
>>
>> dependencies {
>> compile 'org.scala-lang:scala-library:2.10.5'
>> compile 'org.scala-lang:scala-compiler:2.10.5'
>>
>> compile 'org.scalanlp:breeze_2.10:0.11.2'
>>
>> compile group: 'org.apache.flink', name: 'flink-clients', version:
>> '0.9-SNAPSHOT'
>> compile group: 'org.apache.flink', name: 'flink-scala', version:
>> '0.9-SNAPSHOT'
>> compile group: 'org.apache.flink', name: 'flink-ml', version:
>> '0.9-SNAPSHOT'
>> }
>>
>> And I get the following error:
>>
>> alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle
>> compileScala
>> Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
>>
>> FAILURE: Build failed with an exception.
>>
>> * What went wrong:
>> Could not resolve all dependencies for configuration ':compile'.
>> > Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
>> Required by:
>> :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
>> > Illegal character in path at index 51:
>> http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom
>>
>> * Try:
>> Run with --stacktrace option to get the stack trace. Run with --info or
>> --debug option to get more log output.
>>
>> BUILD FAILED
>>
>> Total time: 7.113 secs
>>
>>
>> I'm thankful for any ideas!
>>
>> Cheers,
>> Max
>>
>
>
Re: Flink-ML as Dependency
Posted by Till Rohrmann <tr...@apache.org>.
Hi Max,
I just tested a build using gradle (with your build.gradle file) and some
flink-ml algorithms. And it was completed without the problem of the
unresolved breeze dependency.
I use the version 2.2.1 of Gradle. Which version are you using?
Since you’re using Flink’s snapshots and have specified only the local
maven repository, can you re-install flink again and check whether the
error still occurs? Simple call mvn clean install -DskipTests
-Dmaven.javadoc.skip=true from the root directory of Flink.
Cheers,
Till
On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber alber.maximilian@gmail.com
<ht...@gmail.com> wrote:
Hi Flinksters,
>
> I would like to test FlinkML. Unfortunately, I get an error when including
> it to my project. It might be my error as I'm not experienced with Gradle,
> but with Google I got any wiser.
>
> My build.gradle looks as follows:
>
> apply plugin: 'java'
> apply plugin: 'scala'
>
> //sourceCompatibility = 1.5
> version = '1.0'
> jar {
> manifest {
> attributes 'Implementation-Title': 'Test Project',
> 'Implementation-Version': 1.0
> }
> }
>
> repositories {
> mavenCentral()
> mavenLocal()
> }
>
> dependencies {
> compile 'org.scala-lang:scala-library:2.10.5'
> compile 'org.scala-lang:scala-compiler:2.10.5'
>
> compile 'org.scalanlp:breeze_2.10:0.11.2'
>
> compile group: 'org.apache.flink', name: 'flink-clients', version:
> '0.9-SNAPSHOT'
> compile group: 'org.apache.flink', name: 'flink-scala', version:
> '0.9-SNAPSHOT'
> compile group: 'org.apache.flink', name: 'flink-ml', version:
> '0.9-SNAPSHOT'
> }
>
> And I get the following error:
>
> alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle
> compileScala
> Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Could not resolve all dependencies for configuration ':compile'.
> > Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
> Required by:
> :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
> > Illegal character in path at index 51:
> http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom
>
> * Try:
> Run with --stacktrace option to get the stack trace. Run with --info or
> --debug option to get more log output.
>
> BUILD FAILED
>
> Total time: 7.113 secs
>
>
> I'm thankful for any ideas!
>
> Cheers,
> Max
>
Re: Flink-ML as Dependency
Posted by Maximilian Alber <al...@gmail.com>.
Hi Till,
Thanks for the quick help!
Cheers,
Max
On Wed, Jun 10, 2015 at 5:50 PM, Till Rohrmann <ti...@gmail.com>
wrote:
> Hi Max,
>
> I think the reason is that the flink-ml pom contains as a dependency an
> artifact with artifactId breeze_${scala.binary.version}. The variable
> scala.binary.version is defined in the parent pom and not substituted
> when flink-ml is installed. Therefore gradle tries to find a dependency
> with the name breeze_${scala.binary.version}.
>
> I try to find a solution for this problem. As a quick work around you
> should be able to define the variable manually and set it to 2.10.
>
> Cheers,
> Till
>
>
> On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber <
> alber.maximilian@gmail.com> wrote:
>
>> Hi Flinksters,
>>
>> I would like to test FlinkML. Unfortunately, I get an error when
>> including it to my project. It might be my error as I'm not experienced
>> with Gradle, but with Google I got any wiser.
>>
>> My build.gradle looks as follows:
>>
>> apply plugin: 'java'
>> apply plugin: 'scala'
>>
>> //sourceCompatibility = 1.5
>> version = '1.0'
>> jar {
>> manifest {
>> attributes 'Implementation-Title': 'Test Project',
>> 'Implementation-Version': 1.0
>> }
>> }
>>
>> repositories {
>> mavenCentral()
>> mavenLocal()
>> }
>>
>> dependencies {
>> compile 'org.scala-lang:scala-library:2.10.5'
>> compile 'org.scala-lang:scala-compiler:2.10.5'
>>
>> compile 'org.scalanlp:breeze_2.10:0.11.2'
>>
>> compile group: 'org.apache.flink', name: 'flink-clients', version:
>> '0.9-SNAPSHOT'
>> compile group: 'org.apache.flink', name: 'flink-scala', version:
>> '0.9-SNAPSHOT'
>> compile group: 'org.apache.flink', name: 'flink-ml', version:
>> '0.9-SNAPSHOT'
>> }
>>
>> And I get the following error:
>>
>> alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle
>> compileScala
>> Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
>>
>> FAILURE: Build failed with an exception.
>>
>> * What went wrong:
>> Could not resolve all dependencies for configuration ':compile'.
>> > Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
>> Required by:
>> :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
>> > Illegal character in path at index 51:
>> http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom
>>
>> * Try:
>> Run with --stacktrace option to get the stack trace. Run with --info or
>> --debug option to get more log output.
>>
>> BUILD FAILED
>>
>> Total time: 7.113 secs
>>
>>
>> I'm thankful for any ideas!
>>
>> Cheers,
>> Max
>>
>
Re: Flink-ML as Dependency
Posted by Till Rohrmann <ti...@gmail.com>.
Hi Max,
I think the reason is that the flink-ml pom contains as a dependency an
artifact with artifactId breeze_${scala.binary.version}. The variable
scala.binary.version is defined in the parent pom and not substituted when
flink-ml is installed. Therefore gradle tries to find a dependency with the
name breeze_${scala.binary.version}.
I try to find a solution for this problem. As a quick work around you
should be able to define the variable manually and set it to 2.10.
Cheers,
Till
On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber <al...@gmail.com>
wrote:
> Hi Flinksters,
>
> I would like to test FlinkML. Unfortunately, I get an error when including
> it to my project. It might be my error as I'm not experienced with Gradle,
> but with Google I got any wiser.
>
> My build.gradle looks as follows:
>
> apply plugin: 'java'
> apply plugin: 'scala'
>
> //sourceCompatibility = 1.5
> version = '1.0'
> jar {
> manifest {
> attributes 'Implementation-Title': 'Test Project',
> 'Implementation-Version': 1.0
> }
> }
>
> repositories {
> mavenCentral()
> mavenLocal()
> }
>
> dependencies {
> compile 'org.scala-lang:scala-library:2.10.5'
> compile 'org.scala-lang:scala-compiler:2.10.5'
>
> compile 'org.scalanlp:breeze_2.10:0.11.2'
>
> compile group: 'org.apache.flink', name: 'flink-clients', version:
> '0.9-SNAPSHOT'
> compile group: 'org.apache.flink', name: 'flink-scala', version:
> '0.9-SNAPSHOT'
> compile group: 'org.apache.flink', name: 'flink-ml', version:
> '0.9-SNAPSHOT'
> }
>
> And I get the following error:
>
> alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle
> compileScala
> Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Could not resolve all dependencies for configuration ':compile'.
> > Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
> Required by:
> :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
> > Illegal character in path at index 51:
> http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom
>
> * Try:
> Run with --stacktrace option to get the stack trace. Run with --info or
> --debug option to get more log output.
>
> BUILD FAILED
>
> Total time: 7.113 secs
>
>
> I'm thankful for any ideas!
>
> Cheers,
> Max
>