You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Xing Yong <xy...@gmail.com> on 2014/04/14 13:24:54 UTC

compiling storm code with maven and using storm client

1. when I compile the storm-0.9.1 release source code with maven, always
get this error, how to fix it ? thank you.

Compiling backtype.storm.ui.core to
/home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/classes
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Storm ............................................. SUCCESS
[3:53.213s]
[INFO] maven-shade-clojure-transformer ................... SUCCESS [4.043s]
[INFO] Storm Core ........................................ FAILURE
[1:57.586s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 5:58.106s
[INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
[INFO] Final Memory: 27M/2030M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
com.theoryinpractise:clojure-maven-plugin:1.3.18:compile (compile-clojure)
on project storm-core: Clojure failed. -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
(compile-clojure) on project storm-core: Clojure failed.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure failed.
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:451)
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:367)
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:344)
at
com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompilerMojo.java:47)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
[ERROR]
[ERROR]

2. Using storm client, how to submit additional files to server, does storm
client support this operation? for example, i want to transfer some files
from client to server which my topology will use, someone have any idea to
share with ?

thank you

Re: compiling storm code with maven and using storm client

Posted by Xing Yong <xy...@gmail.com>.
hi Harsha,
   i have ruby 1.8.7，but i always build it skipping test and still get the
same error above when attach "mvn -X" output.
i have tried on different machines for centos and ubuntu. i'm very confused
with it.


2014-04-16 0:45 GMT+08:00 Harsha <st...@harsha.io>:

>
>
> Xing,
>
>         Do you have ruby 1.9.3 and python installed. I was able to
> build using java 1.6.0_37 on centos 6.5
>
> but you need ruby and python for the build as multilang tests uses
> them. If you still seeing issues with build please attach "mvn -X clean
> package" output.
>
> -Harsha
>
>
> On Mon, Apr 14, 2014, at 06:29 PM, Xing Yong wrote:
>
> thanks Harsha for your reply.   My platform details:
>
> linux: CentOS release 6.3 (Final)
>
> mvn --version :
> Apache Maven 3.0.4 (r1232337; 2012-01-17 16:44:56+0800)
> Maven home: /opt/soft/apache-maven-3.0.4
> Java version: 1.6.0_37, vendor: Sun Microsystems Inc.
> Java home: /opt/soft/jdk1.6.0_37/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "2.6.32-279.23.1.mi3.el6.x86_64", arch:
> "amd64", family: "unix"
>
> java -version:
> java version "1.6.0_37"
> Java(TM) SE Runtime Environment (build 1.6.0_37-b06)
> Java HotSpot(TM) 64-Bit Server VM (build 20.12-b01, mixed mode)
>
>  I open the debug pattern for maven, but not found useful infor
>
>
> 2014-04-14 21:53 GMT+08:00 Harsha <st...@harsha.io>:
>
>  Xing,
>     Can you share your platform details . Are you compiling on windows or
> linux , maven, java versions etc.
> -Harsha
>
>
> On Mon, Apr 14, 2014, at 05:32 AM, David Crossland wrote:
>
> I'm not sure about 1
>
> But 2, you can just copy any topology dependant jars to storms lib
> directory
>
> D
>
>  *From:* Xing Yong <xy...@gmail.com>
>  *Sent:* ‎Monday‎, ‎14‎ ‎April‎ ‎2014 ‎12‎:‎25
>  *To:* user@storm.incubator.apache.org
>
> 1. when I compile the storm-0.9.1 release source code with maven, always
> get this error, how to fix it ? thank you.
>
>
> Compiling backtype.storm.ui.core to
> /home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/classes
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Storm ............................................. SUCCESS
> [3:53.213s]
> [INFO] maven-shade-clojure-transformer ................... SUCCESS [4.043s]
> [INFO] Storm Core ........................................ FAILURE
> [1:57.586s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 5:58.106s
> [INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
> [INFO] Final Memory: 27M/2030M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> com.theoryinpractise:clojure-maven-plugin:1.3.18:compile (compile-clojure)
> on project storm-core: Clojure failed. -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
> (compile-clojure) on project storm-core: Clojure failed.
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure failed.
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:451)
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:367)
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:344)
> at
> com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompilerMojo.java:47)
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> ... 19 more
> [ERROR]
> [ERROR]
>
>  2. Using storm client, how to submit additional files to server, does
> storm client support this operation? for example, i want to transfer some
> files from client to server which my topology will use, someone have any
> idea to share with ?
>
> thank you
>
>
>
>

Re: compiling storm code with maven and using storm client

Posted by Harsha <st...@harsha.io>.

Xing,

     Do you have ruby 1.9.3 and python installed. I was able to
build using java 1.6.0_37 on centos 6.5

but you need ruby and python for the build as multilang tests uses
them. If you still seeing issues with build please attach "mvn -X clean
package" output.

-Harsha



On Mon, Apr 14, 2014, at 06:29 PM, Xing Yong wrote:

thanks Harsha for your reply.   My platform details:

linux: CentOS release 6.3 (Final)

mvn --version :
Apache Maven 3.0.4 (r1232337; 2012-01-17 16:44:56+0800)
Maven home: /opt/soft/apache-maven-3.0.4
Java version: 1.6.0_37, vendor: Sun Microsystems Inc.
Java home: /opt/soft/jdk1.6.0_37/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-279.23.1.mi3.el6.x86_64", arch:
"amd64", family: "unix"

java -version:
java version "1.6.0_37"
Java(TM) SE Runtime Environment (build 1.6.0_37-b06)
Java HotSpot(TM) 64-Bit Server VM (build 20.12-b01, mixed mode)

 I open the debug pattern for maven, but not found useful infor



2014-04-14 21:53 GMT+08:00 Harsha <[1...@harsha.io>:

Xing,
    Can you share your platform details . Are you compiling on windows
or linux , maven, java versions etc.
-Harsha


On Mon, Apr 14, 2014, at 05:32 AM, David Crossland wrote:

I'm not sure about 1

But 2, you can just copy any topology dependant jars to storms lib
directory

D

From: [2]Xing Yong
Sent: Monday, 14 April 2014 12:25
To: [3]user@storm.incubator.apache.org

1. when I compile the storm-0.9.1 release source code with maven,
always get this error, how to fix it ? thank you.


Compiling backtype.storm.ui.core to
/home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/class
es
[INFO]
-----------------------------------------------------------------------
-
[INFO] Reactor Summary:
[INFO]
[INFO] Storm ............................................. SUCCESS
[3:53.213s]
[INFO] maven-shade-clojure-transformer ................... SUCCESS
[4.043s]
[INFO] Storm Core ........................................ FAILURE
[1:57.586s]
[INFO]
-----------------------------------------------------------------------
-
[INFO] BUILD FAILURE
[INFO]
-----------------------------------------------------------------------
-
[INFO] Total time: 5:58.106s
[INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
[INFO] Final Memory: 27M/2030M
[INFO]
-----------------------------------------------------------------------
-
[ERROR] Failed to execute goal
com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
(compile-clojure) on project storm-core: Clojure failed. -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
execute goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
(compile-clojure) on project storm-core: Clojure failed.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:217)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuil
d(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleS
tarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja
va:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso
rImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launch
er.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:
230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Laun
cher.java:409)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:35
2)
Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure
failed.
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWit
h(AbstractClojureCompilerMojo.java:451)
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWit
h(AbstractClojureCompilerMojo.java:367)
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWit
h(AbstractClojureCompilerMojo.java:344)
at
com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompile
rMojo.java:47)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBu
ildPluginManager.java:101)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:209)
... 19 more
[ERROR]
[ERROR]

2. Using storm client, how to submit additional files to server, does
storm client support this operation? for example, i want to transfer
some files from client to server which my topology will use, someone
have any idea to share with ?

thank you

References

1. mailto:storm@harsha.io
2. mailto:xyong.ac@gmail.com
3. mailto:user@storm.incubator.apache.org

Re: compiling storm code with maven and using storm client

Posted by Xing Yong <xy...@gmail.com>.
thanks Harsha for your reply.   My platform details:

linux: CentOS release 6.3 (Final)

mvn --version :
Apache Maven 3.0.4 (r1232337; 2012-01-17 16:44:56+0800)
Maven home: /opt/soft/apache-maven-3.0.4
Java version: 1.6.0_37, vendor: Sun Microsystems Inc.
Java home: /opt/soft/jdk1.6.0_37/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-279.23.1.mi3.el6.x86_64", arch: "amd64",
family: "unix"

java -version:
java version "1.6.0_37"
Java(TM) SE Runtime Environment (build 1.6.0_37-b06)
Java HotSpot(TM) 64-Bit Server VM (build 20.12-b01, mixed mode)

 I open the debug pattern for maven, but not found useful infor


2014-04-14 21:53 GMT+08:00 Harsha <st...@harsha.io>:

>  Xing,
>     Can you share your platform details . Are you compiling on windows or
> linux , maven, java versions etc.
> -Harsha
>
>
> On Mon, Apr 14, 2014, at 05:32 AM, David Crossland wrote:
>
> I'm not sure about 1
>
> But 2, you can just copy any topology dependant jars to storms lib
> directory
>
> D
>
>  *From:* Xing Yong <xy...@gmail.com>
>  *Sent:* ‎Monday‎, ‎14‎ ‎April‎ ‎2014 ‎12‎:‎25
>  *To:* user@storm.incubator.apache.org
>
> 1. when I compile the storm-0.9.1 release source code with maven, always
> get this error, how to fix it ? thank you.
>
>
> Compiling backtype.storm.ui.core to
> /home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/classes
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Storm ............................................. SUCCESS
> [3:53.213s]
> [INFO] maven-shade-clojure-transformer ................... SUCCESS [4.043s]
> [INFO] Storm Core ........................................ FAILURE
> [1:57.586s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 5:58.106s
> [INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
> [INFO] Final Memory: 27M/2030M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> com.theoryinpractise:clojure-maven-plugin:1.3.18:compile (compile-clojure)
> on project storm-core: Clojure failed. -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
> (compile-clojure) on project storm-core: Clojure failed.
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure failed.
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:451)
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:367)
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:344)
> at
> com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompilerMojo.java:47)
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> ... 19 more
> [ERROR]
> [ERROR]
>
>  2. Using storm client, how to submit additional files to server, does
> storm client support this operation? for example, i want to transfer some
> files from client to server which my topology will use, someone have any
> idea to share with ?
>
> thank you
>
>

Re: compiling storm code with maven and using storm client

Posted by Harsha <st...@harsha.io>.
Xing,

    Can you share your platform details . Are you compiling on windows
or linux , maven, java versions etc.

-Harsha





On Mon, Apr 14, 2014, at 05:32 AM, David Crossland wrote:

I'm not sure about 1

But 2, you can just copy any topology dependant jars to storms lib
directory

D

From: [1]Xing Yong
Sent: Monday, 14 April 2014 12:25
To: [2]user@storm.incubator.apache.org

1. when I compile the storm-0.9.1 release source code with maven,
always get this error, how to fix it ? thank you.


Compiling backtype.storm.ui.core to
/home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/class
es
[INFO]
-----------------------------------------------------------------------
-
[INFO] Reactor Summary:
[INFO]
[INFO] Storm ............................................. SUCCESS
[3:53.213s]
[INFO] maven-shade-clojure-transformer ................... SUCCESS
[4.043s]
[INFO] Storm Core ........................................ FAILURE
[1:57.586s]
[INFO]
-----------------------------------------------------------------------
-
[INFO] BUILD FAILURE
[INFO]
-----------------------------------------------------------------------
-
[INFO] Total time: 5:58.106s
[INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
[INFO] Final Memory: 27M/2030M
[INFO]
-----------------------------------------------------------------------
-
[ERROR] Failed to execute goal
com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
(compile-clojure) on project storm-core: Clojure failed. -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
execute goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
(compile-clojure) on project storm-core: Clojure failed.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:217)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuil
d(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleS
tarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja
va:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso
rImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launch
er.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:
230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Laun
cher.java:409)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:35
2)
Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure
failed.
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWit
h(AbstractClojureCompilerMojo.java:451)
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWit
h(AbstractClojureCompilerMojo.java:367)
at
com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWit
h(AbstractClojureCompilerMojo.java:344)
at
com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompile
rMojo.java:47)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBu
ildPluginManager.java:101)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j
ava:209)
... 19 more
[ERROR]
[ERROR]

2. Using storm client, how to submit additional files to server, does
storm client support this operation? for example, i want to transfer
some files from client to server which my topology will use, someone
have any idea to share with ?

thank you

References

1. mailto:xyong.ac@gmail.com
2. mailto:user@storm.incubator.apache.org

Re: compiling storm code with maven and using storm client

Posted by Carlos Rodriguez <cr...@gmail.com>.
Take a look at storm-starter project from Nathan (
https://github.com/nathanmarz/storm-starter)

It uses maven to build two different jar files: one with dependencies (so
you don't have to put these in the lib folder) and one without them (so you
will have to provide these in the lib folder).

Hopefully you could just modify its pom.xml file to achieve what you need.

Regards,
Carlos


2014-04-15 3:33 GMT+02:00 Xing Yong <xy...@gmail.com>:

> yes, it's a way to solve the problem.
>
> but if i have a storm cluster, i must do two things:
> 1. copy the dependant jars to every production machine
> 2. every time one topology has dependant jars, i must do the step 1 again.
>
> so, hope storm client can support submit third part files for topologies.
>
>
> 2014-04-14 20:32 GMT+08:00 David Crossland <da...@elastacloud.com>:
>
>   I'm not sure about 1
>>
>>  But 2, you can just copy any topology dependant jars to storms lib
>> directory
>>
>>  D
>>
>>   *From:* Xing Yong <xy...@gmail.com>
>> *Sent:* ‎Monday‎, ‎14‎ ‎April‎ ‎2014 ‎12‎:‎25
>> *To:* user@storm.incubator.apache.org
>>
>>  1. when I compile the storm-0.9.1 release source code with maven,
>> always get this error, how to fix it ? thank you.
>>
>>  Compiling backtype.storm.ui.core to
>> /home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/classes
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Storm ............................................. SUCCESS
>> [3:53.213s]
>> [INFO] maven-shade-clojure-transformer ................... SUCCESS
>> [4.043s]
>> [INFO] Storm Core ........................................ FAILURE
>> [1:57.586s]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 5:58.106s
>> [INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
>> [INFO] Final Memory: 27M/2030M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> com.theoryinpractise:clojure-maven-plugin:1.3.18:compile (compile-clojure)
>> on project storm-core: Clojure failed. -> [Help 1]
>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
>> goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
>> (compile-clojure) on project storm-core: Clojure failed.
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
>> Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure failed.
>> at
>> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:451)
>> at
>> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:367)
>> at
>> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:344)
>> at
>> com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompilerMojo.java:47)
>> at
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>> ... 19 more
>> [ERROR]
>> [ERROR]
>>
>>  2. Using storm client, how to submit additional files to server, does
>> storm client support this operation? for example, i want to transfer some
>> files from client to server which my topology will use, someone have any
>> idea to share with ?
>>
>>  thank you
>>
>
>

Re: compiling storm code with maven and using storm client

Posted by Xing Yong <xy...@gmail.com>.
yes, it's a way to solve the problem.

but if i have a storm cluster, i must do two things:
1. copy the dependant jars to every production machine
2. every time one topology has dependant jars, i must do the step 1 again.

so, hope storm client can support submit third part files for topologies.


2014-04-14 20:32 GMT+08:00 David Crossland <da...@elastacloud.com>:

>  I'm not sure about 1
>
>  But 2, you can just copy any topology dependant jars to storms lib
> directory
>
>  D
>
>   *From:* Xing Yong <xy...@gmail.com>
> *Sent:* ‎Monday‎, ‎14‎ ‎April‎ ‎2014 ‎12‎:‎25
> *To:* user@storm.incubator.apache.org
>
>  1. when I compile the storm-0.9.1 release source code with maven, always
> get this error, how to fix it ? thank you.
>
>  Compiling backtype.storm.ui.core to
> /home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/classes
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Storm ............................................. SUCCESS
> [3:53.213s]
> [INFO] maven-shade-clojure-transformer ................... SUCCESS [4.043s]
> [INFO] Storm Core ........................................ FAILURE
> [1:57.586s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 5:58.106s
> [INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
> [INFO] Final Memory: 27M/2030M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> com.theoryinpractise:clojure-maven-plugin:1.3.18:compile (compile-clojure)
> on project storm-core: Clojure failed. -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile
> (compile-clojure) on project storm-core: Clojure failed.
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure failed.
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:451)
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:367)
> at
> com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:344)
> at
> com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompilerMojo.java:47)
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> ... 19 more
> [ERROR]
> [ERROR]
>
>  2. Using storm client, how to submit additional files to server, does
> storm client support this operation? for example, i want to transfer some
> files from client to server which my topology will use, someone have any
> idea to share with ?
>
>  thank you
>

Re: compiling storm code with maven and using storm client

Posted by David Crossland <da...@elastacloud.com>.
I'm not sure about 1

But 2, you can just copy any topology dependant jars to storms lib directory

D

From: Xing Yong<ma...@gmail.com>
Sent: ?Monday?, ?14? ?April? ?2014 ?12?:?25
To: user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>

1. when I compile the storm-0.9.1 release source code with maven, always get this error, how to fix it ? thank you.

Compiling backtype.storm.ui.core to /home/yongxing/infra-git/storm-0.9.1-incubating/storm-core/target/classes
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Storm ............................................. SUCCESS [3:53.213s]
[INFO] maven-shade-clojure-transformer ................... SUCCESS [4.043s]
[INFO] Storm Core ........................................ FAILURE [1:57.586s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:58.106s
[INFO] Finished at: Mon Apr 14 12:28:08 CST 2014
[INFO] Final Memory: 27M/2030M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile (compile-clojure) on project storm-core: Clojure failed. -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal com.theoryinpractise:clojure-maven-plugin:1.3.18:compile (compile-clojure) on project storm-core: Clojure failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.MojoExecutionException: Clojure failed.
at com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:451)
at com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:367)
at com.theoryinpractise.clojure.AbstractClojureCompilerMojo.callClojureWith(AbstractClojureCompilerMojo.java:344)
at com.theoryinpractise.clojure.ClojureCompilerMojo.execute(ClojureCompilerMojo.java:47)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
[ERROR]
[ERROR]

2. Using storm client, how to submit additional files to server, does storm client support this operation? for example, i want to transfer some files from client to server which my topology will use, someone have any idea to share with ?

thank you