You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by GitBox <gi...@apache.org> on 2021/07/07 13:51:35 UTC

[GitHub] [storm] FelixEngl edited a comment on pull request #3403: Fix various problems in the python PowerShell execution

FelixEngl edited a comment on pull request #3403:
URL: https://github.com/apache/storm/pull/3403#issuecomment-875613688


   Addendum 2:
   
   Fixed the piping of the stout and stderr of the java-programm to the PowerShell console.  
   In oder to improve the local execution of the code.
   I tested it on my machine again (Windows 10 Pro, Python 3.9.1, OpenJDK 15). 
   
   With this fixes the PowerShell console-output looks like this:
   
   ```
   Running: C:\Program Files\AdoptOpenJDK\jdk-15.0.2.7-hotspot\bin\java.exe -client -Ddaemon.name= -Dstorm.options=onf -Dstorm.home=C:\apache-storm-2.1.0 -Dstorm.log.dir=C:\apache-storm-2.1.0\logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/lib64 -Dstorm.conf.file= -cp C:\apache-storm-2.1.0\*;C:\apache-storm-2.1.0\lib\*;C:\apache-storm-2.1.0\extlib\*;target/FirmensucheStormCrawler-1.0-SNAPSHOT.jar;C:\apache-storm-2.1.0\conf;C:\apache-storm-2.1.0\bin; -Dstorm.local.sleeptime=60 -Dstorm.jar=target/FirmensucheStormCrawler-1.0-SNAPSHOT.jar -Dstorm.dependency.jars= -Dstorm.dependency.artifacts={} org.apache.storm.LocalCluster <censored>.CrawlTopology crawler-conf.yaml
   15:39:16.822 [main] INFO  o.a.s.LocalCluster -
   
                   STARTING LOCAL MODE CLUSTER
   
   
   15:39:16.988 [main] WARN  o.a.s.v.ConfigValidation - task.heartbeat.frequency.secs is a deprecated config please see class org.apache.storm.Config.TASK_HEARTBEAT_FREQUENCY_SECS for more information.
   15:39:16.995 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:zookeeper.version=3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf, built on 03/06/2019 16:18 GMT
   15:39:16.996 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:host.name=host.docker.internal
   15:39:16.996 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.version=15.0.2
   15:39:16.996 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.vendor=AdoptOpenJDK
   15:39:16.996 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.home=C:\Program Files\AdoptOpenJDK\jdk-15.0.2.7-hotspot
   15:39:16.996 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.class.path=C:\apache-storm-2.1.0\*;C:\apache-storm-2.1.0\lib\accessors-smart-1.2.jar;C:\apache-storm-2.1.0\lib\animal-sniffer-annotations-1.17.jar;C:\apache-storm-2.1.0\lib\asm-5.0.3.jar;C:\apache-storm-2.1.0\lib\audience-annotations-0.5.0.jar;C:\apache-storm-2.1.0\lib\carbonite-1.5.0.jar;C:\apache-storm-2.1.0\lib\checker-qual-2.5.2.jar;C:\apache-storm-2.1.0\lib\chill-java-0.8.0.jar;C:\apache-storm-2.1.0\lib\clojure-1.10.0.jar;C:\apache-storm-2.1.0\lib\commons-cli-1.4.jar;C:\apache-storm-2.1.0\lib\commons-codec-1.11.jar;C:\apache-storm-2.1.0\lib\commons-collections-3.2.2.jar;C:\apache-storm-2.1.0\lib\commons-compress-1.18.jar;C:\apache-storm-2.1.0\lib\commons-exec-1.3.jar;C:\apache-storm-2.1.0\lib\commons-fileupload-1.3.3.jar;C:\apache-storm-2.1.0\lib\commons-io-2.6.jar;C:\apache-storm-2.1.0\lib\commons-lang-2.6.jar;C:\apache-storm-2.1.0\lib\commons-logging-1.2.jar;C:\apache-storm-2.1.0\lib\core.sp
 ecs.alpha-0.2.44.jar;C:\apache-storm-2.1.0\lib\curator-client-4.2.0.jar;C:\apache-storm-2.1.0\lib\curator-framework-4.2.0.jar;C:\apache-storm-2.1.0\lib\error_prone_annotations-2.2.0.jar;C:\apache-storm-2.1.0\lib\failureaccess-1.0.1.jar;C:\apache-storm-2.1.0\lib\guava-27.0.1-jre.jar;C:\apache-storm-2.1.0\lib\hadoop-auth-2.8.5.jar;C:\apache-storm-2.1.0\lib\httpclient-4.5.6.jar;C:\apache-storm-2.1.0\lib\httpcore-4.4.10.jar;C:\apache-storm-2.1.0\lib\j2objc-annotations-1.1.jar;C:\apache-storm-2.1.0\lib\jackson-core-2.9.8.jar;C:\apache-storm-2.1.0\lib\jackson-dataformat-smile-2.9.8.jar;C:\apache-storm-2.1.0\lib\javax.annotation-api-1.3.2.jar;C:\apache-storm-2.1.0\lib\javax.servlet-api-3.1.0.jar;C:\apache-storm-2.1.0\lib\jaxb-api-2.3.0.jar;C:\apache-storm-2.1.0\lib\jcip-annotations-1.0-1.jar;C:\apache-storm-2.1.0\lib\jetty-continuation-9.4.14.v20181114.jar;C:\apache-storm-2.1.0\lib\jetty-http-9.4.14.v20181114.jar;C:\apache-storm-2.1.0\lib\jetty-io-9.4.14.v20181114.jar;C:\apache-storm-2.1.0
 \lib\jetty-security-9.4.14.v20181114.jar;C:\apache-storm-2.1.0\lib\jetty-server-9.4.14.v20181114.jar;C:\apache-storm-2.1.0\lib\jetty-servlet-9.4.14.v20181114.jar;C:\apache-storm-2.1.0\lib\jetty-servlets-9.4.14.v20181114.jar;C:\apache-storm-2.1.0\lib\jetty-util-9.4.14.v20181114.jar;C:\apache-storm-2.1.0\lib\jline-0.9.94.jar;C:\apache-storm-2.1.0\lib\joda-time-2.3.jar;C:\apache-storm-2.1.0\lib\json-simple-1.1.jar;C:\apache-storm-2.1.0\lib\json-smart-2.3.jar;C:\apache-storm-2.1.0\lib\jsr305-3.0.2.jar;C:\apache-storm-2.1.0\lib\kryo-3.0.3.jar;C:\apache-storm-2.1.0\lib\kryo-shaded-3.0.3.jar;C:\apache-storm-2.1.0\lib\listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar;C:\apache-storm-2.1.0\lib\log4j-api-2.11.2.jar;C:\apache-storm-2.1.0\lib\log4j-core-2.11.2.jar;C:\apache-storm-2.1.0\lib\log4j-over-slf4j-1.7.26.jar;C:\apache-storm-2.1.0\lib\log4j-slf4j-impl-2.11.2.jar;C:\apache-storm-2.1.0\lib\metrics-core-3.2.6.jar;C:\apache-storm-2.1.0\lib\metrics-graphite-3.2.6.jar;C:\apache-s
 torm-2.1.0\lib\minlog-1.3.0.jar;C:\apache-storm-2.1.0\lib\netty-3.10.6.Final.jar;C:\apache-storm-2.1.0\lib\nimbus-jose-jwt-4.41.1.jar;C:\apache-storm-2.1.0\lib\objenesis-2.1.jar;C:\apache-storm-2.1.0\lib\reflectasm-1.10.1.jar;C:\apache-storm-2.1.0\lib\rocksdbjni-5.18.3.jar;C:\apache-storm-2.1.0\lib\slf4j-api-1.7.26.jar;C:\apache-storm-2.1.0\lib\snakeyaml-1.11.jar;C:\apache-storm-2.1.0\lib\spec.alpha-0.2.176.jar;C:\apache-storm-2.1.0\lib\storm-client-2.1.0.jar;C:\apache-storm-2.1.0\lib\storm-clojure-2.1.0.jar;C:\apache-storm-2.1.0\lib\storm-core-2.1.0.jar;C:\apache-storm-2.1.0\lib\storm-server-2.1.0.jar;C:\apache-storm-2.1.0\lib\storm-shaded-deps-2.1.0.jar;C:\apache-storm-2.1.0\lib\tools.logging-0.2.3.jar;C:\apache-storm-2.1.0\lib\zookeeper-3.4.14.jar;C:\apache-storm-2.1.0\extlib\*;target/FirmensucheStormCrawler-1.0-SNAPSHOT.jar;C:\apache-storm-2.1.0\conf;C:\apache-storm-2.1.0\bin;
   15:39:16.997 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/lib64
   15:39:16.997 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.io.tmpdir=C:\Users\felix\AppData\Local\Temp\
   15:39:16.997 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.compiler=<NA>
   15:39:16.997 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.name=Windows 10
   15:39:16.997 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.arch=amd64
   15:39:16.998 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.version=10.0
   15:39:16.998 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.name=felix
   15:39:16.998 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.home=C:\Users\felix
   15:39:16.998 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.dir=D:\git\FirmensucheStormCrawler
   15:39:17.009 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir C:\Users\felix\AppData\Local\Temp\03515b72-929a-4674-ab1d-3b680323f9de\version-2 snapdir C:\Users\felix\AppData\Local\Temp\03515b72-929a-4674-ab1d-3b680323f9de\version-2
   15:39:17.024 [main] INFO  o.a.s.s.o.a.z.s.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:2000
   15:39:17.025 [main] INFO  o.a.s.z.Zookeeper - Starting inprocess zookeeper at port 2000 and dir C:\Users\felix\AppData\Local\Temp\03515b72-929a-4674-ab1d-3b680323f9de
   15:39:17.065 [main] INFO  o.a.s.s.o.a.c.u.Compatibility - Running in ZooKeeper 3.4.x compatibility mode
   15:39:17.066 [main] INFO  o.a.s.s.o.a.c.u.Compatibility - Using emulated InjectSessionExpiration
   15:39:17.084 [main] INFO  o.a.s.z.ClientZookeeper - Starting ZK Curator
   15:39:17.084 [main] INFO  o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
   15:39:17.087 [main] INFO  o.a.s.s.o.a.z.ZooKeeper - Client environment:zookeeper.version=3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf, built on 03/06/2019 16:18 GMT
   15:39:17.087 [main] INFO  o.a.s.s.o.a.z.ZooKeeper - Client environment:host.name=host.docker.internal
   15:39:17.087 [main] INFO  o.a.s.s.o.a.z.ZooKeeper - Client environment:java.version=15.0.2
   15:39:17.087 [main] INFO  o.a.s.s.o.a.z.ZooKeeper - Client environment:java.vendor=AdoptOpenJDK
   15:39:17.087 [main] INFO  o.a.s.s.o.a.z.ZooKeeper - Client environment:java.home=C:\Program Files\AdoptOpenJDK\jdk-15.0.2.7-hotspot
   15:39:17.087 [main] INFO  o.a.s.s.o.a.z.ZooKeeper - Client environment:java.class.path=C:\apache-storm-2.1.0\*;C:\apache-storm-2.1.0\lib\accessors-smart-1.2.jar;C:\apache-storm-2.1.0\lib\animal-sniffer-annotations-1.17.jar;C:\apache-storm-2.1.0\lib\asm-5.0.3.jar;C:\apache-storm-2.1.0\lib\audience-annotations-0.5.0.jar;C:\apache-storm-2.1.0\lib\carbonite-1.5.0.jar;C:\apache-storm-2.1.0\lib\checker-qual-2.5.2.jar;C:\apache-storm-2.1.0\lib\chill-java-0.8.0.jar;C:\apache-storm-2.1.0\lib\clojure-1.10.0.jar;C:\apache-storm-2.1.0\lib\commons-cli-1.4.jar;C:\apache-storm-2.1.0\lib\commons-codec-1.11.jar;C:\apache-storm-2.1.0\lib\commons-collections-3.2.2.jar;C:\apache-storm-2.1.0\lib\commons-compress-1.18.jar;C:\apache-storm-2.1.0\lib\commons-exec-1.3.jar;C:\apache-s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@storm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org