You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Luke Cwik (JIRA)" <ji...@apache.org> on 2017/05/15 15:37:04 UTC

[jira] [Comment Edited] (BEAM-2298) Java WordCount doesn't work in Window OS

    [ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010724#comment-16010724 ] 

Luke Cwik edited comment on BEAM-2298 at 5/15/17 3:36 PM:
----------------------------------------------------------

When used with RC4 release candidate:
{code}
mvn archetype:generate   --debug   -D archetypeGroupId=org.apache.beam   -D archetypeArtifactId=beam-sdks-java-maven-archetypes-examples    -D archetypeVersion=2.0.0  -D groupId=beamrc -D artifactId=word-count-beam  -D version="0.1" -D package=beamrc  -D interactiveMode=false
{code}

This worked:
{code}
mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml --output=pom_count"
{code}

This did not:
* {code}mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.x* --output=pom_count"
Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.nio.file.InvalidPathException: Illegal char <*> at index 56: c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.x*{code}
* {code}mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=file:/c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml --output=pom_count"
Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.nio.file.InvalidPathException: Illegal char <:> at index 4: file:///c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml{code}
* {code}mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=file:///c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml --output=pom_count"
Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.nio.file.InvalidPathException: Illegal char <:> at index 4: file:///c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml{code}





was (Author: lcwik):
When used with RC4 release candidate:
mvn archetype:generate   --debug   -D archetypeGroupId=org.apache.beam   -D archetypeArtifactId=beam-sdks-java-maven-archetypes-examples    -D archetypeVersion=2.0.0  -D groupId=beamrc -D artifactId=word-count-beam  -D version="0.1" -D package=beamrc  -D interactiveMode=false

This worked:
mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml --output=pom_count"

This did not:
* mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.x* --output=pom_count"
Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.nio.file.InvalidPathException: Illegal char <*> at index 56: c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.x*
* mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=file:/c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml --output=pom_count"
Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.nio.file.InvalidPathException: Illegal char <:> at index 4: file:///c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml
* mvn compile exec:java -P direct-runner -D exec.mainClass=beamrc.WordCount -D exec.args="--inputFile=file:///c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml --output=pom_count"
Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.nio.file.InvalidPathException: Illegal char <:> at index 4: file:///c:/Users/lcwik/Desktop/beamRC4Java/word-count-beam/pom.xml




> Java WordCount doesn't work in Window OS
> ----------------------------------------
>
>                 Key: BEAM-2298
>                 URL: https://issues.apache.org/jira/browse/BEAM-2298
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>            Reporter: Pei He
>            Assignee: Thomas Groh
>
> I am not able to build beam repo in Windows OS, so I copied the jar file from my Mac.
> WordCount failed with the following cmd:
> java -cp beam-examples-java-2.0.0-jar-with-dependencies.jar
>  org.apache.beam.examples.WordCount --inputFile=input.txt --output=counts
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeB
> ytes
> INFO: Filepattern input.txt matched 1 files with total size 0
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource expandFilePattern
> INFO: Matched 1 files for pattern input.txt
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource split
> INFO: Splitting filepattern input.txt into bundles of size 0 took 0 ms and produ
> ced 1 files and 0 bundles
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.WriteFiles$2 processElement
> INFO: Finalizing write operation TextWriteOperation{tempDirectory=C:\Users\Pei\D
> esktop\.temp-beam-2017-05-135_13-09-48-1\, windowedWrites=false}.
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.WriteFiles$2 processElement
> INFO: Creating 1 empty output shards in addition to 0 written for a total of 1.
> Exception in thread "main" org.apache.beam.sdk.Pipeline$PipelineExecutionExcepti
> on: java.lang.IllegalStateException: Unable to find registrar for c
>         at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.wait
> UntilFinish(DirectRunner.java:322)
>         at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.wait
> UntilFinish(DirectRunner.java:292)
>         at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:200
> )
>         at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:63)
>         at org.apache.beam.sdk.Pipeline.run(Pipeline.java:295)
>         at org.apache.beam.sdk.Pipeline.run(Pipeline.java:281)
>         at org.apache.beam.examples.WordCount.main(WordCount.java:184)
> Caused by: java.lang.IllegalStateException: Unable to find registrar for c
>         at org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.
> java:447)
>         at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:111)
>         at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:17
> 4)
>         at org.apache.beam.sdk.io.FileSystems.filterMissingFiles(FileSystems.jav
> a:367)
>         at org.apache.beam.sdk.io.FileSystems.copy(FileSystems.java:251)
>         at org.apache.beam.sdk.io.FileBasedSink$WriteOperation.copyToOutputFiles
> (FileBasedSink.java:641)
>         at org.apache.beam.sdk.io.FileBasedSink$WriteOperation.finalize(FileBase
> dSink.java:529)
>         at org.apache.beam.sdk.io.WriteFiles$2.processElement(WriteFiles.java:59
> 2)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)