You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Pei He (JIRA)" <ji...@apache.org> on 2017/05/15 13:59:04 UTC

[jira] [Commented] (BEAM-2298) Java WordCount doesn't work in Window OS

    [ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010555#comment-16010555 ] 

Pei He commented on BEAM-2298:
------------------------------

Tried "file:///C:/input.txt" as the input path, also failed.

java -cp beam-examples-java-2.0.0-jar-with-dependencie
s(1).jar org.apache.beam.examples.WordCount --inputFile=file:///C:/input.txt --o
utput=count
Exception in thread "main" org.apache.beam.sdk.Pipeline$PipelineExecutionExcepti
on: java.nio.file.InvalidPathException: Illegal char <:> at index 4: file:///C:/
input.txt
        at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
        at org.apache.beam.sdk.Pipeline.run(Pipeline.java:281)
        at org.apache.beam.examples.WordCount.main(WordCount.java:184)
Caused by: java.nio.file.InvalidPathException: Illegal char <:> at index 4: file
:///C:/input.txt
        at sun.nio.fs.WindowsPathParser.normalize(Unknown Source)
        at sun.nio.fs.WindowsPathParser.parse(Unknown Source)
        at sun.nio.fs.WindowsPathParser.parse(Unknown Source)
        at sun.nio.fs.WindowsPath.parse(Unknown Source)
        at sun.nio.fs.WindowsFileSystem.getPath(Unknown Source)
        at java.nio.file.Paths.get(Unknown Source)
        at org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:
179)
        at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:66)

        at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:111)
        at org.apache.beam.sdk.io.FileBasedSource.getEstimatedSizeBytes(FileBase
dSource.java:207)
        at org.apache.beam.runners.direct.BoundedReadEvaluatorFactory$InputProvi
der.getInitialInputs(BoundedReadEvaluatorFactory.java:205)
        at org.apache.beam.runners.direct.RootProviderRegistry.getInitialInputs(
RootProviderRegistry.java:64)


> Java WordCount doesn't work in Window OS
> ----------------------------------------
>
>                 Key: BEAM-2298
>                 URL: https://issues.apache.org/jira/browse/BEAM-2298
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>            Reporter: Pei He
>            Assignee: Davor Bonaci
>
> I am not able to build beam repo in Windows OS, so I copied the jar file from my Mac.
> WordCount failed with the following cmd:
> java -cp beam-examples-java-2.0.0-jar-with-dependencies.jar
>  org.apache.beam.examples.WordCount --inputFile=input.txt --output=counts
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeB
> ytes
> INFO: Filepattern input.txt matched 1 files with total size 0
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource expandFilePattern
> INFO: Matched 1 files for pattern input.txt
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource split
> INFO: Splitting filepattern input.txt into bundles of size 0 took 0 ms and produ
> ced 1 files and 0 bundles
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.WriteFiles$2 processElement
> INFO: Finalizing write operation TextWriteOperation{tempDirectory=C:\Users\Pei\D
> esktop\.temp-beam-2017-05-135_13-09-48-1\, windowedWrites=false}.
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.WriteFiles$2 processElement
> INFO: Creating 1 empty output shards in addition to 0 written for a total of 1.
> Exception in thread "main" org.apache.beam.sdk.Pipeline$PipelineExecutionExcepti
> on: java.lang.IllegalStateException: Unable to find registrar for c
>         at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.wait
> UntilFinish(DirectRunner.java:322)
>         at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.wait
> UntilFinish(DirectRunner.java:292)
>         at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:200
> )
>         at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:63)
>         at org.apache.beam.sdk.Pipeline.run(Pipeline.java:295)
>         at org.apache.beam.sdk.Pipeline.run(Pipeline.java:281)
>         at org.apache.beam.examples.WordCount.main(WordCount.java:184)
> Caused by: java.lang.IllegalStateException: Unable to find registrar for c
>         at org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.
> java:447)
>         at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:111)
>         at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:17
> 4)
>         at org.apache.beam.sdk.io.FileSystems.filterMissingFiles(FileSystems.jav
> a:367)
>         at org.apache.beam.sdk.io.FileSystems.copy(FileSystems.java:251)
>         at org.apache.beam.sdk.io.FileBasedSink$WriteOperation.copyToOutputFiles
> (FileBasedSink.java:641)
>         at org.apache.beam.sdk.io.FileBasedSink$WriteOperation.finalize(FileBase
> dSink.java:529)
>         at org.apache.beam.sdk.io.WriteFiles$2.processElement(WriteFiles.java:59
> 2)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)