[jira] [Created] (BEAM-1213) WordCount example failure on Apex Runner

["Sandeep Deshmukh (JIRA)" <ji...@apache.org>]

Sandeep Deshmukh created BEAM-1213:
--------------------------------------

             Summary: WordCount example failure on Apex Runner
                 Key: BEAM-1213
                 URL: https://issues.apache.org/jira/browse/BEAM-1213
             Project: Beam
          Issue Type: Bug
          Components: runner-apex
            Reporter: Sandeep Deshmukh


Tried running WordCount example using apex runner (on YARN) with https://github.com/apache/incubator-beam/pull/1693 , fix for httpclient version issue fixed.

Create /tmp/input-beam/ dir on all nodes and pushed a test data in that directory. Ran the following command in examples/java/

~/bin/apache-maven-3.3.9/bin/mvn  compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=/tmp/input-beam/java.java --output=/tmp/output-beam/ --runner=ApexRunner --embeddedExecution=false" -Papex-runner



INFO: using /disk2/devhdfs/nn_20161013/usercache/sandeep/appcache/application_1482319446115_4336/container_1482319446115_4336_01_000014/tmp/chkp5198889890309038810 as the basepath for checkpointing.
Dec 23, 2016 7:17:44 AM com.datatorrent.stram.engine.StreamingContainer main
SEVERE: Fatal exception in container!
java.lang.IllegalArgumentException: Invalid slice: offset=1426, length=0 array.length=67108864
        at com.datatorrent.netlet.util.Slice.<init>(Slice.java:43)
        at com.datatorrent.bufferserver.util.SerializedData.<init>(SerializedData.java:40)
        at com.datatorrent.bufferserver.internal.DataList$Block.purge(DataList.java:712)
        at com.datatorrent.bufferserver.internal.DataList.purge(DataList.java:192)
        at com.datatorrent.bufferserver.server.Server.purge(Server.java:204)
        at com.datatorrent.stram.engine.StreamingContainer.processHeartbeatResponse(StreamingContainer.java:776)
        at com.datatorrent.stram.engine.StreamingContainer.heartbeatLoop(StreamingContainer.java:705)
        at com.datatorrent.stram.engine.StreamingContainer.main(StreamingContainer.java:310)

Dec 23, 2016 7:17:44 AM com.datatorrent.bufferserver.server.Server unregistered
INFO: Server stopped listening at /0:0:0:0:0:0:0:0:40904
Dec 23, 2016 7:17:44 AM com.datatorrent.stram.engine.StreamingContainer main
INFO: Exit status for container: 1



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)