You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2014/09/02 19:58:21 UTC

[jira] [Commented] (STORM-386) Development of multilang protocol in nodejs

    [ https://issues.apache.org/jira/browse/STORM-386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118431#comment-14118431 ] 

ASF GitHub Bot commented on STORM-386:
--------------------------------------

Github user harshach commented on the pull request:

    https://github.com/apache/incubator-storm/pull/177#issuecomment-54191625
  
    I've gone through the code and ran the build with node v0.10.28 installed on osx all the test passes. I ran a single node cluster and deployed WordCountTopologyNode and it stops after less than minute with this Spout errror 
     Emitting: spout __ack_init [1107591454335615211 4198602525173443000 24]
    2014-09-02 10:51:42 b.s.util [ERROR] Async loop died!
    java.lang.RuntimeException: java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
    Serializer Exception:
    
    apache-storm-0.9.3-incubating-SNAPSHOT/storm-local/supervisor/stormdist/wordcount-1-1409680231/resources/randomsentence.js
    :59
            self.log(this.pending[id] + ' sent to task ids - ' + taskIds);
            ^
    ReferenceError: self is not defined
    
    and my topology complete latency at 30757.945. I haven't debugged enough to find the cause.
    I am able to run WordCountTopology without any issues on the same cluster. It might be related my environment (os x). I'll look into this to find more details. If anyone encountered similar issue or ran WordCountTopologyNode without any issues please let me know.


> Development of multilang protocol in nodejs
> -------------------------------------------
>
>                 Key: STORM-386
>                 URL: https://issues.apache.org/jira/browse/STORM-386
>             Project: Apache Storm (Incubating)
>          Issue Type: New Feature
>         Environment: nodejs
>            Reporter: Anya Tchernishov
>
> Support nodejs multilang protocol.
> Design considerations:
> - Emit will receive an object (like args and kwargs in python) and a callback that is called when task ids list is received.
>             self.emit({tuple: [word]}, function(taskIds) {
>                 self.log(word + ' sent to task ids - ' + taskIds);
>             });
> - The following methods will received done method that must be invoked on completion (same pattern used by the mocha test framework for async unit tests). 
> - Internal implementation of emit uses Process.stdout.write without a callback since nodejs streams maintain FIFO order (so far, we have not found a need for providing a callback).
>   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)