You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@heron.apache.org by GitBox <gi...@apache.org> on 2020/02/17 06:28:48 UTC
[GitHub] [incubator-heron] dttlgotv opened a new issue #3457: streamlet
examples do not work
dttlgotv opened a new issue #3457: streamlet examples do not work
URL: https://github.com/apache/incubator-heron/issues/3457
I just run heron streamlet examples step by step according to the doc https://heron.incubator.apache.org/docs/getting-started-local-single-node/, but in heron ui it seems that it do not work well.
Why is source emitting count 0? I try other examples in streamlets, the results are same, the count is 0.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-heron] dttlgotv closed issue #3457: streamlet examples
do not work
Posted by GitBox <gi...@apache.org>.
dttlgotv closed issue #3457: streamlet examples do not work
URL: https://github.com/apache/incubator-heron/issues/3457
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3457: streamlet
examples do not work
Posted by GitBox <gi...@apache.org>.
dttlgotv commented on issue #3457: streamlet examples do not work
URL: https://github.com/apache/incubator-heron/issues/3457#issuecomment-588597534
Log file created at: 2020/02/20 10:05:30
Running on machine: macdeMBP-2.lan
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0220 10:05:30.882355 250181056 stmgr.cpp:102] Init Stmgr
I0220 10:05:30.882732 250181056 mempool.cpp:35] Set max size of each memory pool to 512
E0220 10:05:30.882930 250181056 fileutils.cpp:139] Unable to get file modified time for /Users/zz/.herondata/repository/state/local/metricscaches/WindowedWordCountTopology: No such file or directory [2]
I0220 10:05:30.882967 250181056 stmgr.cpp:388] Creating tuple cache
I0220 10:05:30.883098 250181056 stmgr.cpp:286] Creating StmgrServer
E0220 10:05:30.889335 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 13107200: No buffer space available [55]
E0220 10:05:30.889353 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 13107200: No buffer space available [55]
I0220 10:05:30.889407 250181056 stmgr.cpp:306] Creating InstanceServer
E0220 10:05:30.890929 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 13107200: No buffer space available [55]
E0220 10:05:30.890944 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 13107200: No buffer space available [55]
E0220 10:05:30.891161 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 13107200: No buffer space available [55]
E0220 10:05:30.891175 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 13107200: No buffer space available [55]
I0220 10:05:30.891247 250181056 stmgr.cpp:263] Fetching TMaster Location
I0220 10:05:30.891330 250181056 stmgr.cpp:274] Fetching MetricsCache Location
E0220 10:05:30.891352 250181056 heron-localfilestatemgr.cpp:419] Error reading from /Users/zz/.herondata/repository/state/local/metricscaches/WindowedWordCountTopology: No such file or directory [2]
E0220 10:05:30.891446 250181056 metricsmgr-client.cpp:55] Could not connect to metrics mgr. Will Retry in 1 second
I0220 10:05:30.891463 250181056 stmgr.cpp:448] Fetched TMasterLocation to be macdeMBP-2.lan:53575
I0220 10:05:30.891469 250181056 stmgr.cpp:352] Creating Tmaster Client at macdeMBP-2.lan:53575
I0220 10:05:30.892119 250181056 metricsmgr-client.cpp:118] We have not yet registered to metricsmgr. Holding off sending TMasterLocation
I0220 10:05:30.892132 250181056 stmgr.cpp:486] MetricsCache Location Fetch failed with status 2000
I0220 10:05:30.892138 250181056 stmgr.cpp:487] Retrying after 10000000 micro seconds
E0220 10:05:31.680256 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 14698800: No buffer space available [55]
E0220 10:05:31.680271 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 40830000: No buffer space available [55]
I0220 10:05:31.680302 250181056 instance-server.cpp:199] Instance Server got new connection 0x7fe6df405f00 from 127.0.0.1:53608
E0220 10:05:31.692914 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 14698800: No buffer space available [55]
E0220 10:05:31.692934 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 40830000: No buffer space available [55]
I0220 10:05:31.692958 250181056 instance-server.cpp:199] Instance Server got new connection 0x7fe6df50fcf0 from 127.0.0.1:53610
I0220 10:05:31.871403 250181056 instance-server.cpp:256] Got HandleRegisterInstanceRequest from connection 0x7fe6df405f00 and instance container_1_reduce-operation_3
I0220 10:05:31.871418 250181056 instance-server.cpp:294] New instance registered with us container_1_reduce-operation_3
I0220 10:05:31.876827 250181056 instance-server.cpp:256] Got HandleRegisterInstanceRequest from connection 0x7fe6df50fcf0 and instance container_1_random-sentences-source_1
I0220 10:05:31.876842 250181056 instance-server.cpp:294] New instance registered with us container_1_random-sentences-source_1
I0220 10:05:31.876869 250181056 stmgr.cpp:527] Connecting to the TMaster as all the instances have connected to us
E0220 10:05:31.876899 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 13107200: No buffer space available [55]
E0220 10:05:31.876910 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 13107200: No buffer space available [55]
I0220 10:05:31.877513 250181056 tmaster-client.cpp:107] Connected to tmaster running at macdeMBP-2.lan:53575
I0220 10:05:31.881508 250181056 tmaster-client.cpp:158] Registered successfully with Tmaster
I0220 10:05:31.882642 250181056 tmaster-client.cpp:193] Got a new assignment
I0220 10:05:31.882654 250181056 stmgr.cpp:534] Received a new physical plan from tmaster
I0220 10:05:31.882659 250181056 stmgr.cpp:553] This is the first time we received the physical plan
I0220 10:05:31.882791 250181056 neighbour-calculator.cpp:72] Reconstructed Upstream/Downstream Checkpoint Dependencies
I0220 10:05:31.882798 250181056 neighbour-calculator.cpp:73] Upstream Dependencies for task_id 1:
Upstream Dependencies for task_id 2: 1
Upstream Dependencies for task_id 3: 2
Upstream Dependencies for task_id 4: 3
Downstream Dependencies for task_id 1: 2
Downstream Dependencies for task_id 2: 3
Downstream Dependencies for task_id 3: 4
I0220 10:05:31.882817 250181056 stmgr-clientmgr.cpp:87] Stmgr stmgr-2 came on macdeMBP-2.lan:53593
E0220 10:05:31.882923 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 13107200: No buffer space available [55]
E0220 10:05:31.882936 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 13107200: No buffer space available [55]
I0220 10:05:31.883648 250181056 instance-server.cpp:423] Sending new physical plan to instance with task_id: 1
I0220 10:05:31.883677 250181056 instance-server.cpp:423] Sending new physical plan to instance with task_id: 3
E0220 10:05:31.883759 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 14698800: No buffer space available [55]
E0220 10:05:31.883772 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 40830000: No buffer space available [55]
I0220 10:05:31.883792 250181056 stmgr-server.cpp:66] StMgrServer Got new connection 0x7fe6df40ac90 from 192.168.199.219:53616
I0220 10:05:31.883812 250181056 stmgr-client.cpp:94] Connected to stmgr stmgr-2 running at macdeMBP-2.lan:53593
E0220 10:05:31.891214 250181056 fileutils.cpp:139] Unable to get file modified time for /Users/zz/.herondata/repository/state/local/metricscaches/WindowedWordCountTopology: No such file or directory [2]
I0220 10:05:31.891273 250181056 stmgr-server.cpp:99] Got a hello message from stmgr stmgr-2 on connection 0x7fe6df40ac90
E0220 10:05:31.891479 250181056 sockutils.cpp:132] Could not set SO_SNDBUF to max 13107200: No buffer space available [55]
E0220 10:05:31.891492 250181056 sockutils.cpp:148] Could not set SO_RCVBUF to max 13107200: No buffer space available [55]
E0220 10:05:31.891587 250181056 metricsmgr-client.cpp:55] Could not connect to metrics mgr. Will Retry in 1 second
E0220 10:05:32.123747 250181056 baseconnection.cpp:136] BufferEvent reported error on connection 0x7fe6df50fcf0
I0220 10:05:32.123823 250181056 instance-server.cpp:204] Instance Server got connection close of 0x7fe6df50fcf0 from 127.0.0.1:53610
I0220 10:05:32.123838 250181056 instance-server.cpp:226] Instance container_1_random-sentences-source_1 closed connection
E0220 10:05:32.134147 250181056 baseconnection.cpp:136] BufferEvent reported error on connection 0x7fe6df405f00
I0220 10:05:32.134173 250181056 instance-server.cpp:204] Instance Server got connection close of 0x7fe6df405f00 from 127.0.0.1:53608
I0220 10:05:32.134184
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3457: streamlet
examples do not work
Posted by GitBox <gi...@apache.org>.
dttlgotv commented on issue #3457: streamlet examples do not work
URL: https://github.com/apache/incubator-heron/issues/3457#issuecomment-589939728
work on newest codes
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3457: streamlet
examples do not work
Posted by GitBox <gi...@apache.org>.
dttlgotv commented on issue #3457: streamlet examples do not work
URL: https://github.com/apache/incubator-heron/issues/3457#issuecomment-588055958
anyone can answer this issue?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3457: streamlet
examples do not work
Posted by GitBox <gi...@apache.org>.
dttlgotv commented on issue #3457: streamlet examples do not work
URL: https://github.com/apache/incubator-heron/issues/3457#issuecomment-588594754
logs error：
[2020-02-20 11:43:11 +0800] [信息] com.twitter.heron.network.StreamManagerClient: Stop writing due to not yet connected to Stream Manager.
[2020-02-20 11:43:11 +0800] [信息] com.twitter.heron.network.StreamManagerClient: Stop writing due to not yet connected to Stream Manager.
[2020-02-20 11:43:11 +0800] [信息] com.twitter.heron.network.StreamManagerClient: Stop writing due to not yet connected to Stream Manager
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services