You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com> on 2017/09/12 14:45:37 UTC
Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node
Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper
When I am trying bin/grid bootstrap getting connection timed out error
It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap
Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Yi,
I am trying to build Samza locally by following the steps provided by Navina.
As per those steps kafka will be installed after Zookeeper, I am getting Error while starting Zookeeper after it is installed
Steps Followed :
Yes. You can clone apache/samza locally and build it with:
cd <samza-workspace>
gradle -b bootstrap.gradle
./gradlew clean build -x test
./gradlew publishToMavenLocal ## This publishes a snapshot version of the latest apache/samza into your local maven repo
Then, head to hello-samza workspace and build again:
cd <hello-samza-workspace>
mvn clean package ## This should create a build target
./bin/grid install zookeeper
./bin/grid start zookeeper
./bin/grid install kafka
./bin/grid start kafka
./bin/grid install yarn
./bin/grid start yarn
mkdir -p deploy/samza
tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
NOTE : BTW From the above steps I could not execute " gradle -b bootstrap.gradle" since that command does not exists
Regards,
~Sri
-----Original Message-----
From: Yi Pan [mailto:nickpan47@gmail.com]
Sent: Tuesday, September 12, 2017 7:13 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharam,
Could you confirm at which step your setup failed? It seems that your zookeeper server is running. Could you check to see whether your Kafka broker is running? You can either do a telnet localhost 9092 or do a ps auxww | grep kafka to see whether you got any broker running.
Sometimes, the Kafka service takes time to start on a single laptop. You can just try to run ./bin/grid start kafka
again to see whether the service is up.
Thanks!
-Yi
On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com<ma...@comcast.com>> wrote:
> Find below Zookeeper logs:
>
> 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101] -
> Reading configuration from: /app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> 2017-09-12 17:05:19,133 [myid:] - INFO
> [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
> 2017-09-12 17:05:19,134 [myid:] - INFO
> [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
> 2017-09-12 17:05:19,134 [myid:] - INFO
> [main:DatadirCleanupManager@101]
> - Purge task is not scheduled.
> 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
> Either no config or no quorum defined in config, running in
> standalone mode
> 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101] -
> Reading configuration from: /app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> 2017-09-12 17:05:19,162 [myid:] - INFO [main:ZooKeeperServerMain@95]
> - Starting server
> 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - Server
> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48
> GMT
> 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
> environment:host.name=codehdplak-po-r19p.sys.comcast.net
> 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
> environment:java.version=1.8.0_31
> 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
> environment:java.vendor=Oracle Corporation
> 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
> environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> 8.0.31-2.b13.el7.x86_64/jre
> 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
> environment:java.class.path=/app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../conf:
> 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
> environment:java.library.path=/usr/java/packages/lib/amd64:/
> usr/lib64:/lib64:/lib:/usr/lib
> 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
> environment:java.io.tmpdir=/tmp
> 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
> environment:java.compiler=<NA>
> 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
> environment:os.name=Linux
> 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
> environment:os.arch=amd64
> 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
> environment:os.version=3.10.0-123.20.1.el7.x86_64
> 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
> environment:user.name=root
> 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
> environment:user.home=/root
> 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
> environment:user.dir=/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] -
> tickTime set to 2000
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] -
> minSessionTimeout set to -1
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] -
> maxSessionTimeout set to -1
> 2017-09-12 17:05:19,213 [myid:] - INFO
> [main:NIOServerCnxnFactory@110] - binding to port 0.0.0.0/0.0.0.0:2181
> 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
> Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> 2017-09-12 17:05:19,673 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
> from
> /0:0:0:0:0:0:0:1:21754
> 2017-09-12 17:17:40,265 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
> EndOfStreamException: Unable to read additional data from client
> sessionid 0x0, likely client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> NIOServerCnxn.java:220)
> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> NIOServerCnxnFactory.java:224)
> at java.lang.Thread.run(Thread.java:745)
> 2017-09-12 17:17:40,267 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for client
> /0:0:0:0:0:0:0:1:21754 (no session established for client)
> 2017-09-12 17:18:06,236 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
> from /
> 127.0.0.1:48071
> 2017-09-12 17:18:06,247 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish new
> session at /127.0.0.1:48071
> 2017-09-12 17:18:06,250 [myid:] - INFO [SyncThread:0:FileTxnLog@199]
> - Creating new log file: log.1
> 2017-09-12 17:18:06,263 [myid:] - INFO
> [SyncThread:0:ZooKeeperServer@604]
> - Established session 0x15e770d61920000 with negotiated timeout 6000
> for client /127.0.0.1:48071
> 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3
> txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
> NoNode for /brokers
> 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7
> txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
> NoNode for /config
> 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x13 zxid:0xc
> txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
> NoNode for /admin
> 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x1b zxid:0x11
> txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
> NoNode for /cluster
> 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:setData cxid:0x25
> zxid:0x15
> txntype:-1 reqpath:n/a Error Path:/controller_epoch
> Error:KeeperErrorCode = NoNode for /controller_epoch
> 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:delete cxid:0x34 zxid:0x17
> txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
> Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
> 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x3f zxid:0x18
> txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
> NodeExists for /brokers
> 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x40 zxid:0x19
> txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode =
> NodeExists for /brokers/ids
>
>
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Tuesday, September 12, 2017 2:02 PM
> To: dev@samza.apache.org<ma...@samza.apache.org>
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi, Anantharaman,
>
> Could you post your zookeeper startup logs here?
>
> On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor)
> < Srinatha_Anantharaman@comcast.com<ma...@comcast.com>> wrote:
>
> > It hangs while bringing up the service
> >
> > [root@codehdplak-po-r19p hello-samza]# pwd
> > /app/home/eventsvc/samza-git/hello-samza
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Using previously downloaded file /root/.samza/download/
> > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> > ./bin/grid start zookeeper
> > EXECUTING: start zookeeper
> > JMX enabled by default
> > Using config:
> > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > bin/../conf/zoo.cfg
> > Starting zookeeper ... STARTED
> > Waiting for zookeeper to start...
> >
> > ^C
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
> > EXECUTING: install kafka
> > Using previously downloaded file /root/.samza/download/kafka_2.
> > 11-0.10.1.1.tgz
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
> > EXECUTING: start kafka
> > Waiting for kafka to start...
> > Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .^C
> > [root@codehdplak-po-r19p hello-samza]#
> >
> >
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 12:43 PM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Yes. You can clone apache/samza locally and build it with:
> >
> >
> > cd <samza-workspace>
> >
> > gradle -b bootstrap.gradle
> >
> > ./gradlew clean build -x test
> >
> > ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> > the latest apache/samza into your local maven repo
> >
> >
> > Then, head to hello-samza workspace and build again:
> >
> > cd <hello-samza-workspace>
> >
> > mvn clean package ## This should create a build target
> >
> > ./bin/grid install zookeeper
> >
> > ./bin/grid start zookeeper
> >
> > ./bin/grid install kafka
> >
> > ./bin/grid start kafka
> >
> > ./bin/grid install yarn
> >
> > ./bin/grid start yarn
> >
> >
> > mkdir -p deploy/samza
> >
> > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
> >
> >
> > After this, you can follow steps in the tutorial to "Run" the
> > example Samza job.
> >
> >
> > HTH! Let me know if you need further help.
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: RE: Connection timed out error while installing "Hello Samza"
> >
> > Navina,
> >
> > Is there any other way we can install Hello Samza?
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 11:42 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Ok. I tried again for the "latest" branch in hello-samza and it
> > still works.
> >
> >
> > > While installing it says "Building samza from master..."
> >
> > It is expected to build from "master" in apache/samza repo. So, the
> > output line is expected.
> >
> >
> > It is weird that you are unable to connect. Is it possible you are
> > behind a firewall or something? Can you try to ping "git.apache.org" ?
> > Or try the setup on a different box?
> >
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: RE: Connection timed out error while installing "Hello Samza"
> >
> > Navina,
> >
> > I tried again but still same error
> >
> > While installing it says "Building samza from master..."
> >
> > But when after I cloned I executed " git checkout latest"
> >
> > Regards,
> > ~Sri
> >
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 11:10 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Hi Anantharaman,
> >
> > It looks like a transient connection failure to connect to Apache's
> > git. I tried on my host and it seems to be working.
> >
> > Can you give it another shot?
> >
> >
> > If it still doesn't work, please let me know if you are running the
> > command under the "master" or "latest" branch of samza-hello-samza.
> >
> >
> > Thanks!
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Connection timed out error while installing "Hello Samza"
> >
> > Hi,
> >
> > I am trying to install "Hello Samza" on a single node Initially I
> > have installed Kafka, Yarn and Zookeeper using bin/grid install
> > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
> > connection timed out error It also mentions no kafka, yarn and
> > zookeeper installed
> >
> > Please find below the error message
> >
> > [root@codehdplak-po-r19p bin]# cd ..
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
> > EXECUTING: install kafka
> > Using previously downloaded file /root/.samza/download/kafka_2.
> > 11-0.10.1.1.tgz
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> > EXECUTING: install yarn
> > Using previously downloaded file
> > /root/.samza/download/hadoop-2.6.1.tar.gz
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Using previously downloaded file /root/.samza/download/
> > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> > bin/grid bootstrap Bootstrapping the system...
> > EXECUTING: stop kafka
> > No kafka server to stop
> > EXECUTING: stop yarn
> > no resourcemanager to stop
> > no nodemanager to stop
> > EXECUTING: stop zookeeper
> > JMX enabled by default
> > Using config:
> > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > bin/../conf/zoo.cfg
> > Stopping zookeeper ... no zookeeper to stop (could not find file
> > /tmp/zookeeper/zookeeper_server.pid)
> > EXECUTING: install samza
> > Building samza from master...
> > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> > Cloning into 'samza'...
> > fatal: unable to connect to git.apache.org:
> > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >
> >
> > Could you please help me to resolve this issue?
> >
> > Regards,
> > ~Sri
> >
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Yi,
Thank you for your kindly reply.
I am able to ping localhost and it is accessible.
BTW I am installing Samza on Linux server
Eagerly waiting for your help.
Regards,
~Sri
[cid:image001.png@01D32D68.6F1A2730]
-----Original Message-----
From: Yi Pan [mailto:nickpan47@gmail.com]
Sent: Thursday, September 14, 2017 2:22 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Ananarath,
It is very strange that you are seeing this timeout exception that we do not see. I am trying to follow the exact steps you did to see whether there is anything broken. I will update you this afternoon.
Meanwhile, could you check your hostname setup and firewall configuration to see whether your local laptop has blocked access via the public IP address to your laptop? Could you verify that your localhost is resolved to
127.0.0.1 and is accessible?
-Yi
On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com<ma...@comcast.com>> wrote:
> Yi,
>
> Is there any alternate way to install Samza Or solution to the
> connection time out error?
>
> Regards,
> ~Sri
>
> From: Anantharaman, Srinatha (Contractor)
> Sent: Wednesday, September 13, 2017 11:37 AM
> To: dev@samza.apache.org<ma...@samza.apache.org>
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
>
> Yi,
>
>
>
> I am trying to build Samza locally by following the steps provided by
> Navina.
>
> As per those steps kafka will be installed after Zookeeper, I am
> getting Error while starting Zookeeper after it is installed
>
>
>
>
>
> Steps Followed :
>
>
>
> Yes. You can clone apache/samza locally and build it with:
>
>
>
>
>
> cd <samza-workspace>
>
>
>
> gradle -b bootstrap.gradle
>
>
>
> ./gradlew clean build -x test
>
>
>
> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> the latest apache/samza into your local maven repo
>
>
>
>
>
> Then, head to hello-samza workspace and build again:
>
>
>
> cd <hello-samza-workspace>
>
>
>
> mvn clean package ## This should create a build target
>
>
>
> ./bin/grid install zookeeper
>
>
>
> ./bin/grid start zookeeper
>
>
>
> ./bin/grid install kafka
>
>
>
> ./bin/grid start kafka
>
>
>
> ./bin/grid install yarn
>
>
>
> ./bin/grid start yarn
>
>
>
>
>
> mkdir -p deploy/samza
>
>
>
> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>
>
>
>
>
> NOTE : BTW From the above steps I could not execute " gradle -b
> bootstrap.gradle" since that command does not exists
>
>
>
> Regards,
>
> ~Sri
>
>
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Tuesday, September 12, 2017 7:13 PM
> To: dev@samza.apache.org<ma...@samza.apache.org>>
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
>
>
> Hi, Anantharam,
>
>
>
> Could you confirm at which step your setup failed? It seems that your
> zookeeper server is running. Could you check to see whether your Kafka
> broker is running? You can either do a telnet localhost 9092 or do a
> ps auxww | grep kafka to see whether you got any broker running.
>
>
>
> Sometimes, the Kafka service takes time to start on a single laptop.
> You can just try to run ./bin/grid start kafka
>
>
>
> again to see whether the service is up.
>
>
>
> Thanks!
>
>
>
> -Yi
>
>
>
> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor)
> <
> Srinatha_Anantharaman@comcast.com<ma...@comcast>
> .com>>
> wrote:
>
>
>
> > Find below Zookeeper logs:
>
> >
>
> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101]
> > -
>
> > Reading configuration from: /app/home/eventsvc/samza-git/
>
> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>
> > 2017-09-12 17:05:19,133 [myid:] - INFO
>
> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
>
> > 2017-09-12 17:05:19,134 [myid:] - INFO
>
> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>
> > 2017-09-12 17:05:19,134 [myid:] - INFO
>
> > [main:DatadirCleanupManager@101]
>
> > - Purge task is not scheduled.
>
> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
>
> > Either no config or no quorum defined in config, running in
>
> > standalone mode
>
> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101]
> > -
>
> > Reading configuration from: /app/home/eventsvc/samza-git/
>
> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>
> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > [main:ZooKeeperServerMain@95]
>
> > - Starting server
>
> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
> > 10:48
>
> > GMT
>
> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>
> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:java.version=1.8.0_31
>
> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:java.vendor=Oracle Corporation
>
> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>
> > 8.0.31-2.b13.el7.x86_64/jre
>
> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:java.class.path=/app/home/eventsvc/samza-git/
>
> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>
> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>
> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>
> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>
> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>
> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>
> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>
> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>
> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>
> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>
> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../conf:
>
> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>
> > usr/lib64:/lib64:/lib:/usr/lib
>
> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:java.io.tmpdir=/tmp
>
> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:java.compiler=<NA>
>
> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:os.name=Linux
>
> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:os.arch=amd64
>
> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>
> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:user.name=root
>
> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:user.home=/root
>
> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
> > Server
>
> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper
>
> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] -
>
> > tickTime set to 2000
>
> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] -
>
> > minSessionTimeout set to -1
>
> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] -
>
> > maxSessionTimeout set to -1
>
> > 2017-09-12 17:05:19,213 [myid:] - INFO
>
> > [main:NIOServerCnxnFactory@110] - binding to port
> > 0.0.0.0/0.0.0.0:2181
>
> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
>
> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>
> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>
> > from
>
> > /0:0:0:0:0:0:0:1:21754
>
> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>
> > EndOfStreamException: Unable to read additional data from client
>
> > sessionid 0x0, likely client has closed socket
>
> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>
> > NIOServerCnxn.java:220)
>
> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>
> > NIOServerCnxnFactory.java:224)
>
> > at java.lang.Thread.run(Thread.java:745)
>
> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
> > client
>
> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>
> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>
> > from /
>
> > 127.0.0.1:48071
>
> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish
> > new
>
> > session at /127.0.0.1:48071
>
> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > [SyncThread:0:FileTxnLog@199]
>
> > - Creating new log file: log.1
>
> > 2017-09-12 17:18:06,263 [myid:] - INFO
>
> > [SyncThread:0:ZooKeeperServer@604]
>
> > - Established session 0x15e770d61920000 with negotiated timeout 6000
>
> > for client /127.0.0.1:48071
>
> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3
>
> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>
> > NoNode for /brokers
>
> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7
>
> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>
> > NoNode for /config
>
> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
> > zxid:0xc
>
> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>
> > NoNode for /admin
>
> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
> > zxid:0x11
>
> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>
> > NoNode for /cluster
>
> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>
> > zxid:0x15
>
> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>
> > Error:KeeperErrorCode = NoNode for /controller_epoch
>
> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
> > zxid:0x17
>
> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>
> > Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
>
> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
> > zxid:0x18
>
> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>
> > NodeExists for /brokers
>
> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
> > zxid:0x19
>
> > txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode
> > =
>
> > NodeExists for /brokers/ids
>
> >
>
> >
>
> >
>
> > -----Original Message-----
>
> > From: Yi Pan [mailto:nickpan47@gmail.com]
>
> > Sent: Tuesday, September 12, 2017 2:02 PM
>
> > To: dev@samza.apache.org<ma...@samza.apache.org>>
>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> >
>
> > Hi, Anantharaman,
>
> >
>
> > Could you post your zookeeper startup logs here?
>
> >
>
> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > (Contractor)
>
> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_<mailto:Srinatha_Anantharaman@comcast.com%3cmailto:Srinatha_>
> Anantharaman@comcast.com<ma...@comcast.com>>> wrote:
>
> >
>
> > > It hangs while bringing up the service
>
> > >
>
> > > [root@codehdplak-po-r19p hello-samza]# pwd
>
> > > /app/home/eventsvc/samza-git/hello-samza
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> > > zookeeper
>
> > > EXECUTING: install zookeeper
>
> > > Using previously downloaded file /root/.samza/download/
>
> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>
> > > ./bin/grid start zookeeper
>
> > > EXECUTING: start zookeeper
>
> > > JMX enabled by default
>
> > > Using config:
>
> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>
> > > bin/../conf/zoo.cfg
>
> > > Starting zookeeper ... STARTED
>
> > > Waiting for zookeeper to start...
>
> > >
>
> > > ^C
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > zookeeper^C
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>
> > > EXECUTING: install kafka
>
> > > Using previously downloaded file /root/.samza/download/kafka_2.
>
> > > 11-0.10.1.1.tgz
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>
> > > EXECUTING: start kafka
>
> > > Waiting for kafka to start...
>
> > > Ncat: Connection refused.
>
> > > .Ncat: Connection refused.
>
> > > .Ncat: Connection refused.
>
> > > .^C
>
> > > [root@codehdplak-po-r19p hello-samza]#
>
> > >
>
> > >
>
> > >
>
> > > -----Original Message-----
>
> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>
> > > Sent: Tuesday, September 12, 2017 12:43 PM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>>
>
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Yes. You can clone apache/samza locally and build it with:
>
> > >
>
> > >
>
> > > cd <samza-workspace>
>
> > >
>
> > > gradle -b bootstrap.gradle
>
> > >
>
> > > ./gradlew clean build -x test
>
> > >
>
> > > ./gradlew publishToMavenLocal ## This publishes a snapshot version
> of
>
> > > the latest apache/samza into your local maven repo
>
> > >
>
> > >
>
> > > Then, head to hello-samza workspace and build again:
>
> > >
>
> > > cd <hello-samza-workspace>
>
> > >
>
> > > mvn clean package ## This should create a build target
>
> > >
>
> > > ./bin/grid install zookeeper
>
> > >
>
> > > ./bin/grid start zookeeper
>
> > >
>
> > > ./bin/grid install kafka
>
> > >
>
> > > ./bin/grid start kafka
>
> > >
>
> > > ./bin/grid install yarn
>
> > >
>
> > > ./bin/grid start yarn
>
> > >
>
> > >
>
> > > mkdir -p deploy/samza
>
> > >
>
> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > deploy/samza
>
> > >
>
> > >
>
> > > After this, you can follow steps in the tutorial to "Run" the
>
> > > example Samza job.
>
> > >
>
> > >
>
> > > HTH! Let me know if you need further help.
>
> > >
>
> > > Navina
>
> > >
>
> > > ________________________________
>
> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>
> > > comcast.com>
>
> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>>
>
> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Navina,
>
> > >
>
> > > Is there any other way we can install Hello Samza?
>
> > >
>
> > > Regards,
>
> > > ~Sri
>
> > >
>
> > > -----Original Message-----
>
> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>
> > > Sent: Tuesday, September 12, 2017 11:42 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>>
>
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Ok. I tried again for the "latest" branch in hello-samza and it
>
> > > still works.
>
> > >
>
> > >
>
> > > > While installing it says "Building samza from master..."
>
> > >
>
> > > It is expected to build from "master" in apache/samza repo. So,
> > > the
>
> > > output line is expected.
>
> > >
>
> > >
>
> > > It is weird that you are unable to connect. Is it possible you are
>
> > > behind a firewall or something? Can you try to ping "git.apache.org" ?
>
> > > Or try the setup on a different box?
>
> > >
>
> > >
>
> > > Navina
>
> > >
>
> > > ________________________________
>
> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>
> > > comcast.com>
>
> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>>
>
> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Navina,
>
> > >
>
> > > I tried again but still same error
>
> > >
>
> > > While installing it says "Building samza from master..."
>
> > >
>
> > > But when after I cloned I executed " git checkout latest"
>
> > >
>
> > > Regards,
>
> > > ~Sri
>
> > >
>
> > >
>
> > > -----Original Message-----
>
> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>
> > > Sent: Tuesday, September 12, 2017 11:10 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>>
>
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Hi Anantharaman,
>
> > >
>
> > > It looks like a transient connection failure to connect to
> > > Apache's
>
> > > git. I tried on my host and it seems to be working.
>
> > >
>
> > > Can you give it another shot?
>
> > >
>
> > >
>
> > > If it still doesn't work, please let me know if you are running
> > > the
>
> > > command under the "master" or "latest" branch of samza-hello-samza.
>
> > >
>
> > >
>
> > > Thanks!
>
> > >
>
> > > Navina
>
> > >
>
> > > ________________________________
>
> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>
> > > comcast.com>
>
> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>>
>
> > > Subject: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Hi,
>
> > >
>
> > > I am trying to install "Hello Samza" on a single node Initially I
>
> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
>
> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>
> > > connection timed out error It also mentions no kafka, yarn and
>
> > > zookeeper installed
>
> > >
>
> > > Please find below the error message
>
> > >
>
> > > [root@codehdplak-po-r19p bin]# cd ..
>
> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>
> > > EXECUTING: install kafka
>
> > > Using previously downloaded file /root/.samza/download/kafka_2.
>
> > > 11-0.10.1.1.tgz
>
> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>
> > > EXECUTING: install yarn
>
> > > Using previously downloaded file
>
> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>
> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>
> > > EXECUTING: install zookeeper
>
> > > Using previously downloaded file /root/.samza/download/
>
> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>
> > > bin/grid bootstrap Bootstrapping the system...
>
> > > EXECUTING: stop kafka
>
> > > No kafka server to stop
>
> > > EXECUTING: stop yarn
>
> > > no resourcemanager to stop
>
> > > no nodemanager to stop
>
> > > EXECUTING: stop zookeeper
>
> > > JMX enabled by default
>
> > > Using config:
>
> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>
> > > bin/../conf/zoo.cfg
>
> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>
> > > /tmp/zookeeper/zookeeper_server.pid)
>
> > > EXECUTING: install samza
>
> > > Building samza from master...
>
> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>
> > > Cloning into 'samza'...
>
> > > fatal: unable to connect to git.apache.org:
>
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
> > >
>
> > >
>
> > > Could you please help me to resolve this issue?
>
> > >
>
> > > Regards,
>
> > > ~Sri
>
> > >
>
> >
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Yi,
It is my mistake I was looking at the previous version documentation
All the telnet worked like you showed me except for " telnet localhost 9092"
Got the cluster info as below
{"clusterInfo":{"id":1506020118416,"startedOn":1506020118416,"state":"STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1 from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum 74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn":"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1 from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"2015-09-16T21:07Z"}}Connection closed by foreign host.
BTW earlier I did not execute the " Build a Samza Job Package" { was referring to .7 and this step is not part of it)
./gradlew publishToMavenLocal
When I run the above command I am getting below error
[root@csadatlak-wc-a1t hello-samza]# ./gradlew publishToMavenLocal
FAILURE: Build failed with an exception.
* What went wrong:
Task 'publishToMavenLocal' not found in root project 'hello-samza'.
* Try:
Run gradlew tasks to get a list of available tasks. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.
BUILD FAILED
Total time: 5.786 secs
Kindly advise me for the above errors
Regards,
~Sri
-----Original Message-----
From: Yi Pan [mailto:nickpan47@gmail.com]
Sent: Wednesday, September 20, 2017 8:29 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharaman,
Did you follow documentation here:
http://samza.apache.org/startup/hello-samza/0.13/? It states that you will need to use the following commands to install hello-samza job, in the same directory that you cloned the hello-samza git project:
{code}
mvn clean package
mkdir -p deploy/samza
tar -xvf ./target/hello-samza-0.13.0-dist.tar.gz -C deploy/samza
{code}
We apologize if the documentation is not clear and please file/open JIRA for unclear documentation issues s.t. we can fix and help.
But first, please follow the exact steps, especially when we are trying to help debugging your local deployment issue.
P.S. if all 3 services (i.e. zookeeper, kafka, and YARN) are running, are you able to telnet to those service like the response I got from my local box below:
{noformat}
yipan-mn1:hello-samza yipan$ telnet localhost 2181
Trying ::1...
Connected to localhost.
Escape character is '^]'.
^]
telnet> quit
Connection closed.
yipan-mn1:hello-samza yipan$ telnet localhost 9092
Trying ::1...
Connected to localhost.
Escape character is '^]'.
^]
telnet>
quit
Connection closed by foreign host.
yipan-mn1:hello-samza yipan$ telnet localhost 8088
Trying ::1...
telnet: connect to address ::1: Connection refused
Trying fe80::1...
telnet: connect to address fe80::1: Connection refused
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
GET /ws/v1/cluster/info
{"clusterInfo":{"id":1505953361666,"startedOn":1505953361666,"state":"STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1
from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn":"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1
from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"2015-09-16T21:07Z"}}Connection
closed by foreign host.
{noformat}
And are you using VPN to access Internet on the host you are deploying Samza?
-Yi
On Wed, Sep 20, 2017 at 2:58 PM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> I had already seen using ps aux that all 3 services are running I am
> not able to open the Yarn UI and when I start YARN it says "Waiting
> for resourcemanager to start... Ncat: Connection refused" that made
> me to think YARN not started properly
>
> Now Trying to build the Samza Package with the below steps
>
> mvn clean package -- Done
> mkdir -p deploy/samza --Done
> tar -xvf
> ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz
> -C deploy/samza -- Fails as file does not exists.
>
> Samza documentation sucks, I do not find that folder Or file. Do I
> need to use hello-samza-0.13.0-dist.tar.gz which is under my
> "/home/sanant003c/hello-samza/target" folder?
>
>
>
> -----Original Message-----
> From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> Sent: Wednesday, September 20, 2017 4:48 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> What do you mean by YARN fails to start? The logs you pointed out
> don't seem to have any error.
>
> Is the ResourceManager process running and you are not able to connect
> to it? Perhaps, try running a quick *ps aux* to find that.
>
> On Wed, Sep 20, 2017 at 1:18 PM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
> > Jagdish,
> >
> > I appreciate your help.
> >
> > It worked though netcat gave "0' output I still changed the grid
> > script to "https"
> >
> >
> > [root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null;
> > echo $?
> > 0
> >
> >
> > Before I build my Samza job I wanted to confirm if I am able to
> > access my YARN When I start YARN it fails to start, Below are the
> > last few lines from Yarn log
> >
> > LOG :
> >
> > 2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
> > 2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract
> > jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/
> > hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to
> > /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
> > 2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$
> > SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
> > 2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > Web app /cluster started at 8088
> > 2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > Registered webapp guice modules
> > 2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager:
> > Using callQueue class java.util.concurrent.LinkedBlockingQueue
> > 2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting
> > Socket Reader #1 for port 8033
> > 2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.
> RpcServerFactoryPBImpl:
> > Adding protocol org.apache.hadoop.yarn.server.api.
> > ResourceManagerAdministrationProtocolPB to the server
> > 2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC
> > Server
> > Responder: starting
> > 2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC
> > Server listener on 8033: starting
> > 2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.
> > resourcemanager.scheduler.AbstractYarnScheduler: Release request
> > cache is cleaned up
> >
> >
> >
> >
> >
> > Command line output of Zookeepr and Yarn process Start :
> >
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
> > EXECUTING: start zookeeper
> > JMX enabled by default
> > Using config:
> > /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/
> > zoo.cfg
> > Starting zookeeper ... already running as process 11824.
> > Waiting for zookeeper to start...
> > ^C
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
> > EXECUTING: start yarn
> > starting resourcemanager, logging to /home/sanant003c/hello-samza/
> > deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-
> > a1t.sys.comcast.net.out
> > Waiting for resourcemanager to start...
> > Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .
> >
> >
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> > Sent: Wednesday, September 20, 2017 1:36 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Hi Anantharaman,
> >
> > It's likely that your server blocks the GIT protocol. If so, I'd
> > recommend cloning via HTTPS instead of git.
> >
> > *First, determine if the git protocol is blocked on the server as
> > follows:*
> >
> > Please run:
> > # connects to github default port ➜ ~ nc github.com 9418 <
> > /dev/null; echo $?
> >
> > You should see the output as "0". Any other exit code means that the
> > GIT protocol is blocked.
> >
> > *If the above command gets you a non-zero exit code, please clone
> > using HTTPS as follows:*
> >
> > git clone https://github.com/apache/samza.git
> >
> > Alternately, you can edit the line in the bin/grid script replacing
> > git clone git://git.apache.org/samza.git with git clone
> > https://github.com/apache/samza.git
> > and re-run the same command.
> >
> > Please let us know how it goes! :-)
> >
> > Best,
> > Jagdish
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor)
> > < Srinatha_Anantharaman@comcast.com> wrote:
> >
> > > Yi,
> > >
> > > As you suggested this time I tried to install Samza on clean
> > > server (there is nothing installed on this server) Still I am
> > > getting connection timeout error, Please find below command line outputs.
> > > My System Admin/Dev Ops confirmed that this server does not have
> > > any firewall restrictions
> > >
> > >
> > > [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> > > /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo
> > > $PATH
> > > /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> > > 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> > > usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> > > [root@csadatlak-wc-a1t ~]# clear
> > > [root@csadatlak-wc-a1t ~]# pwd
> > > /root
> > > [root@csadatlak-wc-a1t ~]# cd
> > > [root@csadatlak-wc-a1t ~]# set -o vi [root@csadatlak-wc-a1t ~]#
> > > ^Ct -o vi [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
> > > [root@csadatlak-wc-a1t sanant003c]# ll total 4 drwxr-xr-x 7 root
> > > root 4096 Sep 20 15:32 hello-samza [root@csadatlak-wc-a1t
> > > sanant003c]# cd hello-samza/ [root@csadatlak-wc-a1t hello-samza]#
> > > ll
> total 312
> > > drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> > > -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> > > drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> > > drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> > > -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> > > -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> > > -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> > > -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> > > -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> > > -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> > > -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> > > drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> > > -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
> > > Bootstrapping the system...
> > > EXECUTING: stop kafka
> > > Kafka is not installed. Run: bin/grid install kafka
> > > EXECUTING: stop yarn
> > > YARN is not installed. Run: bin/grid install yarn
> > > EXECUTING: stop zookeeper
> > > Zookeeper is not installed. Run: bin/grid install zookeeper
> > > EXECUTING: install samza
> > > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > > fatal: unable to connect to git.apache.org:
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> > > EXECUTING: install kafka
> > > Downloading kafka_2.11-0.10.1.1.tgz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54
> --:--:--
> > > 620k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> > > EXECUTING: install yarn
> > > Downloading hadoop-2.6.1.tar.gz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28
> --:--:--
> > > 734k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> > > EXECUTING: install zookeeper
> > > Downloading zookeeper-3.4.3.tar.gz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21
> --:--:--
> > > 747k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> > > EXECUTING: install samza
> > > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > > fatal: unable to connect to git.apache.org:
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >
> > > Kindly help me to install Samza on my UNIX server
> > >
> > > Regards,
> > > ~Sri
> > >
> > > -----Original Message-----
> > > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > Sent: Thursday, September 14, 2017 6:42 PM
> > > To: dev@samza.apache.org
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
> > >
> > > P.S., the attachment you post w/ the previous email does not show
> > > up (Apache mailing list disallow attachments). If would be better
> > > if you send the command line outputs in pure text or html format.
> > >
> > > -Yi
> > >
> > > On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> > >
> > > > Hi, Anantharaman,
> > > >
> > > > A lot of firewall setup prevents "incoming connections", not
> > > > "outgoing connections" from a box. I.e. if you are downloading
> > > > files, you are establishing outgoing connections and it is fine.
> > > > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > > > making an "incoming
> > > connections"
> > > > to the box and will trigger the firewall rules.
> > > >
> > > > Just trying to pin down the problem, could you try on a Linux
> > > > box w/o any firewall rules setup and see whether that works? At
> > > > least, verify that localhost resolves to 127.0.0.1 and try
> > > > telnet locahost
> > > > 9092 or
> > > 2181?
> > > >
> > > > NOTE: Success in ping simply means that you can access via ICMP,
> > > > not guarantee you can establish TCP connection to the ports via
> > > > firewall
> > > rules.
> > > >
> > > > -Yi
> > > >
> > > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > > > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > >
> > > >> That is a good catch Naveena the server which I am trying to
> > > >> install is an Hadoop edge node, it has kafka broker and
> > > >> Zookeeper client already installed for my Hadoop Does it matter
> > > >> If I am installing it on a separate folder?. My guess Even if
> > > >> there are conflicts on earlier installations it should throw
> > > >> some other error but not the connection time out
> > > >>
> > > >> Coming to your question " it could either related resolving
> > "localhost"
> > > >> or firewall that prevents communication between ports" - how to
> > > >> prove it is because of Firewall issue. I am able to clone Samza
> > > >> files from
> > > Apache git.
> > > >> I can download any external files on this server
> > > >>
> > > >> ~Sri
> > > >>
> > > >> -----Original Message-----
> > > >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> Sent: Thursday, September 14, 2017 2:51 PM
> > > >> To: dev@samza.apache.org
> > > >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >>
> > > >> I wonder if this has anything to do with previous kafka /
> > > >> zookeeper installed on your box. Just for sanity, try clearing
> > > >> /tmp/zookeeeper* and
> > > >> /tmp/kafka* before re-trying those steps.
> > > >>
> > > >>
> > > >> Same as Yi, I strongly suspect issues with your local laptop
> > > >> setup
> > > >> - it could either related resolving "localhost" or firewall
> > > >> that prevents communication between ports.
> > > >>
> > > >>
> > > >> Navina
> > > >>
> > > >> ________________________________
> > > >> From: Yi Pan <ni...@gmail.com>
> > > >> Sent: Thursday, September 14, 2017 11:37:46 AM
> > > >> To: dev@samza.apache.org
> > > >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >>
> > > >> Hi, Anantharaman,
> > > >>
> > > >> I just did the same steps as you described in your email and
> > > >> all passed on my box. Hence, I strongly suspect that it is
> > > >> related to your local laptop network setup.
> > > >>
> > > >> Could you post all the command line output when you ran the
> > > >> sequence of commands?
> > > >>
> > > >> -Yi
> > > >>
> > > >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com>
> wrote:
> > > >>
> > > >> > Hi, Ananarath,
> > > >> >
> > > >> > It is very strange that you are seeing this timeout exception
> > > >> > that we do not see. I am trying to follow the exact steps you
> > > >> > did to see whether there is anything broken. I will update
> > > >> > you this
> > afternoon.
> > > >> >
> > > >> > Meanwhile, could you check your hostname setup and firewall
> > > >> > configuration to see whether your local laptop has blocked
> > > >> > access via the public IP address to your laptop? Could you
> > > >> > verify that your localhost is resolved to
> > > >> > 127.0.0.1 and is accessible?
> > > >> >
> > > >> > -Yi
> > > >> >
> > > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> > > >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > >> >
> > > >> >> Yi,
> > > >> >>
> > > >> >> Is there any alternate way to install Samza Or solution to
> > > >> >> the connection time out error?
> > > >> >>
> > > >> >> Regards,
> > > >> >> ~Sri
> > > >> >>
> > > >> >> From: Anantharaman, Srinatha (Contractor)
> > > >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> > > >> >> To: dev@samza.apache.org
> > > >> >> Subject: RE: Connection timed out error while installing
> > > >> >> "Hello
> > > Samza"
> > > >> >>
> > > >> >>
> > > >> >> Yi,
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> I am trying to build Samza locally by following the steps
> > > >> >> provided by Navina.
> > > >> >>
> > > >> >> As per those steps kafka will be installed after Zookeeper,
> > > >> >> I am getting Error while starting Zookeeper after it is
> > > >> >> installed
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Steps Followed :
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Yes. You can clone apache/samza locally and build it with:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> cd <samza-workspace>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> gradle -b bootstrap.gradle
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./gradlew clean build -x test
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot
> > version
> > > >> of
> > > >> >> the latest apache/samza into your local maven repo
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Then, head to hello-samza workspace and build again:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> cd <hello-samza-workspace>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> mvn clean package ## This should create a build target
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install zookeeper
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start zookeeper
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install yarn
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start yarn
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> mkdir -p deploy/samza
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > >> >> deploy/samza
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> NOTE : BTW From the above steps I could not execute " gradle
> > > >> >> -b bootstrap.gradle" since that command does not exists
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Regards,
> > > >> >>
> > > >> >> ~Sri
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> -----Original Message-----
> > > >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> > > >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> > > >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >> Subject: Re: Connection timed out error while installing
> > > >> >> "Hello
> > > Samza"
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Hi, Anantharam,
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Could you confirm at which step your setup failed? It seems
> > > >> >> that your zookeeper server is running. Could you check to
> > > >> >> see whether your Kafka broker is running? You can either do
> > > >> >> a telnet localhost
> > > >> >> 9092 or do a ps auxww | grep kafka to see whether you got
> > > >> >> any broker
> > > running.
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Sometimes, the Kafka service takes time to start on a single
> > laptop.
> > > >> >> You can just try to run ./bin/grid start kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> again to see whether the service is up.
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Thanks!
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> -Yi
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> > > >> >> (Contractor) <
> > > >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > > >> >> an@comcast.com>> wrote:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> > Find below Zookeeper logs:
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> > > >> >> > [main:QuorumPeerConfig@101]
> > > >> >> > -
> > > >> >>
> > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@78] -
> > > >> >> > autopurge.snapRetainCount set to
> > > >> >> > 3
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval
> > > >> >> > set to
> > > >> >> > 0
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@101]
> > > >> >>
> > > >> >> > - Purge task is not scheduled.
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> > > >> >> > [main:QuorumPeerMain@113] -
> > > >> >>
> > > >> >> > Either no config or no quorum defined in config, running
> > > >> >> > in
> > > >> >>
> > > >> >> > standalone mode
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> > > >> >> > [main:QuorumPeerConfig@101]
> > > >> >> > -
> > > >> >>
> > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServerMain@95]
> > > >> >>
> > > >> >> > - Starting server
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> > > >> >> > 02/06/2012
> > > >> >> > 10:48
> > > >> >>
> > > >> >> > GMT
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.version=1.8.0_31
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.vendor=Oracle Corporation
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> > > >> >>
> > > >> >> > 8.0.31-2.b13.el7.x86_64/jre
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> > > >> >>
> > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > >> >> > ./
> > > >> >>
> > > >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:
> > > >> >> > /
> > > >> >>
> > > >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > > >> >>
> > > >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> > > >> >>
> > > >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> > > >> >>
> > > >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> > > >> >>
> > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > >> >> > ./
> > > >> >>
> > > >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/hom
> > > >> >> > e/
> > > >> >>
> > > >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > > >> >>
> > > >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../conf:
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.library.path=/usr/java/packages/lib/amd64
> > > >> >> > :/
> > > >> >>
> > > >> >> > usr/lib64:/lib64:/lib:/usr/lib
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.io.tmpdir=/tmp
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.compiler=<NA>
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.name=Linux
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.arch=amd64
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.name=root
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.home=/root
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@733]
> > > >> >> > -
> > > >> >>
> > > >> >> > tickTime set to 2000
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@742]
> > > >> >> > -
> > > >> >>
> > > >> >> > minSessionTimeout set to -1
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@751]
> > > >> >> > -
> > > >> >>
> > > >> >> > maxSessionTimeout set to -1
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> > > >> >> > 0.0.0.0/0.0.0.0:2181
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> > > >> >> > [main:FileTxnSnapLog@238] -
> > > >> >>
> > > >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > >> >> > connection
> > > >> >>
> > > >> >> > from
> > > >> >>
> > > >> >> > /0:0:0:0:0:0:0:1:21754
> > > >> >>
> > > >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> > > >> >> > exception
> > > >> >>
> > > >> >> > EndOfStreamException: Unable to read additional data from
> > > >> >> > client
> > > >> >>
> > > >> >> > sessionid 0x0, likely client has closed socket
> > > >> >>
> > > >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > > >> >>
> > > >> >> > NIOServerCnxn.java:220)
> > > >> >>
> > > >> >> > at
> > > >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > > >> >>
> > > >> >> > NIOServerCnxnFactory.java:224)
> > > >> >>
> > > >> >> > at java.lang.Thread.run(Thread.java:745)
> > > >> >>
> > > >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket
> > > >> >> > connection for client
> > > >> >>
> > > >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > >> >> > connection
> > > >> >>
> > > >> >> > from /
> > > >> >>
> > > >> >> > 127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> > > >> >> > establish new
> > > >> >>
> > > >> >> > session at /127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > > >> >> > [SyncThread:0:FileTxnLog@199]
> > > >> >>
> > > >> >> > - Creating new log file: log.1
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> > > >> >>
> > > >> >> > [SyncThread:0:ZooKeeperServer@604]
> > > >> >>
> > > >> >> > - Established session 0x15e770d61920000 with negotiated
> > > >> >> > timeout
> > > >> >> > 6000
> > > >> >>
> > > >> >> > for client /127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x5
> > > >> >> > zxid:0x3
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /brokers
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0xb
> > > >> >> > zxid:0x7
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/config
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /config
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x13 zxid:0xc
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/admin
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /admin
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x1b
> > > >> >> > zxid:0x11
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /cluster
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:setData
> > > >> >> > cxid:0x25
> > > >> >>
> > > >> >> > zxid:0x15
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> > > >> >>
> > > >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:delete
> > > >> >> > cxid:0x34
> > > >> >> > zxid:0x17
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error
> > > >> >> > Path:/admin/preferred_replica_election
> > > >> >>
> > > >> >> > Error:KeeperErrorCode = NoNode for
> > > >> >> > /admin/preferred_replica_election
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x3f
> > > >> >> > zxid:0x18
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NodeExists for /brokers
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x40
> > > >> >> > zxid:0x19
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NodeExists for /brokers/ids
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > -----Original Message-----
> > > >> >>
> > > >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > >> >>
> > > >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> > > >> >>
> > > >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > Subject: Re: Connection timed out error while installing
> > > >> >> > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > Hi, Anantharaman,
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > Could you post your zookeeper startup logs here?
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > > >> >> > (Contractor)
> > > >> >>
> > > >> >> > <
> > > >> >> > Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Ananthar
> > > >> >> > am
> > > >> >> an@comcast.com>> wrote:
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > > It hangs while bringing up the service
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > >> >> > > install zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: install zookeeper
> > > >> >>
> > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > >> >>
> > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > >> >> > > hello-samza]#
> > > >> >>
> > > >> >> > > ./bin/grid start zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: start zookeeper
> > > >> >>
> > > >> >> > > JMX enabled by default
> > > >> >>
> > > >> >> > > Using config:
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > >> >> > > r/
> > > >> >>
> > > >> >> > > bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > > Starting zookeeper ... STARTED
> > > >> >>
> > > >> >> > > Waiting for zookeeper to start...
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > >> >> > > zookeeper^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > >> >> > > install kafka
> > > >> >>
> > > >> >> > > EXECUTING: install kafka
> > > >> >>
> > > >> >> > > Using previously downloaded file
> /root/.samza/download/kafka_2.
> > > >> >>
> > > >> >> > > 11-0.10.1.1.tgz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > >> >> > > kafka
> > > >> >>
> > > >> >> > > EXECUTING: start kafka
> > > >> >>
> > > >> >> > > Waiting for kafka to start...
> > > >> >>
> > > >> >> > > Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]#
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Yes. You can clone apache/samza locally and build it with:
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > cd <samza-workspace>
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > gradle -b bootstrap.gradle
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./gradlew clean build -x test
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> > > >> version
> > > >> >> of
> > > >> >>
> > > >> >> > > the latest apache/samza into your local maven repo
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Then, head to hello-samza workspace and build again:
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > cd <hello-samza-workspace>
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > mvn clean package ## This should create a build target
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install zookeeper
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start zookeeper
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install kafka
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start kafka
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install yarn
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start yarn
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > mkdir -p deploy/samza
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > >> >> > > deploy/samza
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > After this, you can follow steps in the tutorial to "Run"
> > > >> >> > > the
> > > >> >>
> > > >> >> > > example Samza job.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > HTH! Let me know if you need further help.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: RE: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Is there any other way we can install Hello Samza?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Ok. I tried again for the "latest" branch in hello-samza
> > > >> >> > > and it
> > > >> >>
> > > >> >> > > still works.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > > While installing it says "Building samza from master..."
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It is expected to build from "master" in apache/samza repo.
> > > >> >> > > So, the
> > > >> >>
> > > >> >> > > output line is expected.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It is weird that you are unable to connect. Is it
> > > >> >> > > possible you are
> > > >> >>
> > > >> >> > > behind a firewall or something? Can you try to ping "
> > > >> git.apache.org"
> > > >> >> ?
> > > >> >>
> > > >> >> > > Or try the setup on a different box?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: RE: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > I tried again but still same error
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > While installing it says "Building samza from master..."
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > But when after I cloned I executed " git checkout latest"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Hi Anantharaman,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It looks like a transient connection failure to connect
> > > >> >> > > to Apache's
> > > >> >>
> > > >> >> > > git. I tried on my host and it seems to be working.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Can you give it another shot?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > If it still doesn't work, please let me know if you are
> > > >> >> > > running the
> > > >> >>
> > > >> >> > > command under the "master" or "latest" branch of
> > > samza-hello-samza.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Thanks!
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Connection timed out error while installing
> > > >> >> > > "Hello
> > > Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Hi,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > I am trying to install "Hello Samza" on a single node
> > > >> >> > > Initially I
> > > >> >>
> > > >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> > > >> >> > > install
> > > >> >>
> > > >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> > > >> >> > > getting
> > > >> >>
> > > >> >> > > connection timed out error It also mentions no kafka,
> > > >> >> > > yarn and
> > > >> >>
> > > >> >> > > zookeeper installed
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Please find below the error message
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > kafka
> > > >> >>
> > > >> >> > > EXECUTING: install kafka
> > > >> >>
> > > >> >> > > Using previously downloaded file
> /root/.samza/download/kafka_2.
> > > >> >>
> > > >> >> > > 11-0.10.1.1.tgz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > yarn
> > > >> >>
> > > >> >> > > EXECUTING: install yarn
> > > >> >>
> > > >> >> > > Using previously downloaded file
> > > >> >>
> > > >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: install zookeeper
> > > >> >>
> > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > >> >>
> > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > >> >> > > hello-samza]#
> > > >> >>
> > > >> >> > > bin/grid bootstrap Bootstrapping the system...
> > > >> >>
> > > >> >> > > EXECUTING: stop kafka
> > > >> >>
> > > >> >> > > No kafka server to stop
> > > >> >>
> > > >> >> > > EXECUTING: stop yarn
> > > >> >>
> > > >> >> > > no resourcemanager to stop
> > > >> >>
> > > >> >> > > no nodemanager to stop
> > > >> >>
> > > >> >> > > EXECUTING: stop zookeeper
> > > >> >>
> > > >> >> > > JMX enabled by default
> > > >> >>
> > > >> >> > > Using config:
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > >> >> > > r/
> > > >> >>
> > > >> >> > > bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > > Stopping zookeeper ... no zookeeper to stop (could not
> > > >> >> > > find file
> > > >> >>
> > > >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> > > >> >>
> > > >> >> > > EXECUTING: install samza
> > > >> >>
> > > >> >> > > Building samza from master...
> > > >> >>
> > > >> >> > > ~/.samza/download
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > >> >>
> > > >> >> > > Cloning into 'samza'...
> > > >> >>
> > > >> >> > > fatal: unable to connect to git.apache.org:
> > > >> >>
> > > >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed
> > > >> >> > > out
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Could you please help me to resolve this issue?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
> >
>
>
>
> --
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
Hi, Anantharaman,
So, apparently, your local Kafka broker has not started successfully. Could
you try:
{noformat}
./bin/grid stop kafka
ps auxww | grep kafka
{noformat}
First make sure there is no Kafka broker running, and run the following
command:
{noformat}
./bin/grid start kafka
telnet localhost 9092
{noformat}
If it does not work, please post the Kafka broker side log file (under
${YOUR-HELLO-SAMZA-DIR}/deploy/kafka/logs), please post server.log,
kafka.log, and controller.log).
P.S. regarding to your build failure w/ publishToMavenLocal, please note
the following in the online doc (
http://samza.apache.org/startup/hello-samza/0.13/):
1. The online doc stated that you will only need that if trying to build
and deploy hello-samza in *latest branch*. If you are building and
deploying in master branch, you don't need to do that.
2. The online doc also stated that you will run this command in *Samza*
build directory, not in *hello-samza* build directory.
Hope the above help to clarify it.
-Yi
On Thu, Sep 21, 2017 at 2:14 PM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> Yi,
>
> Meanwhile I fixed the issue with "]# ./gradlew publishToMavenLocal" by
> adding apply plugin: 'maven-publish' inside the build.gradle file
>
> Still telnet to port 9092 is not working
>
> I also tried the next steps to run the Samza job and to consume the feed
> through kafka but getting below warning
>
> 2017-09-21 21:13:01.104 [main] KafkaSystemAdmin [WARN] Failed to create
> topic __samza_coordinator_wikipedia-feed_1: org.apache.kafka.common.
> errors.InvalidReplicationFactorException: replication factor: 1 larger
> than available brokers: 0. Retrying.
>
> Kafka Consumer:
>
> [root@csadatlak-wc-a1t hello-samza]# deploy/kafka/bin/kafka-console-consumer.sh
> --zookeeper localhost:2181 --topic wikipedia-raw
> Using the ConsoleConsumer with old consumer is deprecated and will be
> removed in a future major release. Consider using the new consumer by
> passing [bootstrap-server] instead of [zookeeper].
> [2017-09-21 21:07:24,744] WARN [console-consumer-21819_
> csadatlak-wc-a1t.sys.comcast.net-1506028044391-5afc1cc2], no brokers
> found when trying to rebalance. (kafka.consumer.
> ZookeeperConsumerConnector)
>
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Anantharaman, Srinatha (Contractor)
> Sent: Thursday, September 21, 2017 4:06 PM
> To: dev@samza.apache.org
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
> Yi,
>
> It is my mistake I was looking at the previous version documentation
>
> All the telnet worked like you showed me except for " telnet localhost
> 9092"
> Got the cluster info as below
>
> {"clusterInfo":{"id":1506020118416,"startedOn":1506020118416,"state":"
> STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.
> hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","
> resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1 from
> b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> 74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn"
> :"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1
> from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"2015-09-16T21:07Z"}}Connection
> closed by foreign host.
>
>
> BTW earlier I did not execute the " Build a Samza Job Package" { was
> referring to .7 and this step is not part of it)
>
> ./gradlew publishToMavenLocal
>
> When I run the above command I am getting below error
>
> [root@csadatlak-wc-a1t hello-samza]# ./gradlew publishToMavenLocal
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Task 'publishToMavenLocal' not found in root project 'hello-samza'.
>
> * Try:
> Run gradlew tasks to get a list of available tasks. Run with --stacktrace
> option to get the stack trace. Run with --info or --debug option to get
> more log output.
>
> BUILD FAILED
>
> Total time: 5.786 secs
>
> Kindly advise me for the above errors
>
> Regards,
> ~Sri
>
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Wednesday, September 20, 2017 8:29 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi, Anantharaman,
>
> Did you follow documentation here:
> http://samza.apache.org/startup/hello-samza/0.13/? It states that you
> will need to use the following commands to install hello-samza job, in the
> same directory that you cloned the hello-samza git project:
> {code}
>
> mvn clean package
> mkdir -p deploy/samza
> tar -xvf ./target/hello-samza-0.13.0-dist.tar.gz -C deploy/samza
>
> {code}
>
> We apologize if the documentation is not clear and please file/open JIRA
> for unclear documentation issues s.t. we can fix and help.
>
> But first, please follow the exact steps, especially when we are trying to
> help debugging your local deployment issue.
>
> P.S. if all 3 services (i.e. zookeeper, kafka, and YARN) are running, are
> you able to telnet to those service like the response I got from my local
> box below:
>
> {noformat}
>
> yipan-mn1:hello-samza yipan$ telnet localhost 2181
>
> Trying ::1...
>
> Connected to localhost.
>
> Escape character is '^]'.
>
> ^]
>
> telnet> quit
>
> Connection closed.
>
> yipan-mn1:hello-samza yipan$ telnet localhost 9092
>
> Trying ::1...
>
> Connected to localhost.
>
> Escape character is '^]'.
>
> ^]
>
> telnet>
>
> quit
>
> Connection closed by foreign host.
>
> yipan-mn1:hello-samza yipan$ telnet localhost 8088
>
> Trying ::1...
>
> telnet: connect to address ::1: Connection refused
>
> Trying fe80::1...
>
> telnet: connect to address fe80::1: Connection refused
>
> Trying 127.0.0.1...
>
> Connected to localhost.
>
> Escape character is '^]'.
>
> GET /ws/v1/cluster/info
>
> {"clusterInfo":{"id":1505953361666,"startedOn":1505953361666,"state":"
> STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.
> hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","
> resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1
> from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> 74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn"
> :"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1
> from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"
> 2015-09-16T21:07Z"}}Connection
> closed by foreign host.
>
> {noformat}
>
>
> And are you using VPN to access Internet on the host you are deploying
> Samza?
>
>
> -Yi
>
>
> On Wed, Sep 20, 2017 at 2:58 PM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
> > I had already seen using ps aux that all 3 services are running I am
> > not able to open the Yarn UI and when I start YARN it says "Waiting
> > for resourcemanager to start... Ncat: Connection refused" that made
> > me to think YARN not started properly
> >
> > Now Trying to build the Samza Package with the below steps
> >
> > mvn clean package -- Done
> > mkdir -p deploy/samza --Done
> > tar -xvf
> > ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz
> > -C deploy/samza -- Fails as file does not exists.
> >
> > Samza documentation sucks, I do not find that folder Or file. Do I
> > need to use hello-samza-0.13.0-dist.tar.gz which is under my
> > "/home/sanant003c/hello-samza/target" folder?
> >
> >
> >
> > -----Original Message-----
> > From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> > Sent: Wednesday, September 20, 2017 4:48 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > What do you mean by YARN fails to start? The logs you pointed out
> > don't seem to have any error.
> >
> > Is the ResourceManager process running and you are not able to connect
> > to it? Perhaps, try running a quick *ps aux* to find that.
> >
> > On Wed, Sep 20, 2017 at 1:18 PM, Anantharaman, Srinatha (Contractor) <
> > Srinatha_Anantharaman@comcast.com> wrote:
> >
> > > Jagdish,
> > >
> > > I appreciate your help.
> > >
> > > It worked though netcat gave "0' output I still changed the grid
> > > script to "https"
> > >
> > >
> > > [root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null;
> > > echo $?
> > > 0
> > >
> > >
> > > Before I build my Samza job I wanted to confirm if I am able to
> > > access my YARN When I start YARN it fails to start, Below are the
> > > last few lines from Yarn log
> > >
> > > LOG :
> > >
> > > 2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
> > > 2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract
> > > jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/
> > > hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to
> > > /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
> > > 2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Starting expired delegation
> > > token remover thread, tokenRemoverScanInterval=60 min(s)
> > > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Starting expired delegation
> > > token remover thread, tokenRemoverScanInterval=60 min(s)
> > > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Starting expired delegation
> > > token remover thread, tokenRemoverScanInterval=60 min(s)
> > > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$
> > > SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
> > > 2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > > Web app /cluster started at 8088
> > > 2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > > Registered webapp guice modules
> > > 2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager:
> > > Using callQueue class java.util.concurrent.LinkedBlockingQueue
> > > 2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting
> > > Socket Reader #1 for port 8033
> > > 2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.
> > RpcServerFactoryPBImpl:
> > > Adding protocol org.apache.hadoop.yarn.server.api.
> > > ResourceManagerAdministrationProtocolPB to the server
> > > 2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC
> > > Server
> > > Responder: starting
> > > 2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC
> > > Server listener on 8033: starting
> > > 2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.
> > > resourcemanager.scheduler.AbstractYarnScheduler: Release request
> > > cache is cleaned up
> > >
> > >
> > >
> > >
> > >
> > > Command line output of Zookeepr and Yarn process Start :
> > >
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
> > > EXECUTING: start zookeeper
> > > JMX enabled by default
> > > Using config:
> > > /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/
> > > zoo.cfg
> > > Starting zookeeper ... already running as process 11824.
> > > Waiting for zookeeper to start...
> > > ^C
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
> > > EXECUTING: start yarn
> > > starting resourcemanager, logging to /home/sanant003c/hello-samza/
> > > deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-
> > > a1t.sys.comcast.net.out
> > > Waiting for resourcemanager to start...
> > > Ncat: Connection refused.
> > > .Ncat: Connection refused.
> > > .
> > >
> > >
> > >
> > > Regards,
> > > ~Sri
> > >
> > > -----Original Message-----
> > > From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> > > Sent: Wednesday, September 20, 2017 1:36 PM
> > > To: dev@samza.apache.org
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
> > >
> > > Hi Anantharaman,
> > >
> > > It's likely that your server blocks the GIT protocol. If so, I'd
> > > recommend cloning via HTTPS instead of git.
> > >
> > > *First, determine if the git protocol is blocked on the server as
> > > follows:*
> > >
> > > Please run:
> > > # connects to github default port ➜ ~ nc github.com 9418 <
> > > /dev/null; echo $?
> > >
> > > You should see the output as "0". Any other exit code means that the
> > > GIT protocol is blocked.
> > >
> > > *If the above command gets you a non-zero exit code, please clone
> > > using HTTPS as follows:*
> > >
> > > git clone https://github.com/apache/samza.git
> > >
> > > Alternately, you can edit the line in the bin/grid script replacing
> > > git clone git://git.apache.org/samza.git with git clone
> > > https://github.com/apache/samza.git
> > > and re-run the same command.
> > >
> > > Please let us know how it goes! :-)
> > >
> > > Best,
> > > Jagdish
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor)
> > > < Srinatha_Anantharaman@comcast.com> wrote:
> > >
> > > > Yi,
> > > >
> > > > As you suggested this time I tried to install Samza on clean
> > > > server (there is nothing installed on this server) Still I am
> > > > getting connection timeout error, Please find below command line
> outputs.
> > > > My System Admin/Dev Ops confirmed that this server does not have
> > > > any firewall restrictions
> > > >
> > > >
> > > > [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> > > > /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo
> > > > $PATH
> > > > /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> > > > 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> > > > usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> > > > [root@csadatlak-wc-a1t ~]# clear
> > > > [root@csadatlak-wc-a1t ~]# pwd
> > > > /root
> > > > [root@csadatlak-wc-a1t ~]# cd
> > > > [root@csadatlak-wc-a1t ~]# set -o vi [root@csadatlak-wc-a1t ~]#
> > > > ^Ct -o vi [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > > [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > > [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
> > > > [root@csadatlak-wc-a1t sanant003c]# ll total 4 drwxr-xr-x 7 root
> > > > root 4096 Sep 20 15:32 hello-samza [root@csadatlak-wc-a1t
> > > > sanant003c]# cd hello-samza/ [root@csadatlak-wc-a1t hello-samza]#
> > > > ll
> > total 312
> > > > drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> > > > -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> > > > drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> > > > drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> > > > -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> > > > -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> > > > -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> > > > -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> > > > -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> > > > -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> > > > -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> > > > drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> > > > -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
> > > > Bootstrapping the system...
> > > > EXECUTING: stop kafka
> > > > Kafka is not installed. Run: bin/grid install kafka
> > > > EXECUTING: stop yarn
> > > > YARN is not installed. Run: bin/grid install yarn
> > > > EXECUTING: stop zookeeper
> > > > Zookeeper is not installed. Run: bin/grid install zookeeper
> > > > EXECUTING: install samza
> > > > ~/.samza/download /home/sanant003c/hello-samza Cloning into
> 'samza'...
> > > > fatal: unable to connect to git.apache.org:
> > > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > > >
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> > > > EXECUTING: install kafka
> > > > Downloading kafka_2.11-0.10.1.1.tgz...
> > > > % Total % Received % Xferd Average Speed Time Time
> Time
> > > > Current
> > > > Dload Upload Total Spent
> Left
> > > > Speed
> > > > 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54
> > --:--:--
> > > > 620k
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> > > > EXECUTING: install yarn
> > > > Downloading hadoop-2.6.1.tar.gz...
> > > > % Total % Received % Xferd Average Speed Time Time
> Time
> > > > Current
> > > > Dload Upload Total Spent
> Left
> > > > Speed
> > > > 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28
> > --:--:--
> > > > 734k
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> > > > EXECUTING: install zookeeper
> > > > Downloading zookeeper-3.4.3.tar.gz...
> > > > % Total % Received % Xferd Average Speed Time Time
> Time
> > > > Current
> > > > Dload Upload Total Spent
> Left
> > > > Speed
> > > > 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21
> > --:--:--
> > > > 747k
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> > > > EXECUTING: install samza
> > > > ~/.samza/download /home/sanant003c/hello-samza Cloning into
> 'samza'...
> > > > fatal: unable to connect to git.apache.org:
> > > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > > >
> > > > Kindly help me to install Samza on my UNIX server
> > > >
> > > > Regards,
> > > > ~Sri
> > > >
> > > > -----Original Message-----
> > > > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > > Sent: Thursday, September 14, 2017 6:42 PM
> > > > To: dev@samza.apache.org
> > > > Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >
> > > > P.S., the attachment you post w/ the previous email does not show
> > > > up (Apache mailing list disallow attachments). If would be better
> > > > if you send the command line outputs in pure text or html format.
> > > >
> > > > -Yi
> > > >
> > > > On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> > > >
> > > > > Hi, Anantharaman,
> > > > >
> > > > > A lot of firewall setup prevents "incoming connections", not
> > > > > "outgoing connections" from a box. I.e. if you are downloading
> > > > > files, you are establishing outgoing connections and it is fine.
> > > > > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > > > > making an "incoming
> > > > connections"
> > > > > to the box and will trigger the firewall rules.
> > > > >
> > > > > Just trying to pin down the problem, could you try on a Linux
> > > > > box w/o any firewall rules setup and see whether that works? At
> > > > > least, verify that localhost resolves to 127.0.0.1 and try
> > > > > telnet locahost
> > > > > 9092 or
> > > > 2181?
> > > > >
> > > > > NOTE: Success in ping simply means that you can access via ICMP,
> > > > > not guarantee you can establish TCP connection to the ports via
> > > > > firewall
> > > > rules.
> > > > >
> > > > > -Yi
> > > > >
> > > > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > > > > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > > >
> > > > >> That is a good catch Naveena the server which I am trying to
> > > > >> install is an Hadoop edge node, it has kafka broker and
> > > > >> Zookeeper client already installed for my Hadoop Does it matter
> > > > >> If I am installing it on a separate folder?. My guess Even if
> > > > >> there are conflicts on earlier installations it should throw
> > > > >> some other error but not the connection time out
> > > > >>
> > > > >> Coming to your question " it could either related resolving
> > > "localhost"
> > > > >> or firewall that prevents communication between ports" - how to
> > > > >> prove it is because of Firewall issue. I am able to clone Samza
> > > > >> files from
> > > > Apache git.
> > > > >> I can download any external files on this server
> > > > >>
> > > > >> ~Sri
> > > > >>
> > > > >> -----Original Message-----
> > > > >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > > >> Sent: Thursday, September 14, 2017 2:51 PM
> > > > >> To: dev@samza.apache.org
> > > > >> Subject: Re: Connection timed out error while installing "Hello
> > Samza"
> > > > >>
> > > > >> I wonder if this has anything to do with previous kafka /
> > > > >> zookeeper installed on your box. Just for sanity, try clearing
> > > > >> /tmp/zookeeeper* and
> > > > >> /tmp/kafka* before re-trying those steps.
> > > > >>
> > > > >>
> > > > >> Same as Yi, I strongly suspect issues with your local laptop
> > > > >> setup
> > > > >> - it could either related resolving "localhost" or firewall
> > > > >> that prevents communication between ports.
> > > > >>
> > > > >>
> > > > >> Navina
> > > > >>
> > > > >> ________________________________
> > > > >> From: Yi Pan <ni...@gmail.com>
> > > > >> Sent: Thursday, September 14, 2017 11:37:46 AM
> > > > >> To: dev@samza.apache.org
> > > > >> Subject: Re: Connection timed out error while installing "Hello
> > Samza"
> > > > >>
> > > > >> Hi, Anantharaman,
> > > > >>
> > > > >> I just did the same steps as you described in your email and
> > > > >> all passed on my box. Hence, I strongly suspect that it is
> > > > >> related to your local laptop network setup.
> > > > >>
> > > > >> Could you post all the command line output when you ran the
> > > > >> sequence of commands?
> > > > >>
> > > > >> -Yi
> > > > >>
> > > > >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com>
> > wrote:
> > > > >>
> > > > >> > Hi, Ananarath,
> > > > >> >
> > > > >> > It is very strange that you are seeing this timeout exception
> > > > >> > that we do not see. I am trying to follow the exact steps you
> > > > >> > did to see whether there is anything broken. I will update
> > > > >> > you this
> > > afternoon.
> > > > >> >
> > > > >> > Meanwhile, could you check your hostname setup and firewall
> > > > >> > configuration to see whether your local laptop has blocked
> > > > >> > access via the public IP address to your laptop? Could you
> > > > >> > verify that your localhost is resolved to
> > > > >> > 127.0.0.1 and is accessible?
> > > > >> >
> > > > >> > -Yi
> > > > >> >
> > > > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> > > > >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > > >> >
> > > > >> >> Yi,
> > > > >> >>
> > > > >> >> Is there any alternate way to install Samza Or solution to
> > > > >> >> the connection time out error?
> > > > >> >>
> > > > >> >> Regards,
> > > > >> >> ~Sri
> > > > >> >>
> > > > >> >> From: Anantharaman, Srinatha (Contractor)
> > > > >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> > > > >> >> To: dev@samza.apache.org
> > > > >> >> Subject: RE: Connection timed out error while installing
> > > > >> >> "Hello
> > > > Samza"
> > > > >> >>
> > > > >> >>
> > > > >> >> Yi,
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> I am trying to build Samza locally by following the steps
> > > > >> >> provided by Navina.
> > > > >> >>
> > > > >> >> As per those steps kafka will be installed after Zookeeper,
> > > > >> >> I am getting Error while starting Zookeeper after it is
> > > > >> >> installed
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Steps Followed :
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Yes. You can clone apache/samza locally and build it with:
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> cd <samza-workspace>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> gradle -b bootstrap.gradle
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./gradlew clean build -x test
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot
> > > version
> > > > >> of
> > > > >> >> the latest apache/samza into your local maven repo
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Then, head to hello-samza workspace and build again:
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> cd <hello-samza-workspace>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> mvn clean package ## This should create a build target
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid install zookeeper
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid start zookeeper
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid install kafka
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid start kafka
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid install yarn
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid start yarn
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> mkdir -p deploy/samza
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > > >> >> deploy/samza
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> NOTE : BTW From the above steps I could not execute " gradle
> > > > >> >> -b bootstrap.gradle" since that command does not exists
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Regards,
> > > > >> >>
> > > > >> >> ~Sri
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> -----Original Message-----
> > > > >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> > > > >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> > > > >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >> Subject: Re: Connection timed out error while installing
> > > > >> >> "Hello
> > > > Samza"
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Hi, Anantharam,
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Could you confirm at which step your setup failed? It seems
> > > > >> >> that your zookeeper server is running. Could you check to
> > > > >> >> see whether your Kafka broker is running? You can either do
> > > > >> >> a telnet localhost
> > > > >> >> 9092 or do a ps auxww | grep kafka to see whether you got
> > > > >> >> any broker
> > > > running.
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Sometimes, the Kafka service takes time to start on a single
> > > laptop.
> > > > >> >> You can just try to run ./bin/grid start kafka
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> again to see whether the service is up.
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Thanks!
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> -Yi
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> > > > >> >> (Contractor) <
> > > > >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > > > >> >> an@comcast.com>> wrote:
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> > Find below Zookeeper logs:
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> > > > >> >> > [main:QuorumPeerConfig@101]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > > >> >>
> > > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:DatadirCleanupManager@78] -
> > > > >> >> > autopurge.snapRetainCount set to
> > > > >> >> > 3
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval
> > > > >> >> > set to
> > > > >> >> > 0
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:DatadirCleanupManager@101]
> > > > >> >>
> > > > >> >> > - Purge task is not scheduled.
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> > > > >> >> > [main:QuorumPeerMain@113] -
> > > > >> >>
> > > > >> >> > Either no config or no quorum defined in config, running
> > > > >> >> > in
> > > > >> >>
> > > > >> >> > standalone mode
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> > > > >> >> > [main:QuorumPeerConfig@101]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > > >> >>
> > > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServerMain@95]
> > > > >> >>
> > > > >> >> > - Starting server
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> > > > >> >> > 02/06/2012
> > > > >> >> > 10:48
> > > > >> >>
> > > > >> >> > GMT
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.version=1.8.0_31
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.vendor=Oracle Corporation
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> > > > >> >>
> > > > >> >> > 8.0.31-2.b13.el7.x86_64/jre
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> > > > >> >>
> > > > >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> > > > >> >>
> > > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > > >> >> > ./
> > > > >> >>
> > > > >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:
> > > > >> >> > /
> > > > >> >>
> > > > >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > > > >> >>
> > > > >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> > > > >> >>
> > > > >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> > > > >> >>
> > > > >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> > > > >> >>
> > > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > > >> >> > ./
> > > > >> >>
> > > > >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/hom
> > > > >> >> > e/
> > > > >> >>
> > > > >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > > > >> >>
> > > > >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../conf:
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.library.path=/usr/java/packages/lib/amd64
> > > > >> >> > :/
> > > > >> >>
> > > > >> >> > usr/lib64:/lib64:/lib:/usr/lib
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.io.tmpdir=/tmp
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.compiler=<NA>
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:os.name=Linux
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:os.arch=amd64
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:user.name=root
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:user.home=/root
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServer@733]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > tickTime set to 2000
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServer@742]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > minSessionTimeout set to -1
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServer@751]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > maxSessionTimeout set to -1
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> > > > >> >> > 0.0.0.0/0.0.0.0:2181
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> > > > >> >> > [main:FileTxnSnapLog@238] -
> > > > >> >>
> > > > >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > > >> >> > connection
> > > > >> >>
> > > > >> >> > from
> > > > >> >>
> > > > >> >> > /0:0:0:0:0:0:0:1:21754
> > > > >> >>
> > > > >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> > > > >> >> > exception
> > > > >> >>
> > > > >> >> > EndOfStreamException: Unable to read additional data from
> > > > >> >> > client
> > > > >> >>
> > > > >> >> > sessionid 0x0, likely client has closed socket
> > > > >> >>
> > > > >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > > > >> >>
> > > > >> >> > NIOServerCnxn.java:220)
> > > > >> >>
> > > > >> >> > at
> > > > >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > > > >> >>
> > > > >> >> > NIOServerCnxnFactory.java:224)
> > > > >> >>
> > > > >> >> > at java.lang.Thread.run(Thread.java:745)
> > > > >> >>
> > > > >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket
> > > > >> >> > connection for client
> > > > >> >>
> > > > >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > > >> >> > connection
> > > > >> >>
> > > > >> >> > from /
> > > > >> >>
> > > > >> >> > 127.0.0.1:48071
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> > > > >> >> > establish new
> > > > >> >>
> > > > >> >> > session at /127.0.0.1:48071
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > > > >> >> > [SyncThread:0:FileTxnLog@199]
> > > > >> >>
> > > > >> >> > - Creating new log file: log.1
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [SyncThread:0:ZooKeeperServer@604]
> > > > >> >>
> > > > >> >> > - Established session 0x15e770d61920000 with negotiated
> > > > >> >> > timeout
> > > > >> >> > 6000
> > > > >> >>
> > > > >> >> > for client /127.0.0.1:48071
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x5
> > > > >> >> > zxid:0x3
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /brokers
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0xb
> > > > >> >> > zxid:0x7
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/config
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /config
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x13 zxid:0xc
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/admin
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /admin
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x1b
> > > > >> >> > zxid:0x11
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /cluster
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:setData
> > > > >> >> > cxid:0x25
> > > > >> >>
> > > > >> >> > zxid:0x15
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> > > > >> >>
> > > > >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:delete
> > > > >> >> > cxid:0x34
> > > > >> >> > zxid:0x17
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error
> > > > >> >> > Path:/admin/preferred_replica_election
> > > > >> >>
> > > > >> >> > Error:KeeperErrorCode = NoNode for
> > > > >> >> > /admin/preferred_replica_election
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x3f
> > > > >> >> > zxid:0x18
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NodeExists for /brokers
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x40
> > > > >> >> > zxid:0x19
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NodeExists for /brokers/ids
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > -----Original Message-----
> > > > >> >>
> > > > >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > > >> >>
> > > > >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> > > > >> >>
> > > > >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >>
> > > > >> >> > Subject: Re: Connection timed out error while installing
> > > > >> >> > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > Hi, Anantharaman,
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > Could you post your zookeeper startup logs here?
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > > > >> >> > (Contractor)
> > > > >> >>
> > > > >> >> > <
> > > > >> >> > Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Ananthar
> > > > >> >> > am
> > > > >> >> an@comcast.com>> wrote:
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > > It hangs while bringing up the service
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> > > > >> >>
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > > >> >> > > install zookeeper
> > > > >> >>
> > > > >> >> > > EXECUTING: install zookeeper
> > > > >> >>
> > > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > > >> >>
> > > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > > >> >> > > hello-samza]#
> > > > >> >>
> > > > >> >> > > ./bin/grid start zookeeper
> > > > >> >>
> > > > >> >> > > EXECUTING: start zookeeper
> > > > >> >>
> > > > >> >> > > JMX enabled by default
> > > > >> >>
> > > > >> >> > > Using config:
> > > > >> >>
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > > >> >> > > r/
> > > > >> >>
> > > > >> >> > > bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > > Starting zookeeper ... STARTED
> > > > >> >>
> > > > >> >> > > Waiting for zookeeper to start...
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ^C
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > > >> >> > > zookeeper^C
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > > >> >> > > install kafka
> > > > >> >>
> > > > >> >> > > EXECUTING: install kafka
> > > > >> >>
> > > > >> >> > > Using previously downloaded file
> > /root/.samza/download/kafka_2.
> > > > >> >>
> > > > >> >> > > 11-0.10.1.1.tgz
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > > >> >> > > kafka
> > > > >> >>
> > > > >> >> > > EXECUTING: start kafka
> > > > >> >>
> > > > >> >> > > Waiting for kafka to start...
> > > > >> >>
> > > > >> >> > > Ncat: Connection refused.
> > > > >> >>
> > > > >> >> > > .Ncat: Connection refused.
> > > > >> >>
> > > > >> >> > > .Ncat: Connection refused.
> > > > >> >>
> > > > >> >> > > .^C
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]#
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > -----Original Message-----
> > > > >> >>
> > > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Re: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Yes. You can clone apache/samza locally and build it with:
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > cd <samza-workspace>
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > gradle -b bootstrap.gradle
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./gradlew clean build -x test
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./gradlew publishToMavenLocal ## This publishes a
> snapshot
> > > > >> version
> > > > >> >> of
> > > > >> >>
> > > > >> >> > > the latest apache/samza into your local maven repo
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Then, head to hello-samza workspace and build again:
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > cd <hello-samza-workspace>
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > mvn clean package ## This should create a build target
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid install zookeeper
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid start zookeeper
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid install kafka
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid start kafka
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid install yarn
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid start yarn
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > mkdir -p deploy/samza
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > > >> >> > > deploy/samza
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > After this, you can follow steps in the tutorial to "Run"
> > > > >> >> > > the
> > > > >> >>
> > > > >> >> > > example Samza job.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > HTH! Let me know if you need further help.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ________________________________
> > > > >> >>
> > > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > > >> >> > > <Srinatha_Anantharaman@
> > > > >> >>
> > > > >> >> > > comcast.com>
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: RE: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Is there any other way we can install Hello Samza?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Regards,
> > > > >> >>
> > > > >> >> > > ~Sri
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > -----Original Message-----
> > > > >> >>
> > > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Re: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Ok. I tried again for the "latest" branch in hello-samza
> > > > >> >> > > and it
> > > > >> >>
> > > > >> >> > > still works.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > > While installing it says "Building samza from master..."
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > It is expected to build from "master" in apache/samza repo.
> > > > >> >> > > So, the
> > > > >> >>
> > > > >> >> > > output line is expected.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > It is weird that you are unable to connect. Is it
> > > > >> >> > > possible you are
> > > > >> >>
> > > > >> >> > > behind a firewall or something? Can you try to ping "
> > > > >> git.apache.org"
> > > > >> >> ?
> > > > >> >>
> > > > >> >> > > Or try the setup on a different box?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ________________________________
> > > > >> >>
> > > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > > >> >> > > <Srinatha_Anantharaman@
> > > > >> >>
> > > > >> >> > > comcast.com>
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: RE: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > I tried again but still same error
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > While installing it says "Building samza from master..."
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > But when after I cloned I executed " git checkout latest"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Regards,
> > > > >> >>
> > > > >> >> > > ~Sri
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > -----Original Message-----
> > > > >> >>
> > > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Re: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Hi Anantharaman,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > It looks like a transient connection failure to connect
> > > > >> >> > > to Apache's
> > > > >> >>
> > > > >> >> > > git. I tried on my host and it seems to be working.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Can you give it another shot?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > If it still doesn't work, please let me know if you are
> > > > >> >> > > running the
> > > > >> >>
> > > > >> >> > > command under the "master" or "latest" branch of
> > > > samza-hello-samza.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Thanks!
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ________________________________
> > > > >> >>
> > > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > > >> >> > > <Srinatha_Anantharaman@
> > > > >> >>
> > > > >> >> > > comcast.com>
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Hi,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > I am trying to install "Hello Samza" on a single node
> > > > >> >> > > Initially I
> > > > >> >>
> > > > >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> > > > >> >> > > install
> > > > >> >>
> > > > >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> > > > >> >> > > getting
> > > > >> >>
> > > > >> >> > > connection timed out error It also mentions no kafka,
> > > > >> >> > > yarn and
> > > > >> >>
> > > > >> >> > > zookeeper installed
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Please find below the error message
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > > >> >> > > kafka
> > > > >> >>
> > > > >> >> > > EXECUTING: install kafka
> > > > >> >>
> > > > >> >> > > Using previously downloaded file
> > /root/.samza/download/kafka_2.
> > > > >> >>
> > > > >> >> > > 11-0.10.1.1.tgz
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > > >> >> > > yarn
> > > > >> >>
> > > > >> >> > > EXECUTING: install yarn
> > > > >> >>
> > > > >> >> > > Using previously downloaded file
> > > > >> >>
> > > > >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > > >> >> > > zookeeper
> > > > >> >>
> > > > >> >> > > EXECUTING: install zookeeper
> > > > >> >>
> > > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > > >> >>
> > > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > > >> >> > > hello-samza]#
> > > > >> >>
> > > > >> >> > > bin/grid bootstrap Bootstrapping the system...
> > > > >> >>
> > > > >> >> > > EXECUTING: stop kafka
> > > > >> >>
> > > > >> >> > > No kafka server to stop
> > > > >> >>
> > > > >> >> > > EXECUTING: stop yarn
> > > > >> >>
> > > > >> >> > > no resourcemanager to stop
> > > > >> >>
> > > > >> >> > > no nodemanager to stop
> > > > >> >>
> > > > >> >> > > EXECUTING: stop zookeeper
> > > > >> >>
> > > > >> >> > > JMX enabled by default
> > > > >> >>
> > > > >> >> > > Using config:
> > > > >> >>
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > > >> >> > > r/
> > > > >> >>
> > > > >> >> > > bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > > Stopping zookeeper ... no zookeeper to stop (could not
> > > > >> >> > > find file
> > > > >> >>
> > > > >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> > > > >> >>
> > > > >> >> > > EXECUTING: install samza
> > > > >> >>
> > > > >> >> > > Building samza from master...
> > > > >> >>
> > > > >> >> > > ~/.samza/download
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > > >> >>
> > > > >> >> > > Cloning into 'samza'...
> > > > >> >>
> > > > >> >> > > fatal: unable to connect to git.apache.org:
> > > > >> >>
> > > > >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed
> > > > >> >> > > out
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Could you please help me to resolve this issue?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Regards,
> > > > >> >>
> > > > >> >> > > ~Sri
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Jagadish V,
> > > Graduate Student,
> > > Department of Computer Science,
> > > Stanford University
> > >
> >
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
> >
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Yi,
Meanwhile I fixed the issue with "]# ./gradlew publishToMavenLocal" by adding apply plugin: 'maven-publish' inside the build.gradle file
Still telnet to port 9092 is not working
I also tried the next steps to run the Samza job and to consume the feed through kafka but getting below warning
2017-09-21 21:13:01.104 [main] KafkaSystemAdmin [WARN] Failed to create topic __samza_coordinator_wikipedia-feed_1: org.apache.kafka.common.errors.InvalidReplicationFactorException: replication factor: 1 larger than available brokers: 0. Retrying.
Kafka Consumer:
[root@csadatlak-wc-a1t hello-samza]# deploy/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic wikipedia-raw
Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper].
[2017-09-21 21:07:24,744] WARN [console-consumer-21819_csadatlak-wc-a1t.sys.comcast.net-1506028044391-5afc1cc2], no brokers found when trying to rebalance. (kafka.consumer.ZookeeperConsumerConnector)
Regards,
~Sri
-----Original Message-----
From: Anantharaman, Srinatha (Contractor)
Sent: Thursday, September 21, 2017 4:06 PM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Yi,
It is my mistake I was looking at the previous version documentation
All the telnet worked like you showed me except for " telnet localhost 9092"
Got the cluster info as below
{"clusterInfo":{"id":1506020118416,"startedOn":1506020118416,"state":"STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1 from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum 74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn":"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1 from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"2015-09-16T21:07Z"}}Connection closed by foreign host.
BTW earlier I did not execute the " Build a Samza Job Package" { was referring to .7 and this step is not part of it)
./gradlew publishToMavenLocal
When I run the above command I am getting below error
[root@csadatlak-wc-a1t hello-samza]# ./gradlew publishToMavenLocal
FAILURE: Build failed with an exception.
* What went wrong:
Task 'publishToMavenLocal' not found in root project 'hello-samza'.
* Try:
Run gradlew tasks to get a list of available tasks. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.
BUILD FAILED
Total time: 5.786 secs
Kindly advise me for the above errors
Regards,
~Sri
-----Original Message-----
From: Yi Pan [mailto:nickpan47@gmail.com]
Sent: Wednesday, September 20, 2017 8:29 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharaman,
Did you follow documentation here:
http://samza.apache.org/startup/hello-samza/0.13/? It states that you will need to use the following commands to install hello-samza job, in the same directory that you cloned the hello-samza git project:
{code}
mvn clean package
mkdir -p deploy/samza
tar -xvf ./target/hello-samza-0.13.0-dist.tar.gz -C deploy/samza
{code}
We apologize if the documentation is not clear and please file/open JIRA for unclear documentation issues s.t. we can fix and help.
But first, please follow the exact steps, especially when we are trying to help debugging your local deployment issue.
P.S. if all 3 services (i.e. zookeeper, kafka, and YARN) are running, are you able to telnet to those service like the response I got from my local box below:
{noformat}
yipan-mn1:hello-samza yipan$ telnet localhost 2181
Trying ::1...
Connected to localhost.
Escape character is '^]'.
^]
telnet> quit
Connection closed.
yipan-mn1:hello-samza yipan$ telnet localhost 9092
Trying ::1...
Connected to localhost.
Escape character is '^]'.
^]
telnet>
quit
Connection closed by foreign host.
yipan-mn1:hello-samza yipan$ telnet localhost 8088
Trying ::1...
telnet: connect to address ::1: Connection refused
Trying fe80::1...
telnet: connect to address fe80::1: Connection refused
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
GET /ws/v1/cluster/info
{"clusterInfo":{"id":1505953361666,"startedOn":1505953361666,"state":"STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1
from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn":"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1
from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"2015-09-16T21:07Z"}}Connection
closed by foreign host.
{noformat}
And are you using VPN to access Internet on the host you are deploying Samza?
-Yi
On Wed, Sep 20, 2017 at 2:58 PM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> I had already seen using ps aux that all 3 services are running I am
> not able to open the Yarn UI and when I start YARN it says "Waiting
> for resourcemanager to start... Ncat: Connection refused" that made
> me to think YARN not started properly
>
> Now Trying to build the Samza Package with the below steps
>
> mvn clean package -- Done
> mkdir -p deploy/samza --Done
> tar -xvf
> ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz
> -C deploy/samza -- Fails as file does not exists.
>
> Samza documentation sucks, I do not find that folder Or file. Do I
> need to use hello-samza-0.13.0-dist.tar.gz which is under my
> "/home/sanant003c/hello-samza/target" folder?
>
>
>
> -----Original Message-----
> From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> Sent: Wednesday, September 20, 2017 4:48 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> What do you mean by YARN fails to start? The logs you pointed out
> don't seem to have any error.
>
> Is the ResourceManager process running and you are not able to connect
> to it? Perhaps, try running a quick *ps aux* to find that.
>
> On Wed, Sep 20, 2017 at 1:18 PM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
> > Jagdish,
> >
> > I appreciate your help.
> >
> > It worked though netcat gave "0' output I still changed the grid
> > script to "https"
> >
> >
> > [root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null;
> > echo $?
> > 0
> >
> >
> > Before I build my Samza job I wanted to confirm if I am able to
> > access my YARN When I start YARN it fails to start, Below are the
> > last few lines from Yarn log
> >
> > LOG :
> >
> > 2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
> > 2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract
> > jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/
> > hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to
> > /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
> > 2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master
> > key for generating delegation tokens
> > 2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$
> > SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
> > 2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > Web app /cluster started at 8088
> > 2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > Registered webapp guice modules
> > 2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager:
> > Using callQueue class java.util.concurrent.LinkedBlockingQueue
> > 2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting
> > Socket Reader #1 for port 8033
> > 2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.
> RpcServerFactoryPBImpl:
> > Adding protocol org.apache.hadoop.yarn.server.api.
> > ResourceManagerAdministrationProtocolPB to the server
> > 2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC
> > Server
> > Responder: starting
> > 2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC
> > Server listener on 8033: starting
> > 2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.
> > resourcemanager.scheduler.AbstractYarnScheduler: Release request
> > cache is cleaned up
> >
> >
> >
> >
> >
> > Command line output of Zookeepr and Yarn process Start :
> >
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
> > EXECUTING: start zookeeper
> > JMX enabled by default
> > Using config:
> > /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/
> > zoo.cfg
> > Starting zookeeper ... already running as process 11824.
> > Waiting for zookeeper to start...
> > ^C
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
> > EXECUTING: start yarn
> > starting resourcemanager, logging to /home/sanant003c/hello-samza/
> > deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-
> > a1t.sys.comcast.net.out
> > Waiting for resourcemanager to start...
> > Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .
> >
> >
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> > Sent: Wednesday, September 20, 2017 1:36 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Hi Anantharaman,
> >
> > It's likely that your server blocks the GIT protocol. If so, I'd
> > recommend cloning via HTTPS instead of git.
> >
> > *First, determine if the git protocol is blocked on the server as
> > follows:*
> >
> > Please run:
> > # connects to github default port ➜ ~ nc github.com 9418 <
> > /dev/null; echo $?
> >
> > You should see the output as "0". Any other exit code means that the
> > GIT protocol is blocked.
> >
> > *If the above command gets you a non-zero exit code, please clone
> > using HTTPS as follows:*
> >
> > git clone https://github.com/apache/samza.git
> >
> > Alternately, you can edit the line in the bin/grid script replacing
> > git clone git://git.apache.org/samza.git with git clone
> > https://github.com/apache/samza.git
> > and re-run the same command.
> >
> > Please let us know how it goes! :-)
> >
> > Best,
> > Jagdish
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor)
> > < Srinatha_Anantharaman@comcast.com> wrote:
> >
> > > Yi,
> > >
> > > As you suggested this time I tried to install Samza on clean
> > > server (there is nothing installed on this server) Still I am
> > > getting connection timeout error, Please find below command line outputs.
> > > My System Admin/Dev Ops confirmed that this server does not have
> > > any firewall restrictions
> > >
> > >
> > > [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> > > /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo
> > > $PATH
> > > /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> > > 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> > > usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> > > [root@csadatlak-wc-a1t ~]# clear
> > > [root@csadatlak-wc-a1t ~]# pwd
> > > /root
> > > [root@csadatlak-wc-a1t ~]# cd
> > > [root@csadatlak-wc-a1t ~]# set -o vi [root@csadatlak-wc-a1t ~]#
> > > ^Ct -o vi [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
> > > [root@csadatlak-wc-a1t sanant003c]# ll total 4 drwxr-xr-x 7 root
> > > root 4096 Sep 20 15:32 hello-samza [root@csadatlak-wc-a1t
> > > sanant003c]# cd hello-samza/ [root@csadatlak-wc-a1t hello-samza]#
> > > ll
> total 312
> > > drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> > > -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> > > drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> > > drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> > > -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> > > -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> > > -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> > > -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> > > -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> > > -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> > > -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> > > drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> > > -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
> > > Bootstrapping the system...
> > > EXECUTING: stop kafka
> > > Kafka is not installed. Run: bin/grid install kafka
> > > EXECUTING: stop yarn
> > > YARN is not installed. Run: bin/grid install yarn
> > > EXECUTING: stop zookeeper
> > > Zookeeper is not installed. Run: bin/grid install zookeeper
> > > EXECUTING: install samza
> > > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > > fatal: unable to connect to git.apache.org:
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> > > EXECUTING: install kafka
> > > Downloading kafka_2.11-0.10.1.1.tgz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54
> --:--:--
> > > 620k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> > > EXECUTING: install yarn
> > > Downloading hadoop-2.6.1.tar.gz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28
> --:--:--
> > > 734k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> > > EXECUTING: install zookeeper
> > > Downloading zookeeper-3.4.3.tar.gz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21
> --:--:--
> > > 747k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> > > EXECUTING: install samza
> > > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > > fatal: unable to connect to git.apache.org:
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >
> > > Kindly help me to install Samza on my UNIX server
> > >
> > > Regards,
> > > ~Sri
> > >
> > > -----Original Message-----
> > > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > Sent: Thursday, September 14, 2017 6:42 PM
> > > To: dev@samza.apache.org
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
> > >
> > > P.S., the attachment you post w/ the previous email does not show
> > > up (Apache mailing list disallow attachments). If would be better
> > > if you send the command line outputs in pure text or html format.
> > >
> > > -Yi
> > >
> > > On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> > >
> > > > Hi, Anantharaman,
> > > >
> > > > A lot of firewall setup prevents "incoming connections", not
> > > > "outgoing connections" from a box. I.e. if you are downloading
> > > > files, you are establishing outgoing connections and it is fine.
> > > > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > > > making an "incoming
> > > connections"
> > > > to the box and will trigger the firewall rules.
> > > >
> > > > Just trying to pin down the problem, could you try on a Linux
> > > > box w/o any firewall rules setup and see whether that works? At
> > > > least, verify that localhost resolves to 127.0.0.1 and try
> > > > telnet locahost
> > > > 9092 or
> > > 2181?
> > > >
> > > > NOTE: Success in ping simply means that you can access via ICMP,
> > > > not guarantee you can establish TCP connection to the ports via
> > > > firewall
> > > rules.
> > > >
> > > > -Yi
> > > >
> > > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > > > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > >
> > > >> That is a good catch Naveena the server which I am trying to
> > > >> install is an Hadoop edge node, it has kafka broker and
> > > >> Zookeeper client already installed for my Hadoop Does it matter
> > > >> If I am installing it on a separate folder?. My guess Even if
> > > >> there are conflicts on earlier installations it should throw
> > > >> some other error but not the connection time out
> > > >>
> > > >> Coming to your question " it could either related resolving
> > "localhost"
> > > >> or firewall that prevents communication between ports" - how to
> > > >> prove it is because of Firewall issue. I am able to clone Samza
> > > >> files from
> > > Apache git.
> > > >> I can download any external files on this server
> > > >>
> > > >> ~Sri
> > > >>
> > > >> -----Original Message-----
> > > >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> Sent: Thursday, September 14, 2017 2:51 PM
> > > >> To: dev@samza.apache.org
> > > >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >>
> > > >> I wonder if this has anything to do with previous kafka /
> > > >> zookeeper installed on your box. Just for sanity, try clearing
> > > >> /tmp/zookeeeper* and
> > > >> /tmp/kafka* before re-trying those steps.
> > > >>
> > > >>
> > > >> Same as Yi, I strongly suspect issues with your local laptop
> > > >> setup
> > > >> - it could either related resolving "localhost" or firewall
> > > >> that prevents communication between ports.
> > > >>
> > > >>
> > > >> Navina
> > > >>
> > > >> ________________________________
> > > >> From: Yi Pan <ni...@gmail.com>
> > > >> Sent: Thursday, September 14, 2017 11:37:46 AM
> > > >> To: dev@samza.apache.org
> > > >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >>
> > > >> Hi, Anantharaman,
> > > >>
> > > >> I just did the same steps as you described in your email and
> > > >> all passed on my box. Hence, I strongly suspect that it is
> > > >> related to your local laptop network setup.
> > > >>
> > > >> Could you post all the command line output when you ran the
> > > >> sequence of commands?
> > > >>
> > > >> -Yi
> > > >>
> > > >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com>
> wrote:
> > > >>
> > > >> > Hi, Ananarath,
> > > >> >
> > > >> > It is very strange that you are seeing this timeout exception
> > > >> > that we do not see. I am trying to follow the exact steps you
> > > >> > did to see whether there is anything broken. I will update
> > > >> > you this
> > afternoon.
> > > >> >
> > > >> > Meanwhile, could you check your hostname setup and firewall
> > > >> > configuration to see whether your local laptop has blocked
> > > >> > access via the public IP address to your laptop? Could you
> > > >> > verify that your localhost is resolved to
> > > >> > 127.0.0.1 and is accessible?
> > > >> >
> > > >> > -Yi
> > > >> >
> > > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> > > >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > >> >
> > > >> >> Yi,
> > > >> >>
> > > >> >> Is there any alternate way to install Samza Or solution to
> > > >> >> the connection time out error?
> > > >> >>
> > > >> >> Regards,
> > > >> >> ~Sri
> > > >> >>
> > > >> >> From: Anantharaman, Srinatha (Contractor)
> > > >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> > > >> >> To: dev@samza.apache.org
> > > >> >> Subject: RE: Connection timed out error while installing
> > > >> >> "Hello
> > > Samza"
> > > >> >>
> > > >> >>
> > > >> >> Yi,
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> I am trying to build Samza locally by following the steps
> > > >> >> provided by Navina.
> > > >> >>
> > > >> >> As per those steps kafka will be installed after Zookeeper,
> > > >> >> I am getting Error while starting Zookeeper after it is
> > > >> >> installed
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Steps Followed :
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Yes. You can clone apache/samza locally and build it with:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> cd <samza-workspace>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> gradle -b bootstrap.gradle
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./gradlew clean build -x test
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot
> > version
> > > >> of
> > > >> >> the latest apache/samza into your local maven repo
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Then, head to hello-samza workspace and build again:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> cd <hello-samza-workspace>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> mvn clean package ## This should create a build target
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install zookeeper
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start zookeeper
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install yarn
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start yarn
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> mkdir -p deploy/samza
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > >> >> deploy/samza
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> NOTE : BTW From the above steps I could not execute " gradle
> > > >> >> -b bootstrap.gradle" since that command does not exists
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Regards,
> > > >> >>
> > > >> >> ~Sri
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> -----Original Message-----
> > > >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> > > >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> > > >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >> Subject: Re: Connection timed out error while installing
> > > >> >> "Hello
> > > Samza"
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Hi, Anantharam,
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Could you confirm at which step your setup failed? It seems
> > > >> >> that your zookeeper server is running. Could you check to
> > > >> >> see whether your Kafka broker is running? You can either do
> > > >> >> a telnet localhost
> > > >> >> 9092 or do a ps auxww | grep kafka to see whether you got
> > > >> >> any broker
> > > running.
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Sometimes, the Kafka service takes time to start on a single
> > laptop.
> > > >> >> You can just try to run ./bin/grid start kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> again to see whether the service is up.
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Thanks!
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> -Yi
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> > > >> >> (Contractor) <
> > > >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > > >> >> an@comcast.com>> wrote:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> > Find below Zookeeper logs:
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> > > >> >> > [main:QuorumPeerConfig@101]
> > > >> >> > -
> > > >> >>
> > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@78] -
> > > >> >> > autopurge.snapRetainCount set to
> > > >> >> > 3
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval
> > > >> >> > set to
> > > >> >> > 0
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@101]
> > > >> >>
> > > >> >> > - Purge task is not scheduled.
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> > > >> >> > [main:QuorumPeerMain@113] -
> > > >> >>
> > > >> >> > Either no config or no quorum defined in config, running
> > > >> >> > in
> > > >> >>
> > > >> >> > standalone mode
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> > > >> >> > [main:QuorumPeerConfig@101]
> > > >> >> > -
> > > >> >>
> > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServerMain@95]
> > > >> >>
> > > >> >> > - Starting server
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> > > >> >> > 02/06/2012
> > > >> >> > 10:48
> > > >> >>
> > > >> >> > GMT
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.version=1.8.0_31
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.vendor=Oracle Corporation
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> > > >> >>
> > > >> >> > 8.0.31-2.b13.el7.x86_64/jre
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> > > >> >>
> > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > >> >> > ./
> > > >> >>
> > > >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:
> > > >> >> > /
> > > >> >>
> > > >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > > >> >>
> > > >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> > > >> >>
> > > >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> > > >> >>
> > > >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> > > >> >>
> > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > >> >> > ./
> > > >> >>
> > > >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/hom
> > > >> >> > e/
> > > >> >>
> > > >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > > >> >>
> > > >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../conf:
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.library.path=/usr/java/packages/lib/amd64
> > > >> >> > :/
> > > >> >>
> > > >> >> > usr/lib64:/lib64:/lib:/usr/lib
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.io.tmpdir=/tmp
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.compiler=<NA>
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.name=Linux
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.arch=amd64
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.name=root
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.home=/root
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@733]
> > > >> >> > -
> > > >> >>
> > > >> >> > tickTime set to 2000
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@742]
> > > >> >> > -
> > > >> >>
> > > >> >> > minSessionTimeout set to -1
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@751]
> > > >> >> > -
> > > >> >>
> > > >> >> > maxSessionTimeout set to -1
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> > > >> >> > 0.0.0.0/0.0.0.0:2181
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> > > >> >> > [main:FileTxnSnapLog@238] -
> > > >> >>
> > > >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > >> >> > connection
> > > >> >>
> > > >> >> > from
> > > >> >>
> > > >> >> > /0:0:0:0:0:0:0:1:21754
> > > >> >>
> > > >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> > > >> >> > exception
> > > >> >>
> > > >> >> > EndOfStreamException: Unable to read additional data from
> > > >> >> > client
> > > >> >>
> > > >> >> > sessionid 0x0, likely client has closed socket
> > > >> >>
> > > >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > > >> >>
> > > >> >> > NIOServerCnxn.java:220)
> > > >> >>
> > > >> >> > at
> > > >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > > >> >>
> > > >> >> > NIOServerCnxnFactory.java:224)
> > > >> >>
> > > >> >> > at java.lang.Thread.run(Thread.java:745)
> > > >> >>
> > > >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket
> > > >> >> > connection for client
> > > >> >>
> > > >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > >> >> > connection
> > > >> >>
> > > >> >> > from /
> > > >> >>
> > > >> >> > 127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> > > >> >> > establish new
> > > >> >>
> > > >> >> > session at /127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > > >> >> > [SyncThread:0:FileTxnLog@199]
> > > >> >>
> > > >> >> > - Creating new log file: log.1
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> > > >> >>
> > > >> >> > [SyncThread:0:ZooKeeperServer@604]
> > > >> >>
> > > >> >> > - Established session 0x15e770d61920000 with negotiated
> > > >> >> > timeout
> > > >> >> > 6000
> > > >> >>
> > > >> >> > for client /127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x5
> > > >> >> > zxid:0x3
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /brokers
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0xb
> > > >> >> > zxid:0x7
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/config
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /config
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x13 zxid:0xc
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/admin
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /admin
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x1b
> > > >> >> > zxid:0x11
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /cluster
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:setData
> > > >> >> > cxid:0x25
> > > >> >>
> > > >> >> > zxid:0x15
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> > > >> >>
> > > >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:delete
> > > >> >> > cxid:0x34
> > > >> >> > zxid:0x17
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error
> > > >> >> > Path:/admin/preferred_replica_election
> > > >> >>
> > > >> >> > Error:KeeperErrorCode = NoNode for
> > > >> >> > /admin/preferred_replica_election
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x3f
> > > >> >> > zxid:0x18
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NodeExists for /brokers
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO
> > > >> >> > [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > >> >> > cxid:0x40
> > > >> >> > zxid:0x19
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NodeExists for /brokers/ids
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > -----Original Message-----
> > > >> >>
> > > >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > >> >>
> > > >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> > > >> >>
> > > >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > Subject: Re: Connection timed out error while installing
> > > >> >> > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > Hi, Anantharaman,
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > Could you post your zookeeper startup logs here?
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > > >> >> > (Contractor)
> > > >> >>
> > > >> >> > <
> > > >> >> > Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Ananthar
> > > >> >> > am
> > > >> >> an@comcast.com>> wrote:
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > > It hangs while bringing up the service
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > >> >> > > install zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: install zookeeper
> > > >> >>
> > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > >> >>
> > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > >> >> > > hello-samza]#
> > > >> >>
> > > >> >> > > ./bin/grid start zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: start zookeeper
> > > >> >>
> > > >> >> > > JMX enabled by default
> > > >> >>
> > > >> >> > > Using config:
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > >> >> > > r/
> > > >> >>
> > > >> >> > > bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > > Starting zookeeper ... STARTED
> > > >> >>
> > > >> >> > > Waiting for zookeeper to start...
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > >> >> > > zookeeper^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > >> >> > > install kafka
> > > >> >>
> > > >> >> > > EXECUTING: install kafka
> > > >> >>
> > > >> >> > > Using previously downloaded file
> /root/.samza/download/kafka_2.
> > > >> >>
> > > >> >> > > 11-0.10.1.1.tgz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > >> >> > > kafka
> > > >> >>
> > > >> >> > > EXECUTING: start kafka
> > > >> >>
> > > >> >> > > Waiting for kafka to start...
> > > >> >>
> > > >> >> > > Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]#
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Yes. You can clone apache/samza locally and build it with:
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > cd <samza-workspace>
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > gradle -b bootstrap.gradle
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./gradlew clean build -x test
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> > > >> version
> > > >> >> of
> > > >> >>
> > > >> >> > > the latest apache/samza into your local maven repo
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Then, head to hello-samza workspace and build again:
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > cd <hello-samza-workspace>
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > mvn clean package ## This should create a build target
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install zookeeper
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start zookeeper
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install kafka
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start kafka
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install yarn
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start yarn
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > mkdir -p deploy/samza
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > >> >> > > deploy/samza
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > After this, you can follow steps in the tutorial to "Run"
> > > >> >> > > the
> > > >> >>
> > > >> >> > > example Samza job.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > HTH! Let me know if you need further help.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: RE: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Is there any other way we can install Hello Samza?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Ok. I tried again for the "latest" branch in hello-samza
> > > >> >> > > and it
> > > >> >>
> > > >> >> > > still works.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > > While installing it says "Building samza from master..."
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It is expected to build from "master" in apache/samza repo.
> > > >> >> > > So, the
> > > >> >>
> > > >> >> > > output line is expected.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It is weird that you are unable to connect. Is it
> > > >> >> > > possible you are
> > > >> >>
> > > >> >> > > behind a firewall or something? Can you try to ping "
> > > >> git.apache.org"
> > > >> >> ?
> > > >> >>
> > > >> >> > > Or try the setup on a different box?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: RE: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > I tried again but still same error
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > While installing it says "Building samza from master..."
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > But when after I cloned I executed " git checkout latest"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Hi Anantharaman,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It looks like a transient connection failure to connect
> > > >> >> > > to Apache's
> > > >> >>
> > > >> >> > > git. I tried on my host and it seems to be working.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Can you give it another shot?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > If it still doesn't work, please let me know if you are
> > > >> >> > > running the
> > > >> >>
> > > >> >> > > command under the "master" or "latest" branch of
> > > samza-hello-samza.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Thanks!
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Connection timed out error while installing
> > > >> >> > > "Hello
> > > Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Hi,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > I am trying to install "Hello Samza" on a single node
> > > >> >> > > Initially I
> > > >> >>
> > > >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> > > >> >> > > install
> > > >> >>
> > > >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> > > >> >> > > getting
> > > >> >>
> > > >> >> > > connection timed out error It also mentions no kafka,
> > > >> >> > > yarn and
> > > >> >>
> > > >> >> > > zookeeper installed
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Please find below the error message
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > kafka
> > > >> >>
> > > >> >> > > EXECUTING: install kafka
> > > >> >>
> > > >> >> > > Using previously downloaded file
> /root/.samza/download/kafka_2.
> > > >> >>
> > > >> >> > > 11-0.10.1.1.tgz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > yarn
> > > >> >>
> > > >> >> > > EXECUTING: install yarn
> > > >> >>
> > > >> >> > > Using previously downloaded file
> > > >> >>
> > > >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: install zookeeper
> > > >> >>
> > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > >> >>
> > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > >> >> > > hello-samza]#
> > > >> >>
> > > >> >> > > bin/grid bootstrap Bootstrapping the system...
> > > >> >>
> > > >> >> > > EXECUTING: stop kafka
> > > >> >>
> > > >> >> > > No kafka server to stop
> > > >> >>
> > > >> >> > > EXECUTING: stop yarn
> > > >> >>
> > > >> >> > > no resourcemanager to stop
> > > >> >>
> > > >> >> > > no nodemanager to stop
> > > >> >>
> > > >> >> > > EXECUTING: stop zookeeper
> > > >> >>
> > > >> >> > > JMX enabled by default
> > > >> >>
> > > >> >> > > Using config:
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > >> >> > > r/
> > > >> >>
> > > >> >> > > bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > > Stopping zookeeper ... no zookeeper to stop (could not
> > > >> >> > > find file
> > > >> >>
> > > >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> > > >> >>
> > > >> >> > > EXECUTING: install samza
> > > >> >>
> > > >> >> > > Building samza from master...
> > > >> >>
> > > >> >> > > ~/.samza/download
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > >> >>
> > > >> >> > > Cloning into 'samza'...
> > > >> >>
> > > >> >> > > fatal: unable to connect to git.apache.org:
> > > >> >>
> > > >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed
> > > >> >> > > out
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Could you please help me to resolve this issue?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
> >
>
>
>
> --
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
Hi, Anantharaman,
Did you follow documentation here:
http://samza.apache.org/startup/hello-samza/0.13/? It states that you will
need to use the following commands to install hello-samza job, in the same
directory that you cloned the hello-samza git project:
{code}
mvn clean package
mkdir -p deploy/samza
tar -xvf ./target/hello-samza-0.13.0-dist.tar.gz -C deploy/samza
{code}
We apologize if the documentation is not clear and please file/open JIRA
for unclear documentation issues s.t. we can fix and help.
But first, please follow the exact steps, especially when we are trying to
help debugging your local deployment issue.
P.S. if all 3 services (i.e. zookeeper, kafka, and YARN) are running, are
you able to telnet to those service like the response I got from my local
box below:
{noformat}
yipan-mn1:hello-samza yipan$ telnet localhost 2181
Trying ::1...
Connected to localhost.
Escape character is '^]'.
^]
telnet> quit
Connection closed.
yipan-mn1:hello-samza yipan$ telnet localhost 9092
Trying ::1...
Connected to localhost.
Escape character is '^]'.
^]
telnet>
quit
Connection closed by foreign host.
yipan-mn1:hello-samza yipan$ telnet localhost 8088
Trying ::1...
telnet: connect to address ::1: Connection refused
Trying fe80::1...
telnet: connect to address fe80::1: Connection refused
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
GET /ws/v1/cluster/info
{"clusterInfo":{"id":1505953361666,"startedOn":1505953361666,"state":"STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1
from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn":"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1
from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"2015-09-16T21:07Z"}}Connection
closed by foreign host.
{noformat}
And are you using VPN to access Internet on the host you are deploying
Samza?
-Yi
On Wed, Sep 20, 2017 at 2:58 PM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> I had already seen using ps aux that all 3 services are running
> I am not able to open the Yarn UI and when I start YARN it says "Waiting
> for resourcemanager to start... Ncat: Connection refused" that made me to
> think YARN not started properly
>
> Now Trying to build the Samza Package with the below steps
>
> mvn clean package -- Done
> mkdir -p deploy/samza --Done
> tar -xvf ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz
> -C deploy/samza -- Fails as file does not exists.
>
> Samza documentation sucks, I do not find that folder Or file. Do I need to
> use hello-samza-0.13.0-dist.tar.gz which is under my
> "/home/sanant003c/hello-samza/target" folder?
>
>
>
> -----Original Message-----
> From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> Sent: Wednesday, September 20, 2017 4:48 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> What do you mean by YARN fails to start? The logs you pointed out don't
> seem to have any error.
>
> Is the ResourceManager process running and you are not able to connect to
> it? Perhaps, try running a quick *ps aux* to find that.
>
> On Wed, Sep 20, 2017 at 1:18 PM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
> > Jagdish,
> >
> > I appreciate your help.
> >
> > It worked though netcat gave "0' output I still changed the grid
> > script to "https"
> >
> >
> > [root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null;
> > echo $?
> > 0
> >
> >
> > Before I build my Samza job I wanted to confirm if I am able to access
> > my YARN When I start YARN it fails to start, Below are the last few
> > lines from Yarn log
> >
> > LOG :
> >
> > 2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
> > 2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract
> > jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/
> > hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to
> > /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
> > 2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master key
> > for generating delegation tokens
> > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master key
> > for generating delegation tokens
> > 2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master key
> > for generating delegation tokens
> > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master key
> > for generating delegation tokens
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master key
> > for generating delegation tokens
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Starting expired delegation
> > token remover thread, tokenRemoverScanInterval=60 min(s)
> > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> token.delegation.
> > AbstractDelegationTokenSecretManager: Updating the current master key
> > for generating delegation tokens
> > 2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$
> > SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
> > 2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > Web app /cluster started at 8088
> > 2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > Registered webapp guice modules
> > 2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager:
> > Using callQueue class java.util.concurrent.LinkedBlockingQueue
> > 2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting
> > Socket Reader #1 for port 8033
> > 2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.
> RpcServerFactoryPBImpl:
> > Adding protocol org.apache.hadoop.yarn.server.api.
> > ResourceManagerAdministrationProtocolPB to the server
> > 2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC Server
> > Responder: starting
> > 2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC Server
> > listener on 8033: starting
> > 2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.
> > resourcemanager.scheduler.AbstractYarnScheduler: Release request cache
> > is cleaned up
> >
> >
> >
> >
> >
> > Command line output of Zookeepr and Yarn process Start :
> >
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
> > EXECUTING: start zookeeper
> > JMX enabled by default
> > Using config:
> > /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/
> > zoo.cfg
> > Starting zookeeper ... already running as process 11824.
> > Waiting for zookeeper to start...
> > ^C
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
> > EXECUTING: start yarn
> > starting resourcemanager, logging to /home/sanant003c/hello-samza/
> > deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-
> > a1t.sys.comcast.net.out
> > Waiting for resourcemanager to start...
> > Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .
> >
> >
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> > Sent: Wednesday, September 20, 2017 1:36 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Hi Anantharaman,
> >
> > It's likely that your server blocks the GIT protocol. If so, I'd
> > recommend cloning via HTTPS instead of git.
> >
> > *First, determine if the git protocol is blocked on the server as
> > follows:*
> >
> > Please run:
> > # connects to github default port ➜ ~ nc github.com 9418 <
> > /dev/null; echo $?
> >
> > You should see the output as "0". Any other exit code means that the
> > GIT protocol is blocked.
> >
> > *If the above command gets you a non-zero exit code, please clone
> > using HTTPS as follows:*
> >
> > git clone https://github.com/apache/samza.git
> >
> > Alternately, you can edit the line in the bin/grid script replacing
> > git clone git://git.apache.org/samza.git with git clone
> > https://github.com/apache/samza.git
> > and re-run the same command.
> >
> > Please let us know how it goes! :-)
> >
> > Best,
> > Jagdish
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor) <
> > Srinatha_Anantharaman@comcast.com> wrote:
> >
> > > Yi,
> > >
> > > As you suggested this time I tried to install Samza on clean server
> > > (there is nothing installed on this server) Still I am getting
> > > connection timeout error, Please find below command line outputs.
> > > My System Admin/Dev Ops confirmed that this server does not have any
> > > firewall restrictions
> > >
> > >
> > > [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> > > /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo
> > > $PATH
> > > /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> > > 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> > > usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> > > [root@csadatlak-wc-a1t ~]# clear
> > > [root@csadatlak-wc-a1t ~]# pwd
> > > /root
> > > [root@csadatlak-wc-a1t ~]# cd
> > > [root@csadatlak-wc-a1t ~]# set -o vi [root@csadatlak-wc-a1t ~]# ^Ct
> > > -o vi [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
> > > [root@csadatlak-wc-a1t sanant003c]# ll total 4 drwxr-xr-x 7 root
> > > root 4096 Sep 20 15:32 hello-samza [root@csadatlak-wc-a1t
> > > sanant003c]# cd hello-samza/ [root@csadatlak-wc-a1t hello-samza]# ll
> total 312
> > > drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> > > -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> > > drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> > > drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> > > -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> > > -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> > > -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> > > -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> > > -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> > > -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> > > -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> > > drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> > > -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
> > > Bootstrapping the system...
> > > EXECUTING: stop kafka
> > > Kafka is not installed. Run: bin/grid install kafka
> > > EXECUTING: stop yarn
> > > YARN is not installed. Run: bin/grid install yarn
> > > EXECUTING: stop zookeeper
> > > Zookeeper is not installed. Run: bin/grid install zookeeper
> > > EXECUTING: install samza
> > > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > > fatal: unable to connect to git.apache.org:
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> > > EXECUTING: install kafka
> > > Downloading kafka_2.11-0.10.1.1.tgz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54
> --:--:--
> > > 620k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> > > EXECUTING: install yarn
> > > Downloading hadoop-2.6.1.tar.gz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28
> --:--:--
> > > 734k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> > > EXECUTING: install zookeeper
> > > Downloading zookeeper-3.4.3.tar.gz...
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21
> --:--:--
> > > 747k
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> > > EXECUTING: install samza
> > > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > > fatal: unable to connect to git.apache.org:
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >
> > > Kindly help me to install Samza on my UNIX server
> > >
> > > Regards,
> > > ~Sri
> > >
> > > -----Original Message-----
> > > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > Sent: Thursday, September 14, 2017 6:42 PM
> > > To: dev@samza.apache.org
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
> > >
> > > P.S., the attachment you post w/ the previous email does not show up
> > > (Apache mailing list disallow attachments). If would be better if
> > > you send the command line outputs in pure text or html format.
> > >
> > > -Yi
> > >
> > > On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> > >
> > > > Hi, Anantharaman,
> > > >
> > > > A lot of firewall setup prevents "incoming connections", not
> > > > "outgoing connections" from a box. I.e. if you are downloading
> > > > files, you are establishing outgoing connections and it is fine.
> > > > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > > > making an "incoming
> > > connections"
> > > > to the box and will trigger the firewall rules.
> > > >
> > > > Just trying to pin down the problem, could you try on a Linux box
> > > > w/o any firewall rules setup and see whether that works? At least,
> > > > verify that localhost resolves to 127.0.0.1 and try telnet
> > > > locahost
> > > > 9092 or
> > > 2181?
> > > >
> > > > NOTE: Success in ping simply means that you can access via ICMP,
> > > > not guarantee you can establish TCP connection to the ports via
> > > > firewall
> > > rules.
> > > >
> > > > -Yi
> > > >
> > > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > > > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > >
> > > >> That is a good catch Naveena the server which I am trying to
> > > >> install is an Hadoop edge node, it has kafka broker and Zookeeper
> > > >> client already installed for my Hadoop Does it matter If I am
> > > >> installing it on a separate folder?. My guess Even if there are
> > > >> conflicts on earlier installations it should throw some other
> > > >> error but not the connection time out
> > > >>
> > > >> Coming to your question " it could either related resolving
> > "localhost"
> > > >> or firewall that prevents communication between ports" - how to
> > > >> prove it is because of Firewall issue. I am able to clone Samza
> > > >> files from
> > > Apache git.
> > > >> I can download any external files on this server
> > > >>
> > > >> ~Sri
> > > >>
> > > >> -----Original Message-----
> > > >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> Sent: Thursday, September 14, 2017 2:51 PM
> > > >> To: dev@samza.apache.org
> > > >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >>
> > > >> I wonder if this has anything to do with previous kafka /
> > > >> zookeeper installed on your box. Just for sanity, try clearing
> > > >> /tmp/zookeeeper* and
> > > >> /tmp/kafka* before re-trying those steps.
> > > >>
> > > >>
> > > >> Same as Yi, I strongly suspect issues with your local laptop
> > > >> setup
> > > >> - it could either related resolving "localhost" or firewall that
> > > >> prevents communication between ports.
> > > >>
> > > >>
> > > >> Navina
> > > >>
> > > >> ________________________________
> > > >> From: Yi Pan <ni...@gmail.com>
> > > >> Sent: Thursday, September 14, 2017 11:37:46 AM
> > > >> To: dev@samza.apache.org
> > > >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >>
> > > >> Hi, Anantharaman,
> > > >>
> > > >> I just did the same steps as you described in your email and all
> > > >> passed on my box. Hence, I strongly suspect that it is related to
> > > >> your local laptop network setup.
> > > >>
> > > >> Could you post all the command line output when you ran the
> > > >> sequence of commands?
> > > >>
> > > >> -Yi
> > > >>
> > > >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com>
> wrote:
> > > >>
> > > >> > Hi, Ananarath,
> > > >> >
> > > >> > It is very strange that you are seeing this timeout exception
> > > >> > that we do not see. I am trying to follow the exact steps you
> > > >> > did to see whether there is anything broken. I will update you
> > > >> > this
> > afternoon.
> > > >> >
> > > >> > Meanwhile, could you check your hostname setup and firewall
> > > >> > configuration to see whether your local laptop has blocked
> > > >> > access via the public IP address to your laptop? Could you
> > > >> > verify that your localhost is resolved to
> > > >> > 127.0.0.1 and is accessible?
> > > >> >
> > > >> > -Yi
> > > >> >
> > > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> > > >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > > >> >
> > > >> >> Yi,
> > > >> >>
> > > >> >> Is there any alternate way to install Samza Or solution to
> > > >> >> the connection time out error?
> > > >> >>
> > > >> >> Regards,
> > > >> >> ~Sri
> > > >> >>
> > > >> >> From: Anantharaman, Srinatha (Contractor)
> > > >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> > > >> >> To: dev@samza.apache.org
> > > >> >> Subject: RE: Connection timed out error while installing
> > > >> >> "Hello
> > > Samza"
> > > >> >>
> > > >> >>
> > > >> >> Yi,
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> I am trying to build Samza locally by following the steps
> > > >> >> provided by Navina.
> > > >> >>
> > > >> >> As per those steps kafka will be installed after Zookeeper, I
> > > >> >> am getting Error while starting Zookeeper after it is
> > > >> >> installed
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Steps Followed :
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Yes. You can clone apache/samza locally and build it with:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> cd <samza-workspace>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> gradle -b bootstrap.gradle
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./gradlew clean build -x test
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot
> > version
> > > >> of
> > > >> >> the latest apache/samza into your local maven repo
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Then, head to hello-samza workspace and build again:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> cd <hello-samza-workspace>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> mvn clean package ## This should create a build target
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install zookeeper
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start zookeeper
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid install yarn
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> ./bin/grid start yarn
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> mkdir -p deploy/samza
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > >> >> deploy/samza
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> NOTE : BTW From the above steps I could not execute " gradle
> > > >> >> -b bootstrap.gradle" since that command does not exists
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Regards,
> > > >> >>
> > > >> >> ~Sri
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> -----Original Message-----
> > > >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> > > >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> > > >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >> Subject: Re: Connection timed out error while installing
> > > >> >> "Hello
> > > Samza"
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Hi, Anantharam,
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Could you confirm at which step your setup failed? It seems
> > > >> >> that your zookeeper server is running. Could you check to see
> > > >> >> whether your Kafka broker is running? You can either do a
> > > >> >> telnet localhost
> > > >> >> 9092 or do a ps auxww | grep kafka to see whether you got any
> > > >> >> broker
> > > running.
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Sometimes, the Kafka service takes time to start on a single
> > laptop.
> > > >> >> You can just try to run ./bin/grid start kafka
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> again to see whether the service is up.
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> Thanks!
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> -Yi
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> > > >> >> (Contractor) <
> > > >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > > >> >> an@comcast.com>> wrote:
> > > >> >>
> > > >> >>
> > > >> >>
> > > >> >> > Find below Zookeeper logs:
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> > > >> >> > [main:QuorumPeerConfig@101]
> > > >> >> > -
> > > >> >>
> > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount
> > > >> >> > set to
> > > >> >> > 3
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval
> > > >> >> > set to
> > > >> >> > 0
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:DatadirCleanupManager@101]
> > > >> >>
> > > >> >> > - Purge task is not scheduled.
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> > > >> >> > [main:QuorumPeerMain@113] -
> > > >> >>
> > > >> >> > Either no config or no quorum defined in config, running in
> > > >> >>
> > > >> >> > standalone mode
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> > > >> >> > [main:QuorumPeerConfig@101]
> > > >> >> > -
> > > >> >>
> > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServerMain@95]
> > > >> >>
> > > >> >> > - Starting server
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> > > >> >> > 02/06/2012
> > > >> >> > 10:48
> > > >> >>
> > > >> >> > GMT
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.version=1.8.0_31
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.vendor=Oracle Corporation
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> > > >> >>
> > > >> >> > 8.0.31-2.b13.el7.x86_64/jre
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> > > >> >>
> > > >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> > > >> >>
> > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > > >> >>
> > > >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> > > >> >>
> > > >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > > >> >>
> > > >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> > > >> >>
> > > >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> > > >> >>
> > > >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> > > >> >>
> > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > > >> >>
> > > >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> > > >> >>
> > > >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > > >> >>
> > > >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper/bin/../conf:
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
> > > >> >>
> > > >> >> > usr/lib64:/lib64:/lib:/usr/lib
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.io.tmpdir=/tmp
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:java.compiler=<NA>
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.name=Linux
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.arch=amd64
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.name=root
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.home=/root
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > >> >> > [main:Environment@98]
> > > >> >> > - Server
> > > >> >>
> > > >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> > > >> >>
> > > >> >> > samza/deploy/zookeeper
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@733]
> > > >> >> > -
> > > >> >>
> > > >> >> > tickTime set to 2000
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@742]
> > > >> >> > -
> > > >> >>
> > > >> >> > minSessionTimeout set to -1
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > >> >> > [main:ZooKeeperServer@751]
> > > >> >> > -
> > > >> >>
> > > >> >> > maxSessionTimeout set to -1
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> > > >> >>
> > > >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> > > >> >> > 0.0.0.0/0.0.0.0:2181
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> > > >> >> > [main:FileTxnSnapLog@238] -
> > > >> >>
> > > >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> > > >> >>
> > > >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > >> >> > connection
> > > >> >>
> > > >> >> > from
> > > >> >>
> > > >> >> > /0:0:0:0:0:0:0:1:21754
> > > >> >>
> > > >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> > > >> >> > exception
> > > >> >>
> > > >> >> > EndOfStreamException: Unable to read additional data from
> > > >> >> > client
> > > >> >>
> > > >> >> > sessionid 0x0, likely client has closed socket
> > > >> >>
> > > >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > > >> >>
> > > >> >> > NIOServerCnxn.java:220)
> > > >> >>
> > > >> >> > at
> > > >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > > >> >>
> > > >> >> > NIOServerCnxnFactory.java:224)
> > > >> >>
> > > >> >> > at java.lang.Thread.run(Thread.java:745)
> > > >> >>
> > > >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection
> > > >> >> > for client
> > > >> >>
> > > >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > >> >> > connection
> > > >> >>
> > > >> >> > from /
> > > >> >>
> > > >> >> > 127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > >> >>
> > > >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> > > >> >> > establish new
> > > >> >>
> > > >> >> > session at /127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > > >> >> > [SyncThread:0:FileTxnLog@199]
> > > >> >>
> > > >> >> > - Creating new log file: log.1
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> > > >> >>
> > > >> >> > [SyncThread:0:ZooKeeperServer@604]
> > > >> >>
> > > >> >> > - Established session 0x15e770d61920000 with negotiated
> > > >> >> > timeout
> > > >> >> > 6000
> > > >> >>
> > > >> >> > for client /127.0.0.1:48071
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
> > > >> >> > zxid:0x3
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /brokers
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
> > > >> >> > zxid:0x7
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/config
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /config
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
> > > >> >> > zxid:0xc
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/admin
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /admin
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
> > > >> >> > zxid:0x11
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NoNode for /cluster
> > > >> >>
> > > >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:setData
> > > >> >> > cxid:0x25
> > > >> >>
> > > >> >> > zxid:0x15
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> > > >> >>
> > > >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
> > > >> >> > zxid:0x17
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error
> > > >> >> > Path:/admin/preferred_replica_election
> > > >> >>
> > > >> >> > Error:KeeperErrorCode = NoNode for
> > > >> >> > /admin/preferred_replica_election
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
> > > >> >> > zxid:0x18
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NodeExists for /brokers
> > > >> >>
> > > >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
> > > >> cport:-1)::
> > > >> >>
> > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > >> >> > when
> > > >> >>
> > > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
> > > >> >> > zxid:0x19
> > > >> >>
> > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> > > >> >> > Error:KeeperErrorCode =
> > > >> >>
> > > >> >> > NodeExists for /brokers/ids
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > -----Original Message-----
> > > >> >>
> > > >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > > >> >>
> > > >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> > > >> >>
> > > >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > Subject: Re: Connection timed out error while installing
> > > >> >> > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > Hi, Anantharaman,
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > Could you post your zookeeper startup logs here?
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > > >> >> > (Contractor)
> > > >> >>
> > > >> >> > <
> > > >> >> > Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > > >> >> an@comcast.com>> wrote:
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >> > > It hangs while bringing up the service
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> > > >> >> > > zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: install zookeeper
> > > >> >>
> > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > >> >>
> > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > >> >> > > hello-samza]#
> > > >> >>
> > > >> >> > > ./bin/grid start zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: start zookeeper
> > > >> >>
> > > >> >> > > JMX enabled by default
> > > >> >>
> > > >> >> > > Using config:
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > > >> >>
> > > >> >> > > bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > > Starting zookeeper ... STARTED
> > > >> >>
> > > >> >> > > Waiting for zookeeper to start...
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > >> >> > > zookeeper^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> > > >> >> > > kafka
> > > >> >>
> > > >> >> > > EXECUTING: install kafka
> > > >> >>
> > > >> >> > > Using previously downloaded file
> /root/.samza/download/kafka_2.
> > > >> >>
> > > >> >> > > 11-0.10.1.1.tgz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > >> >> > > kafka
> > > >> >>
> > > >> >> > > EXECUTING: start kafka
> > > >> >>
> > > >> >> > > Waiting for kafka to start...
> > > >> >>
> > > >> >> > > Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .Ncat: Connection refused.
> > > >> >>
> > > >> >> > > .^C
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]#
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Yes. You can clone apache/samza locally and build it with:
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > cd <samza-workspace>
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > gradle -b bootstrap.gradle
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./gradlew clean build -x test
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> > > >> version
> > > >> >> of
> > > >> >>
> > > >> >> > > the latest apache/samza into your local maven repo
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Then, head to hello-samza workspace and build again:
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > cd <hello-samza-workspace>
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > mvn clean package ## This should create a build target
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install zookeeper
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start zookeeper
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install kafka
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start kafka
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid install yarn
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ./bin/grid start yarn
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > mkdir -p deploy/samza
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > >> >> > > deploy/samza
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > After this, you can follow steps in the tutorial to "Run"
> > > >> >> > > the
> > > >> >>
> > > >> >> > > example Samza job.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > HTH! Let me know if you need further help.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: RE: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Is there any other way we can install Hello Samza?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Ok. I tried again for the "latest" branch in hello-samza
> > > >> >> > > and it
> > > >> >>
> > > >> >> > > still works.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > > While installing it says "Building samza from master..."
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It is expected to build from "master" in apache/samza repo.
> > > >> >> > > So, the
> > > >> >>
> > > >> >> > > output line is expected.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It is weird that you are unable to connect. Is it possible
> > > >> >> > > you are
> > > >> >>
> > > >> >> > > behind a firewall or something? Can you try to ping "
> > > >> git.apache.org"
> > > >> >> ?
> > > >> >>
> > > >> >> > > Or try the setup on a different box?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: RE: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > I tried again but still same error
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > While installing it says "Building samza from master..."
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > But when after I cloned I executed " git checkout latest"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > -----Original Message-----
> > > >> >>
> > > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Re: Connection timed out error while installing
> > > >> >> > > "Hello
> > > >> Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Hi Anantharaman,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > It looks like a transient connection failure to connect to
> > > >> >> > > Apache's
> > > >> >>
> > > >> >> > > git. I tried on my host and it seems to be working.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Can you give it another shot?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > If it still doesn't work, please let me know if you are
> > > >> >> > > running the
> > > >> >>
> > > >> >> > > command under the "master" or "latest" branch of
> > > samza-hello-samza.
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Thanks!
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Navina
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > ________________________________
> > > >> >>
> > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > >> >> > > <Srinatha_Anantharaman@
> > > >> >>
> > > >> >> > > comcast.com>
> > > >> >>
> > > >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > > >> >>
> > > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > > >> >>
> > > >> >> > > Subject: Connection timed out error while installing
> > > >> >> > > "Hello
> > > Samza"
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Hi,
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > I am trying to install "Hello Samza" on a single node
> > > >> >> > > Initially I
> > > >> >>
> > > >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> > > >> >> > > install
> > > >> >>
> > > >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> > > >> >> > > getting
> > > >> >>
> > > >> >> > > connection timed out error It also mentions no kafka, yarn
> > > >> >> > > and
> > > >> >>
> > > >> >> > > zookeeper installed
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Please find below the error message
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > kafka
> > > >> >>
> > > >> >> > > EXECUTING: install kafka
> > > >> >>
> > > >> >> > > Using previously downloaded file
> /root/.samza/download/kafka_2.
> > > >> >>
> > > >> >> > > 11-0.10.1.1.tgz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > yarn
> > > >> >>
> > > >> >> > > EXECUTING: install yarn
> > > >> >>
> > > >> >> > > Using previously downloaded file
> > > >> >>
> > > >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> > > >> >>
> > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > >> >> > > zookeeper
> > > >> >>
> > > >> >> > > EXECUTING: install zookeeper
> > > >> >>
> > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > >> >>
> > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > >> >> > > hello-samza]#
> > > >> >>
> > > >> >> > > bin/grid bootstrap Bootstrapping the system...
> > > >> >>
> > > >> >> > > EXECUTING: stop kafka
> > > >> >>
> > > >> >> > > No kafka server to stop
> > > >> >>
> > > >> >> > > EXECUTING: stop yarn
> > > >> >>
> > > >> >> > > no resourcemanager to stop
> > > >> >>
> > > >> >> > > no nodemanager to stop
> > > >> >>
> > > >> >> > > EXECUTING: stop zookeeper
> > > >> >>
> > > >> >> > > JMX enabled by default
> > > >> >>
> > > >> >> > > Using config:
> > > >> >>
> > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > > >> >>
> > > >> >> > > bin/../conf/zoo.cfg
> > > >> >>
> > > >> >> > > Stopping zookeeper ... no zookeeper to stop (could not
> > > >> >> > > find file
> > > >> >>
> > > >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> > > >> >>
> > > >> >> > > EXECUTING: install samza
> > > >> >>
> > > >> >> > > Building samza from master...
> > > >> >>
> > > >> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> > > >> >>
> > > >> >> > > Cloning into 'samza'...
> > > >> >>
> > > >> >> > > fatal: unable to connect to git.apache.org:
> > > >> >>
> > > >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Could you please help me to resolve this issue?
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> > > Regards,
> > > >> >>
> > > >> >> > > ~Sri
> > > >> >>
> > > >> >> > >
> > > >> >>
> > > >> >> >
> > > >> >>
> > > >> >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
> >
>
>
>
> --
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
I had already seen using ps aux that all 3 services are running
I am not able to open the Yarn UI and when I start YARN it says "Waiting for resourcemanager to start... Ncat: Connection refused" that made me to think YARN not started properly
Now Trying to build the Samza Package with the below steps
mvn clean package -- Done
mkdir -p deploy/samza --Done
tar -xvf ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz -C deploy/samza -- Fails as file does not exists.
Samza documentation sucks, I do not find that folder Or file. Do I need to use hello-samza-0.13.0-dist.tar.gz which is under my "/home/sanant003c/hello-samza/target" folder?
-----Original Message-----
From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
Sent: Wednesday, September 20, 2017 4:48 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
What do you mean by YARN fails to start? The logs you pointed out don't seem to have any error.
Is the ResourceManager process running and you are not able to connect to it? Perhaps, try running a quick *ps aux* to find that.
On Wed, Sep 20, 2017 at 1:18 PM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> Jagdish,
>
> I appreciate your help.
>
> It worked though netcat gave "0' output I still changed the grid
> script to "https"
>
>
> [root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null;
> echo $?
> 0
>
>
> Before I build my Samza job I wanted to confirm if I am able to access
> my YARN When I start YARN it fails to start, Below are the last few
> lines from Yarn log
>
> LOG :
>
> 2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
> 2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract
> jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/
> hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to
> /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
> 2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key
> for generating delegation tokens
> 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Starting expired delegation
> token remover thread, tokenRemoverScanInterval=60 min(s)
> 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key
> for generating delegation tokens
> 2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key
> for generating delegation tokens
> 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Starting expired delegation
> token remover thread, tokenRemoverScanInterval=60 min(s)
> 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key
> for generating delegation tokens
> 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key
> for generating delegation tokens
> 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Starting expired delegation
> token remover thread, tokenRemoverScanInterval=60 min(s)
> 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key
> for generating delegation tokens
> 2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$
> SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
> 2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps:
> Web app /cluster started at 8088
> 2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps:
> Registered webapp guice modules
> 2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager:
> Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting
> Socket Reader #1 for port 8033
> 2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> Adding protocol org.apache.hadoop.yarn.server.api.
> ResourceManagerAdministrationProtocolPB to the server
> 2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC Server
> Responder: starting
> 2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC Server
> listener on 8033: starting
> 2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.
> resourcemanager.scheduler.AbstractYarnScheduler: Release request cache
> is cleaned up
>
>
>
>
>
> Command line output of Zookeepr and Yarn process Start :
>
> [root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
> EXECUTING: start zookeeper
> JMX enabled by default
> Using config:
> /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/
> zoo.cfg
> Starting zookeeper ... already running as process 11824.
> Waiting for zookeeper to start...
> ^C
> [root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
> EXECUTING: start yarn
> starting resourcemanager, logging to /home/sanant003c/hello-samza/
> deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-
> a1t.sys.comcast.net.out
> Waiting for resourcemanager to start...
> Ncat: Connection refused.
> .Ncat: Connection refused.
> .
>
>
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> Sent: Wednesday, September 20, 2017 1:36 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi Anantharaman,
>
> It's likely that your server blocks the GIT protocol. If so, I'd
> recommend cloning via HTTPS instead of git.
>
> *First, determine if the git protocol is blocked on the server as
> follows:*
>
> Please run:
> # connects to github default port ➜ ~ nc github.com 9418 <
> /dev/null; echo $?
>
> You should see the output as "0". Any other exit code means that the
> GIT protocol is blocked.
>
> *If the above command gets you a non-zero exit code, please clone
> using HTTPS as follows:*
>
> git clone https://github.com/apache/samza.git
>
> Alternately, you can edit the line in the bin/grid script replacing
> git clone git://git.apache.org/samza.git with git clone
> https://github.com/apache/samza.git
> and re-run the same command.
>
> Please let us know how it goes! :-)
>
> Best,
> Jagdish
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
> > Yi,
> >
> > As you suggested this time I tried to install Samza on clean server
> > (there is nothing installed on this server) Still I am getting
> > connection timeout error, Please find below command line outputs.
> > My System Admin/Dev Ops confirmed that this server does not have any
> > firewall restrictions
> >
> >
> > [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> > /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo
> > $PATH
> > /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> > 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> > usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> > [root@csadatlak-wc-a1t ~]# clear
> > [root@csadatlak-wc-a1t ~]# pwd
> > /root
> > [root@csadatlak-wc-a1t ~]# cd
> > [root@csadatlak-wc-a1t ~]# set -o vi [root@csadatlak-wc-a1t ~]# ^Ct
> > -o vi [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
> > [root@csadatlak-wc-a1t sanant003c]# ll total 4 drwxr-xr-x 7 root
> > root 4096 Sep 20 15:32 hello-samza [root@csadatlak-wc-a1t
> > sanant003c]# cd hello-samza/ [root@csadatlak-wc-a1t hello-samza]# ll total 312
> > drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> > -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> > drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> > drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> > -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> > -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> > -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> > -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> > -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> > -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> > -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> > drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> > -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
> > Bootstrapping the system...
> > EXECUTING: stop kafka
> > Kafka is not installed. Run: bin/grid install kafka
> > EXECUTING: stop yarn
> > YARN is not installed. Run: bin/grid install yarn
> > EXECUTING: stop zookeeper
> > Zookeeper is not installed. Run: bin/grid install zookeeper
> > EXECUTING: install samza
> > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > fatal: unable to connect to git.apache.org:
> > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> > EXECUTING: install kafka
> > Downloading kafka_2.11-0.10.1.1.tgz...
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> > 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54 --:--:--
> > 620k
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> > EXECUTING: install yarn
> > Downloading hadoop-2.6.1.tar.gz...
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> > 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28 --:--:--
> > 734k
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Downloading zookeeper-3.4.3.tar.gz...
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> > 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21 --:--:--
> > 747k
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> > EXECUTING: install samza
> > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > fatal: unable to connect to git.apache.org:
> > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >
> > Kindly help me to install Samza on my UNIX server
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > Sent: Thursday, September 14, 2017 6:42 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > P.S., the attachment you post w/ the previous email does not show up
> > (Apache mailing list disallow attachments). If would be better if
> > you send the command line outputs in pure text or html format.
> >
> > -Yi
> >
> > On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> >
> > > Hi, Anantharaman,
> > >
> > > A lot of firewall setup prevents "incoming connections", not
> > > "outgoing connections" from a box. I.e. if you are downloading
> > > files, you are establishing outgoing connections and it is fine.
> > > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > > making an "incoming
> > connections"
> > > to the box and will trigger the firewall rules.
> > >
> > > Just trying to pin down the problem, could you try on a Linux box
> > > w/o any firewall rules setup and see whether that works? At least,
> > > verify that localhost resolves to 127.0.0.1 and try telnet
> > > locahost
> > > 9092 or
> > 2181?
> > >
> > > NOTE: Success in ping simply means that you can access via ICMP,
> > > not guarantee you can establish TCP connection to the ports via
> > > firewall
> > rules.
> > >
> > > -Yi
> > >
> > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > >
> > >> That is a good catch Naveena the server which I am trying to
> > >> install is an Hadoop edge node, it has kafka broker and Zookeeper
> > >> client already installed for my Hadoop Does it matter If I am
> > >> installing it on a separate folder?. My guess Even if there are
> > >> conflicts on earlier installations it should throw some other
> > >> error but not the connection time out
> > >>
> > >> Coming to your question " it could either related resolving
> "localhost"
> > >> or firewall that prevents communication between ports" - how to
> > >> prove it is because of Firewall issue. I am able to clone Samza
> > >> files from
> > Apache git.
> > >> I can download any external files on this server
> > >>
> > >> ~Sri
> > >>
> > >> -----Original Message-----
> > >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> Sent: Thursday, September 14, 2017 2:51 PM
> > >> To: dev@samza.apache.org
> > >> Subject: Re: Connection timed out error while installing "Hello Samza"
> > >>
> > >> I wonder if this has anything to do with previous kafka /
> > >> zookeeper installed on your box. Just for sanity, try clearing
> > >> /tmp/zookeeeper* and
> > >> /tmp/kafka* before re-trying those steps.
> > >>
> > >>
> > >> Same as Yi, I strongly suspect issues with your local laptop
> > >> setup
> > >> - it could either related resolving "localhost" or firewall that
> > >> prevents communication between ports.
> > >>
> > >>
> > >> Navina
> > >>
> > >> ________________________________
> > >> From: Yi Pan <ni...@gmail.com>
> > >> Sent: Thursday, September 14, 2017 11:37:46 AM
> > >> To: dev@samza.apache.org
> > >> Subject: Re: Connection timed out error while installing "Hello Samza"
> > >>
> > >> Hi, Anantharaman,
> > >>
> > >> I just did the same steps as you described in your email and all
> > >> passed on my box. Hence, I strongly suspect that it is related to
> > >> your local laptop network setup.
> > >>
> > >> Could you post all the command line output when you ran the
> > >> sequence of commands?
> > >>
> > >> -Yi
> > >>
> > >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> > >>
> > >> > Hi, Ananarath,
> > >> >
> > >> > It is very strange that you are seeing this timeout exception
> > >> > that we do not see. I am trying to follow the exact steps you
> > >> > did to see whether there is anything broken. I will update you
> > >> > this
> afternoon.
> > >> >
> > >> > Meanwhile, could you check your hostname setup and firewall
> > >> > configuration to see whether your local laptop has blocked
> > >> > access via the public IP address to your laptop? Could you
> > >> > verify that your localhost is resolved to
> > >> > 127.0.0.1 and is accessible?
> > >> >
> > >> > -Yi
> > >> >
> > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> > >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > >> >
> > >> >> Yi,
> > >> >>
> > >> >> Is there any alternate way to install Samza Or solution to
> > >> >> the connection time out error?
> > >> >>
> > >> >> Regards,
> > >> >> ~Sri
> > >> >>
> > >> >> From: Anantharaman, Srinatha (Contractor)
> > >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> > >> >> To: dev@samza.apache.org
> > >> >> Subject: RE: Connection timed out error while installing
> > >> >> "Hello
> > Samza"
> > >> >>
> > >> >>
> > >> >> Yi,
> > >> >>
> > >> >>
> > >> >>
> > >> >> I am trying to build Samza locally by following the steps
> > >> >> provided by Navina.
> > >> >>
> > >> >> As per those steps kafka will be installed after Zookeeper, I
> > >> >> am getting Error while starting Zookeeper after it is
> > >> >> installed
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> Steps Followed :
> > >> >>
> > >> >>
> > >> >>
> > >> >> Yes. You can clone apache/samza locally and build it with:
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> cd <samza-workspace>
> > >> >>
> > >> >>
> > >> >>
> > >> >> gradle -b bootstrap.gradle
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./gradlew clean build -x test
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot
> version
> > >> of
> > >> >> the latest apache/samza into your local maven repo
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> Then, head to hello-samza workspace and build again:
> > >> >>
> > >> >>
> > >> >>
> > >> >> cd <hello-samza-workspace>
> > >> >>
> > >> >>
> > >> >>
> > >> >> mvn clean package ## This should create a build target
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid install zookeeper
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid start zookeeper
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid install kafka
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid start kafka
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid install yarn
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid start yarn
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> mkdir -p deploy/samza
> > >> >>
> > >> >>
> > >> >>
> > >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > >> >> deploy/samza
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> NOTE : BTW From the above steps I could not execute " gradle
> > >> >> -b bootstrap.gradle" since that command does not exists
> > >> >>
> > >> >>
> > >> >>
> > >> >> Regards,
> > >> >>
> > >> >> ~Sri
> > >> >>
> > >> >>
> > >> >>
> > >> >> -----Original Message-----
> > >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> > >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> > >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >> Subject: Re: Connection timed out error while installing
> > >> >> "Hello
> > Samza"
> > >> >>
> > >> >>
> > >> >>
> > >> >> Hi, Anantharam,
> > >> >>
> > >> >>
> > >> >>
> > >> >> Could you confirm at which step your setup failed? It seems
> > >> >> that your zookeeper server is running. Could you check to see
> > >> >> whether your Kafka broker is running? You can either do a
> > >> >> telnet localhost
> > >> >> 9092 or do a ps auxww | grep kafka to see whether you got any
> > >> >> broker
> > running.
> > >> >>
> > >> >>
> > >> >>
> > >> >> Sometimes, the Kafka service takes time to start on a single
> laptop.
> > >> >> You can just try to run ./bin/grid start kafka
> > >> >>
> > >> >>
> > >> >>
> > >> >> again to see whether the service is up.
> > >> >>
> > >> >>
> > >> >>
> > >> >> Thanks!
> > >> >>
> > >> >>
> > >> >>
> > >> >> -Yi
> > >> >>
> > >> >>
> > >> >>
> > >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> > >> >> (Contractor) <
> > >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > >> >> an@comcast.com>> wrote:
> > >> >>
> > >> >>
> > >> >>
> > >> >> > Find below Zookeeper logs:
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> > >> >> > [main:QuorumPeerConfig@101]
> > >> >> > -
> > >> >>
> > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > >> >>
> > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > >> >>
> > >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> > >> >>
> > >> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount
> > >> >> > set to
> > >> >> > 3
> > >> >>
> > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > >> >>
> > >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval
> > >> >> > set to
> > >> >> > 0
> > >> >>
> > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > >> >>
> > >> >> > [main:DatadirCleanupManager@101]
> > >> >>
> > >> >> > - Purge task is not scheduled.
> > >> >>
> > >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> > >> >> > [main:QuorumPeerMain@113] -
> > >> >>
> > >> >> > Either no config or no quorum defined in config, running in
> > >> >>
> > >> >> > standalone mode
> > >> >>
> > >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> > >> >> > [main:QuorumPeerConfig@101]
> > >> >> > -
> > >> >>
> > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > >> >>
> > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > >> >>
> > >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > >> >> > [main:ZooKeeperServerMain@95]
> > >> >>
> > >> >> > - Starting server
> > >> >>
> > >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> > >> >> > 02/06/2012
> > >> >> > 10:48
> > >> >>
> > >> >> > GMT
> > >> >>
> > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> > >> >>
> > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.version=1.8.0_31
> > >> >>
> > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.vendor=Oracle Corporation
> > >> >>
> > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> > >> >>
> > >> >> > 8.0.31-2.b13.el7.x86_64/jre
> > >> >>
> > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> > >> >>
> > >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> > >> >>
> > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > >> >>
> > >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> > >> >>
> > >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > >> >>
> > >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> > >> >>
> > >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> > >> >>
> > >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> > >> >>
> > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > >> >>
> > >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> > >> >>
> > >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > >> >>
> > >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../conf:
> > >> >>
> > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
> > >> >>
> > >> >> > usr/lib64:/lib64:/lib:/usr/lib
> > >> >>
> > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.io.tmpdir=/tmp
> > >> >>
> > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.compiler=<NA>
> > >> >>
> > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:os.name=Linux
> > >> >>
> > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:os.arch=amd64
> > >> >>
> > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> > >> >>
> > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:user.name=root
> > >> >>
> > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:user.home=/root
> > >> >>
> > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > >> >> > [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper
> > >> >>
> > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > >> >> > [main:ZooKeeperServer@733]
> > >> >> > -
> > >> >>
> > >> >> > tickTime set to 2000
> > >> >>
> > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > >> >> > [main:ZooKeeperServer@742]
> > >> >> > -
> > >> >>
> > >> >> > minSessionTimeout set to -1
> > >> >>
> > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > >> >> > [main:ZooKeeperServer@751]
> > >> >> > -
> > >> >>
> > >> >> > maxSessionTimeout set to -1
> > >> >>
> > >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> > >> >>
> > >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> > >> >> > 0.0.0.0/0.0.0.0:2181
> > >> >>
> > >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> > >> >> > [main:FileTxnSnapLog@238] -
> > >> >>
> > >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> > >> >>
> > >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > >> >> > connection
> > >> >>
> > >> >> > from
> > >> >>
> > >> >> > /0:0:0:0:0:0:0:1:21754
> > >> >>
> > >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> > >> >> > exception
> > >> >>
> > >> >> > EndOfStreamException: Unable to read additional data from
> > >> >> > client
> > >> >>
> > >> >> > sessionid 0x0, likely client has closed socket
> > >> >>
> > >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > >> >>
> > >> >> > NIOServerCnxn.java:220)
> > >> >>
> > >> >> > at
> > >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > >> >>
> > >> >> > NIOServerCnxnFactory.java:224)
> > >> >>
> > >> >> > at java.lang.Thread.run(Thread.java:745)
> > >> >>
> > >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection
> > >> >> > for client
> > >> >>
> > >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> > >> >>
> > >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > >> >> > connection
> > >> >>
> > >> >> > from /
> > >> >>
> > >> >> > 127.0.0.1:48071
> > >> >>
> > >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> > >> >> > establish new
> > >> >>
> > >> >> > session at /127.0.0.1:48071
> > >> >>
> > >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > >> >> > [SyncThread:0:FileTxnLog@199]
> > >> >>
> > >> >> > - Creating new log file: log.1
> > >> >>
> > >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> > >> >>
> > >> >> > [SyncThread:0:ZooKeeperServer@604]
> > >> >>
> > >> >> > - Established session 0x15e770d61920000 with negotiated
> > >> >> > timeout
> > >> >> > 6000
> > >> >>
> > >> >> > for client /127.0.0.1:48071
> > >> >>
> > >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
> > >> >> > zxid:0x3
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NoNode for /brokers
> > >> >>
> > >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
> > >> >> > zxid:0x7
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/config
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NoNode for /config
> > >> >>
> > >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
> > >> >> > zxid:0xc
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/admin
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NoNode for /admin
> > >> >>
> > >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
> > >> >> > zxid:0x11
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NoNode for /cluster
> > >> >>
> > >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:setData
> > >> >> > cxid:0x25
> > >> >>
> > >> >> > zxid:0x15
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> > >> >>
> > >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> > >> >>
> > >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
> > >> >> > zxid:0x17
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error
> > >> >> > Path:/admin/preferred_replica_election
> > >> >>
> > >> >> > Error:KeeperErrorCode = NoNode for
> > >> >> > /admin/preferred_replica_election
> > >> >>
> > >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
> > >> >> > zxid:0x18
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NodeExists for /brokers
> > >> >>
> > >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
> > >> >> > zxid:0x19
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NodeExists for /brokers/ids
> > >> >>
> > >> >> >
> > >> >>
> > >> >> >
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > -----Original Message-----
> > >> >>
> > >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > >> >>
> > >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> > >> >>
> > >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > Subject: Re: Connection timed out error while installing
> > >> >> > "Hello
> > >> Samza"
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > Hi, Anantharaman,
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > Could you post your zookeeper startup logs here?
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > >> >> > (Contractor)
> > >> >>
> > >> >> > <
> > >> >> > Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > >> >> an@comcast.com>> wrote:
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > > It hangs while bringing up the service
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> > >> >>
> > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> > >> >> > > zookeeper
> > >> >>
> > >> >> > > EXECUTING: install zookeeper
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/
> > >> >>
> > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > >> >> > > hello-samza]#
> > >> >>
> > >> >> > > ./bin/grid start zookeeper
> > >> >>
> > >> >> > > EXECUTING: start zookeeper
> > >> >>
> > >> >> > > JMX enabled by default
> > >> >>
> > >> >> > > Using config:
> > >> >>
> > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > >> >>
> > >> >> > > bin/../conf/zoo.cfg
> > >> >>
> > >> >> > > Starting zookeeper ... STARTED
> > >> >>
> > >> >> > > Waiting for zookeeper to start...
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ^C
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > >> >> > > zookeeper^C
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> > >> >> > > kafka
> > >> >>
> > >> >> > > EXECUTING: install kafka
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> > >> >>
> > >> >> > > 11-0.10.1.1.tgz
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > >> >> > > kafka
> > >> >>
> > >> >> > > EXECUTING: start kafka
> > >> >>
> > >> >> > > Waiting for kafka to start...
> > >> >>
> > >> >> > > Ncat: Connection refused.
> > >> >>
> > >> >> > > .Ncat: Connection refused.
> > >> >>
> > >> >> > > .Ncat: Connection refused.
> > >> >>
> > >> >> > > .^C
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]#
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > -----Original Message-----
> > >> >>
> > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Re: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Yes. You can clone apache/samza locally and build it with:
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > cd <samza-workspace>
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > gradle -b bootstrap.gradle
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./gradlew clean build -x test
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> > >> version
> > >> >> of
> > >> >>
> > >> >> > > the latest apache/samza into your local maven repo
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Then, head to hello-samza workspace and build again:
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > cd <hello-samza-workspace>
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > mvn clean package ## This should create a build target
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid install zookeeper
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid start zookeeper
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid install kafka
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid start kafka
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid install yarn
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid start yarn
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > mkdir -p deploy/samza
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > >> >> > > deploy/samza
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > After this, you can follow steps in the tutorial to "Run"
> > >> >> > > the
> > >> >>
> > >> >> > > example Samza job.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > HTH! Let me know if you need further help.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ________________________________
> > >> >>
> > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > >> >> > > <Srinatha_Anantharaman@
> > >> >>
> > >> >> > > comcast.com>
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: RE: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Is there any other way we can install Hello Samza?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Regards,
> > >> >>
> > >> >> > > ~Sri
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > -----Original Message-----
> > >> >>
> > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Re: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Ok. I tried again for the "latest" branch in hello-samza
> > >> >> > > and it
> > >> >>
> > >> >> > > still works.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > > While installing it says "Building samza from master..."
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > It is expected to build from "master" in apache/samza repo.
> > >> >> > > So, the
> > >> >>
> > >> >> > > output line is expected.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > It is weird that you are unable to connect. Is it possible
> > >> >> > > you are
> > >> >>
> > >> >> > > behind a firewall or something? Can you try to ping "
> > >> git.apache.org"
> > >> >> ?
> > >> >>
> > >> >> > > Or try the setup on a different box?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ________________________________
> > >> >>
> > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > >> >> > > <Srinatha_Anantharaman@
> > >> >>
> > >> >> > > comcast.com>
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: RE: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > I tried again but still same error
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > While installing it says "Building samza from master..."
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > But when after I cloned I executed " git checkout latest"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Regards,
> > >> >>
> > >> >> > > ~Sri
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > -----Original Message-----
> > >> >>
> > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Re: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Hi Anantharaman,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > It looks like a transient connection failure to connect to
> > >> >> > > Apache's
> > >> >>
> > >> >> > > git. I tried on my host and it seems to be working.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Can you give it another shot?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > If it still doesn't work, please let me know if you are
> > >> >> > > running the
> > >> >>
> > >> >> > > command under the "master" or "latest" branch of
> > samza-hello-samza.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Thanks!
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ________________________________
> > >> >>
> > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > >> >> > > <Srinatha_Anantharaman@
> > >> >>
> > >> >> > > comcast.com>
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Connection timed out error while installing
> > >> >> > > "Hello
> > Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Hi,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > I am trying to install "Hello Samza" on a single node
> > >> >> > > Initially I
> > >> >>
> > >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> > >> >> > > install
> > >> >>
> > >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> > >> >> > > getting
> > >> >>
> > >> >> > > connection timed out error It also mentions no kafka, yarn
> > >> >> > > and
> > >> >>
> > >> >> > > zookeeper installed
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Please find below the error message
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > >> >> > > kafka
> > >> >>
> > >> >> > > EXECUTING: install kafka
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> > >> >>
> > >> >> > > 11-0.10.1.1.tgz
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > >> >> > > yarn
> > >> >>
> > >> >> > > EXECUTING: install yarn
> > >> >>
> > >> >> > > Using previously downloaded file
> > >> >>
> > >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > >> >> > > zookeeper
> > >> >>
> > >> >> > > EXECUTING: install zookeeper
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/
> > >> >>
> > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > >> >> > > hello-samza]#
> > >> >>
> > >> >> > > bin/grid bootstrap Bootstrapping the system...
> > >> >>
> > >> >> > > EXECUTING: stop kafka
> > >> >>
> > >> >> > > No kafka server to stop
> > >> >>
> > >> >> > > EXECUTING: stop yarn
> > >> >>
> > >> >> > > no resourcemanager to stop
> > >> >>
> > >> >> > > no nodemanager to stop
> > >> >>
> > >> >> > > EXECUTING: stop zookeeper
> > >> >>
> > >> >> > > JMX enabled by default
> > >> >>
> > >> >> > > Using config:
> > >> >>
> > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > >> >>
> > >> >> > > bin/../conf/zoo.cfg
> > >> >>
> > >> >> > > Stopping zookeeper ... no zookeeper to stop (could not
> > >> >> > > find file
> > >> >>
> > >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> > >> >>
> > >> >> > > EXECUTING: install samza
> > >> >>
> > >> >> > > Building samza from master...
> > >> >>
> > >> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> > >> >>
> > >> >> > > Cloning into 'samza'...
> > >> >>
> > >> >> > > fatal: unable to connect to git.apache.org:
> > >> >>
> > >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Could you please help me to resolve this issue?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Regards,
> > >> >>
> > >> >> > > ~Sri
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> >
> > >> >>
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>
>
>
> --
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University
>
--
Jagadish V,
Graduate Student,
Department of Computer Science,
Stanford University
Re: Connection timed out error while installing "Hello Samza"
Posted by Jagadish Venkatraman <ja...@gmail.com>.
What do you mean by YARN fails to start? The logs you pointed out don't
seem to have any error.
Is the ResourceManager process running and you are not able to connect to
it? Perhaps, try running a quick *ps aux* to find that.
On Wed, Sep 20, 2017 at 1:18 PM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> Jagdish,
>
> I appreciate your help.
>
> It worked though netcat gave "0' output I still changed the grid script to
> "https"
>
>
> [root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null; echo
> $?
> 0
>
>
> Before I build my Samza job I wanted to confirm if I am able to access my
> YARN
> When I start YARN it fails to start, Below are the last few lines from
> Yarn log
>
> LOG :
>
> 2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
> 2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract
> jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/
> hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to
> /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
> 2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key for
> generating delegation tokens
> 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Starting expired delegation token
> remover thread, tokenRemoverScanInterval=60 min(s)
> 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key for
> generating delegation tokens
> 2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key for
> generating delegation tokens
> 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Starting expired delegation token
> remover thread, tokenRemoverScanInterval=60 min(s)
> 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key for
> generating delegation tokens
> 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key for
> generating delegation tokens
> 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Starting expired delegation token
> remover thread, tokenRemoverScanInterval=60 min(s)
> 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.
> AbstractDelegationTokenSecretManager: Updating the current master key for
> generating delegation tokens
> 2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$
> SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
> 2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps: Web
> app /cluster started at 8088
> 2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps:
> Registered webapp guice modules
> 2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager:
> Using callQueue class java.util.concurrent.LinkedBlockingQueue
> 2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting Socket
> Reader #1 for port 8033
> 2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
> Adding protocol org.apache.hadoop.yarn.server.api.
> ResourceManagerAdministrationProtocolPB to the server
> 2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC Server
> Responder: starting
> 2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC Server
> listener on 8033: starting
> 2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.
> resourcemanager.scheduler.AbstractYarnScheduler: Release request cache is
> cleaned up
>
>
>
>
>
> Command line output of Zookeepr and Yarn process Start :
>
> [root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
> EXECUTING: start zookeeper
> JMX enabled by default
> Using config: /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/
> zoo.cfg
> Starting zookeeper ... already running as process 11824.
> Waiting for zookeeper to start...
> ^C
> [root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
> EXECUTING: start yarn
> starting resourcemanager, logging to /home/sanant003c/hello-samza/
> deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-
> a1t.sys.comcast.net.out
> Waiting for resourcemanager to start...
> Ncat: Connection refused.
> .Ncat: Connection refused.
> .
>
>
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> Sent: Wednesday, September 20, 2017 1:36 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi Anantharaman,
>
> It's likely that your server blocks the GIT protocol. If so, I'd recommend
> cloning via HTTPS instead of git.
>
> *First, determine if the git protocol is blocked on the server as follows:*
>
> Please run:
> # connects to github default port
> ➜ ~ nc github.com 9418 < /dev/null; echo $?
>
> You should see the output as "0". Any other exit code means that the GIT
> protocol is blocked.
>
> *If the above command gets you a non-zero exit code, please clone using
> HTTPS as follows:*
>
> git clone https://github.com/apache/samza.git
>
> Alternately, you can edit the line in the bin/grid script replacing git
> clone git://git.apache.org/samza.git with git clone
> https://github.com/apache/samza.git
> and re-run the same command.
>
> Please let us know how it goes! :-)
>
> Best,
> Jagdish
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
> > Yi,
> >
> > As you suggested this time I tried to install Samza on clean server
> > (there is nothing installed on this server) Still I am getting
> > connection timeout error, Please find below command line outputs.
> > My System Admin/Dev Ops confirmed that this server does not have any
> > firewall restrictions
> >
> >
> > [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> > /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo $PATH
> > /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> > 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> > usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> > [root@csadatlak-wc-a1t ~]# clear
> > [root@csadatlak-wc-a1t ~]# pwd
> > /root
> > [root@csadatlak-wc-a1t ~]# cd
> > [root@csadatlak-wc-a1t ~]# set -o vi
> > [root@csadatlak-wc-a1t ~]# ^Ct -o vi
> > [root@csadatlak-wc-a1t ~]#
> > [root@csadatlak-wc-a1t ~]#
> > [root@csadatlak-wc-a1t ~]#
> > [root@csadatlak-wc-a1t ~]#
> > [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/ [root@csadatlak-wc-a1t
> > sanant003c]# ll total 4 drwxr-xr-x 7 root root 4096 Sep 20 15:32
> > hello-samza [root@csadatlak-wc-a1t sanant003c]# cd hello-samza/
> > [root@csadatlak-wc-a1t hello-samza]# ll total 312
> > drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> > -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> > drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> > drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> > -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> > -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> > -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> > -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> > -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> > -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> > -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> > drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> > -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap Bootstrapping
> > the system...
> > EXECUTING: stop kafka
> > Kafka is not installed. Run: bin/grid install kafka
> > EXECUTING: stop yarn
> > YARN is not installed. Run: bin/grid install yarn
> > EXECUTING: stop zookeeper
> > Zookeeper is not installed. Run: bin/grid install zookeeper
> > EXECUTING: install samza
> > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > fatal: unable to connect to git.apache.org:
> > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> > EXECUTING: install kafka
> > Downloading kafka_2.11-0.10.1.1.tgz...
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> > 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54 --:--:--
> > 620k
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> > EXECUTING: install yarn
> > Downloading hadoop-2.6.1.tar.gz...
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> > 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28 --:--:--
> > 734k
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Downloading zookeeper-3.4.3.tar.gz...
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> > 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21 --:--:--
> > 747k
> > [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> > EXECUTING: install samza
> > ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> > fatal: unable to connect to git.apache.org:
> > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >
> > Kindly help me to install Samza on my UNIX server
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > Sent: Thursday, September 14, 2017 6:42 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > P.S., the attachment you post w/ the previous email does not show up
> > (Apache mailing list disallow attachments). If would be better if you
> > send the command line outputs in pure text or html format.
> >
> > -Yi
> >
> > On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> >
> > > Hi, Anantharaman,
> > >
> > > A lot of firewall setup prevents "incoming connections", not
> > > "outgoing connections" from a box. I.e. if you are downloading
> > > files, you are establishing outgoing connections and it is fine.
> > > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > > making an "incoming
> > connections"
> > > to the box and will trigger the firewall rules.
> > >
> > > Just trying to pin down the problem, could you try on a Linux box
> > > w/o any firewall rules setup and see whether that works? At least,
> > > verify that localhost resolves to 127.0.0.1 and try telnet locahost
> > > 9092 or
> > 2181?
> > >
> > > NOTE: Success in ping simply means that you can access via ICMP, not
> > > guarantee you can establish TCP connection to the ports via firewall
> > rules.
> > >
> > > -Yi
> > >
> > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > >
> > >> That is a good catch Naveena the server which I am trying to
> > >> install is an Hadoop edge node, it has kafka broker and Zookeeper
> > >> client already installed for my Hadoop Does it matter If I am
> > >> installing it on a separate folder?. My guess Even if there are
> > >> conflicts on earlier installations it should throw some other error
> > >> but not the connection time out
> > >>
> > >> Coming to your question " it could either related resolving
> "localhost"
> > >> or firewall that prevents communication between ports" - how to
> > >> prove it is because of Firewall issue. I am able to clone Samza
> > >> files from
> > Apache git.
> > >> I can download any external files on this server
> > >>
> > >> ~Sri
> > >>
> > >> -----Original Message-----
> > >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> Sent: Thursday, September 14, 2017 2:51 PM
> > >> To: dev@samza.apache.org
> > >> Subject: Re: Connection timed out error while installing "Hello Samza"
> > >>
> > >> I wonder if this has anything to do with previous kafka / zookeeper
> > >> installed on your box. Just for sanity, try clearing
> > >> /tmp/zookeeeper* and
> > >> /tmp/kafka* before re-trying those steps.
> > >>
> > >>
> > >> Same as Yi, I strongly suspect issues with your local laptop setup
> > >> - it could either related resolving "localhost" or firewall that
> > >> prevents communication between ports.
> > >>
> > >>
> > >> Navina
> > >>
> > >> ________________________________
> > >> From: Yi Pan <ni...@gmail.com>
> > >> Sent: Thursday, September 14, 2017 11:37:46 AM
> > >> To: dev@samza.apache.org
> > >> Subject: Re: Connection timed out error while installing "Hello Samza"
> > >>
> > >> Hi, Anantharaman,
> > >>
> > >> I just did the same steps as you described in your email and all
> > >> passed on my box. Hence, I strongly suspect that it is related to
> > >> your local laptop network setup.
> > >>
> > >> Could you post all the command line output when you ran the
> > >> sequence of commands?
> > >>
> > >> -Yi
> > >>
> > >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> > >>
> > >> > Hi, Ananarath,
> > >> >
> > >> > It is very strange that you are seeing this timeout exception
> > >> > that we do not see. I am trying to follow the exact steps you did
> > >> > to see whether there is anything broken. I will update you this
> afternoon.
> > >> >
> > >> > Meanwhile, could you check your hostname setup and firewall
> > >> > configuration to see whether your local laptop has blocked access
> > >> > via the public IP address to your laptop? Could you verify that
> > >> > your localhost is resolved to
> > >> > 127.0.0.1 and is accessible?
> > >> >
> > >> > -Yi
> > >> >
> > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> > >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> > >> >
> > >> >> Yi,
> > >> >>
> > >> >> Is there any alternate way to install Samza Or solution to the
> > >> >> connection time out error?
> > >> >>
> > >> >> Regards,
> > >> >> ~Sri
> > >> >>
> > >> >> From: Anantharaman, Srinatha (Contractor)
> > >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> > >> >> To: dev@samza.apache.org
> > >> >> Subject: RE: Connection timed out error while installing "Hello
> > Samza"
> > >> >>
> > >> >>
> > >> >> Yi,
> > >> >>
> > >> >>
> > >> >>
> > >> >> I am trying to build Samza locally by following the steps
> > >> >> provided by Navina.
> > >> >>
> > >> >> As per those steps kafka will be installed after Zookeeper, I am
> > >> >> getting Error while starting Zookeeper after it is installed
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> Steps Followed :
> > >> >>
> > >> >>
> > >> >>
> > >> >> Yes. You can clone apache/samza locally and build it with:
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> cd <samza-workspace>
> > >> >>
> > >> >>
> > >> >>
> > >> >> gradle -b bootstrap.gradle
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./gradlew clean build -x test
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot
> version
> > >> of
> > >> >> the latest apache/samza into your local maven repo
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> Then, head to hello-samza workspace and build again:
> > >> >>
> > >> >>
> > >> >>
> > >> >> cd <hello-samza-workspace>
> > >> >>
> > >> >>
> > >> >>
> > >> >> mvn clean package ## This should create a build target
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid install zookeeper
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid start zookeeper
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid install kafka
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid start kafka
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid install yarn
> > >> >>
> > >> >>
> > >> >>
> > >> >> ./bin/grid start yarn
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> mkdir -p deploy/samza
> > >> >>
> > >> >>
> > >> >>
> > >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > >> >> deploy/samza
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >>
> > >> >> NOTE : BTW From the above steps I could not execute " gradle -b
> > >> >> bootstrap.gradle" since that command does not exists
> > >> >>
> > >> >>
> > >> >>
> > >> >> Regards,
> > >> >>
> > >> >> ~Sri
> > >> >>
> > >> >>
> > >> >>
> > >> >> -----Original Message-----
> > >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> > >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> > >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >> Subject: Re: Connection timed out error while installing "Hello
> > Samza"
> > >> >>
> > >> >>
> > >> >>
> > >> >> Hi, Anantharam,
> > >> >>
> > >> >>
> > >> >>
> > >> >> Could you confirm at which step your setup failed? It seems that
> > >> >> your zookeeper server is running. Could you check to see whether
> > >> >> your Kafka broker is running? You can either do a telnet
> > >> >> localhost
> > >> >> 9092 or do a ps auxww | grep kafka to see whether you got any
> > >> >> broker
> > running.
> > >> >>
> > >> >>
> > >> >>
> > >> >> Sometimes, the Kafka service takes time to start on a single
> laptop.
> > >> >> You can just try to run ./bin/grid start kafka
> > >> >>
> > >> >>
> > >> >>
> > >> >> again to see whether the service is up.
> > >> >>
> > >> >>
> > >> >>
> > >> >> Thanks!
> > >> >>
> > >> >>
> > >> >>
> > >> >> -Yi
> > >> >>
> > >> >>
> > >> >>
> > >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> > >> >> (Contractor) <
> > >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > >> >> an@comcast.com>> wrote:
> > >> >>
> > >> >>
> > >> >>
> > >> >> > Find below Zookeeper logs:
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> > >> >> > [main:QuorumPeerConfig@101]
> > >> >> > -
> > >> >>
> > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > >> >>
> > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > >> >>
> > >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> > >> >>
> > >> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount
> > >> >> > set to
> > >> >> > 3
> > >> >>
> > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > >> >>
> > >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set
> > >> >> > to
> > >> >> > 0
> > >> >>
> > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > >> >>
> > >> >> > [main:DatadirCleanupManager@101]
> > >> >>
> > >> >> > - Purge task is not scheduled.
> > >> >>
> > >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> > >> >> > [main:QuorumPeerMain@113] -
> > >> >>
> > >> >> > Either no config or no quorum defined in config, running in
> > >> >>
> > >> >> > standalone mode
> > >> >>
> > >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> > >> >> > [main:QuorumPeerConfig@101]
> > >> >> > -
> > >> >>
> > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > >> >>
> > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > >> >>
> > >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > >> >> > [main:ZooKeeperServerMain@95]
> > >> >>
> > >> >> > - Starting server
> > >> >>
> > >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> > >> >> > 02/06/2012
> > >> >> > 10:48
> > >> >>
> > >> >> > GMT
> > >> >>
> > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> > >> >>
> > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.version=1.8.0_31
> > >> >>
> > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.vendor=Oracle Corporation
> > >> >>
> > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> > >> >>
> > >> >> > 8.0.31-2.b13.el7.x86_64/jre
> > >> >>
> > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> > >> >>
> > >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> > >> >>
> > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > >> >>
> > >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> > >> >>
> > >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > >> >>
> > >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> > >> >>
> > >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> > >> >>
> > >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> > >> >>
> > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > >> >>
> > >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> > >> >>
> > >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > >> >>
> > >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper/bin/../conf:
> > >> >>
> > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
> > >> >>
> > >> >> > usr/lib64:/lib64:/lib:/usr/lib
> > >> >>
> > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.io.tmpdir=/tmp
> > >> >>
> > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:java.compiler=<NA>
> > >> >>
> > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:os.name=Linux
> > >> >>
> > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:os.arch=amd64
> > >> >>
> > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> > >> >>
> > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:user.name=root
> > >> >>
> > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:user.home=/root
> > >> >>
> > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98]
> > >> >> > - Server
> > >> >>
> > >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> > >> >>
> > >> >> > samza/deploy/zookeeper
> > >> >>
> > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > >> >> > [main:ZooKeeperServer@733]
> > >> >> > -
> > >> >>
> > >> >> > tickTime set to 2000
> > >> >>
> > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > >> >> > [main:ZooKeeperServer@742]
> > >> >> > -
> > >> >>
> > >> >> > minSessionTimeout set to -1
> > >> >>
> > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > >> >> > [main:ZooKeeperServer@751]
> > >> >> > -
> > >> >>
> > >> >> > maxSessionTimeout set to -1
> > >> >>
> > >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> > >> >>
> > >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> > >> >> > 0.0.0.0/0.0.0.0:2181
> > >> >>
> > >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> > >> >> > [main:FileTxnSnapLog@238] -
> > >> >>
> > >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> > >> >>
> > >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > >> >> > connection
> > >> >>
> > >> >> > from
> > >> >>
> > >> >> > /0:0:0:0:0:0:0:1:21754
> > >> >>
> > >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> > >> >> > exception
> > >> >>
> > >> >> > EndOfStreamException: Unable to read additional data from
> > >> >> > client
> > >> >>
> > >> >> > sessionid 0x0, likely client has closed socket
> > >> >>
> > >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > >> >>
> > >> >> > NIOServerCnxn.java:220)
> > >> >>
> > >> >> > at
> > >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > >> >>
> > >> >> > NIOServerCnxnFactory.java:224)
> > >> >>
> > >> >> > at java.lang.Thread.run(Thread.java:745)
> > >> >>
> > >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection
> > >> >> > for client
> > >> >>
> > >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> > >> >>
> > >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > >> >> > connection
> > >> >>
> > >> >> > from /
> > >> >>
> > >> >> > 127.0.0.1:48071
> > >> >>
> > >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > >> >>
> > >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> > >> >> > establish new
> > >> >>
> > >> >> > session at /127.0.0.1:48071
> > >> >>
> > >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > >> >> > [SyncThread:0:FileTxnLog@199]
> > >> >>
> > >> >> > - Creating new log file: log.1
> > >> >>
> > >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> > >> >>
> > >> >> > [SyncThread:0:ZooKeeperServer@604]
> > >> >>
> > >> >> > - Established session 0x15e770d61920000 with negotiated
> > >> >> > timeout
> > >> >> > 6000
> > >> >>
> > >> >> > for client /127.0.0.1:48071
> > >> >>
> > >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
> > >> >> > zxid:0x3
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NoNode for /brokers
> > >> >>
> > >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
> > >> >> > zxid:0x7
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/config
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NoNode for /config
> > >> >>
> > >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
> > >> >> > zxid:0xc
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode
> > >> >> > =
> > >> >>
> > >> >> > NoNode for /admin
> > >> >>
> > >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
> > >> >> > zxid:0x11
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NoNode for /cluster
> > >> >>
> > >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
> > >> >>
> > >> >> > zxid:0x15
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> > >> >>
> > >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> > >> >>
> > >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
> > >> >> > zxid:0x17
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error
> > >> >> > Path:/admin/preferred_replica_election
> > >> >>
> > >> >> > Error:KeeperErrorCode = NoNode for
> > >> >> > /admin/preferred_replica_election
> > >> >>
> > >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
> > >> >> > zxid:0x18
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NodeExists for /brokers
> > >> >>
> > >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
> > >> cport:-1)::
> > >> >>
> > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > >> >> > when
> > >> >>
> > >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
> > >> >> > zxid:0x19
> > >> >>
> > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> > >> >> > Error:KeeperErrorCode =
> > >> >>
> > >> >> > NodeExists for /brokers/ids
> > >> >>
> > >> >> >
> > >> >>
> > >> >> >
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > -----Original Message-----
> > >> >>
> > >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> > >> >>
> > >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> > >> >>
> > >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > Subject: Re: Connection timed out error while installing
> > >> >> > "Hello
> > >> Samza"
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > Hi, Anantharaman,
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > Could you post your zookeeper startup logs here?
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > >> >> > (Contractor)
> > >> >>
> > >> >> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> > >> >> an@comcast.com>> wrote:
> > >> >>
> > >> >> >
> > >> >>
> > >> >> > > It hangs while bringing up the service
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> > >> >>
> > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> > >> >> > > zookeeper
> > >> >>
> > >> >> > > EXECUTING: install zookeeper
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/
> > >> >>
> > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > >> >> > > hello-samza]#
> > >> >>
> > >> >> > > ./bin/grid start zookeeper
> > >> >>
> > >> >> > > EXECUTING: start zookeeper
> > >> >>
> > >> >> > > JMX enabled by default
> > >> >>
> > >> >> > > Using config:
> > >> >>
> > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > >> >>
> > >> >> > > bin/../conf/zoo.cfg
> > >> >>
> > >> >> > > Starting zookeeper ... STARTED
> > >> >>
> > >> >> > > Waiting for zookeeper to start...
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ^C
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > >> >> > > zookeeper^C
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> > >> >> > > kafka
> > >> >>
> > >> >> > > EXECUTING: install kafka
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> > >> >>
> > >> >> > > 11-0.10.1.1.tgz
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > >> >> > > kafka
> > >> >>
> > >> >> > > EXECUTING: start kafka
> > >> >>
> > >> >> > > Waiting for kafka to start...
> > >> >>
> > >> >> > > Ncat: Connection refused.
> > >> >>
> > >> >> > > .Ncat: Connection refused.
> > >> >>
> > >> >> > > .Ncat: Connection refused.
> > >> >>
> > >> >> > > .^C
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]#
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > -----Original Message-----
> > >> >>
> > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Re: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Yes. You can clone apache/samza locally and build it with:
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > cd <samza-workspace>
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > gradle -b bootstrap.gradle
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./gradlew clean build -x test
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> > >> version
> > >> >> of
> > >> >>
> > >> >> > > the latest apache/samza into your local maven repo
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Then, head to hello-samza workspace and build again:
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > cd <hello-samza-workspace>
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > mvn clean package ## This should create a build target
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid install zookeeper
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid start zookeeper
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid install kafka
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid start kafka
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid install yarn
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ./bin/grid start yarn
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > mkdir -p deploy/samza
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > >> >> > > deploy/samza
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > After this, you can follow steps in the tutorial to "Run"
> > >> >> > > the
> > >> >>
> > >> >> > > example Samza job.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > HTH! Let me know if you need further help.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ________________________________
> > >> >>
> > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > >> >> > > <Srinatha_Anantharaman@
> > >> >>
> > >> >> > > comcast.com>
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: RE: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Is there any other way we can install Hello Samza?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Regards,
> > >> >>
> > >> >> > > ~Sri
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > -----Original Message-----
> > >> >>
> > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Re: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Ok. I tried again for the "latest" branch in hello-samza and
> > >> >> > > it
> > >> >>
> > >> >> > > still works.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > > While installing it says "Building samza from master..."
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > It is expected to build from "master" in apache/samza repo.
> > >> >> > > So, the
> > >> >>
> > >> >> > > output line is expected.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > It is weird that you are unable to connect. Is it possible
> > >> >> > > you are
> > >> >>
> > >> >> > > behind a firewall or something? Can you try to ping "
> > >> git.apache.org"
> > >> >> ?
> > >> >>
> > >> >> > > Or try the setup on a different box?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ________________________________
> > >> >>
> > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > >> >> > > <Srinatha_Anantharaman@
> > >> >>
> > >> >> > > comcast.com>
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: RE: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > I tried again but still same error
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > While installing it says "Building samza from master..."
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > But when after I cloned I executed " git checkout latest"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Regards,
> > >> >>
> > >> >> > > ~Sri
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > -----Original Message-----
> > >> >>
> > >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Re: Connection timed out error while installing
> > >> >> > > "Hello
> > >> Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Hi Anantharaman,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > It looks like a transient connection failure to connect to
> > >> >> > > Apache's
> > >> >>
> > >> >> > > git. I tried on my host and it seems to be working.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Can you give it another shot?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > If it still doesn't work, please let me know if you are
> > >> >> > > running the
> > >> >>
> > >> >> > > command under the "master" or "latest" branch of
> > samza-hello-samza.
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Thanks!
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Navina
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > ________________________________
> > >> >>
> > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > >> >> > > <Srinatha_Anantharaman@
> > >> >>
> > >> >> > > comcast.com>
> > >> >>
> > >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > >> >>
> > >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> > >> >>
> > >> >> > > Subject: Connection timed out error while installing "Hello
> > Samza"
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Hi,
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > I am trying to install "Hello Samza" on a single node
> > >> >> > > Initially I
> > >> >>
> > >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> > >> >> > > install
> > >> >>
> > >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> > >> >> > > getting
> > >> >>
> > >> >> > > connection timed out error It also mentions no kafka, yarn
> > >> >> > > and
> > >> >>
> > >> >> > > zookeeper installed
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Please find below the error message
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > >> >> > > kafka
> > >> >>
> > >> >> > > EXECUTING: install kafka
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> > >> >>
> > >> >> > > 11-0.10.1.1.tgz
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> > >> >>
> > >> >> > > EXECUTING: install yarn
> > >> >>
> > >> >> > > Using previously downloaded file
> > >> >>
> > >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> > >> >>
> > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > >> >> > > zookeeper
> > >> >>
> > >> >> > > EXECUTING: install zookeeper
> > >> >>
> > >> >> > > Using previously downloaded file /root/.samza/download/
> > >> >>
> > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > >> >> > > hello-samza]#
> > >> >>
> > >> >> > > bin/grid bootstrap Bootstrapping the system...
> > >> >>
> > >> >> > > EXECUTING: stop kafka
> > >> >>
> > >> >> > > No kafka server to stop
> > >> >>
> > >> >> > > EXECUTING: stop yarn
> > >> >>
> > >> >> > > no resourcemanager to stop
> > >> >>
> > >> >> > > no nodemanager to stop
> > >> >>
> > >> >> > > EXECUTING: stop zookeeper
> > >> >>
> > >> >> > > JMX enabled by default
> > >> >>
> > >> >> > > Using config:
> > >> >>
> > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > >> >>
> > >> >> > > bin/../conf/zoo.cfg
> > >> >>
> > >> >> > > Stopping zookeeper ... no zookeeper to stop (could not find
> > >> >> > > file
> > >> >>
> > >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> > >> >>
> > >> >> > > EXECUTING: install samza
> > >> >>
> > >> >> > > Building samza from master...
> > >> >>
> > >> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> > >> >>
> > >> >> > > Cloning into 'samza'...
> > >> >>
> > >> >> > > fatal: unable to connect to git.apache.org:
> > >> >>
> > >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Could you please help me to resolve this issue?
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> > > Regards,
> > >> >>
> > >> >> > > ~Sri
> > >> >>
> > >> >> > >
> > >> >>
> > >> >> >
> > >> >>
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>
>
>
> --
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University
>
--
Jagadish V,
Graduate Student,
Department of Computer Science,
Stanford University
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Jagdish,
I appreciate your help.
It worked though netcat gave "0' output I still changed the grid script to "https"
[root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null; echo $?
0
Before I build my Samza job I wanted to confirm if I am able to access my YARN
When I start YARN it fails to start, Below are the last few lines from Yarn log
LOG :
2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /cluster started at 8088
2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8033
2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8033: starting
2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Release request cache is cleaned up
Command line output of Zookeepr and Yarn process Start :
[root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
EXECUTING: start zookeeper
JMX enabled by default
Using config: /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... already running as process 11824.
Waiting for zookeeper to start...
^C
[root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
EXECUTING: start yarn
starting resourcemanager, logging to /home/sanant003c/hello-samza/deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-a1t.sys.comcast.net.out
Waiting for resourcemanager to start...
Ncat: Connection refused.
.Ncat: Connection refused.
.
Regards,
~Sri
-----Original Message-----
From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
Sent: Wednesday, September 20, 2017 1:36 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi Anantharaman,
It's likely that your server blocks the GIT protocol. If so, I'd recommend cloning via HTTPS instead of git.
*First, determine if the git protocol is blocked on the server as follows:*
Please run:
# connects to github default port
➜ ~ nc github.com 9418 < /dev/null; echo $?
You should see the output as "0". Any other exit code means that the GIT protocol is blocked.
*If the above command gets you a non-zero exit code, please clone using HTTPS as follows:*
git clone https://github.com/apache/samza.git
Alternately, you can edit the line in the bin/grid script replacing git clone git://git.apache.org/samza.git with git clone https://github.com/apache/samza.git
and re-run the same command.
Please let us know how it goes! :-)
Best,
Jagdish
On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> Yi,
>
> As you suggested this time I tried to install Samza on clean server
> (there is nothing installed on this server) Still I am getting
> connection timeout error, Please find below command line outputs.
> My System Admin/Dev Ops confirmed that this server does not have any
> firewall restrictions
>
>
> [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo $PATH
> /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> [root@csadatlak-wc-a1t ~]# clear
> [root@csadatlak-wc-a1t ~]# pwd
> /root
> [root@csadatlak-wc-a1t ~]# cd
> [root@csadatlak-wc-a1t ~]# set -o vi
> [root@csadatlak-wc-a1t ~]# ^Ct -o vi
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/ [root@csadatlak-wc-a1t
> sanant003c]# ll total 4 drwxr-xr-x 7 root root 4096 Sep 20 15:32
> hello-samza [root@csadatlak-wc-a1t sanant003c]# cd hello-samza/
> [root@csadatlak-wc-a1t hello-samza]# ll total 312
> drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap Bootstrapping
> the system...
> EXECUTING: stop kafka
> Kafka is not installed. Run: bin/grid install kafka
> EXECUTING: stop yarn
> YARN is not installed. Run: bin/grid install yarn
> EXECUTING: stop zookeeper
> Zookeeper is not installed. Run: bin/grid install zookeeper
> EXECUTING: install samza
> ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> fatal: unable to connect to git.apache.org:
> git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> EXECUTING: install kafka
> Downloading kafka_2.11-0.10.1.1.tgz...
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54 --:--:--
> 620k
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> EXECUTING: install yarn
> Downloading hadoop-2.6.1.tar.gz...
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28 --:--:--
> 734k
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> EXECUTING: install zookeeper
> Downloading zookeeper-3.4.3.tar.gz...
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21 --:--:--
> 747k
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> EXECUTING: install samza
> ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'...
> fatal: unable to connect to git.apache.org:
> git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
> Kindly help me to install Samza on my UNIX server
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Thursday, September 14, 2017 6:42 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> P.S., the attachment you post w/ the previous email does not show up
> (Apache mailing list disallow attachments). If would be better if you
> send the command line outputs in pure text or html format.
>
> -Yi
>
> On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
>
> > Hi, Anantharaman,
> >
> > A lot of firewall setup prevents "incoming connections", not
> > "outgoing connections" from a box. I.e. if you are downloading
> > files, you are establishing outgoing connections and it is fine.
> > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > making an "incoming
> connections"
> > to the box and will trigger the firewall rules.
> >
> > Just trying to pin down the problem, could you try on a Linux box
> > w/o any firewall rules setup and see whether that works? At least,
> > verify that localhost resolves to 127.0.0.1 and try telnet locahost
> > 9092 or
> 2181?
> >
> > NOTE: Success in ping simply means that you can access via ICMP, not
> > guarantee you can establish TCP connection to the ports via firewall
> rules.
> >
> > -Yi
> >
> > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> >
> >> That is a good catch Naveena the server which I am trying to
> >> install is an Hadoop edge node, it has kafka broker and Zookeeper
> >> client already installed for my Hadoop Does it matter If I am
> >> installing it on a separate folder?. My guess Even if there are
> >> conflicts on earlier installations it should throw some other error
> >> but not the connection time out
> >>
> >> Coming to your question " it could either related resolving "localhost"
> >> or firewall that prevents communication between ports" - how to
> >> prove it is because of Firewall issue. I am able to clone Samza
> >> files from
> Apache git.
> >> I can download any external files on this server
> >>
> >> ~Sri
> >>
> >> -----Original Message-----
> >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> Sent: Thursday, September 14, 2017 2:51 PM
> >> To: dev@samza.apache.org
> >> Subject: Re: Connection timed out error while installing "Hello Samza"
> >>
> >> I wonder if this has anything to do with previous kafka / zookeeper
> >> installed on your box. Just for sanity, try clearing
> >> /tmp/zookeeeper* and
> >> /tmp/kafka* before re-trying those steps.
> >>
> >>
> >> Same as Yi, I strongly suspect issues with your local laptop setup
> >> - it could either related resolving "localhost" or firewall that
> >> prevents communication between ports.
> >>
> >>
> >> Navina
> >>
> >> ________________________________
> >> From: Yi Pan <ni...@gmail.com>
> >> Sent: Thursday, September 14, 2017 11:37:46 AM
> >> To: dev@samza.apache.org
> >> Subject: Re: Connection timed out error while installing "Hello Samza"
> >>
> >> Hi, Anantharaman,
> >>
> >> I just did the same steps as you described in your email and all
> >> passed on my box. Hence, I strongly suspect that it is related to
> >> your local laptop network setup.
> >>
> >> Could you post all the command line output when you ran the
> >> sequence of commands?
> >>
> >> -Yi
> >>
> >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> >>
> >> > Hi, Ananarath,
> >> >
> >> > It is very strange that you are seeing this timeout exception
> >> > that we do not see. I am trying to follow the exact steps you did
> >> > to see whether there is anything broken. I will update you this afternoon.
> >> >
> >> > Meanwhile, could you check your hostname setup and firewall
> >> > configuration to see whether your local laptop has blocked access
> >> > via the public IP address to your laptop? Could you verify that
> >> > your localhost is resolved to
> >> > 127.0.0.1 and is accessible?
> >> >
> >> > -Yi
> >> >
> >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> >> >
> >> >> Yi,
> >> >>
> >> >> Is there any alternate way to install Samza Or solution to the
> >> >> connection time out error?
> >> >>
> >> >> Regards,
> >> >> ~Sri
> >> >>
> >> >> From: Anantharaman, Srinatha (Contractor)
> >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> >> >> To: dev@samza.apache.org
> >> >> Subject: RE: Connection timed out error while installing "Hello
> Samza"
> >> >>
> >> >>
> >> >> Yi,
> >> >>
> >> >>
> >> >>
> >> >> I am trying to build Samza locally by following the steps
> >> >> provided by Navina.
> >> >>
> >> >> As per those steps kafka will be installed after Zookeeper, I am
> >> >> getting Error while starting Zookeeper after it is installed
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> Steps Followed :
> >> >>
> >> >>
> >> >>
> >> >> Yes. You can clone apache/samza locally and build it with:
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> cd <samza-workspace>
> >> >>
> >> >>
> >> >>
> >> >> gradle -b bootstrap.gradle
> >> >>
> >> >>
> >> >>
> >> >> ./gradlew clean build -x test
> >> >>
> >> >>
> >> >>
> >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot version
> >> of
> >> >> the latest apache/samza into your local maven repo
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> Then, head to hello-samza workspace and build again:
> >> >>
> >> >>
> >> >>
> >> >> cd <hello-samza-workspace>
> >> >>
> >> >>
> >> >>
> >> >> mvn clean package ## This should create a build target
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid install zookeeper
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid start zookeeper
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid install kafka
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid start kafka
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid install yarn
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid start yarn
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> mkdir -p deploy/samza
> >> >>
> >> >>
> >> >>
> >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> >> >> deploy/samza
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> NOTE : BTW From the above steps I could not execute " gradle -b
> >> >> bootstrap.gradle" since that command does not exists
> >> >>
> >> >>
> >> >>
> >> >> Regards,
> >> >>
> >> >> ~Sri
> >> >>
> >> >>
> >> >>
> >> >> -----Original Message-----
> >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> >> >>
> >> >>
> >> >>
> >> >> Hi, Anantharam,
> >> >>
> >> >>
> >> >>
> >> >> Could you confirm at which step your setup failed? It seems that
> >> >> your zookeeper server is running. Could you check to see whether
> >> >> your Kafka broker is running? You can either do a telnet
> >> >> localhost
> >> >> 9092 or do a ps auxww | grep kafka to see whether you got any
> >> >> broker
> running.
> >> >>
> >> >>
> >> >>
> >> >> Sometimes, the Kafka service takes time to start on a single laptop.
> >> >> You can just try to run ./bin/grid start kafka
> >> >>
> >> >>
> >> >>
> >> >> again to see whether the service is up.
> >> >>
> >> >>
> >> >>
> >> >> Thanks!
> >> >>
> >> >>
> >> >>
> >> >> -Yi
> >> >>
> >> >>
> >> >>
> >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> >> >> (Contractor) <
> >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> >> >> an@comcast.com>> wrote:
> >> >>
> >> >>
> >> >>
> >> >> > Find below Zookeeper logs:
> >> >>
> >> >> >
> >> >>
> >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> >> >> > [main:QuorumPeerConfig@101]
> >> >> > -
> >> >>
> >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> >> >>
> >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> >> >>
> >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> >> >>
> >> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount
> >> >> > set to
> >> >> > 3
> >> >>
> >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> >> >>
> >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set
> >> >> > to
> >> >> > 0
> >> >>
> >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> >> >>
> >> >> > [main:DatadirCleanupManager@101]
> >> >>
> >> >> > - Purge task is not scheduled.
> >> >>
> >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> >> >> > [main:QuorumPeerMain@113] -
> >> >>
> >> >> > Either no config or no quorum defined in config, running in
> >> >>
> >> >> > standalone mode
> >> >>
> >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> >> >> > [main:QuorumPeerConfig@101]
> >> >> > -
> >> >>
> >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> >> >>
> >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> >> >>
> >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> >> >> > [main:ZooKeeperServerMain@95]
> >> >>
> >> >> > - Starting server
> >> >>
> >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> >> >> > 02/06/2012
> >> >> > 10:48
> >> >>
> >> >> > GMT
> >> >>
> >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> >> >>
> >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:java.version=1.8.0_31
> >> >>
> >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:java.vendor=Oracle Corporation
> >> >>
> >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> >> >>
> >> >> > 8.0.31-2.b13.el7.x86_64/jre
> >> >>
> >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> >> >>
> >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> >> >>
> >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >> >>
> >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> >> >>
> >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >> >>
> >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> >> >>
> >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> >> >>
> >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> >> >>
> >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >> >>
> >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> >> >>
> >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >> >>
> >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../conf:
> >> >>
> >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
> >> >>
> >> >> > usr/lib64:/lib64:/lib:/usr/lib
> >> >>
> >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:java.io.tmpdir=/tmp
> >> >>
> >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:java.compiler=<NA>
> >> >>
> >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:os.name=Linux
> >> >>
> >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:os.arch=amd64
> >> >>
> >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> >> >>
> >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:user.name=root
> >> >>
> >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:user.home=/root
> >> >>
> >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98]
> >> >> > - Server
> >> >>
> >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper
> >> >>
> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> >> >> > [main:ZooKeeperServer@733]
> >> >> > -
> >> >>
> >> >> > tickTime set to 2000
> >> >>
> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> >> >> > [main:ZooKeeperServer@742]
> >> >> > -
> >> >>
> >> >> > minSessionTimeout set to -1
> >> >>
> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> >> >> > [main:ZooKeeperServer@751]
> >> >> > -
> >> >>
> >> >> > maxSessionTimeout set to -1
> >> >>
> >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> >> >>
> >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> >> >> > 0.0.0.0/0.0.0.0:2181
> >> >>
> >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> >> >> > [main:FileTxnSnapLog@238] -
> >> >>
> >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> >> >>
> >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> >> >> > connection
> >> >>
> >> >> > from
> >> >>
> >> >> > /0:0:0:0:0:0:0:1:21754
> >> >>
> >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> >> >> > exception
> >> >>
> >> >> > EndOfStreamException: Unable to read additional data from
> >> >> > client
> >> >>
> >> >> > sessionid 0x0, likely client has closed socket
> >> >>
> >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> >> >>
> >> >> > NIOServerCnxn.java:220)
> >> >>
> >> >> > at
> >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> >> >>
> >> >> > NIOServerCnxnFactory.java:224)
> >> >>
> >> >> > at java.lang.Thread.run(Thread.java:745)
> >> >>
> >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection
> >> >> > for client
> >> >>
> >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> >> >>
> >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> >> >> > connection
> >> >>
> >> >> > from /
> >> >>
> >> >> > 127.0.0.1:48071
> >> >>
> >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> >> >> > establish new
> >> >>
> >> >> > session at /127.0.0.1:48071
> >> >>
> >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> >> >> > [SyncThread:0:FileTxnLog@199]
> >> >>
> >> >> > - Creating new log file: log.1
> >> >>
> >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> >> >>
> >> >> > [SyncThread:0:ZooKeeperServer@604]
> >> >>
> >> >> > - Established session 0x15e770d61920000 with negotiated
> >> >> > timeout
> >> >> > 6000
> >> >>
> >> >> > for client /127.0.0.1:48071
> >> >>
> >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
> >> >> > zxid:0x3
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> >> >> > Error:KeeperErrorCode =
> >> >>
> >> >> > NoNode for /brokers
> >> >>
> >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
> >> >> > zxid:0x7
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/config
> >> >> > Error:KeeperErrorCode =
> >> >>
> >> >> > NoNode for /config
> >> >>
> >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
> >> >> > zxid:0xc
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode
> >> >> > =
> >> >>
> >> >> > NoNode for /admin
> >> >>
> >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
> >> >> > zxid:0x11
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> >> >> > Error:KeeperErrorCode =
> >> >>
> >> >> > NoNode for /cluster
> >> >>
> >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
> >> >>
> >> >> > zxid:0x15
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> >> >>
> >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> >> >>
> >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
> >> >> > zxid:0x17
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error
> >> >> > Path:/admin/preferred_replica_election
> >> >>
> >> >> > Error:KeeperErrorCode = NoNode for
> >> >> > /admin/preferred_replica_election
> >> >>
> >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
> >> >> > zxid:0x18
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> >> >> > Error:KeeperErrorCode =
> >> >>
> >> >> > NodeExists for /brokers
> >> >>
> >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> >> >> > when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
> >> >> > zxid:0x19
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> >> >> > Error:KeeperErrorCode =
> >> >>
> >> >> > NodeExists for /brokers/ids
> >> >>
> >> >> >
> >> >>
> >> >> >
> >> >>
> >> >> >
> >> >>
> >> >> > -----Original Message-----
> >> >>
> >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> >> >>
> >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> >> >>
> >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > Subject: Re: Connection timed out error while installing
> >> >> > "Hello
> >> Samza"
> >> >>
> >> >> >
> >> >>
> >> >> > Hi, Anantharaman,
> >> >>
> >> >> >
> >> >>
> >> >> > Could you post your zookeeper startup logs here?
> >> >>
> >> >> >
> >> >>
> >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> >> >> > (Contractor)
> >> >>
> >> >> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> >> >> an@comcast.com>> wrote:
> >> >>
> >> >> >
> >> >>
> >> >> > > It hangs while bringing up the service
> >> >>
> >> >> > >
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> >> >>
> >> >> > > /app/home/eventsvc/samza-git/hello-samza
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> >> >> > > zookeeper
> >> >>
> >> >> > > EXECUTING: install zookeeper
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/
> >> >>
> >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> >> >> > > hello-samza]#
> >> >>
> >> >> > > ./bin/grid start zookeeper
> >> >>
> >> >> > > EXECUTING: start zookeeper
> >> >>
> >> >> > > JMX enabled by default
> >> >>
> >> >> > > Using config:
> >> >>
> >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >> >>
> >> >> > > bin/../conf/zoo.cfg
> >> >>
> >> >> > > Starting zookeeper ... STARTED
> >> >>
> >> >> > > Waiting for zookeeper to start...
> >> >>
> >> >> > >
> >> >>
> >> >> > > ^C
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> >> >> > > zookeeper^C
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> >> >> > > kafka
> >> >>
> >> >> > > EXECUTING: install kafka
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> >> >>
> >> >> > > 11-0.10.1.1.tgz
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> >> >> > > kafka
> >> >>
> >> >> > > EXECUTING: start kafka
> >> >>
> >> >> > > Waiting for kafka to start...
> >> >>
> >> >> > > Ncat: Connection refused.
> >> >>
> >> >> > > .Ncat: Connection refused.
> >> >>
> >> >> > > .Ncat: Connection refused.
> >> >>
> >> >> > > .^C
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]#
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > -----Original Message-----
> >> >>
> >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Re: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Yes. You can clone apache/samza locally and build it with:
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > cd <samza-workspace>
> >> >>
> >> >> > >
> >> >>
> >> >> > > gradle -b bootstrap.gradle
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./gradlew clean build -x test
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> >> version
> >> >> of
> >> >>
> >> >> > > the latest apache/samza into your local maven repo
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Then, head to hello-samza workspace and build again:
> >> >>
> >> >> > >
> >> >>
> >> >> > > cd <hello-samza-workspace>
> >> >>
> >> >> > >
> >> >>
> >> >> > > mvn clean package ## This should create a build target
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid install zookeeper
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid start zookeeper
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid install kafka
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid start kafka
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid install yarn
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid start yarn
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > mkdir -p deploy/samza
> >> >>
> >> >> > >
> >> >>
> >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> >> >> > > deploy/samza
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > After this, you can follow steps in the tutorial to "Run"
> >> >> > > the
> >> >>
> >> >> > > example Samza job.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > HTH! Let me know if you need further help.
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina
> >> >>
> >> >> > >
> >> >>
> >> >> > > ________________________________
> >> >>
> >> >> > > From: Anantharaman, Srinatha (Contractor)
> >> >> > > <Srinatha_Anantharaman@
> >> >>
> >> >> > > comcast.com>
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: RE: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina,
> >> >>
> >> >> > >
> >> >>
> >> >> > > Is there any other way we can install Hello Samza?
> >> >>
> >> >> > >
> >> >>
> >> >> > > Regards,
> >> >>
> >> >> > > ~Sri
> >> >>
> >> >> > >
> >> >>
> >> >> > > -----Original Message-----
> >> >>
> >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Re: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Ok. I tried again for the "latest" branch in hello-samza and
> >> >> > > it
> >> >>
> >> >> > > still works.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > > While installing it says "Building samza from master..."
> >> >>
> >> >> > >
> >> >>
> >> >> > > It is expected to build from "master" in apache/samza repo.
> >> >> > > So, the
> >> >>
> >> >> > > output line is expected.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > It is weird that you are unable to connect. Is it possible
> >> >> > > you are
> >> >>
> >> >> > > behind a firewall or something? Can you try to ping "
> >> git.apache.org"
> >> >> ?
> >> >>
> >> >> > > Or try the setup on a different box?
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina
> >> >>
> >> >> > >
> >> >>
> >> >> > > ________________________________
> >> >>
> >> >> > > From: Anantharaman, Srinatha (Contractor)
> >> >> > > <Srinatha_Anantharaman@
> >> >>
> >> >> > > comcast.com>
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: RE: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina,
> >> >>
> >> >> > >
> >> >>
> >> >> > > I tried again but still same error
> >> >>
> >> >> > >
> >> >>
> >> >> > > While installing it says "Building samza from master..."
> >> >>
> >> >> > >
> >> >>
> >> >> > > But when after I cloned I executed " git checkout latest"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Regards,
> >> >>
> >> >> > > ~Sri
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > -----Original Message-----
> >> >>
> >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Re: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Hi Anantharaman,
> >> >>
> >> >> > >
> >> >>
> >> >> > > It looks like a transient connection failure to connect to
> >> >> > > Apache's
> >> >>
> >> >> > > git. I tried on my host and it seems to be working.
> >> >>
> >> >> > >
> >> >>
> >> >> > > Can you give it another shot?
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > If it still doesn't work, please let me know if you are
> >> >> > > running the
> >> >>
> >> >> > > command under the "master" or "latest" branch of
> samza-hello-samza.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Thanks!
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina
> >> >>
> >> >> > >
> >> >>
> >> >> > > ________________________________
> >> >>
> >> >> > > From: Anantharaman, Srinatha (Contractor)
> >> >> > > <Srinatha_Anantharaman@
> >> >>
> >> >> > > comcast.com>
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Connection timed out error while installing "Hello
> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Hi,
> >> >>
> >> >> > >
> >> >>
> >> >> > > I am trying to install "Hello Samza" on a single node
> >> >> > > Initially I
> >> >>
> >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> >> >> > > install
> >> >>
> >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> >> >> > > getting
> >> >>
> >> >> > > connection timed out error It also mentions no kafka, yarn
> >> >> > > and
> >> >>
> >> >> > > zookeeper installed
> >> >>
> >> >> > >
> >> >>
> >> >> > > Please find below the error message
> >> >>
> >> >> > >
> >> >>
> >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> >> >> > > kafka
> >> >>
> >> >> > > EXECUTING: install kafka
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> >> >>
> >> >> > > 11-0.10.1.1.tgz
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> >> >>
> >> >> > > EXECUTING: install yarn
> >> >>
> >> >> > > Using previously downloaded file
> >> >>
> >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> >> >> > > zookeeper
> >> >>
> >> >> > > EXECUTING: install zookeeper
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/
> >> >>
> >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> >> >> > > hello-samza]#
> >> >>
> >> >> > > bin/grid bootstrap Bootstrapping the system...
> >> >>
> >> >> > > EXECUTING: stop kafka
> >> >>
> >> >> > > No kafka server to stop
> >> >>
> >> >> > > EXECUTING: stop yarn
> >> >>
> >> >> > > no resourcemanager to stop
> >> >>
> >> >> > > no nodemanager to stop
> >> >>
> >> >> > > EXECUTING: stop zookeeper
> >> >>
> >> >> > > JMX enabled by default
> >> >>
> >> >> > > Using config:
> >> >>
> >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >> >>
> >> >> > > bin/../conf/zoo.cfg
> >> >>
> >> >> > > Stopping zookeeper ... no zookeeper to stop (could not find
> >> >> > > file
> >> >>
> >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> >> >>
> >> >> > > EXECUTING: install samza
> >> >>
> >> >> > > Building samza from master...
> >> >>
> >> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> >> >>
> >> >> > > Cloning into 'samza'...
> >> >>
> >> >> > > fatal: unable to connect to git.apache.org:
> >> >>
> >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Could you please help me to resolve this issue?
> >> >>
> >> >> > >
> >> >>
> >> >> > > Regards,
> >> >>
> >> >> > > ~Sri
> >> >>
> >> >> > >
> >> >>
> >> >> >
> >> >>
> >> >
> >> >
> >>
> >
> >
>
--
Jagadish V,
Graduate Student,
Department of Computer Science,
Stanford University
Re: Connection timed out error while installing "Hello Samza"
Posted by Jagadish Venkatraman <ja...@gmail.com>.
Hi Anantharaman,
It's likely that your server blocks the GIT protocol. If so, I'd recommend
cloning via HTTPS instead of git.
*First, determine if the git protocol is blocked on the server as follows:*
Please run:
# connects to github default port
➜ ~ nc github.com 9418 < /dev/null; echo $?
You should see the output as "0". Any other exit code means that the GIT
protocol is blocked.
*If the above command gets you a non-zero exit code, please clone using
HTTPS as follows:*
git clone https://github.com/apache/samza.git
Alternately, you can edit the line in the bin/grid script replacing git
clone git://git.apache.org/samza.git with git clone
https://github.com/apache/samza.git
and re-run the same command.
Please let us know how it goes! :-)
Best,
Jagdish
On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> Yi,
>
> As you suggested this time I tried to install Samza on clean server (there
> is nothing installed on this server)
> Still I am getting connection timeout error, Please find below command
> line outputs.
> My System Admin/Dev Ops confirmed that this server does not have any
> firewall restrictions
>
>
> [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> /usr/lib/jvm/java-1.8.0-openjdk
> [root@csadatlak-wc-a1t ~]# echo $PATH
> /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> [root@csadatlak-wc-a1t ~]# clear
> [root@csadatlak-wc-a1t ~]# pwd
> /root
> [root@csadatlak-wc-a1t ~]# cd
> [root@csadatlak-wc-a1t ~]# set -o vi
> [root@csadatlak-wc-a1t ~]# ^Ct -o vi
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]#
> [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
> [root@csadatlak-wc-a1t sanant003c]# ll
> total 4
> drwxr-xr-x 7 root root 4096 Sep 20 15:32 hello-samza
> [root@csadatlak-wc-a1t sanant003c]# cd hello-samza/
> [root@csadatlak-wc-a1t hello-samza]# ll
> total 312
> drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
> Bootstrapping the system...
> EXECUTING: stop kafka
> Kafka is not installed. Run: bin/grid install kafka
> EXECUTING: stop yarn
> YARN is not installed. Run: bin/grid install yarn
> EXECUTING: stop zookeeper
> Zookeeper is not installed. Run: bin/grid install zookeeper
> EXECUTING: install samza
> ~/.samza/download /home/sanant003c/hello-samza
> Cloning into 'samza'...
> fatal: unable to connect to git.apache.org:
> git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> EXECUTING: install kafka
> Downloading kafka_2.11-0.10.1.1.tgz...
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54 --:--:--
> 620k
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> EXECUTING: install yarn
> Downloading hadoop-2.6.1.tar.gz...
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28 --:--:--
> 734k
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> EXECUTING: install zookeeper
> Downloading zookeeper-3.4.3.tar.gz...
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21 --:--:--
> 747k
> [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> EXECUTING: install samza
> ~/.samza/download /home/sanant003c/hello-samza
> Cloning into 'samza'...
> fatal: unable to connect to git.apache.org:
> git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
> Kindly help me to install Samza on my UNIX server
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Thursday, September 14, 2017 6:42 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> P.S., the attachment you post w/ the previous email does not show up
> (Apache mailing list disallow attachments). If would be better if you send
> the command line outputs in pure text or html format.
>
> -Yi
>
> On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
>
> > Hi, Anantharaman,
> >
> > A lot of firewall setup prevents "incoming connections", not "outgoing
> > connections" from a box. I.e. if you are downloading files, you are
> > establishing outgoing connections and it is fine. When you are hosting
> > a server (i.e. ZooKeeper or Kafka), you are making an "incoming
> connections"
> > to the box and will trigger the firewall rules.
> >
> > Just trying to pin down the problem, could you try on a Linux box w/o
> > any firewall rules setup and see whether that works? At least, verify
> > that localhost resolves to 127.0.0.1 and try telnet locahost 9092 or
> 2181?
> >
> > NOTE: Success in ping simply means that you can access via ICMP, not
> > guarantee you can establish TCP connection to the ports via firewall
> rules.
> >
> > -Yi
> >
> > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha (Contractor)
> > < Srinatha_Anantharaman@comcast.com> wrote:
> >
> >> That is a good catch Naveena the server which I am trying to install
> >> is an Hadoop edge node, it has kafka broker and Zookeeper client
> >> already installed for my Hadoop Does it matter If I am installing it
> >> on a separate folder?. My guess Even if there are conflicts on
> >> earlier installations it should throw some other error but not the
> >> connection time out
> >>
> >> Coming to your question " it could either related resolving "localhost"
> >> or firewall that prevents communication between ports" - how to prove
> >> it is because of Firewall issue. I am able to clone Samza files from
> Apache git.
> >> I can download any external files on this server
> >>
> >> ~Sri
> >>
> >> -----Original Message-----
> >> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> Sent: Thursday, September 14, 2017 2:51 PM
> >> To: dev@samza.apache.org
> >> Subject: Re: Connection timed out error while installing "Hello Samza"
> >>
> >> I wonder if this has anything to do with previous kafka / zookeeper
> >> installed on your box. Just for sanity, try clearing /tmp/zookeeeper*
> >> and
> >> /tmp/kafka* before re-trying those steps.
> >>
> >>
> >> Same as Yi, I strongly suspect issues with your local laptop setup -
> >> it could either related resolving "localhost" or firewall that
> >> prevents communication between ports.
> >>
> >>
> >> Navina
> >>
> >> ________________________________
> >> From: Yi Pan <ni...@gmail.com>
> >> Sent: Thursday, September 14, 2017 11:37:46 AM
> >> To: dev@samza.apache.org
> >> Subject: Re: Connection timed out error while installing "Hello Samza"
> >>
> >> Hi, Anantharaman,
> >>
> >> I just did the same steps as you described in your email and all
> >> passed on my box. Hence, I strongly suspect that it is related to
> >> your local laptop network setup.
> >>
> >> Could you post all the command line output when you ran the sequence
> >> of commands?
> >>
> >> -Yi
> >>
> >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> >>
> >> > Hi, Ananarath,
> >> >
> >> > It is very strange that you are seeing this timeout exception that
> >> > we do not see. I am trying to follow the exact steps you did to see
> >> > whether there is anything broken. I will update you this afternoon.
> >> >
> >> > Meanwhile, could you check your hostname setup and firewall
> >> > configuration to see whether your local laptop has blocked access
> >> > via the public IP address to your laptop? Could you verify that
> >> > your localhost is resolved to
> >> > 127.0.0.1 and is accessible?
> >> >
> >> > -Yi
> >> >
> >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> >> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> >> >
> >> >> Yi,
> >> >>
> >> >> Is there any alternate way to install Samza Or solution to the
> >> >> connection time out error?
> >> >>
> >> >> Regards,
> >> >> ~Sri
> >> >>
> >> >> From: Anantharaman, Srinatha (Contractor)
> >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> >> >> To: dev@samza.apache.org
> >> >> Subject: RE: Connection timed out error while installing "Hello
> Samza"
> >> >>
> >> >>
> >> >> Yi,
> >> >>
> >> >>
> >> >>
> >> >> I am trying to build Samza locally by following the steps provided
> >> >> by Navina.
> >> >>
> >> >> As per those steps kafka will be installed after Zookeeper, I am
> >> >> getting Error while starting Zookeeper after it is installed
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> Steps Followed :
> >> >>
> >> >>
> >> >>
> >> >> Yes. You can clone apache/samza locally and build it with:
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> cd <samza-workspace>
> >> >>
> >> >>
> >> >>
> >> >> gradle -b bootstrap.gradle
> >> >>
> >> >>
> >> >>
> >> >> ./gradlew clean build -x test
> >> >>
> >> >>
> >> >>
> >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot version
> >> of
> >> >> the latest apache/samza into your local maven repo
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> Then, head to hello-samza workspace and build again:
> >> >>
> >> >>
> >> >>
> >> >> cd <hello-samza-workspace>
> >> >>
> >> >>
> >> >>
> >> >> mvn clean package ## This should create a build target
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid install zookeeper
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid start zookeeper
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid install kafka
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid start kafka
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid install yarn
> >> >>
> >> >>
> >> >>
> >> >> ./bin/grid start yarn
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> mkdir -p deploy/samza
> >> >>
> >> >>
> >> >>
> >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> >> >> deploy/samza
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> NOTE : BTW From the above steps I could not execute " gradle -b
> >> >> bootstrap.gradle" since that command does not exists
> >> >>
> >> >>
> >> >>
> >> >> Regards,
> >> >>
> >> >> ~Sri
> >> >>
> >> >>
> >> >>
> >> >> -----Original Message-----
> >> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> >> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >> Subject: Re: Connection timed out error while installing "Hello
> Samza"
> >> >>
> >> >>
> >> >>
> >> >> Hi, Anantharam,
> >> >>
> >> >>
> >> >>
> >> >> Could you confirm at which step your setup failed? It seems that
> >> >> your zookeeper server is running. Could you check to see whether
> >> >> your Kafka broker is running? You can either do a telnet localhost
> >> >> 9092 or do a ps auxww | grep kafka to see whether you got any broker
> running.
> >> >>
> >> >>
> >> >>
> >> >> Sometimes, the Kafka service takes time to start on a single laptop.
> >> >> You can just try to run ./bin/grid start kafka
> >> >>
> >> >>
> >> >>
> >> >> again to see whether the service is up.
> >> >>
> >> >>
> >> >>
> >> >> Thanks!
> >> >>
> >> >>
> >> >>
> >> >> -Yi
> >> >>
> >> >>
> >> >>
> >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> >> >> (Contractor) <
> >> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> >> >> an@comcast.com>> wrote:
> >> >>
> >> >>
> >> >>
> >> >> > Find below Zookeeper logs:
> >> >>
> >> >> >
> >> >>
> >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> >> >> > [main:QuorumPeerConfig@101]
> >> >> > -
> >> >>
> >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> >> >>
> >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> >> >>
> >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> >> >>
> >> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set
> >> >> > to
> >> >> > 3
> >> >>
> >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> >> >>
> >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to
> >> >> > 0
> >> >>
> >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> >> >>
> >> >> > [main:DatadirCleanupManager@101]
> >> >>
> >> >> > - Purge task is not scheduled.
> >> >>
> >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> >> >> > [main:QuorumPeerMain@113] -
> >> >>
> >> >> > Either no config or no quorum defined in config, running in
> >> >>
> >> >> > standalone mode
> >> >>
> >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> >> >> > [main:QuorumPeerConfig@101]
> >> >> > -
> >> >>
> >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> >> >>
> >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> >> >>
> >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> >> >> > [main:ZooKeeperServerMain@95]
> >> >>
> >> >> > - Starting server
> >> >>
> >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
> >> >> > 10:48
> >> >>
> >> >> > GMT
> >> >>
> >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> >> >>
> >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:java.version=1.8.0_31
> >> >>
> >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:java.vendor=Oracle Corporation
> >> >>
> >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> >> >>
> >> >> > 8.0.31-2.b13.el7.x86_64/jre
> >> >>
> >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> >> >>
> >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> >> >>
> >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >> >>
> >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> >> >>
> >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >> >>
> >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> >> >>
> >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> >> >>
> >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> >> >>
> >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >> >>
> >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> >> >>
> >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >> >>
> >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper/bin/../conf:
> >> >>
> >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
> >> >>
> >> >> > usr/lib64:/lib64:/lib:/usr/lib
> >> >>
> >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:java.io.tmpdir=/tmp
> >> >>
> >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:java.compiler=<NA>
> >> >>
> >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:os.name=Linux
> >> >>
> >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:os.arch=amd64
> >> >>
> >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> >> >>
> >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:user.name=root
> >> >>
> >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:user.home=/root
> >> >>
> >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
> >> >> > Server
> >> >>
> >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> >> >>
> >> >> > samza/deploy/zookeeper
> >> >>
> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> >> >> > [main:ZooKeeperServer@733]
> >> >> > -
> >> >>
> >> >> > tickTime set to 2000
> >> >>
> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> >> >> > [main:ZooKeeperServer@742]
> >> >> > -
> >> >>
> >> >> > minSessionTimeout set to -1
> >> >>
> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> >> >> > [main:ZooKeeperServer@751]
> >> >> > -
> >> >>
> >> >> > maxSessionTimeout set to -1
> >> >>
> >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> >> >>
> >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> >> >> > 0.0.0.0/0.0.0.0:2181
> >> >>
> >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> >> >> > [main:FileTxnSnapLog@238] -
> >> >>
> >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> >> >>
> >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> >> >> > connection
> >> >>
> >> >> > from
> >> >>
> >> >> > /0:0:0:0:0:0:0:1:21754
> >> >>
> >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
> >> >>
> >> >> > EndOfStreamException: Unable to read additional data from client
> >> >>
> >> >> > sessionid 0x0, likely client has closed socket
> >> >>
> >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> >> >>
> >> >> > NIOServerCnxn.java:220)
> >> >>
> >> >> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> >> >>
> >> >> > NIOServerCnxnFactory.java:224)
> >> >>
> >> >> > at java.lang.Thread.run(Thread.java:745)
> >> >>
> >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
> >> >> > client
> >> >>
> >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> >> >>
> >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> >> >> > connection
> >> >>
> >> >> > from /
> >> >>
> >> >> > 127.0.0.1:48071
> >> >>
> >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> >> >> > [NIOServerCxn.Factory:0.0.0.0/
> >> >>
> >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> >> >> > establish new
> >> >>
> >> >> > session at /127.0.0.1:48071
> >> >>
> >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> >> >> > [SyncThread:0:FileTxnLog@199]
> >> >>
> >> >> > - Creating new log file: log.1
> >> >>
> >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> >> >>
> >> >> > [SyncThread:0:ZooKeeperServer@604]
> >> >>
> >> >> > - Established session 0x15e770d61920000 with negotiated timeout
> >> >> > 6000
> >> >>
> >> >> > for client /127.0.0.1:48071
> >> >>
> >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
> >> >> > zxid:0x3
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode
> >> >> > =
> >> >>
> >> >> > NoNode for /brokers
> >> >>
> >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
> >> >> > zxid:0x7
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode
> >> >> > =
> >> >>
> >> >> > NoNode for /config
> >> >>
> >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
> >> >> > zxid:0xc
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
> >> >>
> >> >> > NoNode for /admin
> >> >>
> >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
> >> >> > zxid:0x11
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode
> >> >> > =
> >> >>
> >> >> > NoNode for /cluster
> >> >>
> >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
> >> >>
> >> >> > zxid:0x15
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> >> >>
> >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> >> >>
> >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
> >> >> > zxid:0x17
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error
> >> >> > Path:/admin/preferred_replica_election
> >> >>
> >> >> > Error:KeeperErrorCode = NoNode for
> >> >> > /admin/preferred_replica_election
> >> >>
> >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
> >> >> > zxid:0x18
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode
> >> >> > =
> >> >>
> >> >> > NodeExists for /brokers
> >> >>
> >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
> >> cport:-1)::
> >> >>
> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >> >>
> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
> >> >> > zxid:0x19
> >> >>
> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> >> >> > Error:KeeperErrorCode =
> >> >>
> >> >> > NodeExists for /brokers/ids
> >> >>
> >> >> >
> >> >>
> >> >> >
> >> >>
> >> >> >
> >> >>
> >> >> > -----Original Message-----
> >> >>
> >> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> >> >>
> >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> >> >>
> >> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > Subject: Re: Connection timed out error while installing "Hello
> >> Samza"
> >> >>
> >> >> >
> >> >>
> >> >> > Hi, Anantharaman,
> >> >>
> >> >> >
> >> >>
> >> >> > Could you post your zookeeper startup logs here?
> >> >>
> >> >> >
> >> >>
> >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> >> >> > (Contractor)
> >> >>
> >> >> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> >> >> an@comcast.com>> wrote:
> >> >>
> >> >> >
> >> >>
> >> >> > > It hangs while bringing up the service
> >> >>
> >> >> > >
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> >> >>
> >> >> > > /app/home/eventsvc/samza-git/hello-samza
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> >> >> > > zookeeper
> >> >>
> >> >> > > EXECUTING: install zookeeper
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/
> >> >>
> >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> >> >>
> >> >> > > ./bin/grid start zookeeper
> >> >>
> >> >> > > EXECUTING: start zookeeper
> >> >>
> >> >> > > JMX enabled by default
> >> >>
> >> >> > > Using config:
> >> >>
> >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >> >>
> >> >> > > bin/../conf/zoo.cfg
> >> >>
> >> >> > > Starting zookeeper ... STARTED
> >> >>
> >> >> > > Waiting for zookeeper to start...
> >> >>
> >> >> > >
> >> >>
> >> >> > > ^C
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> >> >> > > zookeeper^C
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> >> >> > > kafka
> >> >>
> >> >> > > EXECUTING: install kafka
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> >> >>
> >> >> > > 11-0.10.1.1.tgz
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
> >> >>
> >> >> > > EXECUTING: start kafka
> >> >>
> >> >> > > Waiting for kafka to start...
> >> >>
> >> >> > > Ncat: Connection refused.
> >> >>
> >> >> > > .Ncat: Connection refused.
> >> >>
> >> >> > > .Ncat: Connection refused.
> >> >>
> >> >> > > .^C
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]#
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > -----Original Message-----
> >> >>
> >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Re: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Yes. You can clone apache/samza locally and build it with:
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > cd <samza-workspace>
> >> >>
> >> >> > >
> >> >>
> >> >> > > gradle -b bootstrap.gradle
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./gradlew clean build -x test
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> >> version
> >> >> of
> >> >>
> >> >> > > the latest apache/samza into your local maven repo
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Then, head to hello-samza workspace and build again:
> >> >>
> >> >> > >
> >> >>
> >> >> > > cd <hello-samza-workspace>
> >> >>
> >> >> > >
> >> >>
> >> >> > > mvn clean package ## This should create a build target
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid install zookeeper
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid start zookeeper
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid install kafka
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid start kafka
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid install yarn
> >> >>
> >> >> > >
> >> >>
> >> >> > > ./bin/grid start yarn
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > mkdir -p deploy/samza
> >> >>
> >> >> > >
> >> >>
> >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> >> >> > > deploy/samza
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > After this, you can follow steps in the tutorial to "Run" the
> >> >>
> >> >> > > example Samza job.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > HTH! Let me know if you need further help.
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina
> >> >>
> >> >> > >
> >> >>
> >> >> > > ________________________________
> >> >>
> >> >> > > From: Anantharaman, Srinatha (Contractor)
> >> >> > > <Srinatha_Anantharaman@
> >> >>
> >> >> > > comcast.com>
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: RE: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina,
> >> >>
> >> >> > >
> >> >>
> >> >> > > Is there any other way we can install Hello Samza?
> >> >>
> >> >> > >
> >> >>
> >> >> > > Regards,
> >> >>
> >> >> > > ~Sri
> >> >>
> >> >> > >
> >> >>
> >> >> > > -----Original Message-----
> >> >>
> >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Re: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Ok. I tried again for the "latest" branch in hello-samza and
> >> >> > > it
> >> >>
> >> >> > > still works.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > > While installing it says "Building samza from master..."
> >> >>
> >> >> > >
> >> >>
> >> >> > > It is expected to build from "master" in apache/samza repo.
> >> >> > > So, the
> >> >>
> >> >> > > output line is expected.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > It is weird that you are unable to connect. Is it possible you
> >> >> > > are
> >> >>
> >> >> > > behind a firewall or something? Can you try to ping "
> >> git.apache.org"
> >> >> ?
> >> >>
> >> >> > > Or try the setup on a different box?
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina
> >> >>
> >> >> > >
> >> >>
> >> >> > > ________________________________
> >> >>
> >> >> > > From: Anantharaman, Srinatha (Contractor)
> >> >> > > <Srinatha_Anantharaman@
> >> >>
> >> >> > > comcast.com>
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: RE: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina,
> >> >>
> >> >> > >
> >> >>
> >> >> > > I tried again but still same error
> >> >>
> >> >> > >
> >> >>
> >> >> > > While installing it says "Building samza from master..."
> >> >>
> >> >> > >
> >> >>
> >> >> > > But when after I cloned I executed " git checkout latest"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Regards,
> >> >>
> >> >> > > ~Sri
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > -----Original Message-----
> >> >>
> >> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Re: Connection timed out error while installing
> >> >> > > "Hello
> >> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Hi Anantharaman,
> >> >>
> >> >> > >
> >> >>
> >> >> > > It looks like a transient connection failure to connect to
> >> >> > > Apache's
> >> >>
> >> >> > > git. I tried on my host and it seems to be working.
> >> >>
> >> >> > >
> >> >>
> >> >> > > Can you give it another shot?
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > If it still doesn't work, please let me know if you are
> >> >> > > running the
> >> >>
> >> >> > > command under the "master" or "latest" branch of
> samza-hello-samza.
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Thanks!
> >> >>
> >> >> > >
> >> >>
> >> >> > > Navina
> >> >>
> >> >> > >
> >> >>
> >> >> > > ________________________________
> >> >>
> >> >> > > From: Anantharaman, Srinatha (Contractor)
> >> >> > > <Srinatha_Anantharaman@
> >> >>
> >> >> > > comcast.com>
> >> >>
> >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> >> >>
> >> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >> >>
> >> >> > > Subject: Connection timed out error while installing "Hello
> Samza"
> >> >>
> >> >> > >
> >> >>
> >> >> > > Hi,
> >> >>
> >> >> > >
> >> >>
> >> >> > > I am trying to install "Hello Samza" on a single node
> >> >> > > Initially I
> >> >>
> >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> >> >> > > install
> >> >>
> >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> >> >> > > getting
> >> >>
> >> >> > > connection timed out error It also mentions no kafka, yarn and
> >> >>
> >> >> > > zookeeper installed
> >> >>
> >> >> > >
> >> >>
> >> >> > > Please find below the error message
> >> >>
> >> >> > >
> >> >>
> >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
> >> >>
> >> >> > > EXECUTING: install kafka
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> >> >>
> >> >> > > 11-0.10.1.1.tgz
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> >> >>
> >> >> > > EXECUTING: install yarn
> >> >>
> >> >> > > Using previously downloaded file
> >> >>
> >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> >> >>
> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> >> >> > > zookeeper
> >> >>
> >> >> > > EXECUTING: install zookeeper
> >> >>
> >> >> > > Using previously downloaded file /root/.samza/download/
> >> >>
> >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> >> >>
> >> >> > > bin/grid bootstrap Bootstrapping the system...
> >> >>
> >> >> > > EXECUTING: stop kafka
> >> >>
> >> >> > > No kafka server to stop
> >> >>
> >> >> > > EXECUTING: stop yarn
> >> >>
> >> >> > > no resourcemanager to stop
> >> >>
> >> >> > > no nodemanager to stop
> >> >>
> >> >> > > EXECUTING: stop zookeeper
> >> >>
> >> >> > > JMX enabled by default
> >> >>
> >> >> > > Using config:
> >> >>
> >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >> >>
> >> >> > > bin/../conf/zoo.cfg
> >> >>
> >> >> > > Stopping zookeeper ... no zookeeper to stop (could not find
> >> >> > > file
> >> >>
> >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> >> >>
> >> >> > > EXECUTING: install samza
> >> >>
> >> >> > > Building samza from master...
> >> >>
> >> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> >> >>
> >> >> > > Cloning into 'samza'...
> >> >>
> >> >> > > fatal: unable to connect to git.apache.org:
> >> >>
> >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >> >>
> >> >> > >
> >> >>
> >> >> > >
> >> >>
> >> >> > > Could you please help me to resolve this issue?
> >> >>
> >> >> > >
> >> >>
> >> >> > > Regards,
> >> >>
> >> >> > > ~Sri
> >> >>
> >> >> > >
> >> >>
> >> >> >
> >> >>
> >> >
> >> >
> >>
> >
> >
>
--
Jagadish V,
Graduate Student,
Department of Computer Science,
Stanford University
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Yi,
As you suggested this time I tried to install Samza on clean server (there is nothing installed on this server)
Still I am getting connection timeout error, Please find below command line outputs.
My System Admin/Dev Ops confirmed that this server does not have any firewall restrictions
[root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
/usr/lib/jvm/java-1.8.0-openjdk
[root@csadatlak-wc-a1t ~]# echo $PATH
/usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
[root@csadatlak-wc-a1t ~]# clear
[root@csadatlak-wc-a1t ~]# pwd
/root
[root@csadatlak-wc-a1t ~]# cd
[root@csadatlak-wc-a1t ~]# set -o vi
[root@csadatlak-wc-a1t ~]# ^Ct -o vi
[root@csadatlak-wc-a1t ~]#
[root@csadatlak-wc-a1t ~]#
[root@csadatlak-wc-a1t ~]#
[root@csadatlak-wc-a1t ~]#
[root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
[root@csadatlak-wc-a1t sanant003c]# ll
total 4
drwxr-xr-x 7 root root 4096 Sep 20 15:32 hello-samza
[root@csadatlak-wc-a1t sanant003c]# cd hello-samza/
[root@csadatlak-wc-a1t hello-samza]# ll
total 312
drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
-rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
-rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
-rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
-rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
-rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
-rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
-rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
-rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
drwxr-xr-x 3 root root 17 Sep 20 15:32 src
-rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
[root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
Bootstrapping the system...
EXECUTING: stop kafka
Kafka is not installed. Run: bin/grid install kafka
EXECUTING: stop yarn
YARN is not installed. Run: bin/grid install yarn
EXECUTING: stop zookeeper
Zookeeper is not installed. Run: bin/grid install zookeeper
EXECUTING: install samza
~/.samza/download /home/sanant003c/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
[root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Downloading kafka_2.11-0.10.1.1.tgz...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54 --:--:-- 620k
[root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Downloading hadoop-2.6.1.tar.gz...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28 --:--:-- 734k
[root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Downloading zookeeper-3.4.3.tar.gz...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21 --:--:-- 747k
[root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
EXECUTING: install samza
~/.samza/download /home/sanant003c/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Kindly help me to install Samza on my UNIX server
Regards,
~Sri
-----Original Message-----
From: Yi Pan [mailto:nickpan47@gmail.com]
Sent: Thursday, September 14, 2017 6:42 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
P.S., the attachment you post w/ the previous email does not show up (Apache mailing list disallow attachments). If would be better if you send the command line outputs in pure text or html format.
-Yi
On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Anantharaman,
>
> A lot of firewall setup prevents "incoming connections", not "outgoing
> connections" from a box. I.e. if you are downloading files, you are
> establishing outgoing connections and it is fine. When you are hosting
> a server (i.e. ZooKeeper or Kafka), you are making an "incoming connections"
> to the box and will trigger the firewall rules.
>
> Just trying to pin down the problem, could you try on a Linux box w/o
> any firewall rules setup and see whether that works? At least, verify
> that localhost resolves to 127.0.0.1 and try telnet locahost 9092 or 2181?
>
> NOTE: Success in ping simply means that you can access via ICMP, not
> guarantee you can establish TCP connection to the ports via firewall rules.
>
> -Yi
>
> On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha (Contractor)
> < Srinatha_Anantharaman@comcast.com> wrote:
>
>> That is a good catch Naveena the server which I am trying to install
>> is an Hadoop edge node, it has kafka broker and Zookeeper client
>> already installed for my Hadoop Does it matter If I am installing it
>> on a separate folder?. My guess Even if there are conflicts on
>> earlier installations it should throw some other error but not the
>> connection time out
>>
>> Coming to your question " it could either related resolving "localhost"
>> or firewall that prevents communication between ports" - how to prove
>> it is because of Firewall issue. I am able to clone Samza files from Apache git.
>> I can download any external files on this server
>>
>> ~Sri
>>
>> -----Original Message-----
>> From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> Sent: Thursday, September 14, 2017 2:51 PM
>> To: dev@samza.apache.org
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> I wonder if this has anything to do with previous kafka / zookeeper
>> installed on your box. Just for sanity, try clearing /tmp/zookeeeper*
>> and
>> /tmp/kafka* before re-trying those steps.
>>
>>
>> Same as Yi, I strongly suspect issues with your local laptop setup -
>> it could either related resolving "localhost" or firewall that
>> prevents communication between ports.
>>
>>
>> Navina
>>
>> ________________________________
>> From: Yi Pan <ni...@gmail.com>
>> Sent: Thursday, September 14, 2017 11:37:46 AM
>> To: dev@samza.apache.org
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> Hi, Anantharaman,
>>
>> I just did the same steps as you described in your email and all
>> passed on my box. Hence, I strongly suspect that it is related to
>> your local laptop network setup.
>>
>> Could you post all the command line output when you ran the sequence
>> of commands?
>>
>> -Yi
>>
>> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
>>
>> > Hi, Ananarath,
>> >
>> > It is very strange that you are seeing this timeout exception that
>> > we do not see. I am trying to follow the exact steps you did to see
>> > whether there is anything broken. I will update you this afternoon.
>> >
>> > Meanwhile, could you check your hostname setup and firewall
>> > configuration to see whether your local laptop has blocked access
>> > via the public IP address to your laptop? Could you verify that
>> > your localhost is resolved to
>> > 127.0.0.1 and is accessible?
>> >
>> > -Yi
>> >
>> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
>> > (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
>> >
>> >> Yi,
>> >>
>> >> Is there any alternate way to install Samza Or solution to the
>> >> connection time out error?
>> >>
>> >> Regards,
>> >> ~Sri
>> >>
>> >> From: Anantharaman, Srinatha (Contractor)
>> >> Sent: Wednesday, September 13, 2017 11:37 AM
>> >> To: dev@samza.apache.org
>> >> Subject: RE: Connection timed out error while installing "Hello Samza"
>> >>
>> >>
>> >> Yi,
>> >>
>> >>
>> >>
>> >> I am trying to build Samza locally by following the steps provided
>> >> by Navina.
>> >>
>> >> As per those steps kafka will be installed after Zookeeper, I am
>> >> getting Error while starting Zookeeper after it is installed
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> Steps Followed :
>> >>
>> >>
>> >>
>> >> Yes. You can clone apache/samza locally and build it with:
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> cd <samza-workspace>
>> >>
>> >>
>> >>
>> >> gradle -b bootstrap.gradle
>> >>
>> >>
>> >>
>> >> ./gradlew clean build -x test
>> >>
>> >>
>> >>
>> >> ./gradlew publishToMavenLocal ## This publishes a snapshot version
>> of
>> >> the latest apache/samza into your local maven repo
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> Then, head to hello-samza workspace and build again:
>> >>
>> >>
>> >>
>> >> cd <hello-samza-workspace>
>> >>
>> >>
>> >>
>> >> mvn clean package ## This should create a build target
>> >>
>> >>
>> >>
>> >> ./bin/grid install zookeeper
>> >>
>> >>
>> >>
>> >> ./bin/grid start zookeeper
>> >>
>> >>
>> >>
>> >> ./bin/grid install kafka
>> >>
>> >>
>> >>
>> >> ./bin/grid start kafka
>> >>
>> >>
>> >>
>> >> ./bin/grid install yarn
>> >>
>> >>
>> >>
>> >> ./bin/grid start yarn
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> mkdir -p deploy/samza
>> >>
>> >>
>> >>
>> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
>> >> deploy/samza
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> NOTE : BTW From the above steps I could not execute " gradle -b
>> >> bootstrap.gradle" since that command does not exists
>> >>
>> >>
>> >>
>> >> Regards,
>> >>
>> >> ~Sri
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: Yi Pan [mailto:nickpan47@gmail.com]
>> >> Sent: Tuesday, September 12, 2017 7:13 PM
>> >> To: dev@samza.apache.org<ma...@samza.apache.org>
>> >> Subject: Re: Connection timed out error while installing "Hello Samza"
>> >>
>> >>
>> >>
>> >> Hi, Anantharam,
>> >>
>> >>
>> >>
>> >> Could you confirm at which step your setup failed? It seems that
>> >> your zookeeper server is running. Could you check to see whether
>> >> your Kafka broker is running? You can either do a telnet localhost
>> >> 9092 or do a ps auxww | grep kafka to see whether you got any broker running.
>> >>
>> >>
>> >>
>> >> Sometimes, the Kafka service takes time to start on a single laptop.
>> >> You can just try to run ./bin/grid start kafka
>> >>
>> >>
>> >>
>> >> again to see whether the service is up.
>> >>
>> >>
>> >>
>> >> Thanks!
>> >>
>> >>
>> >>
>> >> -Yi
>> >>
>> >>
>> >>
>> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
>> >> (Contractor) <
>> >> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> >> an@comcast.com>> wrote:
>> >>
>> >>
>> >>
>> >> > Find below Zookeeper logs:
>> >>
>> >> >
>> >>
>> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
>> >> > [main:QuorumPeerConfig@101]
>> >> > -
>> >>
>> >> > Reading configuration from: /app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>> >>
>> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set
>> >> > to
>> >> > 3
>> >>
>> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to
>> >> > 0
>> >>
>> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@101]
>> >>
>> >> > - Purge task is not scheduled.
>> >>
>> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
>> >> > [main:QuorumPeerMain@113] -
>> >>
>> >> > Either no config or no quorum defined in config, running in
>> >>
>> >> > standalone mode
>> >>
>> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
>> >> > [main:QuorumPeerConfig@101]
>> >> > -
>> >>
>> >> > Reading configuration from: /app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>> >>
>> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
>> >> > [main:ZooKeeperServerMain@95]
>> >>
>> >> > - Starting server
>> >>
>> >> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
>> >> > 10:48
>> >>
>> >> > GMT
>> >>
>> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>> >>
>> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.version=1.8.0_31
>> >>
>> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.vendor=Oracle Corporation
>> >>
>> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>> >>
>> >> > 8.0.31-2.b13.el7.x86_64/jre
>> >>
>> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>> >>
>> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>> >>
>> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>> >>
>> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>> >>
>> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>> >>
>> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>> >>
>> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../conf:
>> >>
>> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>> >>
>> >> > usr/lib64:/lib64:/lib:/usr/lib
>> >>
>> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.io.tmpdir=/tmp
>> >>
>> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.compiler=<NA>
>> >>
>> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.name=Linux
>> >>
>> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.arch=amd64
>> >>
>> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>> >>
>> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.name=root
>> >>
>> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.home=/root
>> >>
>> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
>> >> > [main:ZooKeeperServer@733]
>> >> > -
>> >>
>> >> > tickTime set to 2000
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
>> >> > [main:ZooKeeperServer@742]
>> >> > -
>> >>
>> >> > minSessionTimeout set to -1
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
>> >> > [main:ZooKeeperServer@751]
>> >> > -
>> >>
>> >> > maxSessionTimeout set to -1
>> >>
>> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
>> >>
>> >> > [main:NIOServerCnxnFactory@110] - binding to port
>> >> > 0.0.0.0/0.0.0.0:2181
>> >>
>> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
>> >> > [main:FileTxnSnapLog@238] -
>> >>
>> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>> >>
>> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
>> >> > connection
>> >>
>> >> > from
>> >>
>> >> > /0:0:0:0:0:0:0:1:21754
>> >>
>> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>> >>
>> >> > EndOfStreamException: Unable to read additional data from client
>> >>
>> >> > sessionid 0x0, likely client has closed socket
>> >>
>> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>> >>
>> >> > NIOServerCnxn.java:220)
>> >>
>> >> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>> >>
>> >> > NIOServerCnxnFactory.java:224)
>> >>
>> >> > at java.lang.Thread.run(Thread.java:745)
>> >>
>> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
>> >> > client
>> >>
>> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>> >>
>> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
>> >> > connection
>> >>
>> >> > from /
>> >>
>> >> > 127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
>> >> > establish new
>> >>
>> >> > session at /127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
>> >> > [SyncThread:0:FileTxnLog@199]
>> >>
>> >> > - Creating new log file: log.1
>> >>
>> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
>> >>
>> >> > [SyncThread:0:ZooKeeperServer@604]
>> >>
>> >> > - Established session 0x15e770d61920000 with negotiated timeout
>> >> > 6000
>> >>
>> >> > for client /127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
>> >> > zxid:0x3
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode
>> >> > =
>> >>
>> >> > NoNode for /brokers
>> >>
>> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
>> >> > zxid:0x7
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode
>> >> > =
>> >>
>> >> > NoNode for /config
>> >>
>> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
>> >> > zxid:0xc
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /admin
>> >>
>> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
>> >> > zxid:0x11
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode
>> >> > =
>> >>
>> >> > NoNode for /cluster
>> >>
>> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>> >>
>> >> > zxid:0x15
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>> >>
>> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
>> >>
>> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
>> >> > zxid:0x17
>> >>
>> >> > txntype:-1 reqpath:n/a Error
>> >> > Path:/admin/preferred_replica_election
>> >>
>> >> > Error:KeeperErrorCode = NoNode for
>> >> > /admin/preferred_replica_election
>> >>
>> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
>> >> > zxid:0x18
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode
>> >> > =
>> >>
>> >> > NodeExists for /brokers
>> >>
>> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
>> >> > zxid:0x19
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
>> >> > Error:KeeperErrorCode =
>> >>
>> >> > NodeExists for /brokers/ids
>> >>
>> >> >
>> >>
>> >> >
>> >>
>> >> >
>> >>
>> >> > -----Original Message-----
>> >>
>> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
>> >>
>> >> > Sent: Tuesday, September 12, 2017 2:02 PM
>> >>
>> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> >
>> >>
>> >> > Hi, Anantharaman,
>> >>
>> >> >
>> >>
>> >> > Could you post your zookeeper startup logs here?
>> >>
>> >> >
>> >>
>> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
>> >> > (Contractor)
>> >>
>> >> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> >> an@comcast.com>> wrote:
>> >>
>> >> >
>> >>
>> >> > > It hangs while bringing up the service
>> >>
>> >> > >
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
>> >> > > zookeeper
>> >>
>> >> > > EXECUTING: install zookeeper
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/
>> >>
>> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > > ./bin/grid start zookeeper
>> >>
>> >> > > EXECUTING: start zookeeper
>> >>
>> >> > > JMX enabled by default
>> >>
>> >> > > Using config:
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > > bin/../conf/zoo.cfg
>> >>
>> >> > > Starting zookeeper ... STARTED
>> >>
>> >> > > Waiting for zookeeper to start...
>> >>
>> >> > >
>> >>
>> >> > > ^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
>> >> > > zookeeper^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
>> >> > > kafka
>> >>
>> >> > > EXECUTING: install kafka
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
>> >>
>> >> > > 11-0.10.1.1.tgz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>> >>
>> >> > > EXECUTING: start kafka
>> >>
>> >> > > Waiting for kafka to start...
>> >>
>> >> > > Ncat: Connection refused.
>> >>
>> >> > > .Ncat: Connection refused.
>> >>
>> >> > > .Ncat: Connection refused.
>> >>
>> >> > > .^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing
>> >> > > "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Yes. You can clone apache/samza locally and build it with:
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > cd <samza-workspace>
>> >>
>> >> > >
>> >>
>> >> > > gradle -b bootstrap.gradle
>> >>
>> >> > >
>> >>
>> >> > > ./gradlew clean build -x test
>> >>
>> >> > >
>> >>
>> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
>> version
>> >> of
>> >>
>> >> > > the latest apache/samza into your local maven repo
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Then, head to hello-samza workspace and build again:
>> >>
>> >> > >
>> >>
>> >> > > cd <hello-samza-workspace>
>> >>
>> >> > >
>> >>
>> >> > > mvn clean package ## This should create a build target
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install zookeeper
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start zookeeper
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install kafka
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start kafka
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install yarn
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start yarn
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > mkdir -p deploy/samza
>> >>
>> >> > >
>> >>
>> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
>> >> > > deploy/samza
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > After this, you can follow steps in the tutorial to "Run" the
>> >>
>> >> > > example Samza job.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > HTH! Let me know if you need further help.
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor)
>> >> > > <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: RE: Connection timed out error while installing
>> >> > > "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Navina,
>> >>
>> >> > >
>> >>
>> >> > > Is there any other way we can install Hello Samza?
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing
>> >> > > "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Ok. I tried again for the "latest" branch in hello-samza and
>> >> > > it
>> >>
>> >> > > still works.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > > While installing it says "Building samza from master..."
>> >>
>> >> > >
>> >>
>> >> > > It is expected to build from "master" in apache/samza repo.
>> >> > > So, the
>> >>
>> >> > > output line is expected.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > It is weird that you are unable to connect. Is it possible you
>> >> > > are
>> >>
>> >> > > behind a firewall or something? Can you try to ping "
>> git.apache.org"
>> >> ?
>> >>
>> >> > > Or try the setup on a different box?
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor)
>> >> > > <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: RE: Connection timed out error while installing
>> >> > > "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Navina,
>> >>
>> >> > >
>> >>
>> >> > > I tried again but still same error
>> >>
>> >> > >
>> >>
>> >> > > While installing it says "Building samza from master..."
>> >>
>> >> > >
>> >>
>> >> > > But when after I cloned I executed " git checkout latest"
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing
>> >> > > "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Hi Anantharaman,
>> >>
>> >> > >
>> >>
>> >> > > It looks like a transient connection failure to connect to
>> >> > > Apache's
>> >>
>> >> > > git. I tried on my host and it seems to be working.
>> >>
>> >> > >
>> >>
>> >> > > Can you give it another shot?
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > If it still doesn't work, please let me know if you are
>> >> > > running the
>> >>
>> >> > > command under the "master" or "latest" branch of samza-hello-samza.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Thanks!
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor)
>> >> > > <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Connection timed out error while installing "Hello Samza"
>> >>
>> >> > >
>> >>
>> >> > > Hi,
>> >>
>> >> > >
>> >>
>> >> > > I am trying to install "Hello Samza" on a single node
>> >> > > Initially I
>> >>
>> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
>> >> > > install
>> >>
>> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
>> >> > > getting
>> >>
>> >> > > connection timed out error It also mentions no kafka, yarn and
>> >>
>> >> > > zookeeper installed
>> >>
>> >> > >
>> >>
>> >> > > Please find below the error message
>> >>
>> >> > >
>> >>
>> >> > > [root@codehdplak-po-r19p bin]# cd ..
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>> >>
>> >> > > EXECUTING: install kafka
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
>> >>
>> >> > > 11-0.10.1.1.tgz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>> >>
>> >> > > EXECUTING: install yarn
>> >>
>> >> > > Using previously downloaded file
>> >>
>> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
>> >> > > zookeeper
>> >>
>> >> > > EXECUTING: install zookeeper
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/
>> >>
>> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > > bin/grid bootstrap Bootstrapping the system...
>> >>
>> >> > > EXECUTING: stop kafka
>> >>
>> >> > > No kafka server to stop
>> >>
>> >> > > EXECUTING: stop yarn
>> >>
>> >> > > no resourcemanager to stop
>> >>
>> >> > > no nodemanager to stop
>> >>
>> >> > > EXECUTING: stop zookeeper
>> >>
>> >> > > JMX enabled by default
>> >>
>> >> > > Using config:
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > > bin/../conf/zoo.cfg
>> >>
>> >> > > Stopping zookeeper ... no zookeeper to stop (could not find
>> >> > > file
>> >>
>> >> > > /tmp/zookeeper/zookeeper_server.pid)
>> >>
>> >> > > EXECUTING: install samza
>> >>
>> >> > > Building samza from master...
>> >>
>> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>> >>
>> >> > > Cloning into 'samza'...
>> >>
>> >> > > fatal: unable to connect to git.apache.org:
>> >>
>> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Could you please help me to resolve this issue?
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> >
>> >>
>> >
>> >
>>
>
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
P.S., the attachment you post w/ the previous email does not show up
(Apache mailing list disallow attachments). If would be better if you send
the command line outputs in pure text or html format.
-Yi
On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Anantharaman,
>
> A lot of firewall setup prevents "incoming connections", not "outgoing
> connections" from a box. I.e. if you are downloading files, you are
> establishing outgoing connections and it is fine. When you are hosting a
> server (i.e. ZooKeeper or Kafka), you are making an "incoming connections"
> to the box and will trigger the firewall rules.
>
> Just trying to pin down the problem, could you try on a Linux box w/o any
> firewall rules setup and see whether that works? At least, verify that
> localhost resolves to 127.0.0.1 and try telnet locahost 9092 or 2181?
>
> NOTE: Success in ping simply means that you can access via ICMP, not
> guarantee you can establish TCP connection to the ports via firewall rules.
>
> -Yi
>
> On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
>> That is a good catch Naveena the server which I am trying to install is
>> an Hadoop edge node, it has kafka broker and Zookeeper client already
>> installed for my Hadoop
>> Does it matter If I am installing it on a separate folder?. My guess Even
>> if there are conflicts on earlier installations it should throw some other
>> error but not the connection time out
>>
>> Coming to your question " it could either related resolving "localhost"
>> or firewall that prevents communication between ports" - how to prove it is
>> because of Firewall issue. I am able to clone Samza files from Apache git.
>> I can download any external files on this server
>>
>> ~Sri
>>
>> -----Original Message-----
>> From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> Sent: Thursday, September 14, 2017 2:51 PM
>> To: dev@samza.apache.org
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> I wonder if this has anything to do with previous kafka / zookeeper
>> installed on your box. Just for sanity, try clearing /tmp/zookeeeper* and
>> /tmp/kafka* before re-trying those steps.
>>
>>
>> Same as Yi, I strongly suspect issues with your local laptop setup - it
>> could either related resolving "localhost" or firewall that prevents
>> communication between ports.
>>
>>
>> Navina
>>
>> ________________________________
>> From: Yi Pan <ni...@gmail.com>
>> Sent: Thursday, September 14, 2017 11:37:46 AM
>> To: dev@samza.apache.org
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> Hi, Anantharaman,
>>
>> I just did the same steps as you described in your email and all passed
>> on my box. Hence, I strongly suspect that it is related to your local
>> laptop network setup.
>>
>> Could you post all the command line output when you ran the sequence of
>> commands?
>>
>> -Yi
>>
>> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
>>
>> > Hi, Ananarath,
>> >
>> > It is very strange that you are seeing this timeout exception that we
>> > do not see. I am trying to follow the exact steps you did to see
>> > whether there is anything broken. I will update you this afternoon.
>> >
>> > Meanwhile, could you check your hostname setup and firewall
>> > configuration to see whether your local laptop has blocked access via
>> > the public IP address to your laptop? Could you verify that your
>> > localhost is resolved to
>> > 127.0.0.1 and is accessible?
>> >
>> > -Yi
>> >
>> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor)
>> > < Srinatha_Anantharaman@comcast.com> wrote:
>> >
>> >> Yi,
>> >>
>> >> Is there any alternate way to install Samza Or solution to the
>> >> connection time out error?
>> >>
>> >> Regards,
>> >> ~Sri
>> >>
>> >> From: Anantharaman, Srinatha (Contractor)
>> >> Sent: Wednesday, September 13, 2017 11:37 AM
>> >> To: dev@samza.apache.org
>> >> Subject: RE: Connection timed out error while installing "Hello Samza"
>> >>
>> >>
>> >> Yi,
>> >>
>> >>
>> >>
>> >> I am trying to build Samza locally by following the steps provided by
>> >> Navina.
>> >>
>> >> As per those steps kafka will be installed after Zookeeper, I am
>> >> getting Error while starting Zookeeper after it is installed
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> Steps Followed :
>> >>
>> >>
>> >>
>> >> Yes. You can clone apache/samza locally and build it with:
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> cd <samza-workspace>
>> >>
>> >>
>> >>
>> >> gradle -b bootstrap.gradle
>> >>
>> >>
>> >>
>> >> ./gradlew clean build -x test
>> >>
>> >>
>> >>
>> >> ./gradlew publishToMavenLocal ## This publishes a snapshot version
>> of
>> >> the latest apache/samza into your local maven repo
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> Then, head to hello-samza workspace and build again:
>> >>
>> >>
>> >>
>> >> cd <hello-samza-workspace>
>> >>
>> >>
>> >>
>> >> mvn clean package ## This should create a build target
>> >>
>> >>
>> >>
>> >> ./bin/grid install zookeeper
>> >>
>> >>
>> >>
>> >> ./bin/grid start zookeeper
>> >>
>> >>
>> >>
>> >> ./bin/grid install kafka
>> >>
>> >>
>> >>
>> >> ./bin/grid start kafka
>> >>
>> >>
>> >>
>> >> ./bin/grid install yarn
>> >>
>> >>
>> >>
>> >> ./bin/grid start yarn
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> mkdir -p deploy/samza
>> >>
>> >>
>> >>
>> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> NOTE : BTW From the above steps I could not execute " gradle -b
>> >> bootstrap.gradle" since that command does not exists
>> >>
>> >>
>> >>
>> >> Regards,
>> >>
>> >> ~Sri
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: Yi Pan [mailto:nickpan47@gmail.com]
>> >> Sent: Tuesday, September 12, 2017 7:13 PM
>> >> To: dev@samza.apache.org<ma...@samza.apache.org>
>> >> Subject: Re: Connection timed out error while installing "Hello Samza"
>> >>
>> >>
>> >>
>> >> Hi, Anantharam,
>> >>
>> >>
>> >>
>> >> Could you confirm at which step your setup failed? It seems that your
>> >> zookeeper server is running. Could you check to see whether your
>> >> Kafka broker is running? You can either do a telnet localhost 9092 or
>> >> do a ps auxww | grep kafka to see whether you got any broker running.
>> >>
>> >>
>> >>
>> >> Sometimes, the Kafka service takes time to start on a single laptop.
>> >> You can just try to run ./bin/grid start kafka
>> >>
>> >>
>> >>
>> >> again to see whether the service is up.
>> >>
>> >>
>> >>
>> >> Thanks!
>> >>
>> >>
>> >>
>> >> -Yi
>> >>
>> >>
>> >>
>> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor)
>> >> < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> >> an@comcast.com>> wrote:
>> >>
>> >>
>> >>
>> >> > Find below Zookeeper logs:
>> >>
>> >> >
>> >>
>> >> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101]
>> >> > -
>> >>
>> >> > Reading configuration from: /app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>> >>
>> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to
>> >> > 3
>> >>
>> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>> >>
>> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@101]
>> >>
>> >> > - Purge task is not scheduled.
>> >>
>> >> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
>> >>
>> >> > Either no config or no quorum defined in config, running in
>> >>
>> >> > standalone mode
>> >>
>> >> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101]
>> >> > -
>> >>
>> >> > Reading configuration from: /app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>> >>
>> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
>> >> > [main:ZooKeeperServerMain@95]
>> >>
>> >> > - Starting server
>> >>
>> >> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
>> >> > 10:48
>> >>
>> >> > GMT
>> >>
>> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>> >>
>> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.version=1.8.0_31
>> >>
>> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.vendor=Oracle Corporation
>> >>
>> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>> >>
>> >> > 8.0.31-2.b13.el7.x86_64/jre
>> >>
>> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>> >>
>> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>> >>
>> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>> >>
>> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>> >>
>> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>> >>
>> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>> >>
>> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../conf:
>> >>
>> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>> >>
>> >> > usr/lib64:/lib64:/lib:/usr/lib
>> >>
>> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.io.tmpdir=/tmp
>> >>
>> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.compiler=<NA>
>> >>
>> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.name=Linux
>> >>
>> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.arch=amd64
>> >>
>> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>> >>
>> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.name=root
>> >>
>> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.home=/root
>> >>
>> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733]
>> >> > -
>> >>
>> >> > tickTime set to 2000
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742]
>> >> > -
>> >>
>> >> > minSessionTimeout set to -1
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751]
>> >> > -
>> >>
>> >> > maxSessionTimeout set to -1
>> >>
>> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
>> >>
>> >> > [main:NIOServerCnxnFactory@110] - binding to port
>> >> > 0.0.0.0/0.0.0.0:2181
>> >>
>> >> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
>> >>
>> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>> >>
>> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>> >>
>> >> > from
>> >>
>> >> > /0:0:0:0:0:0:0:1:21754
>> >>
>> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>> >>
>> >> > EndOfStreamException: Unable to read additional data from client
>> >>
>> >> > sessionid 0x0, likely client has closed socket
>> >>
>> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>> >>
>> >> > NIOServerCnxn.java:220)
>> >>
>> >> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>> >>
>> >> > NIOServerCnxnFactory.java:224)
>> >>
>> >> > at java.lang.Thread.run(Thread.java:745)
>> >>
>> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
>> >> > client
>> >>
>> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>> >>
>> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>> >>
>> >> > from /
>> >>
>> >> > 127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish
>> >> > new
>> >>
>> >> > session at /127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
>> >> > [SyncThread:0:FileTxnLog@199]
>> >>
>> >> > - Creating new log file: log.1
>> >>
>> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
>> >>
>> >> > [SyncThread:0:ZooKeeperServer@604]
>> >>
>> >> > - Established session 0x15e770d61920000 with negotiated timeout
>> >> > 6000
>> >>
>> >> > for client /127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
>> >> > zxid:0x3
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /brokers
>> >>
>> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
>> >> > zxid:0x7
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /config
>> >>
>> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
>> >> > zxid:0xc
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /admin
>> >>
>> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
>> >> > zxid:0x11
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /cluster
>> >>
>> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>> >>
>> >> > zxid:0x15
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>> >>
>> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
>> >>
>> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
>> >> > zxid:0x17
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>> >>
>> >> > Error:KeeperErrorCode = NoNode for
>> >> > /admin/preferred_replica_election
>> >>
>> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
>> >> > zxid:0x18
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>> >>
>> >> > NodeExists for /brokers
>> >>
>> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
>> >> > zxid:0x19
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
>> >> > Error:KeeperErrorCode =
>> >>
>> >> > NodeExists for /brokers/ids
>> >>
>> >> >
>> >>
>> >> >
>> >>
>> >> >
>> >>
>> >> > -----Original Message-----
>> >>
>> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
>> >>
>> >> > Sent: Tuesday, September 12, 2017 2:02 PM
>> >>
>> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> >
>> >>
>> >> > Hi, Anantharaman,
>> >>
>> >> >
>> >>
>> >> > Could you post your zookeeper startup logs here?
>> >>
>> >> >
>> >>
>> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
>> >> > (Contractor)
>> >>
>> >> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> >> an@comcast.com>> wrote:
>> >>
>> >> >
>> >>
>> >> > > It hangs while bringing up the service
>> >>
>> >> > >
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
>> >> > > zookeeper
>> >>
>> >> > > EXECUTING: install zookeeper
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/
>> >>
>> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > > ./bin/grid start zookeeper
>> >>
>> >> > > EXECUTING: start zookeeper
>> >>
>> >> > > JMX enabled by default
>> >>
>> >> > > Using config:
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > > bin/../conf/zoo.cfg
>> >>
>> >> > > Starting zookeeper ... STARTED
>> >>
>> >> > > Waiting for zookeeper to start...
>> >>
>> >> > >
>> >>
>> >> > > ^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
>> >> > > zookeeper^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>> >>
>> >> > > EXECUTING: install kafka
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
>> >>
>> >> > > 11-0.10.1.1.tgz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>> >>
>> >> > > EXECUTING: start kafka
>> >>
>> >> > > Waiting for kafka to start...
>> >>
>> >> > > Ncat: Connection refused.
>> >>
>> >> > > .Ncat: Connection refused.
>> >>
>> >> > > .Ncat: Connection refused.
>> >>
>> >> > > .^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Yes. You can clone apache/samza locally and build it with:
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > cd <samza-workspace>
>> >>
>> >> > >
>> >>
>> >> > > gradle -b bootstrap.gradle
>> >>
>> >> > >
>> >>
>> >> > > ./gradlew clean build -x test
>> >>
>> >> > >
>> >>
>> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
>> version
>> >> of
>> >>
>> >> > > the latest apache/samza into your local maven repo
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Then, head to hello-samza workspace and build again:
>> >>
>> >> > >
>> >>
>> >> > > cd <hello-samza-workspace>
>> >>
>> >> > >
>> >>
>> >> > > mvn clean package ## This should create a build target
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install zookeeper
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start zookeeper
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install kafka
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start kafka
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install yarn
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start yarn
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > mkdir -p deploy/samza
>> >>
>> >> > >
>> >>
>> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
>> >> > > deploy/samza
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > After this, you can follow steps in the tutorial to "Run" the
>> >>
>> >> > > example Samza job.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > HTH! Let me know if you need further help.
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: RE: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Navina,
>> >>
>> >> > >
>> >>
>> >> > > Is there any other way we can install Hello Samza?
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Ok. I tried again for the "latest" branch in hello-samza and it
>> >>
>> >> > > still works.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > > While installing it says "Building samza from master..."
>> >>
>> >> > >
>> >>
>> >> > > It is expected to build from "master" in apache/samza repo. So,
>> >> > > the
>> >>
>> >> > > output line is expected.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > It is weird that you are unable to connect. Is it possible you
>> >> > > are
>> >>
>> >> > > behind a firewall or something? Can you try to ping "
>> git.apache.org"
>> >> ?
>> >>
>> >> > > Or try the setup on a different box?
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: RE: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Navina,
>> >>
>> >> > >
>> >>
>> >> > > I tried again but still same error
>> >>
>> >> > >
>> >>
>> >> > > While installing it says "Building samza from master..."
>> >>
>> >> > >
>> >>
>> >> > > But when after I cloned I executed " git checkout latest"
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Hi Anantharaman,
>> >>
>> >> > >
>> >>
>> >> > > It looks like a transient connection failure to connect to
>> >> > > Apache's
>> >>
>> >> > > git. I tried on my host and it seems to be working.
>> >>
>> >> > >
>> >>
>> >> > > Can you give it another shot?
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > If it still doesn't work, please let me know if you are running
>> >> > > the
>> >>
>> >> > > command under the "master" or "latest" branch of samza-hello-samza.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Thanks!
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>> >>
>> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>> >>
>> >> > > Subject: Connection timed out error while installing "Hello Samza"
>> >>
>> >> > >
>> >>
>> >> > > Hi,
>> >>
>> >> > >
>> >>
>> >> > > I am trying to install "Hello Samza" on a single node Initially I
>> >>
>> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
>> >>
>> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>> >>
>> >> > > connection timed out error It also mentions no kafka, yarn and
>> >>
>> >> > > zookeeper installed
>> >>
>> >> > >
>> >>
>> >> > > Please find below the error message
>> >>
>> >> > >
>> >>
>> >> > > [root@codehdplak-po-r19p bin]# cd ..
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>> >>
>> >> > > EXECUTING: install kafka
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
>> >>
>> >> > > 11-0.10.1.1.tgz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>> >>
>> >> > > EXECUTING: install yarn
>> >>
>> >> > > Using previously downloaded file
>> >>
>> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>> >>
>> >> > > EXECUTING: install zookeeper
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/
>> >>
>> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > > bin/grid bootstrap Bootstrapping the system...
>> >>
>> >> > > EXECUTING: stop kafka
>> >>
>> >> > > No kafka server to stop
>> >>
>> >> > > EXECUTING: stop yarn
>> >>
>> >> > > no resourcemanager to stop
>> >>
>> >> > > no nodemanager to stop
>> >>
>> >> > > EXECUTING: stop zookeeper
>> >>
>> >> > > JMX enabled by default
>> >>
>> >> > > Using config:
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > > bin/../conf/zoo.cfg
>> >>
>> >> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>> >>
>> >> > > /tmp/zookeeper/zookeeper_server.pid)
>> >>
>> >> > > EXECUTING: install samza
>> >>
>> >> > > Building samza from master...
>> >>
>> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>> >>
>> >> > > Cloning into 'samza'...
>> >>
>> >> > > fatal: unable to connect to git.apache.org:
>> >>
>> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Could you please help me to resolve this issue?
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> >
>> >>
>> >
>> >
>>
>
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
Hi, Anantharaman,
A lot of firewall setup prevents "incoming connections", not "outgoing
connections" from a box. I.e. if you are downloading files, you are
establishing outgoing connections and it is fine. When you are hosting a
server (i.e. ZooKeeper or Kafka), you are making an "incoming connections"
to the box and will trigger the firewall rules.
Just trying to pin down the problem, could you try on a Linux box w/o any
firewall rules setup and see whether that works? At least, verify that
localhost resolves to 127.0.0.1 and try telnet locahost 9092 or 2181?
NOTE: Success in ping simply means that you can access via ICMP, not
guarantee you can establish TCP connection to the ports via firewall rules.
-Yi
On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> That is a good catch Naveena the server which I am trying to install is an
> Hadoop edge node, it has kafka broker and Zookeeper client already
> installed for my Hadoop
> Does it matter If I am installing it on a separate folder?. My guess Even
> if there are conflicts on earlier installations it should throw some other
> error but not the connection time out
>
> Coming to your question " it could either related resolving "localhost" or
> firewall that prevents communication between ports" - how to prove it is
> because of Firewall issue. I am able to clone Samza files from Apache git.
> I can download any external files on this server
>
> ~Sri
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> Sent: Thursday, September 14, 2017 2:51 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> I wonder if this has anything to do with previous kafka / zookeeper
> installed on your box. Just for sanity, try clearing /tmp/zookeeeper* and
> /tmp/kafka* before re-trying those steps.
>
>
> Same as Yi, I strongly suspect issues with your local laptop setup - it
> could either related resolving "localhost" or firewall that prevents
> communication between ports.
>
>
> Navina
>
> ________________________________
> From: Yi Pan <ni...@gmail.com>
> Sent: Thursday, September 14, 2017 11:37:46 AM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi, Anantharaman,
>
> I just did the same steps as you described in your email and all passed on
> my box. Hence, I strongly suspect that it is related to your local laptop
> network setup.
>
> Could you post all the command line output when you ran the sequence of
> commands?
>
> -Yi
>
> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
>
> > Hi, Ananarath,
> >
> > It is very strange that you are seeing this timeout exception that we
> > do not see. I am trying to follow the exact steps you did to see
> > whether there is anything broken. I will update you this afternoon.
> >
> > Meanwhile, could you check your hostname setup and firewall
> > configuration to see whether your local laptop has blocked access via
> > the public IP address to your laptop? Could you verify that your
> > localhost is resolved to
> > 127.0.0.1 and is accessible?
> >
> > -Yi
> >
> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor)
> > < Srinatha_Anantharaman@comcast.com> wrote:
> >
> >> Yi,
> >>
> >> Is there any alternate way to install Samza Or solution to the
> >> connection time out error?
> >>
> >> Regards,
> >> ~Sri
> >>
> >> From: Anantharaman, Srinatha (Contractor)
> >> Sent: Wednesday, September 13, 2017 11:37 AM
> >> To: dev@samza.apache.org
> >> Subject: RE: Connection timed out error while installing "Hello Samza"
> >>
> >>
> >> Yi,
> >>
> >>
> >>
> >> I am trying to build Samza locally by following the steps provided by
> >> Navina.
> >>
> >> As per those steps kafka will be installed after Zookeeper, I am
> >> getting Error while starting Zookeeper after it is installed
> >>
> >>
> >>
> >>
> >>
> >> Steps Followed :
> >>
> >>
> >>
> >> Yes. You can clone apache/samza locally and build it with:
> >>
> >>
> >>
> >>
> >>
> >> cd <samza-workspace>
> >>
> >>
> >>
> >> gradle -b bootstrap.gradle
> >>
> >>
> >>
> >> ./gradlew clean build -x test
> >>
> >>
> >>
> >> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> >> the latest apache/samza into your local maven repo
> >>
> >>
> >>
> >>
> >>
> >> Then, head to hello-samza workspace and build again:
> >>
> >>
> >>
> >> cd <hello-samza-workspace>
> >>
> >>
> >>
> >> mvn clean package ## This should create a build target
> >>
> >>
> >>
> >> ./bin/grid install zookeeper
> >>
> >>
> >>
> >> ./bin/grid start zookeeper
> >>
> >>
> >>
> >> ./bin/grid install kafka
> >>
> >>
> >>
> >> ./bin/grid start kafka
> >>
> >>
> >>
> >> ./bin/grid install yarn
> >>
> >>
> >>
> >> ./bin/grid start yarn
> >>
> >>
> >>
> >>
> >>
> >> mkdir -p deploy/samza
> >>
> >>
> >>
> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
> >>
> >>
> >>
> >>
> >>
> >> NOTE : BTW From the above steps I could not execute " gradle -b
> >> bootstrap.gradle" since that command does not exists
> >>
> >>
> >>
> >> Regards,
> >>
> >> ~Sri
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Yi Pan [mailto:nickpan47@gmail.com]
> >> Sent: Tuesday, September 12, 2017 7:13 PM
> >> To: dev@samza.apache.org<ma...@samza.apache.org>
> >> Subject: Re: Connection timed out error while installing "Hello Samza"
> >>
> >>
> >>
> >> Hi, Anantharam,
> >>
> >>
> >>
> >> Could you confirm at which step your setup failed? It seems that your
> >> zookeeper server is running. Could you check to see whether your
> >> Kafka broker is running? You can either do a telnet localhost 9092 or
> >> do a ps auxww | grep kafka to see whether you got any broker running.
> >>
> >>
> >>
> >> Sometimes, the Kafka service takes time to start on a single laptop.
> >> You can just try to run ./bin/grid start kafka
> >>
> >>
> >>
> >> again to see whether the service is up.
> >>
> >>
> >>
> >> Thanks!
> >>
> >>
> >>
> >> -Yi
> >>
> >>
> >>
> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor)
> >> < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> >> an@comcast.com>> wrote:
> >>
> >>
> >>
> >> > Find below Zookeeper logs:
> >>
> >> >
> >>
> >> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101]
> >> > -
> >>
> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> >>
> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> >>
> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> >>
> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to
> >> > 3
> >>
> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> >>
> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
> >>
> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> >>
> >> > [main:DatadirCleanupManager@101]
> >>
> >> > - Purge task is not scheduled.
> >>
> >> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
> >>
> >> > Either no config or no quorum defined in config, running in
> >>
> >> > standalone mode
> >>
> >> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101]
> >> > -
> >>
> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> >>
> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> >>
> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> >> > [main:ZooKeeperServerMain@95]
> >>
> >> > - Starting server
> >>
> >> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
> >> > 10:48
> >>
> >> > GMT
> >>
> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> >>
> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:java.version=1.8.0_31
> >>
> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:java.vendor=Oracle Corporation
> >>
> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> >>
> >> > 8.0.31-2.b13.el7.x86_64/jre
> >>
> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> >>
> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> >>
> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >>
> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> >>
> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> >>
> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >>
> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> >>
> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> >>
> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> >>
> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> >>
> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >>
> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> >>
> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> >>
> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> >>
> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> >>
> >> > samza/deploy/zookeeper/bin/../conf:
> >>
> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
> >>
> >> > usr/lib64:/lib64:/lib:/usr/lib
> >>
> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:java.io.tmpdir=/tmp
> >>
> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:java.compiler=<NA>
> >>
> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:os.name=Linux
> >>
> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:os.arch=amd64
> >>
> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> >>
> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:user.name=root
> >>
> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:user.home=/root
> >>
> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
> >> > Server
> >>
> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> >>
> >> > samza/deploy/zookeeper
> >>
> >> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733]
> >> > -
> >>
> >> > tickTime set to 2000
> >>
> >> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742]
> >> > -
> >>
> >> > minSessionTimeout set to -1
> >>
> >> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751]
> >> > -
> >>
> >> > maxSessionTimeout set to -1
> >>
> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> >>
> >> > [main:NIOServerCnxnFactory@110] - binding to port
> >> > 0.0.0.0/0.0.0.0:2181
> >>
> >> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
> >>
> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> >>
> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> >> > [NIOServerCxn.Factory:0.0.0.0/
> >>
> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
> >>
> >> > from
> >>
> >> > /0:0:0:0:0:0:0:1:21754
> >>
> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> >> > [NIOServerCxn.Factory:0.0.0.0/
> >>
> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
> >>
> >> > EndOfStreamException: Unable to read additional data from client
> >>
> >> > sessionid 0x0, likely client has closed socket
> >>
> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> >>
> >> > NIOServerCnxn.java:220)
> >>
> >> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> >>
> >> > NIOServerCnxnFactory.java:224)
> >>
> >> > at java.lang.Thread.run(Thread.java:745)
> >>
> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> >> > [NIOServerCxn.Factory:0.0.0.0/
> >>
> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
> >> > client
> >>
> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> >>
> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> >> > [NIOServerCxn.Factory:0.0.0.0/
> >>
> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
> >>
> >> > from /
> >>
> >> > 127.0.0.1:48071
> >>
> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> >> > [NIOServerCxn.Factory:0.0.0.0/
> >>
> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish
> >> > new
> >>
> >> > session at /127.0.0.1:48071
> >>
> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> >> > [SyncThread:0:FileTxnLog@199]
> >>
> >> > - Creating new log file: log.1
> >>
> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> >>
> >> > [SyncThread:0:ZooKeeperServer@604]
> >>
> >> > - Established session 0x15e770d61920000 with negotiated timeout
> >> > 6000
> >>
> >> > for client /127.0.0.1:48071
> >>
> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
> >> > zxid:0x3
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
> >>
> >> > NoNode for /brokers
> >>
> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
> >> > zxid:0x7
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
> >>
> >> > NoNode for /config
> >>
> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
> >> > zxid:0xc
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
> >>
> >> > NoNode for /admin
> >>
> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
> >> > zxid:0x11
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
> >>
> >> > NoNode for /cluster
> >>
> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
> >>
> >> > zxid:0x15
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> >>
> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> >>
> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
> >> > zxid:0x17
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
> >>
> >> > Error:KeeperErrorCode = NoNode for
> >> > /admin/preferred_replica_election
> >>
> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
> >> > zxid:0x18
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
> >>
> >> > NodeExists for /brokers
> >>
> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0
> cport:-1)::
> >>
> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
> >>
> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
> >> > zxid:0x19
> >>
> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> >> > Error:KeeperErrorCode =
> >>
> >> > NodeExists for /brokers/ids
> >>
> >> >
> >>
> >> >
> >>
> >> >
> >>
> >> > -----Original Message-----
> >>
> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
> >>
> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> >>
> >> > To: dev@samza.apache.org<ma...@samza.apache.org>
> >>
> >> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >>
> >> >
> >>
> >> > Hi, Anantharaman,
> >>
> >> >
> >>
> >> > Could you post your zookeeper startup logs here?
> >>
> >> >
> >>
> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> >> > (Contractor)
> >>
> >> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
> >> an@comcast.com>> wrote:
> >>
> >> >
> >>
> >> > > It hangs while bringing up the service
> >>
> >> > >
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> >>
> >> > > /app/home/eventsvc/samza-git/hello-samza
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
> >> > > zookeeper
> >>
> >> > > EXECUTING: install zookeeper
> >>
> >> > > Using previously downloaded file /root/.samza/download/
> >>
> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> >>
> >> > > ./bin/grid start zookeeper
> >>
> >> > > EXECUTING: start zookeeper
> >>
> >> > > JMX enabled by default
> >>
> >> > > Using config:
> >>
> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >>
> >> > > bin/../conf/zoo.cfg
> >>
> >> > > Starting zookeeper ... STARTED
> >>
> >> > > Waiting for zookeeper to start...
> >>
> >> > >
> >>
> >> > > ^C
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> >> > > zookeeper^C
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
> >>
> >> > > EXECUTING: install kafka
> >>
> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> >>
> >> > > 11-0.10.1.1.tgz
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
> >>
> >> > > EXECUTING: start kafka
> >>
> >> > > Waiting for kafka to start...
> >>
> >> > > Ncat: Connection refused.
> >>
> >> > > .Ncat: Connection refused.
> >>
> >> > > .Ncat: Connection refused.
> >>
> >> > > .^C
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]#
> >>
> >> > >
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > -----Original Message-----
> >>
> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >>
> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> >>
> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >>
> >> > > Subject: Re: Connection timed out error while installing "Hello
> Samza"
> >>
> >> > >
> >>
> >> > > Yes. You can clone apache/samza locally and build it with:
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > cd <samza-workspace>
> >>
> >> > >
> >>
> >> > > gradle -b bootstrap.gradle
> >>
> >> > >
> >>
> >> > > ./gradlew clean build -x test
> >>
> >> > >
> >>
> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot
> version
> >> of
> >>
> >> > > the latest apache/samza into your local maven repo
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > Then, head to hello-samza workspace and build again:
> >>
> >> > >
> >>
> >> > > cd <hello-samza-workspace>
> >>
> >> > >
> >>
> >> > > mvn clean package ## This should create a build target
> >>
> >> > >
> >>
> >> > > ./bin/grid install zookeeper
> >>
> >> > >
> >>
> >> > > ./bin/grid start zookeeper
> >>
> >> > >
> >>
> >> > > ./bin/grid install kafka
> >>
> >> > >
> >>
> >> > > ./bin/grid start kafka
> >>
> >> > >
> >>
> >> > > ./bin/grid install yarn
> >>
> >> > >
> >>
> >> > > ./bin/grid start yarn
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > mkdir -p deploy/samza
> >>
> >> > >
> >>
> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> >> > > deploy/samza
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > After this, you can follow steps in the tutorial to "Run" the
> >>
> >> > > example Samza job.
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > HTH! Let me know if you need further help.
> >>
> >> > >
> >>
> >> > > Navina
> >>
> >> > >
> >>
> >> > > ________________________________
> >>
> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> >>
> >> > > comcast.com>
> >>
> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> >>
> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >>
> >> > > Subject: RE: Connection timed out error while installing "Hello
> Samza"
> >>
> >> > >
> >>
> >> > > Navina,
> >>
> >> > >
> >>
> >> > > Is there any other way we can install Hello Samza?
> >>
> >> > >
> >>
> >> > > Regards,
> >>
> >> > > ~Sri
> >>
> >> > >
> >>
> >> > > -----Original Message-----
> >>
> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >>
> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> >>
> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >>
> >> > > Subject: Re: Connection timed out error while installing "Hello
> Samza"
> >>
> >> > >
> >>
> >> > > Ok. I tried again for the "latest" branch in hello-samza and it
> >>
> >> > > still works.
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > > While installing it says "Building samza from master..."
> >>
> >> > >
> >>
> >> > > It is expected to build from "master" in apache/samza repo. So,
> >> > > the
> >>
> >> > > output line is expected.
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > It is weird that you are unable to connect. Is it possible you
> >> > > are
> >>
> >> > > behind a firewall or something? Can you try to ping "git.apache.org
> "
> >> ?
> >>
> >> > > Or try the setup on a different box?
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > Navina
> >>
> >> > >
> >>
> >> > > ________________________________
> >>
> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> >>
> >> > > comcast.com>
> >>
> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> >>
> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >>
> >> > > Subject: RE: Connection timed out error while installing "Hello
> Samza"
> >>
> >> > >
> >>
> >> > > Navina,
> >>
> >> > >
> >>
> >> > > I tried again but still same error
> >>
> >> > >
> >>
> >> > > While installing it says "Building samza from master..."
> >>
> >> > >
> >>
> >> > > But when after I cloned I executed " git checkout latest"
> >>
> >> > >
> >>
> >> > > Regards,
> >>
> >> > > ~Sri
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > -----Original Message-----
> >>
> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> >>
> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> >>
> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >>
> >> > > Subject: Re: Connection timed out error while installing "Hello
> Samza"
> >>
> >> > >
> >>
> >> > > Hi Anantharaman,
> >>
> >> > >
> >>
> >> > > It looks like a transient connection failure to connect to
> >> > > Apache's
> >>
> >> > > git. I tried on my host and it seems to be working.
> >>
> >> > >
> >>
> >> > > Can you give it another shot?
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > If it still doesn't work, please let me know if you are running
> >> > > the
> >>
> >> > > command under the "master" or "latest" branch of samza-hello-samza.
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > Thanks!
> >>
> >> > >
> >>
> >> > > Navina
> >>
> >> > >
> >>
> >> > > ________________________________
> >>
> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> >>
> >> > > comcast.com>
> >>
> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> >>
> >> > > To: dev@samza.apache.org<ma...@samza.apache.org>
> >>
> >> > > Subject: Connection timed out error while installing "Hello Samza"
> >>
> >> > >
> >>
> >> > > Hi,
> >>
> >> > >
> >>
> >> > > I am trying to install "Hello Samza" on a single node Initially I
> >>
> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
> >>
> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
> >>
> >> > > connection timed out error It also mentions no kafka, yarn and
> >>
> >> > > zookeeper installed
> >>
> >> > >
> >>
> >> > > Please find below the error message
> >>
> >> > >
> >>
> >> > > [root@codehdplak-po-r19p bin]# cd ..
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
> >>
> >> > > EXECUTING: install kafka
> >>
> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
> >>
> >> > > 11-0.10.1.1.tgz
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> >>
> >> > > EXECUTING: install yarn
> >>
> >> > > Using previously downloaded file
> >>
> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> >>
> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
> >>
> >> > > EXECUTING: install zookeeper
> >>
> >> > > Using previously downloaded file /root/.samza/download/
> >>
> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> >>
> >> > > bin/grid bootstrap Bootstrapping the system...
> >>
> >> > > EXECUTING: stop kafka
> >>
> >> > > No kafka server to stop
> >>
> >> > > EXECUTING: stop yarn
> >>
> >> > > no resourcemanager to stop
> >>
> >> > > no nodemanager to stop
> >>
> >> > > EXECUTING: stop zookeeper
> >>
> >> > > JMX enabled by default
> >>
> >> > > Using config:
> >>
> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> >>
> >> > > bin/../conf/zoo.cfg
> >>
> >> > > Stopping zookeeper ... no zookeeper to stop (could not find file
> >>
> >> > > /tmp/zookeeper/zookeeper_server.pid)
> >>
> >> > > EXECUTING: install samza
> >>
> >> > > Building samza from master...
> >>
> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> >>
> >> > > Cloning into 'samza'...
> >>
> >> > > fatal: unable to connect to git.apache.org:
> >>
> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >>
> >> > >
> >>
> >> > >
> >>
> >> > > Could you please help me to resolve this issue?
> >>
> >> > >
> >>
> >> > > Regards,
> >>
> >> > > ~Sri
> >>
> >> > >
> >>
> >> >
> >>
> >
> >
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Navina Ramesh <nr...@linkedin.com>.
if it is already installed in your system, I don't think you need re-install them again. However, do make sure that there are no ACLs enabled on ZK because kafka may not support it.
> My guess Even if there are conflicts on earlier installations it should throw some other error but not the connection time out
I think your connection timeout was related to when you were trying to download samza from apache.
If you can re-use the already install kafka and zookeeper client, then install yarn, and follow the remaining steps to build and deploy samza. In any case, more logs will be useful for us to debug.
> it could either related resolving "localhost" or firewall that prevents communication between ports"
I meant this could be the reason why ZK is not able to install and/or talk to the kafka broker.
It totally stumps me why you can't downloads samza from your server. Is it possible for you try on another clean host and see if it works or fails for you?
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Thursday, September 14, 2017 12:33:26 PM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
That is a good catch Naveena the server which I am trying to install is an Hadoop edge node, it has kafka broker and Zookeeper client already installed for my Hadoop
Does it matter If I am installing it on a separate folder?. My guess Even if there are conflicts on earlier installations it should throw some other error but not the connection time out
Coming to your question " it could either related resolving "localhost" or firewall that prevents communication between ports" - how to prove it is because of Firewall issue. I am able to clone Samza files from Apache git. I can download any external files on this server
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Thursday, September 14, 2017 2:51 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
I wonder if this has anything to do with previous kafka / zookeeper installed on your box. Just for sanity, try clearing /tmp/zookeeeper* and /tmp/kafka* before re-trying those steps.
Same as Yi, I strongly suspect issues with your local laptop setup - it could either related resolving "localhost" or firewall that prevents communication between ports.
Navina
________________________________
From: Yi Pan <ni...@gmail.com>
Sent: Thursday, September 14, 2017 11:37:46 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharaman,
I just did the same steps as you described in your email and all passed on my box. Hence, I strongly suspect that it is related to your local laptop network setup.
Could you post all the command line output when you ran the sequence of commands?
-Yi
On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Ananarath,
>
> It is very strange that you are seeing this timeout exception that we
> do not see. I am trying to follow the exact steps you did to see
> whether there is anything broken. I will update you this afternoon.
>
> Meanwhile, could you check your hostname setup and firewall
> configuration to see whether your local laptop has blocked access via
> the public IP address to your laptop? Could you verify that your
> localhost is resolved to
> 127.0.0.1 and is accessible?
>
> -Yi
>
> On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor)
> < Srinatha_Anantharaman@comcast.com> wrote:
>
>> Yi,
>>
>> Is there any alternate way to install Samza Or solution to the
>> connection time out error?
>>
>> Regards,
>> ~Sri
>>
>> From: Anantharaman, Srinatha (Contractor)
>> Sent: Wednesday, September 13, 2017 11:37 AM
>> To: dev@samza.apache.org
>> Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>>
>> Yi,
>>
>>
>>
>> I am trying to build Samza locally by following the steps provided by
>> Navina.
>>
>> As per those steps kafka will be installed after Zookeeper, I am
>> getting Error while starting Zookeeper after it is installed
>>
>>
>>
>>
>>
>> Steps Followed :
>>
>>
>>
>> Yes. You can clone apache/samza locally and build it with:
>>
>>
>>
>>
>>
>> cd <samza-workspace>
>>
>>
>>
>> gradle -b bootstrap.gradle
>>
>>
>>
>> ./gradlew clean build -x test
>>
>>
>>
>> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
>> the latest apache/samza into your local maven repo
>>
>>
>>
>>
>>
>> Then, head to hello-samza workspace and build again:
>>
>>
>>
>> cd <hello-samza-workspace>
>>
>>
>>
>> mvn clean package ## This should create a build target
>>
>>
>>
>> ./bin/grid install zookeeper
>>
>>
>>
>> ./bin/grid start zookeeper
>>
>>
>>
>> ./bin/grid install kafka
>>
>>
>>
>> ./bin/grid start kafka
>>
>>
>>
>> ./bin/grid install yarn
>>
>>
>>
>> ./bin/grid start yarn
>>
>>
>>
>>
>>
>> mkdir -p deploy/samza
>>
>>
>>
>> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>>
>>
>>
>>
>>
>> NOTE : BTW From the above steps I could not execute " gradle -b
>> bootstrap.gradle" since that command does not exists
>>
>>
>>
>> Regards,
>>
>> ~Sri
>>
>>
>>
>> -----Original Message-----
>> From: Yi Pan [mailto:nickpan47@gmail.com]
>> Sent: Tuesday, September 12, 2017 7:13 PM
>> To: dev@samza.apache.org<ma...@samza.apache.org>
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>>
>>
>> Hi, Anantharam,
>>
>>
>>
>> Could you confirm at which step your setup failed? It seems that your
>> zookeeper server is running. Could you check to see whether your
>> Kafka broker is running? You can either do a telnet localhost 9092 or
>> do a ps auxww | grep kafka to see whether you got any broker running.
>>
>>
>>
>> Sometimes, the Kafka service takes time to start on a single laptop.
>> You can just try to run ./bin/grid start kafka
>>
>>
>>
>> again to see whether the service is up.
>>
>>
>>
>> Thanks!
>>
>>
>>
>> -Yi
>>
>>
>>
>> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor)
>> < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>>
>>
>> > Find below Zookeeper logs:
>>
>> >
>>
>> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101]
>> > -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,133 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to
>> > 3
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@101]
>>
>> > - Purge task is not scheduled.
>>
>> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
>>
>> > Either no config or no quorum defined in config, running in
>>
>> > standalone mode
>>
>> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101]
>> > -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,162 [myid:] - INFO
>> > [main:ZooKeeperServerMain@95]
>>
>> > - Starting server
>>
>> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
>> > 10:48
>>
>> > GMT
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.version=1.8.0_31
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.vendor=Oracle Corporation
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>>
>> > 8.0.31-2.b13.el7.x86_64/jre
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.class.path=/app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>>
>> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>>
>> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>>
>> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>>
>> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../conf:
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>>
>> > usr/lib64:/lib64:/lib:/usr/lib
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.io.tmpdir=/tmp
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.compiler=<NA>
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:os.name=Linux
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:os.arch=amd64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:user.name=root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:user.home=/root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733]
>> > -
>>
>> > tickTime set to 2000
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742]
>> > -
>>
>> > minSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751]
>> > -
>>
>> > maxSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,213 [myid:] - INFO
>>
>> > [main:NIOServerCnxnFactory@110] - binding to port
>> > 0.0.0.0/0.0.0.0:2181
>>
>> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
>>
>> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>>
>> > 2017-09-12 17:05:19,673 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from
>>
>> > /0:0:0:0:0:0:0:1:21754
>>
>> > 2017-09-12 17:17:40,265 [myid:] - WARN
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>>
>> > EndOfStreamException: Unable to read additional data from client
>>
>> > sessionid 0x0, likely client has closed socket
>>
>> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>>
>> > NIOServerCnxn.java:220)
>>
>> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>>
>> > NIOServerCnxnFactory.java:224)
>>
>> > at java.lang.Thread.run(Thread.java:745)
>>
>> > 2017-09-12 17:17:40,267 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
>> > client
>>
>> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>>
>> > 2017-09-12 17:18:06,236 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from /
>>
>> > 127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,247 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish
>> > new
>>
>> > session at /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,250 [myid:] - INFO
>> > [SyncThread:0:FileTxnLog@199]
>>
>> > - Creating new log file: log.1
>>
>> > 2017-09-12 17:18:06,263 [myid:] - INFO
>>
>> > [SyncThread:0:ZooKeeperServer@604]
>>
>> > - Established session 0x15e770d61920000 with negotiated timeout
>> > 6000
>>
>> > for client /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
>> > zxid:0x3
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NoNode for /brokers
>>
>> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
>> > zxid:0x7
>>
>> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>>
>> > NoNode for /config
>>
>> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
>> > zxid:0xc
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>>
>> > NoNode for /admin
>>
>> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
>> > zxid:0x11
>>
>> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>>
>> > NoNode for /cluster
>>
>> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>>
>> > zxid:0x15
>>
>> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>>
>> > Error:KeeperErrorCode = NoNode for /controller_epoch
>>
>> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
>> > zxid:0x17
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>>
>> > Error:KeeperErrorCode = NoNode for
>> > /admin/preferred_replica_election
>>
>> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
>> > zxid:0x18
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers
>>
>> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
>> > zxid:0x19
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
>> > Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers/ids
>>
>> >
>>
>> >
>>
>> >
>>
>> > -----Original Message-----
>>
>> > From: Yi Pan [mailto:nickpan47@gmail.com]
>>
>> > Sent: Tuesday, September 12, 2017 2:02 PM
>>
>> > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> >
>>
>> > Hi, Anantharaman,
>>
>> >
>>
>> > Could you post your zookeeper startup logs here?
>>
>> >
>>
>> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
>> > (Contractor)
>>
>> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>> >
>>
>> > > It hangs while bringing up the service
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p hello-samza]# pwd
>>
>> > > /app/home/eventsvc/samza-git/hello-samza
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
>> > > zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > ./bin/grid start zookeeper
>>
>> > > EXECUTING: start zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Starting zookeeper ... STARTED
>>
>> > > Waiting for zookeeper to start...
>>
>> > >
>>
>> > > ^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
>> > > zookeeper^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>>
>> > > EXECUTING: start kafka
>>
>> > > Waiting for kafka to start...
>>
>> > > Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]#
>>
>> > >
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 12:43 PM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Yes. You can clone apache/samza locally and build it with:
>>
>> > >
>>
>> > >
>>
>> > > cd <samza-workspace>
>>
>> > >
>>
>> > > gradle -b bootstrap.gradle
>>
>> > >
>>
>> > > ./gradlew clean build -x test
>>
>> > >
>>
>> > > ./gradlew publishToMavenLocal ## This publishes a snapshot version
>> of
>>
>> > > the latest apache/samza into your local maven repo
>>
>> > >
>>
>> > >
>>
>> > > Then, head to hello-samza workspace and build again:
>>
>> > >
>>
>> > > cd <hello-samza-workspace>
>>
>> > >
>>
>> > > mvn clean package ## This should create a build target
>>
>> > >
>>
>> > > ./bin/grid install zookeeper
>>
>> > >
>>
>> > > ./bin/grid start zookeeper
>>
>> > >
>>
>> > > ./bin/grid install kafka
>>
>> > >
>>
>> > > ./bin/grid start kafka
>>
>> > >
>>
>> > > ./bin/grid install yarn
>>
>> > >
>>
>> > > ./bin/grid start yarn
>>
>> > >
>>
>> > >
>>
>> > > mkdir -p deploy/samza
>>
>> > >
>>
>> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
>> > > deploy/samza
>>
>> > >
>>
>> > >
>>
>> > > After this, you can follow steps in the tutorial to "Run" the
>>
>> > > example Samza job.
>>
>> > >
>>
>> > >
>>
>> > > HTH! Let me know if you need further help.
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > Is there any other way we can install Hello Samza?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:42 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Ok. I tried again for the "latest" branch in hello-samza and it
>>
>> > > still works.
>>
>> > >
>>
>> > >
>>
>> > > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > It is expected to build from "master" in apache/samza repo. So,
>> > > the
>>
>> > > output line is expected.
>>
>> > >
>>
>> > >
>>
>> > > It is weird that you are unable to connect. Is it possible you
>> > > are
>>
>> > > behind a firewall or something? Can you try to ping "git.apache.org"
>> ?
>>
>> > > Or try the setup on a different box?
>>
>> > >
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > I tried again but still same error
>>
>> > >
>>
>> > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > But when after I cloned I executed " git checkout latest"
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:10 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi Anantharaman,
>>
>> > >
>>
>> > > It looks like a transient connection failure to connect to
>> > > Apache's
>>
>> > > git. I tried on my host and it seems to be working.
>>
>> > >
>>
>> > > Can you give it another shot?
>>
>> > >
>>
>> > >
>>
>> > > If it still doesn't work, please let me know if you are running
>> > > the
>>
>> > > command under the "master" or "latest" branch of samza-hello-samza.
>>
>> > >
>>
>> > >
>>
>> > > Thanks!
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi,
>>
>> > >
>>
>> > > I am trying to install "Hello Samza" on a single node Initially I
>>
>> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
>>
>> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>>
>> > > connection timed out error It also mentions no kafka, yarn and
>>
>> > > zookeeper installed
>>
>> > >
>>
>> > > Please find below the error message
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p bin]# cd ..
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>>
>> > > EXECUTING: install yarn
>>
>> > > Using previously downloaded file
>>
>> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > bin/grid bootstrap Bootstrapping the system...
>>
>> > > EXECUTING: stop kafka
>>
>> > > No kafka server to stop
>>
>> > > EXECUTING: stop yarn
>>
>> > > no resourcemanager to stop
>>
>> > > no nodemanager to stop
>>
>> > > EXECUTING: stop zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>>
>> > > /tmp/zookeeper/zookeeper_server.pid)
>>
>> > > EXECUTING: install samza
>>
>> > > Building samza from master...
>>
>> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>>
>> > > Cloning into 'samza'...
>>
>> > > fatal: unable to connect to git.apache.org:
>>
>> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>>
>> > >
>>
>> > >
>>
>> > > Could you please help me to resolve this issue?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> >
>>
>
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
That is a good catch Naveena the server which I am trying to install is an Hadoop edge node, it has kafka broker and Zookeeper client already installed for my Hadoop
Does it matter If I am installing it on a separate folder?. My guess Even if there are conflicts on earlier installations it should throw some other error but not the connection time out
Coming to your question " it could either related resolving "localhost" or firewall that prevents communication between ports" - how to prove it is because of Firewall issue. I am able to clone Samza files from Apache git. I can download any external files on this server
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Thursday, September 14, 2017 2:51 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
I wonder if this has anything to do with previous kafka / zookeeper installed on your box. Just for sanity, try clearing /tmp/zookeeeper* and /tmp/kafka* before re-trying those steps.
Same as Yi, I strongly suspect issues with your local laptop setup - it could either related resolving "localhost" or firewall that prevents communication between ports.
Navina
________________________________
From: Yi Pan <ni...@gmail.com>
Sent: Thursday, September 14, 2017 11:37:46 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharaman,
I just did the same steps as you described in your email and all passed on my box. Hence, I strongly suspect that it is related to your local laptop network setup.
Could you post all the command line output when you ran the sequence of commands?
-Yi
On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Ananarath,
>
> It is very strange that you are seeing this timeout exception that we
> do not see. I am trying to follow the exact steps you did to see
> whether there is anything broken. I will update you this afternoon.
>
> Meanwhile, could you check your hostname setup and firewall
> configuration to see whether your local laptop has blocked access via
> the public IP address to your laptop? Could you verify that your
> localhost is resolved to
> 127.0.0.1 and is accessible?
>
> -Yi
>
> On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor)
> < Srinatha_Anantharaman@comcast.com> wrote:
>
>> Yi,
>>
>> Is there any alternate way to install Samza Or solution to the
>> connection time out error?
>>
>> Regards,
>> ~Sri
>>
>> From: Anantharaman, Srinatha (Contractor)
>> Sent: Wednesday, September 13, 2017 11:37 AM
>> To: dev@samza.apache.org
>> Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>>
>> Yi,
>>
>>
>>
>> I am trying to build Samza locally by following the steps provided by
>> Navina.
>>
>> As per those steps kafka will be installed after Zookeeper, I am
>> getting Error while starting Zookeeper after it is installed
>>
>>
>>
>>
>>
>> Steps Followed :
>>
>>
>>
>> Yes. You can clone apache/samza locally and build it with:
>>
>>
>>
>>
>>
>> cd <samza-workspace>
>>
>>
>>
>> gradle -b bootstrap.gradle
>>
>>
>>
>> ./gradlew clean build -x test
>>
>>
>>
>> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
>> the latest apache/samza into your local maven repo
>>
>>
>>
>>
>>
>> Then, head to hello-samza workspace and build again:
>>
>>
>>
>> cd <hello-samza-workspace>
>>
>>
>>
>> mvn clean package ## This should create a build target
>>
>>
>>
>> ./bin/grid install zookeeper
>>
>>
>>
>> ./bin/grid start zookeeper
>>
>>
>>
>> ./bin/grid install kafka
>>
>>
>>
>> ./bin/grid start kafka
>>
>>
>>
>> ./bin/grid install yarn
>>
>>
>>
>> ./bin/grid start yarn
>>
>>
>>
>>
>>
>> mkdir -p deploy/samza
>>
>>
>>
>> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>>
>>
>>
>>
>>
>> NOTE : BTW From the above steps I could not execute " gradle -b
>> bootstrap.gradle" since that command does not exists
>>
>>
>>
>> Regards,
>>
>> ~Sri
>>
>>
>>
>> -----Original Message-----
>> From: Yi Pan [mailto:nickpan47@gmail.com]
>> Sent: Tuesday, September 12, 2017 7:13 PM
>> To: dev@samza.apache.org<ma...@samza.apache.org>
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>>
>>
>> Hi, Anantharam,
>>
>>
>>
>> Could you confirm at which step your setup failed? It seems that your
>> zookeeper server is running. Could you check to see whether your
>> Kafka broker is running? You can either do a telnet localhost 9092 or
>> do a ps auxww | grep kafka to see whether you got any broker running.
>>
>>
>>
>> Sometimes, the Kafka service takes time to start on a single laptop.
>> You can just try to run ./bin/grid start kafka
>>
>>
>>
>> again to see whether the service is up.
>>
>>
>>
>> Thanks!
>>
>>
>>
>> -Yi
>>
>>
>>
>> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor)
>> < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>>
>>
>> > Find below Zookeeper logs:
>>
>> >
>>
>> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101]
>> > -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,133 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to
>> > 3
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@101]
>>
>> > - Purge task is not scheduled.
>>
>> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
>>
>> > Either no config or no quorum defined in config, running in
>>
>> > standalone mode
>>
>> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101]
>> > -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,162 [myid:] - INFO
>> > [main:ZooKeeperServerMain@95]
>>
>> > - Starting server
>>
>> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
>> > 10:48
>>
>> > GMT
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.version=1.8.0_31
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.vendor=Oracle Corporation
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>>
>> > 8.0.31-2.b13.el7.x86_64/jre
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.class.path=/app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>>
>> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>>
>> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>>
>> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>>
>> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../conf:
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>>
>> > usr/lib64:/lib64:/lib:/usr/lib
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.io.tmpdir=/tmp
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:java.compiler=<NA>
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:os.name=Linux
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:os.arch=amd64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:user.name=root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:user.home=/root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] -
>> > Server
>>
>> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733]
>> > -
>>
>> > tickTime set to 2000
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742]
>> > -
>>
>> > minSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751]
>> > -
>>
>> > maxSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,213 [myid:] - INFO
>>
>> > [main:NIOServerCnxnFactory@110] - binding to port
>> > 0.0.0.0/0.0.0.0:2181
>>
>> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
>>
>> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>>
>> > 2017-09-12 17:05:19,673 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from
>>
>> > /0:0:0:0:0:0:0:1:21754
>>
>> > 2017-09-12 17:17:40,265 [myid:] - WARN
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>>
>> > EndOfStreamException: Unable to read additional data from client
>>
>> > sessionid 0x0, likely client has closed socket
>>
>> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>>
>> > NIOServerCnxn.java:220)
>>
>> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>>
>> > NIOServerCnxnFactory.java:224)
>>
>> > at java.lang.Thread.run(Thread.java:745)
>>
>> > 2017-09-12 17:17:40,267 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
>> > client
>>
>> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>>
>> > 2017-09-12 17:18:06,236 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from /
>>
>> > 127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,247 [myid:] - INFO
>> > [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish
>> > new
>>
>> > session at /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,250 [myid:] - INFO
>> > [SyncThread:0:FileTxnLog@199]
>>
>> > - Creating new log file: log.1
>>
>> > 2017-09-12 17:18:06,263 [myid:] - INFO
>>
>> > [SyncThread:0:ZooKeeperServer@604]
>>
>> > - Established session 0x15e770d61920000 with negotiated timeout
>> > 6000
>>
>> > for client /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
>> > zxid:0x3
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NoNode for /brokers
>>
>> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
>> > zxid:0x7
>>
>> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>>
>> > NoNode for /config
>>
>> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
>> > zxid:0xc
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>>
>> > NoNode for /admin
>>
>> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
>> > zxid:0x11
>>
>> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>>
>> > NoNode for /cluster
>>
>> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>>
>> > zxid:0x15
>>
>> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>>
>> > Error:KeeperErrorCode = NoNode for /controller_epoch
>>
>> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
>> > zxid:0x17
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>>
>> > Error:KeeperErrorCode = NoNode for
>> > /admin/preferred_replica_election
>>
>> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
>> > zxid:0x18
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers
>>
>> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
>> > zxid:0x19
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
>> > Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers/ids
>>
>> >
>>
>> >
>>
>> >
>>
>> > -----Original Message-----
>>
>> > From: Yi Pan [mailto:nickpan47@gmail.com]
>>
>> > Sent: Tuesday, September 12, 2017 2:02 PM
>>
>> > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> >
>>
>> > Hi, Anantharaman,
>>
>> >
>>
>> > Could you post your zookeeper startup logs here?
>>
>> >
>>
>> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
>> > (Contractor)
>>
>> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>> >
>>
>> > > It hangs while bringing up the service
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p hello-samza]# pwd
>>
>> > > /app/home/eventsvc/samza-git/hello-samza
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
>> > > zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > ./bin/grid start zookeeper
>>
>> > > EXECUTING: start zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Starting zookeeper ... STARTED
>>
>> > > Waiting for zookeeper to start...
>>
>> > >
>>
>> > > ^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
>> > > zookeeper^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>>
>> > > EXECUTING: start kafka
>>
>> > > Waiting for kafka to start...
>>
>> > > Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]#
>>
>> > >
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 12:43 PM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Yes. You can clone apache/samza locally and build it with:
>>
>> > >
>>
>> > >
>>
>> > > cd <samza-workspace>
>>
>> > >
>>
>> > > gradle -b bootstrap.gradle
>>
>> > >
>>
>> > > ./gradlew clean build -x test
>>
>> > >
>>
>> > > ./gradlew publishToMavenLocal ## This publishes a snapshot version
>> of
>>
>> > > the latest apache/samza into your local maven repo
>>
>> > >
>>
>> > >
>>
>> > > Then, head to hello-samza workspace and build again:
>>
>> > >
>>
>> > > cd <hello-samza-workspace>
>>
>> > >
>>
>> > > mvn clean package ## This should create a build target
>>
>> > >
>>
>> > > ./bin/grid install zookeeper
>>
>> > >
>>
>> > > ./bin/grid start zookeeper
>>
>> > >
>>
>> > > ./bin/grid install kafka
>>
>> > >
>>
>> > > ./bin/grid start kafka
>>
>> > >
>>
>> > > ./bin/grid install yarn
>>
>> > >
>>
>> > > ./bin/grid start yarn
>>
>> > >
>>
>> > >
>>
>> > > mkdir -p deploy/samza
>>
>> > >
>>
>> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
>> > > deploy/samza
>>
>> > >
>>
>> > >
>>
>> > > After this, you can follow steps in the tutorial to "Run" the
>>
>> > > example Samza job.
>>
>> > >
>>
>> > >
>>
>> > > HTH! Let me know if you need further help.
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > Is there any other way we can install Hello Samza?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:42 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Ok. I tried again for the "latest" branch in hello-samza and it
>>
>> > > still works.
>>
>> > >
>>
>> > >
>>
>> > > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > It is expected to build from "master" in apache/samza repo. So,
>> > > the
>>
>> > > output line is expected.
>>
>> > >
>>
>> > >
>>
>> > > It is weird that you are unable to connect. Is it possible you
>> > > are
>>
>> > > behind a firewall or something? Can you try to ping "git.apache.org"
>> ?
>>
>> > > Or try the setup on a different box?
>>
>> > >
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > I tried again but still same error
>>
>> > >
>>
>> > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > But when after I cloned I executed " git checkout latest"
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:10 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi Anantharaman,
>>
>> > >
>>
>> > > It looks like a transient connection failure to connect to
>> > > Apache's
>>
>> > > git. I tried on my host and it seems to be working.
>>
>> > >
>>
>> > > Can you give it another shot?
>>
>> > >
>>
>> > >
>>
>> > > If it still doesn't work, please let me know if you are running
>> > > the
>>
>> > > command under the "master" or "latest" branch of samza-hello-samza.
>>
>> > >
>>
>> > >
>>
>> > > Thanks!
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi,
>>
>> > >
>>
>> > > I am trying to install "Hello Samza" on a single node Initially I
>>
>> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
>>
>> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>>
>> > > connection timed out error It also mentions no kafka, yarn and
>>
>> > > zookeeper installed
>>
>> > >
>>
>> > > Please find below the error message
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p bin]# cd ..
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>>
>> > > EXECUTING: install yarn
>>
>> > > Using previously downloaded file
>>
>> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > bin/grid bootstrap Bootstrapping the system...
>>
>> > > EXECUTING: stop kafka
>>
>> > > No kafka server to stop
>>
>> > > EXECUTING: stop yarn
>>
>> > > no resourcemanager to stop
>>
>> > > no nodemanager to stop
>>
>> > > EXECUTING: stop zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>>
>> > > /tmp/zookeeper/zookeeper_server.pid)
>>
>> > > EXECUTING: install samza
>>
>> > > Building samza from master...
>>
>> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>>
>> > > Cloning into 'samza'...
>>
>> > > fatal: unable to connect to git.apache.org:
>>
>> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>>
>> > >
>>
>> > >
>>
>> > > Could you please help me to resolve this issue?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> >
>>
>
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Navina Ramesh <nr...@linkedin.com>.
I wonder if this has anything to do with previous kafka / zookeeper installed on your box. Just for sanity, try clearing /tmp/zookeeeper* and /tmp/kafka* before re-trying those steps.
Same as Yi, I strongly suspect issues with your local laptop setup - it could either related resolving "localhost" or firewall that prevents communication between ports.
Navina
________________________________
From: Yi Pan <ni...@gmail.com>
Sent: Thursday, September 14, 2017 11:37:46 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharaman,
I just did the same steps as you described in your email and all passed on
my box. Hence, I strongly suspect that it is related to your local laptop
network setup.
Could you post all the command line output when you ran the sequence of
commands?
-Yi
On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Ananarath,
>
> It is very strange that you are seeing this timeout exception that we do
> not see. I am trying to follow the exact steps you did to see whether there
> is anything broken. I will update you this afternoon.
>
> Meanwhile, could you check your hostname setup and firewall configuration
> to see whether your local laptop has blocked access via the public IP
> address to your laptop? Could you verify that your localhost is resolved to
> 127.0.0.1 and is accessible?
>
> -Yi
>
> On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
>> Yi,
>>
>> Is there any alternate way to install Samza Or solution to the
>> connection time out error?
>>
>> Regards,
>> ~Sri
>>
>> From: Anantharaman, Srinatha (Contractor)
>> Sent: Wednesday, September 13, 2017 11:37 AM
>> To: dev@samza.apache.org
>> Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>>
>> Yi,
>>
>>
>>
>> I am trying to build Samza locally by following the steps provided by
>> Navina.
>>
>> As per those steps kafka will be installed after Zookeeper, I am getting
>> Error while starting Zookeeper after it is installed
>>
>>
>>
>>
>>
>> Steps Followed :
>>
>>
>>
>> Yes. You can clone apache/samza locally and build it with:
>>
>>
>>
>>
>>
>> cd <samza-workspace>
>>
>>
>>
>> gradle -b bootstrap.gradle
>>
>>
>>
>> ./gradlew clean build -x test
>>
>>
>>
>> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
>> the latest apache/samza into your local maven repo
>>
>>
>>
>>
>>
>> Then, head to hello-samza workspace and build again:
>>
>>
>>
>> cd <hello-samza-workspace>
>>
>>
>>
>> mvn clean package ## This should create a build target
>>
>>
>>
>> ./bin/grid install zookeeper
>>
>>
>>
>> ./bin/grid start zookeeper
>>
>>
>>
>> ./bin/grid install kafka
>>
>>
>>
>> ./bin/grid start kafka
>>
>>
>>
>> ./bin/grid install yarn
>>
>>
>>
>> ./bin/grid start yarn
>>
>>
>>
>>
>>
>> mkdir -p deploy/samza
>>
>>
>>
>> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>>
>>
>>
>>
>>
>> NOTE : BTW From the above steps I could not execute " gradle -b
>> bootstrap.gradle" since that command does not exists
>>
>>
>>
>> Regards,
>>
>> ~Sri
>>
>>
>>
>> -----Original Message-----
>> From: Yi Pan [mailto:nickpan47@gmail.com]
>> Sent: Tuesday, September 12, 2017 7:13 PM
>> To: dev@samza.apache.org<ma...@samza.apache.org>
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>>
>>
>> Hi, Anantharam,
>>
>>
>>
>> Could you confirm at which step your setup failed? It seems that your
>> zookeeper server is running. Could you check to see whether your Kafka
>> broker is running? You can either do a telnet localhost 9092 or do a ps
>> auxww | grep kafka to see whether you got any broker running.
>>
>>
>>
>> Sometimes, the Kafka service takes time to start on a single laptop. You
>> can just try to run ./bin/grid start kafka
>>
>>
>>
>> again to see whether the service is up.
>>
>>
>>
>> Thanks!
>>
>>
>>
>> -Yi
>>
>>
>>
>> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor) <
>> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>>
>>
>> > Find below Zookeeper logs:
>>
>> >
>>
>> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101] -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,133 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@101]
>>
>> > - Purge task is not scheduled.
>>
>> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
>>
>> > Either no config or no quorum defined in config, running in
>>
>> > standalone mode
>>
>> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101] -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,162 [myid:] - INFO [main:ZooKeeperServerMain@95]
>>
>> > - Starting server
>>
>> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48
>>
>> > GMT
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.version=1.8.0_31
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.vendor=Oracle Corporation
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>>
>> > 8.0.31-2.b13.el7.x86_64/jre
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.class.path=/app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>>
>> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>>
>> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>>
>> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>>
>> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../conf:
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>>
>> > usr/lib64:/lib64:/lib:/usr/lib
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.io.tmpdir=/tmp
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.compiler=<NA>
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:os.name=Linux
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:os.arch=amd64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:user.name=root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:user.home=/root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] -
>>
>> > tickTime set to 2000
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] -
>>
>> > minSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] -
>>
>> > maxSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,213 [myid:] - INFO
>>
>> > [main:NIOServerCnxnFactory@110] - binding to port 0.0.0.0/0.0.0.0:2181
>>
>> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
>>
>> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>>
>> > 2017-09-12 17:05:19,673 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from
>>
>> > /0:0:0:0:0:0:0:1:21754
>>
>> > 2017-09-12 17:17:40,265 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>>
>> > EndOfStreamException: Unable to read additional data from client
>>
>> > sessionid 0x0, likely client has closed socket
>>
>> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>>
>> > NIOServerCnxn.java:220)
>>
>> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>>
>> > NIOServerCnxnFactory.java:224)
>>
>> > at java.lang.Thread.run(Thread.java:745)
>>
>> > 2017-09-12 17:17:40,267 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for client
>>
>> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>>
>> > 2017-09-12 17:18:06,236 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from /
>>
>> > 127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,247 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish new
>>
>> > session at /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,250 [myid:] - INFO [SyncThread:0:FileTxnLog@199]
>>
>> > - Creating new log file: log.1
>>
>> > 2017-09-12 17:18:06,263 [myid:] - INFO
>>
>> > [SyncThread:0:ZooKeeperServer@604]
>>
>> > - Established session 0x15e770d61920000 with negotiated timeout 6000
>>
>> > for client /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NoNode for /brokers
>>
>> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7
>>
>> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>>
>> > NoNode for /config
>>
>> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x13 zxid:0xc
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>>
>> > NoNode for /admin
>>
>> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b zxid:0x11
>>
>> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>>
>> > NoNode for /cluster
>>
>> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>>
>> > zxid:0x15
>>
>> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>>
>> > Error:KeeperErrorCode = NoNode for /controller_epoch
>>
>> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34 zxid:0x17
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>>
>> > Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
>>
>> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f zxid:0x18
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers
>>
>> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x40 zxid:0x19
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers/ids
>>
>> >
>>
>> >
>>
>> >
>>
>> > -----Original Message-----
>>
>> > From: Yi Pan [mailto:nickpan47@gmail.com]
>>
>> > Sent: Tuesday, September 12, 2017 2:02 PM
>>
>> > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> >
>>
>> > Hi, Anantharaman,
>>
>> >
>>
>> > Could you post your zookeeper startup logs here?
>>
>> >
>>
>> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor)
>>
>> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>> >
>>
>> > > It hangs while bringing up the service
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p hello-samza]# pwd
>>
>> > > /app/home/eventsvc/samza-git/hello-samza
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > ./bin/grid start zookeeper
>>
>> > > EXECUTING: start zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Starting zookeeper ... STARTED
>>
>> > > Waiting for zookeeper to start...
>>
>> > >
>>
>> > > ^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>>
>> > > EXECUTING: start kafka
>>
>> > > Waiting for kafka to start...
>>
>> > > Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]#
>>
>> > >
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 12:43 PM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Yes. You can clone apache/samza locally and build it with:
>>
>> > >
>>
>> > >
>>
>> > > cd <samza-workspace>
>>
>> > >
>>
>> > > gradle -b bootstrap.gradle
>>
>> > >
>>
>> > > ./gradlew clean build -x test
>>
>> > >
>>
>> > > ./gradlew publishToMavenLocal ## This publishes a snapshot version
>> of
>>
>> > > the latest apache/samza into your local maven repo
>>
>> > >
>>
>> > >
>>
>> > > Then, head to hello-samza workspace and build again:
>>
>> > >
>>
>> > > cd <hello-samza-workspace>
>>
>> > >
>>
>> > > mvn clean package ## This should create a build target
>>
>> > >
>>
>> > > ./bin/grid install zookeeper
>>
>> > >
>>
>> > > ./bin/grid start zookeeper
>>
>> > >
>>
>> > > ./bin/grid install kafka
>>
>> > >
>>
>> > > ./bin/grid start kafka
>>
>> > >
>>
>> > > ./bin/grid install yarn
>>
>> > >
>>
>> > > ./bin/grid start yarn
>>
>> > >
>>
>> > >
>>
>> > > mkdir -p deploy/samza
>>
>> > >
>>
>> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>>
>> > >
>>
>> > >
>>
>> > > After this, you can follow steps in the tutorial to "Run" the
>>
>> > > example Samza job.
>>
>> > >
>>
>> > >
>>
>> > > HTH! Let me know if you need further help.
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > Is there any other way we can install Hello Samza?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:42 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Ok. I tried again for the "latest" branch in hello-samza and it
>>
>> > > still works.
>>
>> > >
>>
>> > >
>>
>> > > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > It is expected to build from "master" in apache/samza repo. So, the
>>
>> > > output line is expected.
>>
>> > >
>>
>> > >
>>
>> > > It is weird that you are unable to connect. Is it possible you are
>>
>> > > behind a firewall or something? Can you try to ping "git.apache.org"
>> ?
>>
>> > > Or try the setup on a different box?
>>
>> > >
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > I tried again but still same error
>>
>> > >
>>
>> > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > But when after I cloned I executed " git checkout latest"
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:10 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi Anantharaman,
>>
>> > >
>>
>> > > It looks like a transient connection failure to connect to Apache's
>>
>> > > git. I tried on my host and it seems to be working.
>>
>> > >
>>
>> > > Can you give it another shot?
>>
>> > >
>>
>> > >
>>
>> > > If it still doesn't work, please let me know if you are running the
>>
>> > > command under the "master" or "latest" branch of samza-hello-samza.
>>
>> > >
>>
>> > >
>>
>> > > Thanks!
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi,
>>
>> > >
>>
>> > > I am trying to install "Hello Samza" on a single node Initially I
>>
>> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
>>
>> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>>
>> > > connection timed out error It also mentions no kafka, yarn and
>>
>> > > zookeeper installed
>>
>> > >
>>
>> > > Please find below the error message
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p bin]# cd ..
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>>
>> > > EXECUTING: install yarn
>>
>> > > Using previously downloaded file
>>
>> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > bin/grid bootstrap Bootstrapping the system...
>>
>> > > EXECUTING: stop kafka
>>
>> > > No kafka server to stop
>>
>> > > EXECUTING: stop yarn
>>
>> > > no resourcemanager to stop
>>
>> > > no nodemanager to stop
>>
>> > > EXECUTING: stop zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>>
>> > > /tmp/zookeeper/zookeeper_server.pid)
>>
>> > > EXECUTING: install samza
>>
>> > > Building samza from master...
>>
>> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>>
>> > > Cloning into 'samza'...
>>
>> > > fatal: unable to connect to git.apache.org:
>>
>> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>>
>> > >
>>
>> > >
>>
>> > > Could you please help me to resolve this issue?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> >
>>
>
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
Hi, Anantharaman,
I just did the same steps as you described in your email and all passed on
my box. Hence, I strongly suspect that it is related to your local laptop
network setup.
Could you post all the command line output when you ran the sequence of
commands?
-Yi
On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Ananarath,
>
> It is very strange that you are seeing this timeout exception that we do
> not see. I am trying to follow the exact steps you did to see whether there
> is anything broken. I will update you this afternoon.
>
> Meanwhile, could you check your hostname setup and firewall configuration
> to see whether your local laptop has blocked access via the public IP
> address to your laptop? Could you verify that your localhost is resolved to
> 127.0.0.1 and is accessible?
>
> -Yi
>
> On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
>> Yi,
>>
>> Is there any alternate way to install Samza Or solution to the
>> connection time out error?
>>
>> Regards,
>> ~Sri
>>
>> From: Anantharaman, Srinatha (Contractor)
>> Sent: Wednesday, September 13, 2017 11:37 AM
>> To: dev@samza.apache.org
>> Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>>
>> Yi,
>>
>>
>>
>> I am trying to build Samza locally by following the steps provided by
>> Navina.
>>
>> As per those steps kafka will be installed after Zookeeper, I am getting
>> Error while starting Zookeeper after it is installed
>>
>>
>>
>>
>>
>> Steps Followed :
>>
>>
>>
>> Yes. You can clone apache/samza locally and build it with:
>>
>>
>>
>>
>>
>> cd <samza-workspace>
>>
>>
>>
>> gradle -b bootstrap.gradle
>>
>>
>>
>> ./gradlew clean build -x test
>>
>>
>>
>> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
>> the latest apache/samza into your local maven repo
>>
>>
>>
>>
>>
>> Then, head to hello-samza workspace and build again:
>>
>>
>>
>> cd <hello-samza-workspace>
>>
>>
>>
>> mvn clean package ## This should create a build target
>>
>>
>>
>> ./bin/grid install zookeeper
>>
>>
>>
>> ./bin/grid start zookeeper
>>
>>
>>
>> ./bin/grid install kafka
>>
>>
>>
>> ./bin/grid start kafka
>>
>>
>>
>> ./bin/grid install yarn
>>
>>
>>
>> ./bin/grid start yarn
>>
>>
>>
>>
>>
>> mkdir -p deploy/samza
>>
>>
>>
>> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>>
>>
>>
>>
>>
>> NOTE : BTW From the above steps I could not execute " gradle -b
>> bootstrap.gradle" since that command does not exists
>>
>>
>>
>> Regards,
>>
>> ~Sri
>>
>>
>>
>> -----Original Message-----
>> From: Yi Pan [mailto:nickpan47@gmail.com]
>> Sent: Tuesday, September 12, 2017 7:13 PM
>> To: dev@samza.apache.org<ma...@samza.apache.org>
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>>
>>
>> Hi, Anantharam,
>>
>>
>>
>> Could you confirm at which step your setup failed? It seems that your
>> zookeeper server is running. Could you check to see whether your Kafka
>> broker is running? You can either do a telnet localhost 9092 or do a ps
>> auxww | grep kafka to see whether you got any broker running.
>>
>>
>>
>> Sometimes, the Kafka service takes time to start on a single laptop. You
>> can just try to run ./bin/grid start kafka
>>
>>
>>
>> again to see whether the service is up.
>>
>>
>>
>> Thanks!
>>
>>
>>
>> -Yi
>>
>>
>>
>> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor) <
>> Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>>
>>
>> > Find below Zookeeper logs:
>>
>> >
>>
>> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101] -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,133 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>>
>> > 2017-09-12 17:05:19,134 [myid:] - INFO
>>
>> > [main:DatadirCleanupManager@101]
>>
>> > - Purge task is not scheduled.
>>
>> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
>>
>> > Either no config or no quorum defined in config, running in
>>
>> > standalone mode
>>
>> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101] -
>>
>> > Reading configuration from: /app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>>
>> > 2017-09-12 17:05:19,162 [myid:] - INFO [main:ZooKeeperServerMain@95]
>>
>> > - Starting server
>>
>> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48
>>
>> > GMT
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>>
>> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.version=1.8.0_31
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.vendor=Oracle Corporation
>>
>> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>>
>> > 8.0.31-2.b13.el7.x86_64/jre
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.class.path=/app/home/eventsvc/samza-git/
>>
>> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>>
>> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>>
>> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>>
>> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>>
>> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>>
>> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>>
>> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper/bin/../conf:
>>
>> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>>
>> > usr/lib64:/lib64:/lib:/usr/lib
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.io.tmpdir=/tmp
>>
>> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:java.compiler=<NA>
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:os.name=Linux
>>
>> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:os.arch=amd64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>>
>> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:user.name=root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:user.home=/root
>>
>> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
>>
>> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>>
>> > samza/deploy/zookeeper
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] -
>>
>> > tickTime set to 2000
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] -
>>
>> > minSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] -
>>
>> > maxSessionTimeout set to -1
>>
>> > 2017-09-12 17:05:19,213 [myid:] - INFO
>>
>> > [main:NIOServerCnxnFactory@110] - binding to port 0.0.0.0/0.0.0.0:2181
>>
>> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
>>
>> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>>
>> > 2017-09-12 17:05:19,673 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from
>>
>> > /0:0:0:0:0:0:0:1:21754
>>
>> > 2017-09-12 17:17:40,265 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>>
>> > EndOfStreamException: Unable to read additional data from client
>>
>> > sessionid 0x0, likely client has closed socket
>>
>> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>>
>> > NIOServerCnxn.java:220)
>>
>> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>>
>> > NIOServerCnxnFactory.java:224)
>>
>> > at java.lang.Thread.run(Thread.java:745)
>>
>> > 2017-09-12 17:17:40,267 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for client
>>
>> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>>
>> > 2017-09-12 17:18:06,236 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>>
>> > from /
>>
>> > 127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,247 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>>
>> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish new
>>
>> > session at /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,250 [myid:] - INFO [SyncThread:0:FileTxnLog@199]
>>
>> > - Creating new log file: log.1
>>
>> > 2017-09-12 17:18:06,263 [myid:] - INFO
>>
>> > [SyncThread:0:ZooKeeperServer@604]
>>
>> > - Established session 0x15e770d61920000 with negotiated timeout 6000
>>
>> > for client /127.0.0.1:48071
>>
>> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NoNode for /brokers
>>
>> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7
>>
>> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>>
>> > NoNode for /config
>>
>> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x13 zxid:0xc
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>>
>> > NoNode for /admin
>>
>> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b zxid:0x11
>>
>> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>>
>> > NoNode for /cluster
>>
>> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>>
>> > zxid:0x15
>>
>> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>>
>> > Error:KeeperErrorCode = NoNode for /controller_epoch
>>
>> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34 zxid:0x17
>>
>> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>>
>> > Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
>>
>> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f zxid:0x18
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers
>>
>> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>>
>> > PrepRequestProcessor@617] - Got user-level KeeperException when
>>
>> > processing sessionid:0x15e770d61920000 type:create cxid:0x40 zxid:0x19
>>
>> > txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode =
>>
>> > NodeExists for /brokers/ids
>>
>> >
>>
>> >
>>
>> >
>>
>> > -----Original Message-----
>>
>> > From: Yi Pan [mailto:nickpan47@gmail.com]
>>
>> > Sent: Tuesday, September 12, 2017 2:02 PM
>>
>> > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> >
>>
>> > Hi, Anantharaman,
>>
>> >
>>
>> > Could you post your zookeeper startup logs here?
>>
>> >
>>
>> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor)
>>
>> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> an@comcast.com>> wrote:
>>
>> >
>>
>> > > It hangs while bringing up the service
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p hello-samza]# pwd
>>
>> > > /app/home/eventsvc/samza-git/hello-samza
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > ./bin/grid start zookeeper
>>
>> > > EXECUTING: start zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Starting zookeeper ... STARTED
>>
>> > > Waiting for zookeeper to start...
>>
>> > >
>>
>> > > ^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>>
>> > > EXECUTING: start kafka
>>
>> > > Waiting for kafka to start...
>>
>> > > Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .Ncat: Connection refused.
>>
>> > > .^C
>>
>> > > [root@codehdplak-po-r19p hello-samza]#
>>
>> > >
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 12:43 PM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Yes. You can clone apache/samza locally and build it with:
>>
>> > >
>>
>> > >
>>
>> > > cd <samza-workspace>
>>
>> > >
>>
>> > > gradle -b bootstrap.gradle
>>
>> > >
>>
>> > > ./gradlew clean build -x test
>>
>> > >
>>
>> > > ./gradlew publishToMavenLocal ## This publishes a snapshot version
>> of
>>
>> > > the latest apache/samza into your local maven repo
>>
>> > >
>>
>> > >
>>
>> > > Then, head to hello-samza workspace and build again:
>>
>> > >
>>
>> > > cd <hello-samza-workspace>
>>
>> > >
>>
>> > > mvn clean package ## This should create a build target
>>
>> > >
>>
>> > > ./bin/grid install zookeeper
>>
>> > >
>>
>> > > ./bin/grid start zookeeper
>>
>> > >
>>
>> > > ./bin/grid install kafka
>>
>> > >
>>
>> > > ./bin/grid start kafka
>>
>> > >
>>
>> > > ./bin/grid install yarn
>>
>> > >
>>
>> > > ./bin/grid start yarn
>>
>> > >
>>
>> > >
>>
>> > > mkdir -p deploy/samza
>>
>> > >
>>
>> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>>
>> > >
>>
>> > >
>>
>> > > After this, you can follow steps in the tutorial to "Run" the
>>
>> > > example Samza job.
>>
>> > >
>>
>> > >
>>
>> > > HTH! Let me know if you need further help.
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > Is there any other way we can install Hello Samza?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:42 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Ok. I tried again for the "latest" branch in hello-samza and it
>>
>> > > still works.
>>
>> > >
>>
>> > >
>>
>> > > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > It is expected to build from "master" in apache/samza repo. So, the
>>
>> > > output line is expected.
>>
>> > >
>>
>> > >
>>
>> > > It is weird that you are unable to connect. Is it possible you are
>>
>> > > behind a firewall or something? Can you try to ping "git.apache.org"
>> ?
>>
>> > > Or try the setup on a different box?
>>
>> > >
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Navina,
>>
>> > >
>>
>> > > I tried again but still same error
>>
>> > >
>>
>> > > While installing it says "Building samza from master..."
>>
>> > >
>>
>> > > But when after I cloned I executed " git checkout latest"
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> > >
>>
>> > > -----Original Message-----
>>
>> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>>
>> > > Sent: Tuesday, September 12, 2017 11:10 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi Anantharaman,
>>
>> > >
>>
>> > > It looks like a transient connection failure to connect to Apache's
>>
>> > > git. I tried on my host and it seems to be working.
>>
>> > >
>>
>> > > Can you give it another shot?
>>
>> > >
>>
>> > >
>>
>> > > If it still doesn't work, please let me know if you are running the
>>
>> > > command under the "master" or "latest" branch of samza-hello-samza.
>>
>> > >
>>
>> > >
>>
>> > > Thanks!
>>
>> > >
>>
>> > > Navina
>>
>> > >
>>
>> > > ________________________________
>>
>> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>>
>> > > comcast.com>
>>
>> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>>
>> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>>
>> > > Subject: Connection timed out error while installing "Hello Samza"
>>
>> > >
>>
>> > > Hi,
>>
>> > >
>>
>> > > I am trying to install "Hello Samza" on a single node Initially I
>>
>> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
>>
>> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>>
>> > > connection timed out error It also mentions no kafka, yarn and
>>
>> > > zookeeper installed
>>
>> > >
>>
>> > > Please find below the error message
>>
>> > >
>>
>> > > [root@codehdplak-po-r19p bin]# cd ..
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>>
>> > > EXECUTING: install kafka
>>
>> > > Using previously downloaded file /root/.samza/download/kafka_2.
>>
>> > > 11-0.10.1.1.tgz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>>
>> > > EXECUTING: install yarn
>>
>> > > Using previously downloaded file
>>
>> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>>
>> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>>
>> > > EXECUTING: install zookeeper
>>
>> > > Using previously downloaded file /root/.samza/download/
>>
>> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>>
>> > > bin/grid bootstrap Bootstrapping the system...
>>
>> > > EXECUTING: stop kafka
>>
>> > > No kafka server to stop
>>
>> > > EXECUTING: stop yarn
>>
>> > > no resourcemanager to stop
>>
>> > > no nodemanager to stop
>>
>> > > EXECUTING: stop zookeeper
>>
>> > > JMX enabled by default
>>
>> > > Using config:
>>
>> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>>
>> > > bin/../conf/zoo.cfg
>>
>> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>>
>> > > /tmp/zookeeper/zookeeper_server.pid)
>>
>> > > EXECUTING: install samza
>>
>> > > Building samza from master...
>>
>> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>>
>> > > Cloning into 'samza'...
>>
>> > > fatal: unable to connect to git.apache.org:
>>
>> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>>
>> > >
>>
>> > >
>>
>> > > Could you please help me to resolve this issue?
>>
>> > >
>>
>> > > Regards,
>>
>> > > ~Sri
>>
>> > >
>>
>> >
>>
>
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
Hi, Ananarath,
It is very strange that you are seeing this timeout exception that we do
not see. I am trying to follow the exact steps you did to see whether there
is anything broken. I will update you this afternoon.
Meanwhile, could you check your hostname setup and firewall configuration
to see whether your local laptop has blocked access via the public IP
address to your laptop? Could you verify that your localhost is resolved to
127.0.0.1 and is accessible?
-Yi
On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> Yi,
>
> Is there any alternate way to install Samza Or solution to the connection
> time out error?
>
> Regards,
> ~Sri
>
> From: Anantharaman, Srinatha (Contractor)
> Sent: Wednesday, September 13, 2017 11:37 AM
> To: dev@samza.apache.org
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
>
> Yi,
>
>
>
> I am trying to build Samza locally by following the steps provided by
> Navina.
>
> As per those steps kafka will be installed after Zookeeper, I am getting
> Error while starting Zookeeper after it is installed
>
>
>
>
>
> Steps Followed :
>
>
>
> Yes. You can clone apache/samza locally and build it with:
>
>
>
>
>
> cd <samza-workspace>
>
>
>
> gradle -b bootstrap.gradle
>
>
>
> ./gradlew clean build -x test
>
>
>
> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> the latest apache/samza into your local maven repo
>
>
>
>
>
> Then, head to hello-samza workspace and build again:
>
>
>
> cd <hello-samza-workspace>
>
>
>
> mvn clean package ## This should create a build target
>
>
>
> ./bin/grid install zookeeper
>
>
>
> ./bin/grid start zookeeper
>
>
>
> ./bin/grid install kafka
>
>
>
> ./bin/grid start kafka
>
>
>
> ./bin/grid install yarn
>
>
>
> ./bin/grid start yarn
>
>
>
>
>
> mkdir -p deploy/samza
>
>
>
> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>
>
>
>
>
> NOTE : BTW From the above steps I could not execute " gradle -b
> bootstrap.gradle" since that command does not exists
>
>
>
> Regards,
>
> ~Sri
>
>
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Tuesday, September 12, 2017 7:13 PM
> To: dev@samza.apache.org<ma...@samza.apache.org>
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
>
>
> Hi, Anantharam,
>
>
>
> Could you confirm at which step your setup failed? It seems that your
> zookeeper server is running. Could you check to see whether your Kafka
> broker is running? You can either do a telnet localhost 9092 or do a ps
> auxww | grep kafka to see whether you got any broker running.
>
>
>
> Sometimes, the Kafka service takes time to start on a single laptop. You
> can just try to run ./bin/grid start kafka
>
>
>
> again to see whether the service is up.
>
>
>
> Thanks!
>
>
>
> -Yi
>
>
>
> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com<ma...@comcast.com>>
> wrote:
>
>
>
> > Find below Zookeeper logs:
>
> >
>
> > 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101] -
>
> > Reading configuration from: /app/home/eventsvc/samza-git/
>
> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>
> > 2017-09-12 17:05:19,133 [myid:] - INFO
>
> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
>
> > 2017-09-12 17:05:19,134 [myid:] - INFO
>
> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>
> > 2017-09-12 17:05:19,134 [myid:] - INFO
>
> > [main:DatadirCleanupManager@101]
>
> > - Purge task is not scheduled.
>
> > 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
>
> > Either no config or no quorum defined in config, running in
>
> > standalone mode
>
> > 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101] -
>
> > Reading configuration from: /app/home/eventsvc/samza-git/
>
> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>
> > 2017-09-12 17:05:19,162 [myid:] - INFO [main:ZooKeeperServerMain@95]
>
> > - Starting server
>
> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48
>
> > GMT
>
> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>
> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:java.version=1.8.0_31
>
> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:java.vendor=Oracle Corporation
>
> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>
> > 8.0.31-2.b13.el7.x86_64/jre
>
> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:java.class.path=/app/home/eventsvc/samza-git/
>
> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>
> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>
> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>
> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>
> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>
> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>
> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>
> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>
> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>
> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>
> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper/bin/../conf:
>
> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>
> > usr/lib64:/lib64:/lib:/usr/lib
>
> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:java.io.tmpdir=/tmp
>
> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:java.compiler=<NA>
>
> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:os.name=Linux
>
> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:os.arch=amd64
>
> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>
> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:user.name=root
>
> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:user.home=/root
>
> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
>
> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>
> > samza/deploy/zookeeper
>
> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] -
>
> > tickTime set to 2000
>
> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] -
>
> > minSessionTimeout set to -1
>
> > 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] -
>
> > maxSessionTimeout set to -1
>
> > 2017-09-12 17:05:19,213 [myid:] - INFO
>
> > [main:NIOServerCnxnFactory@110] - binding to port 0.0.0.0/0.0.0.0:2181
>
> > 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
>
> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>
> > 2017-09-12 17:05:19,673 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>
> > from
>
> > /0:0:0:0:0:0:0:1:21754
>
> > 2017-09-12 17:17:40,265 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>
> > EndOfStreamException: Unable to read additional data from client
>
> > sessionid 0x0, likely client has closed socket
>
> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>
> > NIOServerCnxn.java:220)
>
> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>
> > NIOServerCnxnFactory.java:224)
>
> > at java.lang.Thread.run(Thread.java:745)
>
> > 2017-09-12 17:17:40,267 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for client
>
> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>
> > 2017-09-12 17:18:06,236 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>
> > from /
>
> > 127.0.0.1:48071
>
> > 2017-09-12 17:18:06,247 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
>
> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish new
>
> > session at /127.0.0.1:48071
>
> > 2017-09-12 17:18:06,250 [myid:] - INFO [SyncThread:0:FileTxnLog@199]
>
> > - Creating new log file: log.1
>
> > 2017-09-12 17:18:06,263 [myid:] - INFO
>
> > [SyncThread:0:ZooKeeperServer@604]
>
> > - Established session 0x15e770d61920000 with negotiated timeout 6000
>
> > for client /127.0.0.1:48071
>
> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3
>
> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>
> > NoNode for /brokers
>
> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7
>
> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>
> > NoNode for /config
>
> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x13 zxid:0xc
>
> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>
> > NoNode for /admin
>
> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b zxid:0x11
>
> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>
> > NoNode for /cluster
>
> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>
> > zxid:0x15
>
> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>
> > Error:KeeperErrorCode = NoNode for /controller_epoch
>
> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34 zxid:0x17
>
> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>
> > Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
>
> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f zxid:0x18
>
> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>
> > NodeExists for /brokers
>
> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
>
> > PrepRequestProcessor@617] - Got user-level KeeperException when
>
> > processing sessionid:0x15e770d61920000 type:create cxid:0x40 zxid:0x19
>
> > txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode =
>
> > NodeExists for /brokers/ids
>
> >
>
> >
>
> >
>
> > -----Original Message-----
>
> > From: Yi Pan [mailto:nickpan47@gmail.com]
>
> > Sent: Tuesday, September 12, 2017 2:02 PM
>
> > To: dev@samza.apache.org<ma...@samza.apache.org>
>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> >
>
> > Hi, Anantharaman,
>
> >
>
> > Could you post your zookeeper startup logs here?
>
> >
>
> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor)
>
> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_
> Anantharaman@comcast.com>> wrote:
>
> >
>
> > > It hangs while bringing up the service
>
> > >
>
> > > [root@codehdplak-po-r19p hello-samza]# pwd
>
> > > /app/home/eventsvc/samza-git/hello-samza
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
>
> > > EXECUTING: install zookeeper
>
> > > Using previously downloaded file /root/.samza/download/
>
> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>
> > > ./bin/grid start zookeeper
>
> > > EXECUTING: start zookeeper
>
> > > JMX enabled by default
>
> > > Using config:
>
> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>
> > > bin/../conf/zoo.cfg
>
> > > Starting zookeeper ... STARTED
>
> > > Waiting for zookeeper to start...
>
> > >
>
> > > ^C
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>
> > > EXECUTING: install kafka
>
> > > Using previously downloaded file /root/.samza/download/kafka_2.
>
> > > 11-0.10.1.1.tgz
>
> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>
> > > EXECUTING: start kafka
>
> > > Waiting for kafka to start...
>
> > > Ncat: Connection refused.
>
> > > .Ncat: Connection refused.
>
> > > .Ncat: Connection refused.
>
> > > .^C
>
> > > [root@codehdplak-po-r19p hello-samza]#
>
> > >
>
> > >
>
> > >
>
> > > -----Original Message-----
>
> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>
> > > Sent: Tuesday, September 12, 2017 12:43 PM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Yes. You can clone apache/samza locally and build it with:
>
> > >
>
> > >
>
> > > cd <samza-workspace>
>
> > >
>
> > > gradle -b bootstrap.gradle
>
> > >
>
> > > ./gradlew clean build -x test
>
> > >
>
> > > ./gradlew publishToMavenLocal ## This publishes a snapshot version
> of
>
> > > the latest apache/samza into your local maven repo
>
> > >
>
> > >
>
> > > Then, head to hello-samza workspace and build again:
>
> > >
>
> > > cd <hello-samza-workspace>
>
> > >
>
> > > mvn clean package ## This should create a build target
>
> > >
>
> > > ./bin/grid install zookeeper
>
> > >
>
> > > ./bin/grid start zookeeper
>
> > >
>
> > > ./bin/grid install kafka
>
> > >
>
> > > ./bin/grid start kafka
>
> > >
>
> > > ./bin/grid install yarn
>
> > >
>
> > > ./bin/grid start yarn
>
> > >
>
> > >
>
> > > mkdir -p deploy/samza
>
> > >
>
> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>
> > >
>
> > >
>
> > > After this, you can follow steps in the tutorial to "Run" the
>
> > > example Samza job.
>
> > >
>
> > >
>
> > > HTH! Let me know if you need further help.
>
> > >
>
> > > Navina
>
> > >
>
> > > ________________________________
>
> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>
> > > comcast.com>
>
> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>
> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Navina,
>
> > >
>
> > > Is there any other way we can install Hello Samza?
>
> > >
>
> > > Regards,
>
> > > ~Sri
>
> > >
>
> > > -----Original Message-----
>
> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>
> > > Sent: Tuesday, September 12, 2017 11:42 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Ok. I tried again for the "latest" branch in hello-samza and it
>
> > > still works.
>
> > >
>
> > >
>
> > > > While installing it says "Building samza from master..."
>
> > >
>
> > > It is expected to build from "master" in apache/samza repo. So, the
>
> > > output line is expected.
>
> > >
>
> > >
>
> > > It is weird that you are unable to connect. Is it possible you are
>
> > > behind a firewall or something? Can you try to ping "git.apache.org" ?
>
> > > Or try the setup on a different box?
>
> > >
>
> > >
>
> > > Navina
>
> > >
>
> > > ________________________________
>
> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>
> > > comcast.com>
>
> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>
> > > Subject: RE: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Navina,
>
> > >
>
> > > I tried again but still same error
>
> > >
>
> > > While installing it says "Building samza from master..."
>
> > >
>
> > > But when after I cloned I executed " git checkout latest"
>
> > >
>
> > > Regards,
>
> > > ~Sri
>
> > >
>
> > >
>
> > > -----Original Message-----
>
> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>
> > > Sent: Tuesday, September 12, 2017 11:10 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Hi Anantharaman,
>
> > >
>
> > > It looks like a transient connection failure to connect to Apache's
>
> > > git. I tried on my host and it seems to be working.
>
> > >
>
> > > Can you give it another shot?
>
> > >
>
> > >
>
> > > If it still doesn't work, please let me know if you are running the
>
> > > command under the "master" or "latest" branch of samza-hello-samza.
>
> > >
>
> > >
>
> > > Thanks!
>
> > >
>
> > > Navina
>
> > >
>
> > > ________________________________
>
> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>
> > > comcast.com>
>
> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>
> > > To: dev@samza.apache.org<ma...@samza.apache.org>
>
> > > Subject: Connection timed out error while installing "Hello Samza"
>
> > >
>
> > > Hi,
>
> > >
>
> > > I am trying to install "Hello Samza" on a single node Initially I
>
> > > have installed Kafka, Yarn and Zookeeper using bin/grid install
>
> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>
> > > connection timed out error It also mentions no kafka, yarn and
>
> > > zookeeper installed
>
> > >
>
> > > Please find below the error message
>
> > >
>
> > > [root@codehdplak-po-r19p bin]# cd ..
>
> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
>
> > > EXECUTING: install kafka
>
> > > Using previously downloaded file /root/.samza/download/kafka_2.
>
> > > 11-0.10.1.1.tgz
>
> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>
> > > EXECUTING: install yarn
>
> > > Using previously downloaded file
>
> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>
> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>
> > > EXECUTING: install zookeeper
>
> > > Using previously downloaded file /root/.samza/download/
>
> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>
> > > bin/grid bootstrap Bootstrapping the system...
>
> > > EXECUTING: stop kafka
>
> > > No kafka server to stop
>
> > > EXECUTING: stop yarn
>
> > > no resourcemanager to stop
>
> > > no nodemanager to stop
>
> > > EXECUTING: stop zookeeper
>
> > > JMX enabled by default
>
> > > Using config:
>
> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>
> > > bin/../conf/zoo.cfg
>
> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>
> > > /tmp/zookeeper/zookeeper_server.pid)
>
> > > EXECUTING: install samza
>
> > > Building samza from master...
>
> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>
> > > Cloning into 'samza'...
>
> > > fatal: unable to connect to git.apache.org:
>
> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
> > >
>
> > >
>
> > > Could you please help me to resolve this issue?
>
> > >
>
> > > Regards,
>
> > > ~Sri
>
> > >
>
> >
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Yi,
Is there any alternate way to install Samza Or solution to the connection time out error?
Regards,
~Sri
From: Anantharaman, Srinatha (Contractor)
Sent: Wednesday, September 13, 2017 11:37 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Yi,
I am trying to build Samza locally by following the steps provided by Navina.
As per those steps kafka will be installed after Zookeeper, I am getting Error while starting Zookeeper after it is installed
Steps Followed :
Yes. You can clone apache/samza locally and build it with:
cd <samza-workspace>
gradle -b bootstrap.gradle
./gradlew clean build -x test
./gradlew publishToMavenLocal ## This publishes a snapshot version of the latest apache/samza into your local maven repo
Then, head to hello-samza workspace and build again:
cd <hello-samza-workspace>
mvn clean package ## This should create a build target
./bin/grid install zookeeper
./bin/grid start zookeeper
./bin/grid install kafka
./bin/grid start kafka
./bin/grid install yarn
./bin/grid start yarn
mkdir -p deploy/samza
tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
NOTE : BTW From the above steps I could not execute " gradle -b bootstrap.gradle" since that command does not exists
Regards,
~Sri
-----Original Message-----
From: Yi Pan [mailto:nickpan47@gmail.com]
Sent: Tuesday, September 12, 2017 7:13 PM
To: dev@samza.apache.org<ma...@samza.apache.org>
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharam,
Could you confirm at which step your setup failed? It seems that your zookeeper server is running. Could you check to see whether your Kafka broker is running? You can either do a telnet localhost 9092 or do a ps auxww | grep kafka to see whether you got any broker running.
Sometimes, the Kafka service takes time to start on a single laptop. You can just try to run ./bin/grid start kafka
again to see whether the service is up.
Thanks!
-Yi
On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com<ma...@comcast.com>> wrote:
> Find below Zookeeper logs:
>
> 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101] -
> Reading configuration from: /app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> 2017-09-12 17:05:19,133 [myid:] - INFO
> [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
> 2017-09-12 17:05:19,134 [myid:] - INFO
> [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
> 2017-09-12 17:05:19,134 [myid:] - INFO
> [main:DatadirCleanupManager@101]
> - Purge task is not scheduled.
> 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
> Either no config or no quorum defined in config, running in
> standalone mode
> 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101] -
> Reading configuration from: /app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> 2017-09-12 17:05:19,162 [myid:] - INFO [main:ZooKeeperServerMain@95]
> - Starting server
> 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - Server
> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48
> GMT
> 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
> environment:host.name=codehdplak-po-r19p.sys.comcast.net
> 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
> environment:java.version=1.8.0_31
> 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
> environment:java.vendor=Oracle Corporation
> 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
> environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> 8.0.31-2.b13.el7.x86_64/jre
> 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
> environment:java.class.path=/app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../conf:
> 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
> environment:java.library.path=/usr/java/packages/lib/amd64:/
> usr/lib64:/lib64:/lib:/usr/lib
> 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
> environment:java.io.tmpdir=/tmp
> 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
> environment:java.compiler=<NA>
> 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
> environment:os.name=Linux
> 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
> environment:os.arch=amd64
> 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
> environment:os.version=3.10.0-123.20.1.el7.x86_64
> 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
> environment:user.name=root
> 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
> environment:user.home=/root
> 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
> environment:user.dir=/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] -
> tickTime set to 2000
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] -
> minSessionTimeout set to -1
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] -
> maxSessionTimeout set to -1
> 2017-09-12 17:05:19,213 [myid:] - INFO
> [main:NIOServerCnxnFactory@110] - binding to port 0.0.0.0/0.0.0.0:2181
> 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
> Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> 2017-09-12 17:05:19,673 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
> from
> /0:0:0:0:0:0:0:1:21754
> 2017-09-12 17:17:40,265 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
> EndOfStreamException: Unable to read additional data from client
> sessionid 0x0, likely client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> NIOServerCnxn.java:220)
> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> NIOServerCnxnFactory.java:224)
> at java.lang.Thread.run(Thread.java:745)
> 2017-09-12 17:17:40,267 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for client
> /0:0:0:0:0:0:0:1:21754 (no session established for client)
> 2017-09-12 17:18:06,236 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
> from /
> 127.0.0.1:48071
> 2017-09-12 17:18:06,247 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish new
> session at /127.0.0.1:48071
> 2017-09-12 17:18:06,250 [myid:] - INFO [SyncThread:0:FileTxnLog@199]
> - Creating new log file: log.1
> 2017-09-12 17:18:06,263 [myid:] - INFO
> [SyncThread:0:ZooKeeperServer@604]
> - Established session 0x15e770d61920000 with negotiated timeout 6000
> for client /127.0.0.1:48071
> 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3
> txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
> NoNode for /brokers
> 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7
> txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
> NoNode for /config
> 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x13 zxid:0xc
> txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
> NoNode for /admin
> 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x1b zxid:0x11
> txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
> NoNode for /cluster
> 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:setData cxid:0x25
> zxid:0x15
> txntype:-1 reqpath:n/a Error Path:/controller_epoch
> Error:KeeperErrorCode = NoNode for /controller_epoch
> 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:delete cxid:0x34 zxid:0x17
> txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
> Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
> 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x3f zxid:0x18
> txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
> NodeExists for /brokers
> 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x40 zxid:0x19
> txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode =
> NodeExists for /brokers/ids
>
>
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Tuesday, September 12, 2017 2:02 PM
> To: dev@samza.apache.org<ma...@samza.apache.org>
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi, Anantharaman,
>
> Could you post your zookeeper startup logs here?
>
> On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor)
> < Srinatha_Anantharaman@comcast.com<ma...@comcast.com>> wrote:
>
> > It hangs while bringing up the service
> >
> > [root@codehdplak-po-r19p hello-samza]# pwd
> > /app/home/eventsvc/samza-git/hello-samza
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Using previously downloaded file /root/.samza/download/
> > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> > ./bin/grid start zookeeper
> > EXECUTING: start zookeeper
> > JMX enabled by default
> > Using config:
> > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > bin/../conf/zoo.cfg
> > Starting zookeeper ... STARTED
> > Waiting for zookeeper to start...
> >
> > ^C
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
> > EXECUTING: install kafka
> > Using previously downloaded file /root/.samza/download/kafka_2.
> > 11-0.10.1.1.tgz
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
> > EXECUTING: start kafka
> > Waiting for kafka to start...
> > Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .^C
> > [root@codehdplak-po-r19p hello-samza]#
> >
> >
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 12:43 PM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Yes. You can clone apache/samza locally and build it with:
> >
> >
> > cd <samza-workspace>
> >
> > gradle -b bootstrap.gradle
> >
> > ./gradlew clean build -x test
> >
> > ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> > the latest apache/samza into your local maven repo
> >
> >
> > Then, head to hello-samza workspace and build again:
> >
> > cd <hello-samza-workspace>
> >
> > mvn clean package ## This should create a build target
> >
> > ./bin/grid install zookeeper
> >
> > ./bin/grid start zookeeper
> >
> > ./bin/grid install kafka
> >
> > ./bin/grid start kafka
> >
> > ./bin/grid install yarn
> >
> > ./bin/grid start yarn
> >
> >
> > mkdir -p deploy/samza
> >
> > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
> >
> >
> > After this, you can follow steps in the tutorial to "Run" the
> > example Samza job.
> >
> >
> > HTH! Let me know if you need further help.
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: RE: Connection timed out error while installing "Hello Samza"
> >
> > Navina,
> >
> > Is there any other way we can install Hello Samza?
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 11:42 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Ok. I tried again for the "latest" branch in hello-samza and it
> > still works.
> >
> >
> > > While installing it says "Building samza from master..."
> >
> > It is expected to build from "master" in apache/samza repo. So, the
> > output line is expected.
> >
> >
> > It is weird that you are unable to connect. Is it possible you are
> > behind a firewall or something? Can you try to ping "git.apache.org" ?
> > Or try the setup on a different box?
> >
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: RE: Connection timed out error while installing "Hello Samza"
> >
> > Navina,
> >
> > I tried again but still same error
> >
> > While installing it says "Building samza from master..."
> >
> > But when after I cloned I executed " git checkout latest"
> >
> > Regards,
> > ~Sri
> >
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 11:10 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Hi Anantharaman,
> >
> > It looks like a transient connection failure to connect to Apache's
> > git. I tried on my host and it seems to be working.
> >
> > Can you give it another shot?
> >
> >
> > If it still doesn't work, please let me know if you are running the
> > command under the "master" or "latest" branch of samza-hello-samza.
> >
> >
> > Thanks!
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > To: dev@samza.apache.org<ma...@samza.apache.org>
> > Subject: Connection timed out error while installing "Hello Samza"
> >
> > Hi,
> >
> > I am trying to install "Hello Samza" on a single node Initially I
> > have installed Kafka, Yarn and Zookeeper using bin/grid install
> > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
> > connection timed out error It also mentions no kafka, yarn and
> > zookeeper installed
> >
> > Please find below the error message
> >
> > [root@codehdplak-po-r19p bin]# cd ..
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
> > EXECUTING: install kafka
> > Using previously downloaded file /root/.samza/download/kafka_2.
> > 11-0.10.1.1.tgz
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> > EXECUTING: install yarn
> > Using previously downloaded file
> > /root/.samza/download/hadoop-2.6.1.tar.gz
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Using previously downloaded file /root/.samza/download/
> > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> > bin/grid bootstrap Bootstrapping the system...
> > EXECUTING: stop kafka
> > No kafka server to stop
> > EXECUTING: stop yarn
> > no resourcemanager to stop
> > no nodemanager to stop
> > EXECUTING: stop zookeeper
> > JMX enabled by default
> > Using config:
> > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > bin/../conf/zoo.cfg
> > Stopping zookeeper ... no zookeeper to stop (could not find file
> > /tmp/zookeeper/zookeeper_server.pid)
> > EXECUTING: install samza
> > Building samza from master...
> > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> > Cloning into 'samza'...
> > fatal: unable to connect to git.apache.org:
> > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >
> >
> > Could you please help me to resolve this issue?
> >
> > Regards,
> > ~Sri
> >
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
Hi, Anantharam,
Could you confirm at which step your setup failed? It seems that your
zookeeper server is running. Could you check to see whether your Kafka
broker is running? You can either do a telnet localhost 9092 or do a ps
auxww | grep kafka to see whether you got any broker running.
Sometimes, the Kafka service takes time to start on a single laptop. You
can just try to run
./bin/grid start kafka
again to see whether the service is up.
Thanks!
-Yi
On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> Find below Zookeeper logs:
>
> 2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101] -
> Reading configuration from: /app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> 2017-09-12 17:05:19,133 [myid:] - INFO [main:DatadirCleanupManager@78] -
> autopurge.snapRetainCount set to 3
> 2017-09-12 17:05:19,134 [myid:] - INFO [main:DatadirCleanupManager@79] -
> autopurge.purgeInterval set to 0
> 2017-09-12 17:05:19,134 [myid:] - INFO [main:DatadirCleanupManager@101]
> - Purge task is not scheduled.
> 2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] -
> Either no config or no quorum defined in config, running in standalone mode
> 2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101] -
> Reading configuration from: /app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> 2017-09-12 17:05:19,162 [myid:] - INFO [main:ZooKeeperServerMain@95] -
> Starting server
> 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - Server
> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
> 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
> environment:host.name=codehdplak-po-r19p.sys.comcast.net
> 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server
> environment:java.version=1.8.0_31
> 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
> environment:java.vendor=Oracle Corporation
> 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server
> environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> 8.0.31-2.b13.el7.x86_64/jre
> 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
> environment:java.class.path=/app/home/eventsvc/samza-git/
> hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
> app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
> eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper/bin/../conf:
> 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server
> environment:java.library.path=/usr/java/packages/lib/amd64:/
> usr/lib64:/lib64:/lib:/usr/lib
> 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
> environment:java.io.tmpdir=/tmp
> 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server
> environment:java.compiler=<NA>
> 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
> environment:os.name=Linux
> 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server
> environment:os.arch=amd64
> 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
> environment:os.version=3.10.0-123.20.1.el7.x86_64
> 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server
> environment:user.name=root
> 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
> environment:user.home=/root
> 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server
> environment:user.dir=/app/home/eventsvc/samza-git/hello-
> samza/deploy/zookeeper
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] -
> tickTime set to 2000
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] -
> minSessionTimeout set to -1
> 2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] -
> maxSessionTimeout set to -1
> 2017-09-12 17:05:19,213 [myid:] - INFO [main:NIOServerCnxnFactory@110] -
> binding to port 0.0.0.0/0.0.0.0:2181
> 2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] -
> Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> 2017-09-12 17:05:19,673 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection from
> /0:0:0:0:0:0:0:1:21754
> 2017-09-12 17:17:40,265 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
> EndOfStreamException: Unable to read additional data from client sessionid
> 0x0, likely client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> NIOServerCnxn.java:220)
> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> NIOServerCnxnFactory.java:224)
> at java.lang.Thread.run(Thread.java:745)
> 2017-09-12 17:17:40,267 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for client
> /0:0:0:0:0:0:0:1:21754 (no session established for client)
> 2017-09-12 17:18:06,236 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection from /
> 127.0.0.1:48071
> 2017-09-12 17:18:06,247 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/
> 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish new
> session at /127.0.0.1:48071
> 2017-09-12 17:18:06,250 [myid:] - INFO [SyncThread:0:FileTxnLog@199] -
> Creating new log file: log.1
> 2017-09-12 17:18:06,263 [myid:] - INFO [SyncThread:0:ZooKeeperServer@604]
> - Established session 0x15e770d61920000 with negotiated timeout 6000 for
> client /127.0.0.1:48071
> 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3
> txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode
> for /brokers
> 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7
> txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode
> for /config
> 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x13 zxid:0xc
> txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode = NoNode for
> /admin
> 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x1b zxid:0x11
> txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode = NoNode
> for /cluster
> 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:setData cxid:0x25 zxid:0x15
> txntype:-1 reqpath:n/a Error Path:/controller_epoch Error:KeeperErrorCode =
> NoNode for /controller_epoch
> 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:delete cxid:0x34 zxid:0x17
> txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
> Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
> 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x3f zxid:0x18
> txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
> NodeExists for /brokers
> 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::
> PrepRequestProcessor@617] - Got user-level KeeperException when
> processing sessionid:0x15e770d61920000 type:create cxid:0x40 zxid:0x19
> txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode =
> NodeExists for /brokers/ids
>
>
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpan47@gmail.com]
> Sent: Tuesday, September 12, 2017 2:02 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi, Anantharaman,
>
> Could you post your zookeeper startup logs here?
>
> On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
> > It hangs while bringing up the service
> >
> > [root@codehdplak-po-r19p hello-samza]# pwd
> > /app/home/eventsvc/samza-git/hello-samza
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Using previously downloaded file /root/.samza/download/
> > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> > ./bin/grid start zookeeper
> > EXECUTING: start zookeeper
> > JMX enabled by default
> > Using config:
> > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > bin/../conf/zoo.cfg
> > Starting zookeeper ... STARTED
> > Waiting for zookeeper to start...
> >
> > ^C
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
> > EXECUTING: install kafka
> > Using previously downloaded file /root/.samza/download/kafka_2.
> > 11-0.10.1.1.tgz
> > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
> > EXECUTING: start kafka
> > Waiting for kafka to start...
> > Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .Ncat: Connection refused.
> > .^C
> > [root@codehdplak-po-r19p hello-samza]#
> >
> >
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 12:43 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Yes. You can clone apache/samza locally and build it with:
> >
> >
> > cd <samza-workspace>
> >
> > gradle -b bootstrap.gradle
> >
> > ./gradlew clean build -x test
> >
> > ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> > the latest apache/samza into your local maven repo
> >
> >
> > Then, head to hello-samza workspace and build again:
> >
> > cd <hello-samza-workspace>
> >
> > mvn clean package ## This should create a build target
> >
> > ./bin/grid install zookeeper
> >
> > ./bin/grid start zookeeper
> >
> > ./bin/grid install kafka
> >
> > ./bin/grid start kafka
> >
> > ./bin/grid install yarn
> >
> > ./bin/grid start yarn
> >
> >
> > mkdir -p deploy/samza
> >
> > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
> >
> >
> > After this, you can follow steps in the tutorial to "Run" the example
> > Samza job.
> >
> >
> > HTH! Let me know if you need further help.
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > To: dev@samza.apache.org
> > Subject: RE: Connection timed out error while installing "Hello Samza"
> >
> > Navina,
> >
> > Is there any other way we can install Hello Samza?
> >
> > Regards,
> > ~Sri
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 11:42 AM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Ok. I tried again for the "latest" branch in hello-samza and it still
> > works.
> >
> >
> > > While installing it says "Building samza from master..."
> >
> > It is expected to build from "master" in apache/samza repo. So, the
> > output line is expected.
> >
> >
> > It is weird that you are unable to connect. Is it possible you are
> > behind a firewall or something? Can you try to ping "git.apache.org" ?
> > Or try the setup on a different box?
> >
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > To: dev@samza.apache.org
> > Subject: RE: Connection timed out error while installing "Hello Samza"
> >
> > Navina,
> >
> > I tried again but still same error
> >
> > While installing it says "Building samza from master..."
> >
> > But when after I cloned I executed " git checkout latest"
> >
> > Regards,
> > ~Sri
> >
> >
> > -----Original Message-----
> > From: Navina Ramesh [mailto:nramesh@linkedin.com]
> > Sent: Tuesday, September 12, 2017 11:10 AM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > Hi Anantharaman,
> >
> > It looks like a transient connection failure to connect to Apache's
> > git. I tried on my host and it seems to be working.
> >
> > Can you give it another shot?
> >
> >
> > If it still doesn't work, please let me know if you are running the
> > command under the "master" or "latest" branch of samza-hello-samza.
> >
> >
> > Thanks!
> >
> > Navina
> >
> > ________________________________
> > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> > comcast.com>
> > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > To: dev@samza.apache.org
> > Subject: Connection timed out error while installing "Hello Samza"
> >
> > Hi,
> >
> > I am trying to install "Hello Samza" on a single node Initially I have
> > installed Kafka, Yarn and Zookeeper using bin/grid install
> > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
> > connection timed out error It also mentions no kafka, yarn and
> > zookeeper installed
> >
> > Please find below the error message
> >
> > [root@codehdplak-po-r19p bin]# cd ..
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
> > EXECUTING: install kafka
> > Using previously downloaded file /root/.samza/download/kafka_2.
> > 11-0.10.1.1.tgz
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> > EXECUTING: install yarn
> > Using previously downloaded file
> > /root/.samza/download/hadoop-2.6.1.tar.gz
> > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
> > EXECUTING: install zookeeper
> > Using previously downloaded file /root/.samza/download/
> > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]# bin/grid
> > bootstrap Bootstrapping the system...
> > EXECUTING: stop kafka
> > No kafka server to stop
> > EXECUTING: stop yarn
> > no resourcemanager to stop
> > no nodemanager to stop
> > EXECUTING: stop zookeeper
> > JMX enabled by default
> > Using config:
> > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > bin/../conf/zoo.cfg
> > Stopping zookeeper ... no zookeeper to stop (could not find file
> > /tmp/zookeeper/zookeeper_server.pid)
> > EXECUTING: install samza
> > Building samza from master...
> > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> > Cloning into 'samza'...
> > fatal: unable to connect to git.apache.org:
> > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> >
> >
> > Could you please help me to resolve this issue?
> >
> > Regards,
> > ~Sri
> >
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Find below Zookeeper logs:
2017-09-12 17:05:19,124 [myid:] - INFO [main:QuorumPeerConfig@101] - Reading configuration from: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
2017-09-12 17:05:19,133 [myid:] - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
2017-09-12 17:05:19,134 [myid:] - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
2017-09-12 17:05:19,134 [myid:] - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled.
2017-09-12 17:05:19,135 [myid:] - WARN [main:QuorumPeerMain@113] - Either no config or no quorum defined in config, running in standalone mode
2017-09-12 17:05:19,161 [myid:] - INFO [main:QuorumPeerConfig@101] - Reading configuration from: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
2017-09-12 17:05:19,162 [myid:] - INFO [main:ZooKeeperServerMain@95] - Starting server
2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - Server environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server environment:host.name=codehdplak-po-r19p.sys.comcast.net
2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - Server environment:java.version=1.8.0_31
2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server environment:java.vendor=Oracle Corporation
2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - Server environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.31-2.b13.el7.x86_64/jre
2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server environment:java.class.path=/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../build/classes:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../build/lib/*.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.2.2.Final.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf:
2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server environment:java.io.tmpdir=/tmp
2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - Server environment:java.compiler=<NA>
2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server environment:os.name=Linux
2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - Server environment:os.arch=amd64
2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server environment:os.version=3.10.0-123.20.1.el7.x86_64
2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - Server environment:user.name=root
2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server environment:user.home=/root
2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - Server environment:user.dir=/app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper
2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@733] - tickTime set to 2000
2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@742] - minSessionTimeout set to -1
2017-09-12 17:05:19,195 [myid:] - INFO [main:ZooKeeperServer@751] - maxSessionTimeout set to -1
2017-09-12 17:05:19,213 [myid:] - INFO [main:NIOServerCnxnFactory@110] - binding to port 0.0.0.0/0.0.0.0:2181
2017-09-12 17:05:19,240 [myid:] - INFO [main:FileTxnSnapLog@238] - Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
2017-09-12 17:05:19,673 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection from /0:0:0:0:0:0:0:1:21754
2017-09-12 17:17:40,265 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:224)
at java.lang.Thread.run(Thread.java:745)
2017-09-12 17:17:40,267 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for client /0:0:0:0:0:0:0:1:21754 (no session established for client)
2017-09-12 17:18:06,236 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection from /127.0.0.1:48071
2017-09-12 17:18:06,247 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish new session at /127.0.0.1:48071
2017-09-12 17:18:06,250 [myid:] - INFO [SyncThread:0:FileTxnLog@199] - Creating new log file: log.1
2017-09-12 17:18:06,263 [myid:] - INFO [SyncThread:0:ZooKeeperServer@604] - Established session 0x15e770d61920000 with negotiated timeout 6000 for client /127.0.0.1:48071
2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:create cxid:0x5 zxid:0x3 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode for /brokers
2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:create cxid:0xb zxid:0x7 txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode for /config
2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:create cxid:0x13 zxid:0xc txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode = NoNode for /admin
2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:create cxid:0x1b zxid:0x11 txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode = NoNode for /cluster
2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:setData cxid:0x25 zxid:0x15 txntype:-1 reqpath:n/a Error Path:/controller_epoch Error:KeeperErrorCode = NoNode for /controller_epoch
2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:delete cxid:0x34 zxid:0x17 txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:create cxid:0x3f zxid:0x18 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NodeExists for /brokers
2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@617] - Got user-level KeeperException when processing sessionid:0x15e770d61920000 type:create cxid:0x40 zxid:0x19 txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode = NodeExists for /brokers/ids
-----Original Message-----
From: Yi Pan [mailto:nickpan47@gmail.com]
Sent: Tuesday, September 12, 2017 2:02 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi, Anantharaman,
Could you post your zookeeper startup logs here?
On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor) < Srinatha_Anantharaman@comcast.com> wrote:
> It hangs while bringing up the service
>
> [root@codehdplak-po-r19p hello-samza]# pwd
> /app/home/eventsvc/samza-git/hello-samza
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
> EXECUTING: install zookeeper
> Using previously downloaded file /root/.samza/download/
> zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
> ./bin/grid start zookeeper
> EXECUTING: start zookeeper
> JMX enabled by default
> Using config:
> /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> bin/../conf/zoo.cfg
> Starting zookeeper ... STARTED
> Waiting for zookeeper to start...
>
> ^C
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
> EXECUTING: install kafka
> Using previously downloaded file /root/.samza/download/kafka_2.
> 11-0.10.1.1.tgz
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
> EXECUTING: start kafka
> Waiting for kafka to start...
> Ncat: Connection refused.
> .Ncat: Connection refused.
> .Ncat: Connection refused.
> .^C
> [root@codehdplak-po-r19p hello-samza]#
>
>
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> Sent: Tuesday, September 12, 2017 12:43 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Yes. You can clone apache/samza locally and build it with:
>
>
> cd <samza-workspace>
>
> gradle -b bootstrap.gradle
>
> ./gradlew clean build -x test
>
> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> the latest apache/samza into your local maven repo
>
>
> Then, head to hello-samza workspace and build again:
>
> cd <hello-samza-workspace>
>
> mvn clean package ## This should create a build target
>
> ./bin/grid install zookeeper
>
> ./bin/grid start zookeeper
>
> ./bin/grid install kafka
>
> ./bin/grid start kafka
>
> ./bin/grid install yarn
>
> ./bin/grid start yarn
>
>
> mkdir -p deploy/samza
>
> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>
>
> After this, you can follow steps in the tutorial to "Run" the example
> Samza job.
>
>
> HTH! Let me know if you need further help.
>
> Navina
>
> ________________________________
> From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> comcast.com>
> Sent: Tuesday, September 12, 2017 9:21:53 AM
> To: dev@samza.apache.org
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
> Navina,
>
> Is there any other way we can install Hello Samza?
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> Sent: Tuesday, September 12, 2017 11:42 AM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Ok. I tried again for the "latest" branch in hello-samza and it still
> works.
>
>
> > While installing it says "Building samza from master..."
>
> It is expected to build from "master" in apache/samza repo. So, the
> output line is expected.
>
>
> It is weird that you are unable to connect. Is it possible you are
> behind a firewall or something? Can you try to ping "git.apache.org" ?
> Or try the setup on a different box?
>
>
> Navina
>
> ________________________________
> From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> comcast.com>
> Sent: Tuesday, September 12, 2017 8:33:30 AM
> To: dev@samza.apache.org
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
> Navina,
>
> I tried again but still same error
>
> While installing it says "Building samza from master..."
>
> But when after I cloned I executed " git checkout latest"
>
> Regards,
> ~Sri
>
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> Sent: Tuesday, September 12, 2017 11:10 AM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi Anantharaman,
>
> It looks like a transient connection failure to connect to Apache's
> git. I tried on my host and it seems to be working.
>
> Can you give it another shot?
>
>
> If it still doesn't work, please let me know if you are running the
> command under the "master" or "latest" branch of samza-hello-samza.
>
>
> Thanks!
>
> Navina
>
> ________________________________
> From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> comcast.com>
> Sent: Tuesday, September 12, 2017 7:45:37 AM
> To: dev@samza.apache.org
> Subject: Connection timed out error while installing "Hello Samza"
>
> Hi,
>
> I am trying to install "Hello Samza" on a single node Initially I have
> installed Kafka, Yarn and Zookeeper using bin/grid install
> kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
> connection timed out error It also mentions no kafka, yarn and
> zookeeper installed
>
> Please find below the error message
>
> [root@codehdplak-po-r19p bin]# cd ..
> [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
> EXECUTING: install kafka
> Using previously downloaded file /root/.samza/download/kafka_2.
> 11-0.10.1.1.tgz
> [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> EXECUTING: install yarn
> Using previously downloaded file
> /root/.samza/download/hadoop-2.6.1.tar.gz
> [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
> EXECUTING: install zookeeper
> Using previously downloaded file /root/.samza/download/
> zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]# bin/grid
> bootstrap Bootstrapping the system...
> EXECUTING: stop kafka
> No kafka server to stop
> EXECUTING: stop yarn
> no resourcemanager to stop
> no nodemanager to stop
> EXECUTING: stop zookeeper
> JMX enabled by default
> Using config:
> /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> bin/../conf/zoo.cfg
> Stopping zookeeper ... no zookeeper to stop (could not find file
> /tmp/zookeeper/zookeeper_server.pid)
> EXECUTING: install samza
> Building samza from master...
> ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> Cloning into 'samza'...
> fatal: unable to connect to git.apache.org:
> git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
>
> Could you please help me to resolve this issue?
>
> Regards,
> ~Sri
>
Re: Connection timed out error while installing "Hello Samza"
Posted by Yi Pan <ni...@gmail.com>.
Hi, Anantharaman,
Could you post your zookeeper startup logs here?
On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha (Contractor) <
Srinatha_Anantharaman@comcast.com> wrote:
> It hangs while bringing up the service
>
> [root@codehdplak-po-r19p hello-samza]# pwd
> /app/home/eventsvc/samza-git/hello-samza
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
> EXECUTING: install zookeeper
> Using previously downloaded file /root/.samza/download/
> zookeeper-3.4.3.tar.gz
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper
> EXECUTING: start zookeeper
> JMX enabled by default
> Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> bin/../conf/zoo.cfg
> Starting zookeeper ... STARTED
> Waiting for zookeeper to start...
>
> ^C
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
> EXECUTING: install kafka
> Using previously downloaded file /root/.samza/download/kafka_2.
> 11-0.10.1.1.tgz
> [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
> EXECUTING: start kafka
> Waiting for kafka to start...
> Ncat: Connection refused.
> .Ncat: Connection refused.
> .Ncat: Connection refused.
> .^C
> [root@codehdplak-po-r19p hello-samza]#
>
>
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> Sent: Tuesday, September 12, 2017 12:43 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Yes. You can clone apache/samza locally and build it with:
>
>
> cd <samza-workspace>
>
> gradle -b bootstrap.gradle
>
> ./gradlew clean build -x test
>
> ./gradlew publishToMavenLocal ## This publishes a snapshot version of
> the latest apache/samza into your local maven repo
>
>
> Then, head to hello-samza workspace and build again:
>
> cd <hello-samza-workspace>
>
> mvn clean package ## This should create a build target
>
> ./bin/grid install zookeeper
>
> ./bin/grid start zookeeper
>
> ./bin/grid install kafka
>
> ./bin/grid start kafka
>
> ./bin/grid install yarn
>
> ./bin/grid start yarn
>
>
> mkdir -p deploy/samza
>
> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>
>
> After this, you can follow steps in the tutorial to "Run" the example
> Samza job.
>
>
> HTH! Let me know if you need further help.
>
> Navina
>
> ________________________________
> From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> comcast.com>
> Sent: Tuesday, September 12, 2017 9:21:53 AM
> To: dev@samza.apache.org
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
> Navina,
>
> Is there any other way we can install Hello Samza?
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> Sent: Tuesday, September 12, 2017 11:42 AM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Ok. I tried again for the "latest" branch in hello-samza and it still
> works.
>
>
> > While installing it says "Building samza from master..."
>
> It is expected to build from "master" in apache/samza repo. So, the output
> line is expected.
>
>
> It is weird that you are unable to connect. Is it possible you are behind
> a firewall or something? Can you try to ping "git.apache.org" ? Or try
> the setup on a different box?
>
>
> Navina
>
> ________________________________
> From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> comcast.com>
> Sent: Tuesday, September 12, 2017 8:33:30 AM
> To: dev@samza.apache.org
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
> Navina,
>
> I tried again but still same error
>
> While installing it says "Building samza from master..."
>
> But when after I cloned I executed " git checkout latest"
>
> Regards,
> ~Sri
>
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com]
> Sent: Tuesday, September 12, 2017 11:10 AM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi Anantharaman,
>
> It looks like a transient connection failure to connect to Apache's git. I
> tried on my host and it seems to be working.
>
> Can you give it another shot?
>
>
> If it still doesn't work, please let me know if you are running the
> command under the "master" or "latest" branch of samza-hello-samza.
>
>
> Thanks!
>
> Navina
>
> ________________________________
> From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
> comcast.com>
> Sent: Tuesday, September 12, 2017 7:45:37 AM
> To: dev@samza.apache.org
> Subject: Connection timed out error while installing "Hello Samza"
>
> Hi,
>
> I am trying to install "Hello Samza" on a single node Initially I have
> installed Kafka, Yarn and Zookeeper using bin/grid install
> kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting connection
> timed out error It also mentions no kafka, yarn and zookeeper installed
>
> Please find below the error message
>
> [root@codehdplak-po-r19p bin]# cd ..
> [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
> EXECUTING: install kafka
> Using previously downloaded file /root/.samza/download/kafka_2.
> 11-0.10.1.1.tgz
> [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
> EXECUTING: install yarn
> Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
> [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
> EXECUTING: install zookeeper
> Using previously downloaded file /root/.samza/download/
> zookeeper-3.4.3.tar.gz
> [root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap Bootstrapping
> the system...
> EXECUTING: stop kafka
> No kafka server to stop
> EXECUTING: stop yarn
> no resourcemanager to stop
> no nodemanager to stop
> EXECUTING: stop zookeeper
> JMX enabled by default
> Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> bin/../conf/zoo.cfg
> Stopping zookeeper ... no zookeeper to stop (could not find file
> /tmp/zookeeper/zookeeper_server.pid)
> EXECUTING: install samza
> Building samza from master...
> ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
> Cloning into 'samza'...
> fatal: unable to connect to git.apache.org:
> git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>
>
> Could you please help me to resolve this issue?
>
> Regards,
> ~Sri
>
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
It hangs while bringing up the service
[root@codehdplak-po-r19p hello-samza]# pwd
/app/home/eventsvc/samza-git/hello-samza
[root@codehdplak-po-r19p hello-samza]# ./bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper
EXECUTING: start zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
Waiting for zookeeper to start...
^C
[root@codehdplak-po-r19p hello-samza]# ./bin/grid start zookeeper^C
[root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
EXECUTING: start kafka
Waiting for kafka to start...
Ncat: Connection refused.
.Ncat: Connection refused.
.Ncat: Connection refused.
.^C
[root@codehdplak-po-r19p hello-samza]#
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 12:43 PM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Yes. You can clone apache/samza locally and build it with:
cd <samza-workspace>
gradle -b bootstrap.gradle
./gradlew clean build -x test
./gradlew publishToMavenLocal ## This publishes a snapshot version of the latest apache/samza into your local maven repo
Then, head to hello-samza workspace and build again:
cd <hello-samza-workspace>
mvn clean package ## This should create a build target
./bin/grid install zookeeper
./bin/grid start zookeeper
./bin/grid install kafka
./bin/grid start kafka
./bin/grid install yarn
./bin/grid start yarn
mkdir -p deploy/samza
tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
After this, you can follow steps in the tutorial to "Run" the example Samza job.
HTH! Let me know if you need further help.
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 9:21:53 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Navina,
Is there any other way we can install Hello Samza?
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:42 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Ok. I tried again for the "latest" branch in hello-samza and it still works.
> While installing it says "Building samza from master..."
It is expected to build from "master" in apache/samza repo. So, the output line is expected.
It is weird that you are unable to connect. Is it possible you are behind a firewall or something? Can you try to ping "git.apache.org" ? Or try the setup on a different box?
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 8:33:30 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Navina,
I tried again but still same error
While installing it says "Building samza from master..."
But when after I cloned I executed " git checkout latest"
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:10 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi Anantharaman,
It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working.
Can you give it another shot?
If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hello-samza.
Thanks!
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 7:45:37 AM
To: dev@samza.apache.org
Subject: Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting connection timed out error It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri
Re: Connection timed out error while installing "Hello Samza"
Posted by Navina Ramesh <nr...@linkedin.com>.
Yes. You can clone apache/samza locally and build it with:
cd <samza-workspace>
gradle -b bootstrap.gradle
./gradlew clean build -x test
./gradlew publishToMavenLocal ## This publishes a snapshot version of the latest apache/samza into your local maven repo
Then, head to hello-samza workspace and build again:
cd <hello-samza-workspace>
mvn clean package ## This should create a build target
./bin/grid install zookeeper
./bin/grid start zookeeper
./bin/grid install kafka
./bin/grid start kafka
./bin/grid install yarn
./bin/grid start yarn
mkdir -p deploy/samza
tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
After this, you can follow steps in the tutorial to "Run" the example Samza job.
HTH! Let me know if you need further help.
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 9:21:53 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Navina,
Is there any other way we can install Hello Samza?
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:42 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Ok. I tried again for the "latest" branch in hello-samza and it still works.
> While installing it says "Building samza from master..."
It is expected to build from "master" in apache/samza repo. So, the output line is expected.
It is weird that you are unable to connect. Is it possible you are behind a firewall or something? Can you try to ping "git.apache.org" ? Or try the setup on a different box?
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 8:33:30 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Navina,
I tried again but still same error
While installing it says "Building samza from master..."
But when after I cloned I executed " git checkout latest"
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:10 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi Anantharaman,
It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working.
Can you give it another shot?
If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hello-samza.
Thanks!
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 7:45:37 AM
To: dev@samza.apache.org
Subject: Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting connection timed out error It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Navina,
Is there any other way we can install Hello Samza?
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:42 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Ok. I tried again for the "latest" branch in hello-samza and it still works.
> While installing it says "Building samza from master..."
It is expected to build from "master" in apache/samza repo. So, the output line is expected.
It is weird that you are unable to connect. Is it possible you are behind a firewall or something? Can you try to ping "git.apache.org" ? Or try the setup on a different box?
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 8:33:30 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Navina,
I tried again but still same error
While installing it says "Building samza from master..."
But when after I cloned I executed " git checkout latest"
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:10 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi Anantharaman,
It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working.
Can you give it another shot?
If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hello-samza.
Thanks!
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 7:45:37 AM
To: dev@samza.apache.org
Subject: Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting connection timed out error It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Server is not behind the firewall, I am able to clone files from Apache git
Here is the ping result
[root@codehdplak-po-r19p hello-samza]# ping git.apache.org
PING git.apache.org (54.84.58.65) 56(84) bytes of data.
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=1 ttl=43 time=48.6 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=2 ttl=43 time=48.1 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=3 ttl=43 time=47.9 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=4 ttl=43 time=49.1 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=5 ttl=43 time=48.4 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=6 ttl=43 time=48.5 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=7 ttl=43 time=49.3 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=8 ttl=43 time=57.3 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=9 ttl=43 time=57.8 ms
64 bytes from ec2-54-84-58-65.compute-1.amazonaws.com (54.84.58.65): icmp_seq=10 ttl=43 time=63.4 ms
^C
--- git.apache.org ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 9010ms
rtt min/avg/max/mdev = 47.956/51.894/63.437/5.263 ms
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:42 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Ok. I tried again for the "latest" branch in hello-samza and it still works.
> While installing it says "Building samza from master..."
It is expected to build from "master" in apache/samza repo. So, the output line is expected.
It is weird that you are unable to connect. Is it possible you are behind a firewall or something? Can you try to ping "git.apache.org" ? Or try the setup on a different box?
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 8:33:30 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Navina,
I tried again but still same error
While installing it says "Building samza from master..."
But when after I cloned I executed " git checkout latest"
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:10 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi Anantharaman,
It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working.
Can you give it another shot?
If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hello-samza.
Thanks!
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 7:45:37 AM
To: dev@samza.apache.org
Subject: Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting connection timed out error It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri
Re: Connection timed out error while installing "Hello Samza"
Posted by Navina Ramesh <nr...@linkedin.com>.
Ok. I tried again for the "latest" branch in hello-samza and it still works.
> While installing it says "Building samza from master..."
It is expected to build from "master" in apache/samza repo. So, the output line is expected.
It is weird that you are unable to connect. Is it possible you are behind a firewall or something? Can you try to ping "git.apache.org" ? Or try the setup on a different box?
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 8:33:30 AM
To: dev@samza.apache.org
Subject: RE: Connection timed out error while installing "Hello Samza"
Navina,
I tried again but still same error
While installing it says "Building samza from master..."
But when after I cloned I executed " git checkout latest"
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:10 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi Anantharaman,
It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working.
Can you give it another shot?
If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hello-samza.
Thanks!
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 7:45:37 AM
To: dev@samza.apache.org
Subject: Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting connection timed out error It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri
RE: Connection timed out error while installing "Hello Samza"
Posted by "Anantharaman, Srinatha (Contractor)" <Sr...@comcast.com>.
Navina,
I tried again but still same error
While installing it says "Building samza from master..."
But when after I cloned I executed " git checkout latest"
Regards,
~Sri
-----Original Message-----
From: Navina Ramesh [mailto:nramesh@linkedin.com]
Sent: Tuesday, September 12, 2017 11:10 AM
To: dev@samza.apache.org
Subject: Re: Connection timed out error while installing "Hello Samza"
Hi Anantharaman,
It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working.
Can you give it another shot?
If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hello-samza.
Thanks!
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 7:45:37 AM
To: dev@samza.apache.org
Subject: Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting connection timed out error It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri
Re: Connection timed out error while installing "Hello Samza"
Posted by Navina Ramesh <nr...@linkedin.com>.
Hi Anantharaman,
It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working.
Can you give it another shot?
If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of samza-hello-samza.
Thanks!
Navina
________________________________
From: Anantharaman, Srinatha (Contractor) <Sr...@comcast.com>
Sent: Tuesday, September 12, 2017 7:45:37 AM
To: dev@samza.apache.org
Subject: Connection timed out error while installing "Hello Samza"
Hi,
I am trying to install "Hello Samza" on a single node
Initially I have installed Kafka, Yarn and Zookeeper using bin/grid install kafka/yarn/zookeeper
When I am trying bin/grid bootstrap getting connection timed out error
It also mentions no kafka, yarn and zookeeper installed
Please find below the error message
[root@codehdplak-po-r19p bin]# cd ..
[root@codehdplak-po-r19p hello-samza]# bin/grid install kafka
EXECUTING: install kafka
Using previously downloaded file /root/.samza/download/kafka_2.11-0.10.1.1.tgz
[root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
EXECUTING: install yarn
Using previously downloaded file /root/.samza/download/hadoop-2.6.1.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
EXECUTING: install zookeeper
Using previously downloaded file /root/.samza/download/zookeeper-3.4.3.tar.gz
[root@codehdplak-po-r19p hello-samza]# bin/grid bootstrap
Bootstrapping the system...
EXECUTING: stop kafka
No kafka server to stop
EXECUTING: stop yarn
no resourcemanager to stop
no nodemanager to stop
EXECUTING: stop zookeeper
JMX enabled by default
Using config: /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... no zookeeper to stop (could not find file /tmp/zookeeper/zookeeper_server.pid)
EXECUTING: install samza
Building samza from master...
~/.samza/download /app/home/eventsvc/samza-git/hello-samza
Cloning into 'samza'...
fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection timed out
Could you please help me to resolve this issue?
Regards,
~Sri