You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mesos.apache.org by Joe Stein <jo...@stealth.ly> on 2014/02/09 22:45:36 UTC
Ignoring updating pid for framework
Hi, I am bumping up to an issue not sure what I am doing wrong with my
Framework.
I have my Framwork driver starting and after the .run() it hangs on
[error] I0209 21:38:36.741349 1875 sched.cpp:224] No credentials provided.
Attempting to register without authentication
and in the mesos logs I see this
==> /var/log/mesos/mesos-slave.INFO <==
W0209 21:38:39.748651 1080 slave.cpp:1285] Ignoring updating pid for
framework KafkaFramework because it does not exist
==> /var/log/mesos/mesos-master.INFO <==
I0209 21:38:40.289823 1064 master.cpp:1766] Sending 1 offers to framework
KafkaFramework
I0209 21:38:40.747304 1065 master.cpp:844] Re-registering framework
KafkaFramework at scheduler(1)@127.0.1.1:36929
I0209 21:38:40.747475 1065 master.cpp:870] Framework KafkaFramework failed
over
I don't see anything coming into the Scheduler functions either (logging
all entries into the implementation that is extending Scheduler)
Mot sure what is going wrong or I should be doing differently?
Any help is appreciated, thanks!
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
Re: Ignoring updating pid for framework
Posted by Joe Stein <jo...@stealth.ly>.
yup, that was it :)
I setup separate vms and bound master and slave to ip and hooked it up
through zookeeper
My framework is running now (not doing much yet but running is a good
start) Thanks!!!!!
[info] Running kafka.mesos.KafkaFramework
[info] [2014-02-09 23:34:23,573] INFO Mesos framework [{KafkaFramework}]
starting up! (kafka.mesos.KafkaFramework$)
[error] 2014-02-09 23:34:23,580:8653(0x7f4ab57fa700):ZOO_INFO@log_env@658:
Client environment:zookeeper.version=zookeeper C client 3.3.4
[error] 2014-02-09 23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@log_env@662:
Client environment:host.name=precise64
[error] 2014-02-09 23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@log_env@669:
Client environment:os.name=Linux
[error] 2014-02-09 23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@log_env@670:
Client environment:os.arch=3.2.0-23-generic
[error] 2014-02-09 23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@log_env@671:
Client environment:os.version=#36-Ubuntu SMP Tue Apr 10 20:39:51 UTC 2012
[error] 2014-02-09 23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@log_env@679:
Client environment:user.name=(null)
[error] 2014-02-09 23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@log_env@687:
Client environment:user.home=/home/vagrant
[error] 2014-02-09 23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@log_env@699:
Client environment:user.dir=/vagrant
[error] 2014-02-09
23:34:23,581:8653(0x7f4ab57fa700):ZOO_INFO@zookeeper_init@727:
Initiating client connection, host=192.168.57.10:2181, sessionTimeout=10000
watcher=0x7f4ade786e60 sessionId=0 sessionPasswd=<null>
context=0x7f4ab0000b80 flags=0
[error] 2014-02-09
23:34:23,591:8653(0x7f4a9ffff700):ZOO_INFO@check_events@1585:
initiated connection to server [192.168.57.10:2181]
[error] 2014-02-09
23:34:23,597:8653(0x7f4a9ffff700):ZOO_INFO@check_events@1632:
session establishment complete on server [192.168.57.10:2181],
sessionId=0x14418f8cef5000d, negotiated timeout=10000
[error] I0209 23:34:23.598711 8672 group.cpp:310] Group process ((2)@
127.0.1.1:58701) connected to ZooKeeper
[error] I0209 23:34:23.598865 8672 group.cpp:752] Syncing group
operations: queue size (joins, cancels, datas) = (0, 0, 0)
[error] I0209 23:34:23.598896 8672 group.cpp:367] Trying to create path
'/etc' in ZooKeeper
[error] I0209 23:34:23.614341 8672 detector.cpp:134] Detected a new
leader: (id='8')
[error] I0209 23:34:23.614490 8672 group.cpp:629] Trying to get
'/etc/0000000008' in ZooKeeper
[error] I0209 23:34:23.629637 8672 detector.cpp:354] A new leading master
(UPID=master@192.168.57.10:5050) is detected
[error] I0209 23:34:23.630004 8672 sched.cpp:218] No credentials provided.
Attempting to register without authentication
[error] I0209 23:34:23.630110 8672 sched.cpp:230] Detecting new master
[info] [2014-02-09 23:34:23,664] INFO registered with FrameworkID
(kafka.mesos.KafkaScheduler)
[info] [2014-02-09 23:34:23,771] INFO resource offers
(kafka.mesos.KafkaScheduler)
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Sun, Feb 9, 2014 at 5:52 PM, Joe Stein <jo...@stealth.ly> wrote:
> Yes, I am using a virtual box with everything running on one node.
>
> config.vm.box = "playa_mesos-0.15.0_ubuntu-13.04"
> config.vm.box_url = "
> http://downloads.mesosphere.io/vagrant/playa_mesos-0.15.0_ubuntu-13.04.box
> "
>
> /var/log/mesos/mesos-master.INFO:I0209 20:44:05.270169 1036
> master.cpp:284] Master started on 127.0.1.1:5050
> /var/log/mesos/mesos-master.mesos.invalid-user.log.INFO.20140114-230440.1025:I0114
> 23:04:40.074041 1057 master.cpp:284] Master started on 127.0.1.1:5050
>
> Let me take a step back and setup another environment and give it another
> try. Thanks!
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
>
> On Sun, Feb 9, 2014 at 5:45 PM, Vinod Kone <vi...@gmail.com> wrote:
>
>> Looks like a networking issue. Is the scheduler running on the same host
>> as
>> the master?
>>
>> I0209 21:38:40.747304 1065 master.cpp:844] Re-registering framework
>> KafkaFramework at scheduler(1)@127.0.1.1:36929
>>
>> The above line tells me that master trying to send an ack for registration
>> on 127.0.1.1 which is a private address.
>>
>> Also, what is the address the master is bound to? There should be a master
>> log line "Master started on <ip address>".
>>
>>
>>
>> On Sun, Feb 9, 2014 at 1:45 PM, Joe Stein <jo...@stealth.ly> wrote:
>>
>> > Hi, I am bumping up to an issue not sure what I am doing wrong with my
>> > Framework.
>> >
>> > I have my Framwork driver starting and after the .run() it hangs on
>> >
>> > [error] I0209 21:38:36.741349 1875 sched.cpp:224] No credentials
>> provided.
>> > Attempting to register without authentication
>> >
>> > and in the mesos logs I see this
>> >
>> > ==> /var/log/mesos/mesos-slave.INFO <==
>> > W0209 21:38:39.748651 1080 slave.cpp:1285] Ignoring updating pid for
>> > framework KafkaFramework because it does not exist
>> >
>> > ==> /var/log/mesos/mesos-master.INFO <==
>> > I0209 21:38:40.289823 1064 master.cpp:1766] Sending 1 offers to
>> framework
>> > KafkaFramework
>> > I0209 21:38:40.747304 1065 master.cpp:844] Re-registering framework
>> > KafkaFramework at scheduler(1)@127.0.1.1:36929
>> > I0209 21:38:40.747475 1065 master.cpp:870] Framework KafkaFramework
>> failed
>> > over
>> >
>> > I don't see anything coming into the Scheduler functions either (logging
>> > all entries into the implementation that is extending Scheduler)
>> >
>> > Mot sure what is going wrong or I should be doing differently?
>> >
>> > Any help is appreciated, thanks!
>> >
>> > /*******************************************
>> > Joe Stein
>> > Founder, Principal Consultant
>> > Big Data Open Source Security LLC
>> > http://www.stealth.ly
>> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
>> > ********************************************/
>> >
>>
>
>
Re: Ignoring updating pid for framework
Posted by Joe Stein <jo...@stealth.ly>.
Yes, I am using a virtual box with everything running on one node.
config.vm.box = "playa_mesos-0.15.0_ubuntu-13.04"
config.vm.box_url = "
http://downloads.mesosphere.io/vagrant/playa_mesos-0.15.0_ubuntu-13.04.box"
/var/log/mesos/mesos-master.INFO:I0209 20:44:05.270169 1036
master.cpp:284] Master started on 127.0.1.1:5050
/var/log/mesos/mesos-master.mesos.invalid-user.log.INFO.20140114-230440.1025:I0114
23:04:40.074041 1057 master.cpp:284] Master started on 127.0.1.1:5050
Let me take a step back and setup another environment and give it another
try. Thanks!
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Sun, Feb 9, 2014 at 5:45 PM, Vinod Kone <vi...@gmail.com> wrote:
> Looks like a networking issue. Is the scheduler running on the same host as
> the master?
>
> I0209 21:38:40.747304 1065 master.cpp:844] Re-registering framework
> KafkaFramework at scheduler(1)@127.0.1.1:36929
>
> The above line tells me that master trying to send an ack for registration
> on 127.0.1.1 which is a private address.
>
> Also, what is the address the master is bound to? There should be a master
> log line "Master started on <ip address>".
>
>
>
> On Sun, Feb 9, 2014 at 1:45 PM, Joe Stein <jo...@stealth.ly> wrote:
>
> > Hi, I am bumping up to an issue not sure what I am doing wrong with my
> > Framework.
> >
> > I have my Framwork driver starting and after the .run() it hangs on
> >
> > [error] I0209 21:38:36.741349 1875 sched.cpp:224] No credentials
> provided.
> > Attempting to register without authentication
> >
> > and in the mesos logs I see this
> >
> > ==> /var/log/mesos/mesos-slave.INFO <==
> > W0209 21:38:39.748651 1080 slave.cpp:1285] Ignoring updating pid for
> > framework KafkaFramework because it does not exist
> >
> > ==> /var/log/mesos/mesos-master.INFO <==
> > I0209 21:38:40.289823 1064 master.cpp:1766] Sending 1 offers to
> framework
> > KafkaFramework
> > I0209 21:38:40.747304 1065 master.cpp:844] Re-registering framework
> > KafkaFramework at scheduler(1)@127.0.1.1:36929
> > I0209 21:38:40.747475 1065 master.cpp:870] Framework KafkaFramework
> failed
> > over
> >
> > I don't see anything coming into the Scheduler functions either (logging
> > all entries into the implementation that is extending Scheduler)
> >
> > Mot sure what is going wrong or I should be doing differently?
> >
> > Any help is appreciated, thanks!
> >
> > /*******************************************
> > Joe Stein
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > ********************************************/
> >
>
Re: Ignoring updating pid for framework
Posted by Vinod Kone <vi...@gmail.com>.
Looks like a networking issue. Is the scheduler running on the same host as
the master?
I0209 21:38:40.747304 1065 master.cpp:844] Re-registering framework
KafkaFramework at scheduler(1)@127.0.1.1:36929
The above line tells me that master trying to send an ack for registration
on 127.0.1.1 which is a private address.
Also, what is the address the master is bound to? There should be a master
log line "Master started on <ip address>".
On Sun, Feb 9, 2014 at 1:45 PM, Joe Stein <jo...@stealth.ly> wrote:
> Hi, I am bumping up to an issue not sure what I am doing wrong with my
> Framework.
>
> I have my Framwork driver starting and after the .run() it hangs on
>
> [error] I0209 21:38:36.741349 1875 sched.cpp:224] No credentials provided.
> Attempting to register without authentication
>
> and in the mesos logs I see this
>
> ==> /var/log/mesos/mesos-slave.INFO <==
> W0209 21:38:39.748651 1080 slave.cpp:1285] Ignoring updating pid for
> framework KafkaFramework because it does not exist
>
> ==> /var/log/mesos/mesos-master.INFO <==
> I0209 21:38:40.289823 1064 master.cpp:1766] Sending 1 offers to framework
> KafkaFramework
> I0209 21:38:40.747304 1065 master.cpp:844] Re-registering framework
> KafkaFramework at scheduler(1)@127.0.1.1:36929
> I0209 21:38:40.747475 1065 master.cpp:870] Framework KafkaFramework failed
> over
>
> I don't see anything coming into the Scheduler functions either (logging
> all entries into the implementation that is extending Scheduler)
>
> Mot sure what is going wrong or I should be doing differently?
>
> Any help is appreciated, thanks!
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>