You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@twill.apache.org by j lu <is...@gmail.com> on 2017/04/17 18:02:55 UTC
HelloWorldExample prpoblem
Forks, I am not sure this is the right place to say this. I am just started
playing with apache twill. When I try to run the hello world example. It
apears to be working. There is a HelloWorldRunnable application appearing
successful in the yarn webUI. But I couldnt find the INFO msg says Hello
World, this is my first distrubuted application. I tried the logs in the
yarn webUI. I also tried $(HADOOP_HOME)/logs no luck. Any help?
Re: HelloWorldExample prpoblem
Posted by j lu <is...@gmail.com>.
And stderr says
sync.DefaultEventHandler: Failed to send producer request with
correlation id 36 to broker 1 with data for partitions [log,0]
So is that because of the fact that some msg is not sent?
By the way, Do u know of any ways that can be used to set the slf4j
level to INFO(rather than debug)
On Tue, Apr 18, 2017 at 7:55 PM, j lu <is...@gmail.com> wrote:
> Ok, there is warn msg in stdout says
>
> 18:52:13.492 [kafka-publisher] WARN o.a.t.i.k.c.SimpleKafkaPublisher - Broker list is empty. No Kafka producer is created.
>
> will kafka be the problem here???
>
>
> On Tue, Apr 18, 2017 at 7:33 PM, j lu <is...@gmail.com> wrote:
>
>> Nah, in the web UI of container_002 log in stdout, there is no string
>> show up when I type Hello World in the search box. It meant to be Hello
>> World, my first distributed application, right??
>>
>> On Tue, Apr 18, 2017 at 7:20 PM, Terence Yim <ch...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> You don't need Kafka in your cluster as twill will start an embedded one
>>> inside the Application Master. Besides the stderr, do you see a stdout?
>>> Also, any logs from the client side?
>>>
>>> Terence
>>>
>>> Sent from my iPhone
>>>
>>> > On Apr 18, 2017, at 3:57 PM, j lu <is...@gmail.com> wrote:
>>> >
>>> > Nah, no luck. I check the stderr logs, there are some errors about
>>> kafka
>>> > because there is no kafka in my machine. Could that be the reason why I
>>> > don't get the Hello World msg?
>>> >
>>> >> On Mon, Apr 17, 2017 at 6:31 PM, Terence Yim <ch...@gmail.com>
>>> wrote:
>>> >>
>>> >> Hi,
>>> >>
>>> >> The log message should get collected and printed in the client side
>>> process
>>> >> (the one you launch the app). You should also be able to see the logs
>>> from
>>> >> the YARN container log of the runnable container (usually is the 00002
>>> >> container, while the 00001 is the application master).
>>> >>
>>> >> Terence
>>> >>
>>> >>> On Mon, Apr 17, 2017 at 11:02 AM, j lu <is...@gmail.com> wrote:
>>> >>>
>>> >>> Forks, I am not sure this is the right place to say this. I am just
>>> >> started
>>> >>> playing with apache twill. When I try to run the hello world
>>> example. It
>>> >>> apears to be working. There is a HelloWorldRunnable application
>>> appearing
>>> >>> successful in the yarn webUI. But I couldnt find the INFO msg says
>>> Hello
>>> >>> World, this is my first distrubuted application. I tried the logs in
>>> the
>>> >>> yarn webUI. I also tried $(HADOOP_HOME)/logs no luck. Any help?
>>> >>>
>>> >>
>>>
>>
>>
>
Re: HelloWorldExample prpoblem
Posted by j lu <is...@gmail.com>.
Ok, there is warn msg in stdout says
18:52:13.492 [kafka-publisher] WARN o.a.t.i.k.c.SimpleKafkaPublisher
- Broker list is empty. No Kafka producer is created.
will kafka be the problem here???
On Tue, Apr 18, 2017 at 7:33 PM, j lu <is...@gmail.com> wrote:
> Nah, in the web UI of container_002 log in stdout, there is no string show
> up when I type Hello World in the search box. It meant to be Hello World,
> my first distributed application, right??
>
> On Tue, Apr 18, 2017 at 7:20 PM, Terence Yim <ch...@gmail.com> wrote:
>
>> Hi,
>>
>> You don't need Kafka in your cluster as twill will start an embedded one
>> inside the Application Master. Besides the stderr, do you see a stdout?
>> Also, any logs from the client side?
>>
>> Terence
>>
>> Sent from my iPhone
>>
>> > On Apr 18, 2017, at 3:57 PM, j lu <is...@gmail.com> wrote:
>> >
>> > Nah, no luck. I check the stderr logs, there are some errors about kafka
>> > because there is no kafka in my machine. Could that be the reason why I
>> > don't get the Hello World msg?
>> >
>> >> On Mon, Apr 17, 2017 at 6:31 PM, Terence Yim <ch...@gmail.com> wrote:
>> >>
>> >> Hi,
>> >>
>> >> The log message should get collected and printed in the client side
>> process
>> >> (the one you launch the app). You should also be able to see the logs
>> from
>> >> the YARN container log of the runnable container (usually is the 00002
>> >> container, while the 00001 is the application master).
>> >>
>> >> Terence
>> >>
>> >>> On Mon, Apr 17, 2017 at 11:02 AM, j lu <is...@gmail.com> wrote:
>> >>>
>> >>> Forks, I am not sure this is the right place to say this. I am just
>> >> started
>> >>> playing with apache twill. When I try to run the hello world example.
>> It
>> >>> apears to be working. There is a HelloWorldRunnable application
>> appearing
>> >>> successful in the yarn webUI. But I couldnt find the INFO msg says
>> Hello
>> >>> World, this is my first distrubuted application. I tried the logs in
>> the
>> >>> yarn webUI. I also tried $(HADOOP_HOME)/logs no luck. Any help?
>> >>>
>> >>
>>
>
>
Re: HelloWorldExample prpoblem
Posted by j lu <is...@gmail.com>.
Nah, in the web UI of container_002 log in stdout, there is no string show
up when I type Hello World in the search box. It meant to be Hello World,
my first distributed application, right??
On Tue, Apr 18, 2017 at 7:20 PM, Terence Yim <ch...@gmail.com> wrote:
> Hi,
>
> You don't need Kafka in your cluster as twill will start an embedded one
> inside the Application Master. Besides the stderr, do you see a stdout?
> Also, any logs from the client side?
>
> Terence
>
> Sent from my iPhone
>
> > On Apr 18, 2017, at 3:57 PM, j lu <is...@gmail.com> wrote:
> >
> > Nah, no luck. I check the stderr logs, there are some errors about kafka
> > because there is no kafka in my machine. Could that be the reason why I
> > don't get the Hello World msg?
> >
> >> On Mon, Apr 17, 2017 at 6:31 PM, Terence Yim <ch...@gmail.com> wrote:
> >>
> >> Hi,
> >>
> >> The log message should get collected and printed in the client side
> process
> >> (the one you launch the app). You should also be able to see the logs
> from
> >> the YARN container log of the runnable container (usually is the 00002
> >> container, while the 00001 is the application master).
> >>
> >> Terence
> >>
> >>> On Mon, Apr 17, 2017 at 11:02 AM, j lu <is...@gmail.com> wrote:
> >>>
> >>> Forks, I am not sure this is the right place to say this. I am just
> >> started
> >>> playing with apache twill. When I try to run the hello world example.
> It
> >>> apears to be working. There is a HelloWorldRunnable application
> appearing
> >>> successful in the yarn webUI. But I couldnt find the INFO msg says
> Hello
> >>> World, this is my first distrubuted application. I tried the logs in
> the
> >>> yarn webUI. I also tried $(HADOOP_HOME)/logs no luck. Any help?
> >>>
> >>
>
Re: HelloWorldExample prpoblem
Posted by Terence Yim <ch...@gmail.com>.
Hi,
You don't need Kafka in your cluster as twill will start an embedded one inside the Application Master. Besides the stderr, do you see a stdout? Also, any logs from the client side?
Terence
Sent from my iPhone
> On Apr 18, 2017, at 3:57 PM, j lu <is...@gmail.com> wrote:
>
> Nah, no luck. I check the stderr logs, there are some errors about kafka
> because there is no kafka in my machine. Could that be the reason why I
> don't get the Hello World msg?
>
>> On Mon, Apr 17, 2017 at 6:31 PM, Terence Yim <ch...@gmail.com> wrote:
>>
>> Hi,
>>
>> The log message should get collected and printed in the client side process
>> (the one you launch the app). You should also be able to see the logs from
>> the YARN container log of the runnable container (usually is the 00002
>> container, while the 00001 is the application master).
>>
>> Terence
>>
>>> On Mon, Apr 17, 2017 at 11:02 AM, j lu <is...@gmail.com> wrote:
>>>
>>> Forks, I am not sure this is the right place to say this. I am just
>> started
>>> playing with apache twill. When I try to run the hello world example. It
>>> apears to be working. There is a HelloWorldRunnable application appearing
>>> successful in the yarn webUI. But I couldnt find the INFO msg says Hello
>>> World, this is my first distrubuted application. I tried the logs in the
>>> yarn webUI. I also tried $(HADOOP_HOME)/logs no luck. Any help?
>>>
>>
Re: HelloWorldExample prpoblem
Posted by j lu <is...@gmail.com>.
Nah, no luck. I check the stderr logs, there are some errors about kafka
because there is no kafka in my machine. Could that be the reason why I
don't get the Hello World msg?
On Mon, Apr 17, 2017 at 6:31 PM, Terence Yim <ch...@gmail.com> wrote:
> Hi,
>
> The log message should get collected and printed in the client side process
> (the one you launch the app). You should also be able to see the logs from
> the YARN container log of the runnable container (usually is the 00002
> container, while the 00001 is the application master).
>
> Terence
>
> On Mon, Apr 17, 2017 at 11:02 AM, j lu <is...@gmail.com> wrote:
>
> > Forks, I am not sure this is the right place to say this. I am just
> started
> > playing with apache twill. When I try to run the hello world example. It
> > apears to be working. There is a HelloWorldRunnable application appearing
> > successful in the yarn webUI. But I couldnt find the INFO msg says Hello
> > World, this is my first distrubuted application. I tried the logs in the
> > yarn webUI. I also tried $(HADOOP_HOME)/logs no luck. Any help?
> >
>
Re: HelloWorldExample prpoblem
Posted by Terence Yim <ch...@gmail.com>.
Hi,
The log message should get collected and printed in the client side process
(the one you launch the app). You should also be able to see the logs from
the YARN container log of the runnable container (usually is the 00002
container, while the 00001 is the application master).
Terence
On Mon, Apr 17, 2017 at 11:02 AM, j lu <is...@gmail.com> wrote:
> Forks, I am not sure this is the right place to say this. I am just started
> playing with apache twill. When I try to run the hello world example. It
> apears to be working. There is a HelloWorldRunnable application appearing
> successful in the yarn webUI. But I couldnt find the INFO msg says Hello
> World, this is my first distrubuted application. I tried the logs in the
> yarn webUI. I also tried $(HADOOP_HOME)/logs no luck. Any help?
>