You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by ANUJ THAKWANI <an...@gmail.com> on 2016/07/27 07:21:27 UTC
[Container Killed]:HbaseScan Operator
Hi,
I am trying to input values from Hbase using HbaseScan operator but getting
container killed messages repeatedly. Seems like heart beat is getting
timed out and window of HbaseOperator is not moving.
Please let me know what should i do to get this fixed.
Attaching log for reference.
Re: [Container Killed]:HbaseScan Operator
Posted by ANUJ THAKWANI <an...@gmail.com>.
Hi,
Thanks this was resolved after i changed hbase client from 0.94.27 to 1.1.0.
On Wed, Jul 27, 2016 at 5:54 PM, Bhupesh Chawda <bh...@apache.org> wrote:
> Hi Anuj,
>
> Heartbeat timeout might mean that the operator is not proceeding and is
> stuck. I can see a "Deploy Request", but nothing after that. Operator
> setup() might be one place to look at. You can also check
>
> https://github.com/apache/apex-malhar/blob/release-3.4/contrib/src/test/java/com/datatorrent/contrib/hbase/HBaseScanOperatorTest.java
> to see if you are configuring the operator correctly.
>
> You can also try setting the log levels (explained here
> <http://docs.datatorrent.com/configuration/#adjusting-logging-levels>) to
> debug to get more information.
>
> ~ Bhupesh
>
> On Wed, Jul 27, 2016 at 3:23 PM, Bhupesh Chawda <bh...@apache.org>
> wrote:
>
> > Hi Anuj,
> >
> > I don't see an attachment.
> > If you are facing issues can you create a JIRA issue here
> > <https://issues.apache.org/jira/browse/APEXMALHAR> and attach the logs?
> >
> > ~ Bhupesh
> >
> > On Wed, Jul 27, 2016 at 3:05 PM, ANUJ THAKWANI <an...@gmail.com>
> > wrote:
> >
> >> Hi,
> >>
> >> Attaching full Operator log for reference.
> >>
> >> Operator being used is HbaseScanOperator and its abstract
> operationScan()
> >> & getTuple() method have been implemented.
> >>
> >>
> >>
> >> On Wed, Jul 27, 2016 at 2:55 PM, Bhupesh Chawda <bh...@apache.org>
> >> wrote:
> >>
> >>> Thanks Anuj.
> >>>
> >>> The attachment seems to be for the App master. Can you please check if
> >>> there is any information in the container corresponding to the
> operator?
> >>> The operator log will usually have something like "INFO
> >>> com.datatorrent.stram.engine.StreamingContainer: Child starting" at
> the
> >>> beginning.
> >>>
> >>> Is "HBasePOJOInputOperator" the one you are using?
> >>>
> >>> ~ Bhupesh
> >>>
> >>>
> >>> On Wed, Jul 27, 2016 at 2:32 PM, ANUJ THAKWANI <
> anuj.thakwani@gmail.com>
> >>> wrote:
> >>>
> >>> > Hi Bhupesh,
> >>> >
> >>> > Please find comments inline
> >>> >
> >>> > Can you also share the HBase operator logs? Also, which version of
> >>> Malhar
> >>> > are you using?
> >>> > dt.log shared in first mail is the log file of hbase operator .
> Malhar
> >>> > version is 3.4.0
> >>> >
> >>> > Is the operator getting killed immediately, or does it at least input
> >>> some
> >>> > values and then get killed?
> >>> >
> >>> > Operator gets killed after 30 sec(heartbeat timeout) without
> >>> processing any
> >>> > values. No exception is thrown when the operator is killed by AM.
> >>> >
> >>> > On Wed, Jul 27, 2016 at 1:21 PM, Bhupesh Chawda <bh...@apache.org>
> >>> > wrote:
> >>> >
> >>> > > Hi Anuj,
> >>> > >
> >>> > > Can you also share the HBase operator logs? Also, which version of
> >>> Malhar
> >>> > > are you using?
> >>> > > Is the operator getting killed immediately, or does it at least
> input
> >>> > some
> >>> > > values and then get killed?
> >>> > >
> >>> > > Thanks
> >>> > > ~ Bhupesh
> >>> > >
> >>> > > On Wed, Jul 27, 2016 at 12:51 PM, ANUJ THAKWANI <
> >>> anuj.thakwani@gmail.com
> >>> > >
> >>> > > wrote:
> >>> > >
> >>> > > > Hi,
> >>> > > >
> >>> > > > I am trying to input values from Hbase using HbaseScan operator
> but
> >>> > > > getting container killed messages repeatedly. Seems like heart
> >>> beat is
> >>> > > > getting timed out and window of HbaseOperator is not moving.
> >>> > > >
> >>> > > > Please let me know what should i do to get this fixed.
> >>> > > >
> >>> > > > Attaching log for reference.
> >>> > > >
> >>> > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> >>
> >>
> >
>
Re: [Container Killed]:HbaseScan Operator
Posted by Bhupesh Chawda <bh...@apache.org>.
Hi Anuj,
Heartbeat timeout might mean that the operator is not proceeding and is
stuck. I can see a "Deploy Request", but nothing after that. Operator
setup() might be one place to look at. You can also check
https://github.com/apache/apex-malhar/blob/release-3.4/contrib/src/test/java/com/datatorrent/contrib/hbase/HBaseScanOperatorTest.java
to see if you are configuring the operator correctly.
You can also try setting the log levels (explained here
<http://docs.datatorrent.com/configuration/#adjusting-logging-levels>) to
debug to get more information.
~ Bhupesh
On Wed, Jul 27, 2016 at 3:23 PM, Bhupesh Chawda <bh...@apache.org> wrote:
> Hi Anuj,
>
> I don't see an attachment.
> If you are facing issues can you create a JIRA issue here
> <https://issues.apache.org/jira/browse/APEXMALHAR> and attach the logs?
>
> ~ Bhupesh
>
> On Wed, Jul 27, 2016 at 3:05 PM, ANUJ THAKWANI <an...@gmail.com>
> wrote:
>
>> Hi,
>>
>> Attaching full Operator log for reference.
>>
>> Operator being used is HbaseScanOperator and its abstract operationScan()
>> & getTuple() method have been implemented.
>>
>>
>>
>> On Wed, Jul 27, 2016 at 2:55 PM, Bhupesh Chawda <bh...@apache.org>
>> wrote:
>>
>>> Thanks Anuj.
>>>
>>> The attachment seems to be for the App master. Can you please check if
>>> there is any information in the container corresponding to the operator?
>>> The operator log will usually have something like "INFO
>>> com.datatorrent.stram.engine.StreamingContainer: Child starting" at the
>>> beginning.
>>>
>>> Is "HBasePOJOInputOperator" the one you are using?
>>>
>>> ~ Bhupesh
>>>
>>>
>>> On Wed, Jul 27, 2016 at 2:32 PM, ANUJ THAKWANI <an...@gmail.com>
>>> wrote:
>>>
>>> > Hi Bhupesh,
>>> >
>>> > Please find comments inline
>>> >
>>> > Can you also share the HBase operator logs? Also, which version of
>>> Malhar
>>> > are you using?
>>> > dt.log shared in first mail is the log file of hbase operator . Malhar
>>> > version is 3.4.0
>>> >
>>> > Is the operator getting killed immediately, or does it at least input
>>> some
>>> > values and then get killed?
>>> >
>>> > Operator gets killed after 30 sec(heartbeat timeout) without
>>> processing any
>>> > values. No exception is thrown when the operator is killed by AM.
>>> >
>>> > On Wed, Jul 27, 2016 at 1:21 PM, Bhupesh Chawda <bh...@apache.org>
>>> > wrote:
>>> >
>>> > > Hi Anuj,
>>> > >
>>> > > Can you also share the HBase operator logs? Also, which version of
>>> Malhar
>>> > > are you using?
>>> > > Is the operator getting killed immediately, or does it at least input
>>> > some
>>> > > values and then get killed?
>>> > >
>>> > > Thanks
>>> > > ~ Bhupesh
>>> > >
>>> > > On Wed, Jul 27, 2016 at 12:51 PM, ANUJ THAKWANI <
>>> anuj.thakwani@gmail.com
>>> > >
>>> > > wrote:
>>> > >
>>> > > > Hi,
>>> > > >
>>> > > > I am trying to input values from Hbase using HbaseScan operator but
>>> > > > getting container killed messages repeatedly. Seems like heart
>>> beat is
>>> > > > getting timed out and window of HbaseOperator is not moving.
>>> > > >
>>> > > > Please let me know what should i do to get this fixed.
>>> > > >
>>> > > > Attaching log for reference.
>>> > > >
>>> > > >
>>> > > >
>>> > >
>>> >
>>>
>>
>>
>
Re: [Container Killed]:HbaseScan Operator
Posted by Bhupesh Chawda <bh...@apache.org>.
Hi Anuj,
I don't see an attachment.
If you are facing issues can you create a JIRA issue here
<https://issues.apache.org/jira/browse/APEXMALHAR> and attach the logs?
~ Bhupesh
On Wed, Jul 27, 2016 at 3:05 PM, ANUJ THAKWANI <an...@gmail.com>
wrote:
> Hi,
>
> Attaching full Operator log for reference.
>
> Operator being used is HbaseScanOperator and its abstract operationScan()
> & getTuple() method have been implemented.
>
>
>
> On Wed, Jul 27, 2016 at 2:55 PM, Bhupesh Chawda <bh...@apache.org>
> wrote:
>
>> Thanks Anuj.
>>
>> The attachment seems to be for the App master. Can you please check if
>> there is any information in the container corresponding to the operator?
>> The operator log will usually have something like "INFO
>> com.datatorrent.stram.engine.StreamingContainer: Child starting" at the
>> beginning.
>>
>> Is "HBasePOJOInputOperator" the one you are using?
>>
>> ~ Bhupesh
>>
>>
>> On Wed, Jul 27, 2016 at 2:32 PM, ANUJ THAKWANI <an...@gmail.com>
>> wrote:
>>
>> > Hi Bhupesh,
>> >
>> > Please find comments inline
>> >
>> > Can you also share the HBase operator logs? Also, which version of
>> Malhar
>> > are you using?
>> > dt.log shared in first mail is the log file of hbase operator . Malhar
>> > version is 3.4.0
>> >
>> > Is the operator getting killed immediately, or does it at least input
>> some
>> > values and then get killed?
>> >
>> > Operator gets killed after 30 sec(heartbeat timeout) without processing
>> any
>> > values. No exception is thrown when the operator is killed by AM.
>> >
>> > On Wed, Jul 27, 2016 at 1:21 PM, Bhupesh Chawda <bh...@apache.org>
>> > wrote:
>> >
>> > > Hi Anuj,
>> > >
>> > > Can you also share the HBase operator logs? Also, which version of
>> Malhar
>> > > are you using?
>> > > Is the operator getting killed immediately, or does it at least input
>> > some
>> > > values and then get killed?
>> > >
>> > > Thanks
>> > > ~ Bhupesh
>> > >
>> > > On Wed, Jul 27, 2016 at 12:51 PM, ANUJ THAKWANI <
>> anuj.thakwani@gmail.com
>> > >
>> > > wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > > I am trying to input values from Hbase using HbaseScan operator but
>> > > > getting container killed messages repeatedly. Seems like heart beat
>> is
>> > > > getting timed out and window of HbaseOperator is not moving.
>> > > >
>> > > > Please let me know what should i do to get this fixed.
>> > > >
>> > > > Attaching log for reference.
>> > > >
>> > > >
>> > > >
>> > >
>> >
>>
>
>
Re: [Container Killed]:HbaseScan Operator
Posted by ANUJ THAKWANI <an...@gmail.com>.
Hi,
Attaching full Operator log for reference.
Operator being used is HbaseScanOperator and its abstract operationScan() &
getTuple() method have been implemented.
On Wed, Jul 27, 2016 at 2:55 PM, Bhupesh Chawda <bh...@apache.org> wrote:
> Thanks Anuj.
>
> The attachment seems to be for the App master. Can you please check if
> there is any information in the container corresponding to the operator?
> The operator log will usually have something like "INFO
> com.datatorrent.stram.engine.StreamingContainer: Child starting" at the
> beginning.
>
> Is "HBasePOJOInputOperator" the one you are using?
>
> ~ Bhupesh
>
>
> On Wed, Jul 27, 2016 at 2:32 PM, ANUJ THAKWANI <an...@gmail.com>
> wrote:
>
> > Hi Bhupesh,
> >
> > Please find comments inline
> >
> > Can you also share the HBase operator logs? Also, which version of Malhar
> > are you using?
> > dt.log shared in first mail is the log file of hbase operator . Malhar
> > version is 3.4.0
> >
> > Is the operator getting killed immediately, or does it at least input
> some
> > values and then get killed?
> >
> > Operator gets killed after 30 sec(heartbeat timeout) without processing
> any
> > values. No exception is thrown when the operator is killed by AM.
> >
> > On Wed, Jul 27, 2016 at 1:21 PM, Bhupesh Chawda <bh...@apache.org>
> > wrote:
> >
> > > Hi Anuj,
> > >
> > > Can you also share the HBase operator logs? Also, which version of
> Malhar
> > > are you using?
> > > Is the operator getting killed immediately, or does it at least input
> > some
> > > values and then get killed?
> > >
> > > Thanks
> > > ~ Bhupesh
> > >
> > > On Wed, Jul 27, 2016 at 12:51 PM, ANUJ THAKWANI <
> anuj.thakwani@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I am trying to input values from Hbase using HbaseScan operator but
> > > > getting container killed messages repeatedly. Seems like heart beat
> is
> > > > getting timed out and window of HbaseOperator is not moving.
> > > >
> > > > Please let me know what should i do to get this fixed.
> > > >
> > > > Attaching log for reference.
> > > >
> > > >
> > > >
> > >
> >
>
Re: [Container Killed]:HbaseScan Operator
Posted by Bhupesh Chawda <bh...@apache.org>.
Thanks Anuj.
The attachment seems to be for the App master. Can you please check if
there is any information in the container corresponding to the operator?
The operator log will usually have something like "INFO
com.datatorrent.stram.engine.StreamingContainer: Child starting" at the
beginning.
Is "HBasePOJOInputOperator" the one you are using?
~ Bhupesh
On Wed, Jul 27, 2016 at 2:32 PM, ANUJ THAKWANI <an...@gmail.com>
wrote:
> Hi Bhupesh,
>
> Please find comments inline
>
> Can you also share the HBase operator logs? Also, which version of Malhar
> are you using?
> dt.log shared in first mail is the log file of hbase operator . Malhar
> version is 3.4.0
>
> Is the operator getting killed immediately, or does it at least input some
> values and then get killed?
>
> Operator gets killed after 30 sec(heartbeat timeout) without processing any
> values. No exception is thrown when the operator is killed by AM.
>
> On Wed, Jul 27, 2016 at 1:21 PM, Bhupesh Chawda <bh...@apache.org>
> wrote:
>
> > Hi Anuj,
> >
> > Can you also share the HBase operator logs? Also, which version of Malhar
> > are you using?
> > Is the operator getting killed immediately, or does it at least input
> some
> > values and then get killed?
> >
> > Thanks
> > ~ Bhupesh
> >
> > On Wed, Jul 27, 2016 at 12:51 PM, ANUJ THAKWANI <anuj.thakwani@gmail.com
> >
> > wrote:
> >
> > > Hi,
> > >
> > > I am trying to input values from Hbase using HbaseScan operator but
> > > getting container killed messages repeatedly. Seems like heart beat is
> > > getting timed out and window of HbaseOperator is not moving.
> > >
> > > Please let me know what should i do to get this fixed.
> > >
> > > Attaching log for reference.
> > >
> > >
> > >
> >
>
Re: [Container Killed]:HbaseScan Operator
Posted by ANUJ THAKWANI <an...@gmail.com>.
Hi Bhupesh,
Please find comments inline
Can you also share the HBase operator logs? Also, which version of Malhar
are you using?
dt.log shared in first mail is the log file of hbase operator . Malhar
version is 3.4.0
Is the operator getting killed immediately, or does it at least input some
values and then get killed?
Operator gets killed after 30 sec(heartbeat timeout) without processing any
values. No exception is thrown when the operator is killed by AM.
On Wed, Jul 27, 2016 at 1:21 PM, Bhupesh Chawda <bh...@apache.org> wrote:
> Hi Anuj,
>
> Can you also share the HBase operator logs? Also, which version of Malhar
> are you using?
> Is the operator getting killed immediately, or does it at least input some
> values and then get killed?
>
> Thanks
> ~ Bhupesh
>
> On Wed, Jul 27, 2016 at 12:51 PM, ANUJ THAKWANI <an...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I am trying to input values from Hbase using HbaseScan operator but
> > getting container killed messages repeatedly. Seems like heart beat is
> > getting timed out and window of HbaseOperator is not moving.
> >
> > Please let me know what should i do to get this fixed.
> >
> > Attaching log for reference.
> >
> >
> >
>
Re: [Container Killed]:HbaseScan Operator
Posted by Bhupesh Chawda <bh...@apache.org>.
Hi Anuj,
Can you also share the HBase operator logs? Also, which version of Malhar
are you using?
Is the operator getting killed immediately, or does it at least input some
values and then get killed?
Thanks
~ Bhupesh
On Wed, Jul 27, 2016 at 12:51 PM, ANUJ THAKWANI <an...@gmail.com>
wrote:
> Hi,
>
> I am trying to input values from Hbase using HbaseScan operator but
> getting container killed messages repeatedly. Seems like heart beat is
> getting timed out and window of HbaseOperator is not moving.
>
> Please let me know what should i do to get this fixed.
>
> Attaching log for reference.
>
>
>