You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Ionut Ignatescu (Created) (JIRA)" <ji...@apache.org> on 2012/02/09 17:19:59 UTC
[jira] [Created] (HBASE-5362) ZK connection leak
ZK connection leak
------------------
Key: HBASE-5362
URL: https://issues.apache.org/jira/browse/HBASE-5362
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 0.90.3
Reporter: Ionut Ignatescu
I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list.
I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92.
To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call.
Also, the initTableMapperJob was overwritten.
I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792
Regards,
Ionut I.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5362) ZK connection leak
Posted by "Ionut Ignatescu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204823#comment-13204823 ]
Ionut Ignatescu commented on HBASE-5362:
----------------------------------------
No,I can't. We have a different version deployed on our Hadoop cluster, so it's almost impossible to perform this test.
Anyway, thanks for your suggestion, I'll look into source to check.
> ZK connection leak
> ------------------
>
> Key: HBASE-5362
> URL: https://issues.apache.org/jira/browse/HBASE-5362
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
> Affects Versions: 0.90.3
> Reporter: Ionut Ignatescu
>
> I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list.
> I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92.
> To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call.
> Also, the initTableMapperJob was overwritten.
> I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792
> Regards,
> Ionut I.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5362) ZK connection leak
Posted by "Ionut Ignatescu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397565#comment-13397565 ]
Ionut Ignatescu commented on HBASE-5362:
----------------------------------------
Any update on this?Any fix?
> ZK connection leak
> ------------------
>
> Key: HBASE-5362
> URL: https://issues.apache.org/jira/browse/HBASE-5362
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
> Affects Versions: 0.90.3
> Reporter: Ionut Ignatescu
>
> I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list.
> I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92.
> To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call.
> Also, the initTableMapperJob was overwritten.
> I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792
> Regards,
> Ionut I.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5362) ZK connection leak
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204666#comment-13204666 ]
Zhihong Yu commented on HBASE-5362:
-----------------------------------
HBASE-4508 was integrated into 0.90.5
Can you perform your test using 0.90.5 ?
Thanks
> ZK connection leak
> ------------------
>
> Key: HBASE-5362
> URL: https://issues.apache.org/jira/browse/HBASE-5362
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
> Affects Versions: 0.90.3
> Reporter: Ionut Ignatescu
>
> I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list.
> I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92.
> To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call.
> Also, the initTableMapperJob was overwritten.
> I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792
> Regards,
> Ionut I.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira