You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Ashutosh Chauhan (JIRA)" <ji...@apache.org> on 2012/05/08 04:05:48 UTC

[jira] [Created] (HIVE-3008) Memory leak in TUGIContainingTransport

Ashutosh Chauhan created HIVE-3008:
--------------------------------------

             Summary: Memory leak in TUGIContainingTransport
                 Key: HIVE-3008
                 URL: https://issues.apache.org/jira/browse/HIVE-3008
             Project: Hive
          Issue Type: Bug
          Components: Metastore
    Affects Versions: 0.8.1, 0.9.0
            Reporter: Ashutosh Chauhan
            Assignee: Ashutosh Chauhan


Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401625#comment-13401625 ] 

Hudson commented on HIVE-3008:
------------------------------

Integrated in Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #60 (See [https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/60/])
    HIVE-3008: Memory leak in TUGIContainingTransport. Backported from trunk. (Revision 1354165)

     Result = FAILURE
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1354165
Files : 
* /hive/branches/branch-0.9
* /hive/branches/branch-0.9/shims/src/common/java/org/apache/hadoop/hive/thrift/TUGIContainingTransport.java

                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.10.0, 0.9.1
>
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashutosh Chauhan updated HIVE-3008:
-----------------------------------

    Status: Patch Available  (was: Open)

Ready for review.
                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.9.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270237#comment-13270237 ] 

Ashutosh Chauhan commented on HIVE-3008:
----------------------------------------

Sometimes, phabricator doesn't like you and doesn't post back.  In those times you post yourself. https://reviews.facebook.net/D3069
                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270134#comment-13270134 ] 

Ashutosh Chauhan commented on HIVE-3008:
----------------------------------------

There is a weakhashmap which is from TTransport->TUGIContainingTransport. The map is weak so that when TTransport gets out of scope, it can be GC'ed even though map contains a reference to it. But, since TUGIContainingTransport contains a reference to TTransport, even when TTransport is out of scope otherwise, its ref is still retained. Solution is to wrap reference of TTransport in TUGIContainingTransport in WeakReference.  
                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397741#comment-13397741 ] 

Edward Capriolo commented on HIVE-3008:
---------------------------------------

+1 will commit.

{noformat}
[edward@tablitha trunk]$ ant test -Dtestcase=TestHiveServer ^C^C
    [junit] Hive history file=/home/edward/hive/trunk/build/service/tmp/hive_job_log_edward_201206201133_754589104.txt
    [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 94.256 sec

BUILD SUCCESSFUL
Total time: 3 minutes 6 seconds

{noformat}
                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward Capriolo updated HIVE-3008:
----------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

Committed. Thanks for the good debugging work.
                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.10.0
>
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401934#comment-13401934 ] 

Hudson commented on HIVE-3008:
------------------------------

Integrated in Hive-0.9.1-SNAPSHOT-h0.21 #60 (See [https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/60/])
    HIVE-3008: Memory leak in TUGIContainingTransport. Backported from trunk. (Revision 1354165)

     Result = FAILURE
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1354165
Files : 
* /hive/branches/branch-0.9
* /hive/branches/branch-0.9/shims/src/common/java/org/apache/hadoop/hive/thrift/TUGIContainingTransport.java

                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.10.0, 0.9.1
>
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward Capriolo updated HIVE-3008:
----------------------------------

    Attachment: hive-3008.patch.txt
    
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Comment Edited] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401610#comment-13401610 ] 

Ashutosh Chauhan edited comment on HIVE-3008 at 6/26/12 6:56 PM:
-----------------------------------------------------------------

Backported to 0.9 branch.
                
      was (Author: ashutoshc):
    Backported to trunk.
                  
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.10.0, 0.9.1
>
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398279#comment-13398279 ] 

Carl Steinbach commented on HIVE-3008:
--------------------------------------

Committed with the wrong ticket ID:
40eff10 2012-06-20 HIVE-3009 Memory leak in TUGIContainingTransport (Ashutosh Chauhan via egc)
                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.10.0
>
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashutosh Chauhan updated HIVE-3008:
-----------------------------------

    Fix Version/s: 0.9.1

Backported to trunk.
                
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.10.0, 0.9.1
>
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3008) Memory leak in TUGIContainingTransport

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward Capriolo updated HIVE-3008:
----------------------------------

    Fix Version/s: 0.10.0
    
> Memory leak in TUGIContainingTransport
> --------------------------------------
>
>                 Key: HIVE-3008
>                 URL: https://issues.apache.org/jira/browse/HIVE-3008
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.10.0
>
>         Attachments: hive-3008.patch.txt
>
>
> Identical bug as in THRIFT-1468

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira