You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Johan Oskarsson (JIRA)" <ji...@apache.org> on 2009/05/06 12:47:30 UTC

[jira] Created: (HIVE-473) Clean up after tests

Clean up after tests
--------------------

                 Key: HIVE-473
                 URL: https://issues.apache.org/jira/browse/HIVE-473
             Project: Hadoop Hive
          Issue Type: Improvement
          Components: Testing Infrastructure
            Reporter: Johan Oskarsson
             Fix For: 0.4.0


The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-473) Clean up after tests

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Shao updated HIVE-473:
----------------------------

    Attachment: HIVE-626.2.showinfo_disable_cp.patch

This patch adds the capability of disabling column pruner.

The following query runs successfully, so the problem is inside the column pruner.

{code}
hive> set hive.optimize.cp=false;
hive> explain extended
    > select zshao_foo.foo_name, zshao_bar.bar_name, n from zshao_foo join zshao_bar on zshao_foo.foo_id =
    > zshao_bar.foo_id join zshao_count on zshao_count.bar_id = zshao_bar.bar_id;
{code}


> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: HIVE-473.patch, HIVE-626.2.showinfo_disable_cp.patch
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-473) Clean up after tests

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12706370#action_12706370 ] 

Johan Oskarsson commented on HIVE-473:
--------------------------------------

If we put all these in a timestamped temporary dir the build process can delete that directory when it is done

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>             Fix For: 0.4.0
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-473) Clean up after tests

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12730401#action_12730401 ] 

Namit Jain commented on HIVE-473:
---------------------------------

Zheng, did you mean the above comment for some other jira ?

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: HIVE-473.patch
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-473) Clean up after tests

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-473:
----------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed. Thanks Johan.

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: HIVE-473.patch
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-473) Clean up after tests

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Shao updated HIVE-473:
----------------------------

    Attachment:     (was: HIVE-626.2.showinfo_disable_cp.patch)

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: HIVE-473.patch
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-473) Clean up after tests

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Johan Oskarsson updated HIVE-473:
---------------------------------

    Assignee: Johan Oskarsson
      Status: Patch Available  (was: Open)

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: HIVE-473.patch
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-473) Clean up after tests

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Johan Oskarsson updated HIVE-473:
---------------------------------

    Attachment: HIVE-473.patch

This patch adds a hadoop.tmp.dir setting to the test hive-site.xml that points to the build directory, that way "ant clean" will remove it.

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: HIVE-473.patch
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-473) Clean up after tests

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Johan Oskarsson updated HIVE-473:
---------------------------------

    Priority: Critical  (was: Major)

Seems we've hit this again: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/121/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_union18/

Upgrading to critical.

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-473) Clean up after tests

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12729733#action_12729733 ] 

Namit Jain commented on HIVE-473:
---------------------------------

+1

The patch looks good - will commit if the tests pass

> Clean up after tests
> --------------------
>
>                 Key: HIVE-473
>                 URL: https://issues.apache.org/jira/browse/HIVE-473
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>            Priority: Critical
>             Fix For: 0.4.0
>
>         Attachments: HIVE-473.patch
>
>
> The test suite creates a lot of temporary files that aren't cleaned up. For example plan xml files, mapred/local and mapred/system files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.