You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Aaron Kimball (JIRA)" <ji...@apache.org> on 2009/07/10 23:31:14 UTC

[jira] Created: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Make Sqoop unit tests more Hudson-friendly
------------------------------------------

                 Key: MAPREDUCE-749
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/sqoop
            Reporter: Aaron Kimball
            Assignee: Aaron Kimball


Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-749:
------------------------------------

    Attachment: MAPREDUCE-749.patch

Attaching patch for this. This adds a {{sqoop.thirdparty.lib.dir}} Ant property which identifies a directory where JDBC libraries are kept. This keeps them out from the main Hadoop ivy system so they can be placed statically on a test server. Also added a {{ThirdPartyTests}} module in src/test/o.a.h.sqoop which includes all the third-party tests. This is itself included by {{AllTests}}.

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-749:
------------------------------------

    Status: Patch Available  (was: Open)

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-749:
------------------------------------

    Attachment: MAPREDUCE-749.3.patch

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.3.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-749:
------------------------------------

    Status: Open  (was: Patch Available)

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.3.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated MAPREDUCE-749:
--------------------------------

    Attachment: MAPREDUCE-749.4.patch

Synced with trunk.

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.3.patch, MAPREDUCE-749.4.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740344#action_12740344 ] 

Hadoop QA commented on MAPREDUCE-749:
-------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12415424/MAPREDUCE-749.3.patch
  against trunk revision 801517.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 5 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/447/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/447/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/447/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/447/console

This message is automatically generated.

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.3.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-749:
------------------------------------

    Status: Patch Available  (was: Open)

Attaching new patch which also overrides hadoop.tmp.dir property in the build.xml file, putting it underneath the build dir, so that multiple concurrent Hudson builder instances can test different branches without clobbering the {{/tmp/hadoop-hudson}} dir they would both overwise use. 

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.3.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated MAPREDUCE-749:
--------------------------------

       Resolution: Fixed
    Fix Version/s: 0.21.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

I've just committed this. Thanks Aaron!

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.3.patch, MAPREDUCE-749.4.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740354#action_12740354 ] 

Aaron Kimball commented on MAPREDUCE-749:
-----------------------------------------

Streaming test failures are unrelated

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.3.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-749) Make Sqoop unit tests more Hudson-friendly

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-749:
------------------------------------

    Attachment: MAPREDUCE-749.2.patch

> Make Sqoop unit tests more Hudson-friendly
> ------------------------------------------
>
>                 Key: MAPREDUCE-749
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-749
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-749.2.patch, MAPREDUCE-749.patch
>
>
> Hudson servers (other than Apache's) need to be able to run the sqoop unit tests which depend on thirdparty JDBC drivers / database implementations. The build.xml needs some refactoring to make this happen.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.