You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Richard Ding (JIRA)" <ji...@apache.org> on 2011/05/03 00:39:03 UTC
[jira] [Created] (PIG-2028) Speed up multiquery unit tests
Speed up multiquery unit tests
-------------------------------
Key: PIG-2028
URL: https://issues.apache.org/jira/browse/PIG-2028
Project: Pig
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Richard Ding
Assignee: Richard Ding
Fix For: 0.9.0
Switch TestMultiQueryBasic and TestMultiQuery to use LOCAL mode. The results on my laptop:
Using Mini Cluster:
TestMultiQueryBasic: 17 min 17 sec
TestMultiQuery: 23 min 2 sec
Using LOCAL mode:
TestMultiQueryBasic: 4 min 17 sec
TestMultiQuery: 5 min 51 sec
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (PIG-2028) Speed up multiquery unit tests
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding resolved PIG-2028.
-------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Path committed to trunk and 0.9 branch.
> Speed up multiquery unit tests
> -------------------------------
>
> Key: PIG-2028
> URL: https://issues.apache.org/jira/browse/PIG-2028
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Richard Ding
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2028.patch, PIG-2028_1.patch
>
>
> Switch TestMultiQueryBasic and TestMultiQuery to use LOCAL mode. The results on my laptop:
> Using Mini Cluster:
> TestMultiQueryBasic: 17 min 17 sec
> TestMultiQuery: 23 min 2 sec
> Using LOCAL mode:
> TestMultiQueryBasic: 4 min 17 sec
> TestMultiQuery: 5 min 51 sec
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2028) Speed up multiquery unit tests
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-2028:
------------------------------
Attachment: PIG-2028.patch
> Speed up multiquery unit tests
> -------------------------------
>
> Key: PIG-2028
> URL: https://issues.apache.org/jira/browse/PIG-2028
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Richard Ding
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2028.patch
>
>
> Switch TestMultiQueryBasic and TestMultiQuery to use LOCAL mode. The results on my laptop:
> Using Mini Cluster:
> TestMultiQueryBasic: 17 min 17 sec
> TestMultiQuery: 23 min 2 sec
> Using LOCAL mode:
> TestMultiQueryBasic: 4 min 17 sec
> TestMultiQuery: 5 min 51 sec
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2028) Speed up multiquery unit tests
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-2028:
------------------------------
Attachment: PIG-2028_1.patch
> Speed up multiquery unit tests
> -------------------------------
>
> Key: PIG-2028
> URL: https://issues.apache.org/jira/browse/PIG-2028
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Richard Ding
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2028.patch, PIG-2028_1.patch
>
>
> Switch TestMultiQueryBasic and TestMultiQuery to use LOCAL mode. The results on my laptop:
> Using Mini Cluster:
> TestMultiQueryBasic: 17 min 17 sec
> TestMultiQuery: 23 min 2 sec
> Using LOCAL mode:
> TestMultiQueryBasic: 4 min 17 sec
> TestMultiQuery: 5 min 51 sec
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2028) Speed up multiquery unit tests
Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027944#comment-13027944 ]
Dmitriy V. Ryaboy commented on PIG-2028:
----------------------------------------
Nice speed improvement!
A nitpick: if the test is interrupted, it will leave test files in the working directory; that's messy and causes failures on reruns (since the files already exist). It's better to write to and load from a temp directory created inside java.io.tmpdir, and to set deleteOnExit() on them.
> Speed up multiquery unit tests
> -------------------------------
>
> Key: PIG-2028
> URL: https://issues.apache.org/jira/browse/PIG-2028
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Richard Ding
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2028.patch
>
>
> Switch TestMultiQueryBasic and TestMultiQuery to use LOCAL mode. The results on my laptop:
> Using Mini Cluster:
> TestMultiQueryBasic: 17 min 17 sec
> TestMultiQuery: 23 min 2 sec
> Using LOCAL mode:
> TestMultiQueryBasic: 4 min 17 sec
> TestMultiQuery: 5 min 51 sec
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2028) Speed up multiquery unit tests
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13028485#comment-13028485 ]
Richard Ding commented on PIG-2028:
-----------------------------------
Simplify the test cases. Using Util.createLocalInputFile whenever possible.
> Speed up multiquery unit tests
> -------------------------------
>
> Key: PIG-2028
> URL: https://issues.apache.org/jira/browse/PIG-2028
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Richard Ding
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2028.patch, PIG-2028_1.patch
>
>
> Switch TestMultiQueryBasic and TestMultiQuery to use LOCAL mode. The results on my laptop:
> Using Mini Cluster:
> TestMultiQueryBasic: 17 min 17 sec
> TestMultiQuery: 23 min 2 sec
> Using LOCAL mode:
> TestMultiQueryBasic: 4 min 17 sec
> TestMultiQuery: 5 min 51 sec
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2028) Speed up multiquery unit tests
Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13028509#comment-13028509 ]
Thejas M Nair commented on PIG-2028:
------------------------------------
+1
> Speed up multiquery unit tests
> -------------------------------
>
> Key: PIG-2028
> URL: https://issues.apache.org/jira/browse/PIG-2028
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Richard Ding
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2028.patch, PIG-2028_1.patch
>
>
> Switch TestMultiQueryBasic and TestMultiQuery to use LOCAL mode. The results on my laptop:
> Using Mini Cluster:
> TestMultiQueryBasic: 17 min 17 sec
> TestMultiQuery: 23 min 2 sec
> Using LOCAL mode:
> TestMultiQueryBasic: 4 min 17 sec
> TestMultiQuery: 5 min 51 sec
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira