You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Mukund Madhugiri (JIRA)" <ji...@apache.org> on 2008/04/04 23:09:24 UTC
[jira] Created: (HADOOP-3178) gridmix scripts for small and medium
jobs need to be changed to handle input paths differently
gridmix scripts for small and medium jobs need to be changed to handle input paths differently
----------------------------------------------------------------------------------------------
Key: HADOOP-3178
URL: https://issues.apache.org/jira/browse/HADOOP-3178
Project: Hadoop Core
Issue Type: Bug
Components: test
Affects Versions: 0.17.0
Reporter: Mukund Madhugiri
Priority: Blocker
Fix For: 0.17.0
The gridmix scripts failed to run small and medium jobs as tracked in HADOOP-3162. Based on that fix, the gridmix scripts need to be changed to handle input paths differently.
The scripts that submit the small and medium jobs need to be changed. Example of a change:
${VARINFLTEXT}/part-00000,${VARINFLTEXT}/part-00001,${VARINFLTEXT}/part-00002
nees to be changed to
${VARINFLTEXT}/{part-00000,part-00001,part-00002}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3178) gridmix scripts for small and medium
jobs need to be changed to handle input paths differently
Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mukund Madhugiri updated HADOOP-3178:
-------------------------------------
Attachment: HADOOP-3178.patch
> gridmix scripts for small and medium jobs need to be changed to handle input paths differently
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-3178
> URL: https://issues.apache.org/jira/browse/HADOOP-3178
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Affects Versions: 0.17.0
> Reporter: Mukund Madhugiri
> Assignee: Mukund Madhugiri
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: HADOOP-3178.patch
>
>
> The gridmix scripts failed to run small and medium jobs as tracked in HADOOP-3162. Based on that fix, the gridmix scripts need to be changed to handle input paths differently.
> The scripts that submit the small and medium jobs need to be changed. Example of a change:
> ${VARINFLTEXT}/part-00000,${VARINFLTEXT}/part-00001,${VARINFLTEXT}/part-00002
> nees to be changed to
> ${VARINFLTEXT}/{part-00000,part-00001,part-00002}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3178) gridmix scripts for small and
medium jobs need to be changed to handle input paths differently
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585982#action_12585982 ]
Hudson commented on HADOOP-3178:
--------------------------------
Integrated in Hadoop-trunk #451 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/451/])
> gridmix scripts for small and medium jobs need to be changed to handle input paths differently
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-3178
> URL: https://issues.apache.org/jira/browse/HADOOP-3178
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Affects Versions: 0.17.0
> Reporter: Mukund Madhugiri
> Assignee: Mukund Madhugiri
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: HADOOP-3178.patch
>
>
> The gridmix scripts failed to run small and medium jobs as tracked in HADOOP-3162. Based on that fix, the gridmix scripts need to be changed to handle input paths differently.
> The scripts that submit the small and medium jobs need to be changed. Example of a change:
> ${VARINFLTEXT}/part-00000,${VARINFLTEXT}/part-00001,${VARINFLTEXT}/part-00002
> nees to be changed to
> ${VARINFLTEXT}/{part-00000,part-00001,part-00002}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3178) gridmix scripts for small and medium
jobs need to be changed to handle input paths differently
Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mukund Madhugiri updated HADOOP-3178:
-------------------------------------
Status: Patch Available (was: Open)
I have a patch available for the issue.
We found another minor issue where the log filename is wrong for one job.
Here is the second issue:
$GRID_MIX_HOME/monsterQuery/monster_query.small 2>&1 > monster_query.medium.$i.out &
The small job is logging to a file called medium. Fixed that as well.
> gridmix scripts for small and medium jobs need to be changed to handle input paths differently
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-3178
> URL: https://issues.apache.org/jira/browse/HADOOP-3178
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Affects Versions: 0.17.0
> Reporter: Mukund Madhugiri
> Assignee: Mukund Madhugiri
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: HADOOP-3178.patch
>
>
> The gridmix scripts failed to run small and medium jobs as tracked in HADOOP-3162. Based on that fix, the gridmix scripts need to be changed to handle input paths differently.
> The scripts that submit the small and medium jobs need to be changed. Example of a change:
> ${VARINFLTEXT}/part-00000,${VARINFLTEXT}/part-00001,${VARINFLTEXT}/part-00002
> nees to be changed to
> ${VARINFLTEXT}/{part-00000,part-00001,part-00002}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-3178) gridmix scripts for small and medium
jobs need to be changed to handle input paths differently
Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mukund Madhugiri reassigned HADOOP-3178:
----------------------------------------
Assignee: Mukund Madhugiri
> gridmix scripts for small and medium jobs need to be changed to handle input paths differently
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-3178
> URL: https://issues.apache.org/jira/browse/HADOOP-3178
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Affects Versions: 0.17.0
> Reporter: Mukund Madhugiri
> Assignee: Mukund Madhugiri
> Priority: Blocker
> Fix For: 0.17.0
>
>
> The gridmix scripts failed to run small and medium jobs as tracked in HADOOP-3162. Based on that fix, the gridmix scripts need to be changed to handle input paths differently.
> The scripts that submit the small and medium jobs need to be changed. Example of a change:
> ${VARINFLTEXT}/part-00000,${VARINFLTEXT}/part-00001,${VARINFLTEXT}/part-00002
> nees to be changed to
> ${VARINFLTEXT}/{part-00000,part-00001,part-00002}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3178) gridmix scripts for small and medium
jobs need to be changed to handle input paths differently
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-3178:
--------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thank Mukund!
> gridmix scripts for small and medium jobs need to be changed to handle input paths differently
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-3178
> URL: https://issues.apache.org/jira/browse/HADOOP-3178
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Affects Versions: 0.17.0
> Reporter: Mukund Madhugiri
> Assignee: Mukund Madhugiri
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: HADOOP-3178.patch
>
>
> The gridmix scripts failed to run small and medium jobs as tracked in HADOOP-3162. Based on that fix, the gridmix scripts need to be changed to handle input paths differently.
> The scripts that submit the small and medium jobs need to be changed. Example of a change:
> ${VARINFLTEXT}/part-00000,${VARINFLTEXT}/part-00001,${VARINFLTEXT}/part-00002
> nees to be changed to
> ${VARINFLTEXT}/{part-00000,part-00001,part-00002}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3178) gridmix scripts for small and
medium jobs need to be changed to handle input paths differently
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585799#action_12585799 ]
Runping Qi commented on HADOOP-3178:
------------------------------------
Looks good.
+1
> gridmix scripts for small and medium jobs need to be changed to handle input paths differently
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-3178
> URL: https://issues.apache.org/jira/browse/HADOOP-3178
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Affects Versions: 0.17.0
> Reporter: Mukund Madhugiri
> Assignee: Mukund Madhugiri
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: HADOOP-3178.patch
>
>
> The gridmix scripts failed to run small and medium jobs as tracked in HADOOP-3162. Based on that fix, the gridmix scripts need to be changed to handle input paths differently.
> The scripts that submit the small and medium jobs need to be changed. Example of a change:
> ${VARINFLTEXT}/part-00000,${VARINFLTEXT}/part-00001,${VARINFLTEXT}/part-00002
> nees to be changed to
> ${VARINFLTEXT}/{part-00000,part-00001,part-00002}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.