You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Jerome Boulon (JIRA)" <ji...@apache.org> on 2009/04/29 00:35:30 UTC
[jira] Created: (CHUKWA-195) Support Hadoop 0.20 on the backend
Support Hadoop 0.20 on the backend
----------------------------------
Key: CHUKWA-195
URL: https://issues.apache.org/jira/browse/CHUKWA-195
Project: Hadoop Chukwa
Issue Type: Improvement
Reporter: Jerome Boulon
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jerome Boulon updated CHUKWA-195:
---------------------------------
Attachment: CHUKWA-195.patch
Chukwa is working out of the box on Hadoop 0.20. This patch remove the H 0.18 jar file.
If you want to specify a queue then you need to add the queue parameter to chukwa-demux-conf.xml.
Example:
<property>
<name>mapred.job.queue.name</name>
<value>YourQueueName</value>
<description>Hadoop Queue </description>
</property>
This should not go to the 0.1.2 branch.
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0
>
> Attachments: CHUKWA-195.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-195:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Since Hadoop 0.20 deprecated a lot of JobTracker and JobConf classes, the compilation warnings are ok for now. We will update when Hadoop 0.21 has the job tracker refactor in place. I just committed this, thanks Jerome.
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0
>
> Attachments: CHUKWA-195.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717476#action_12717476 ]
Hudson commented on CHUKWA-195:
-------------------------------
Integrated in Chukwa-trunk #47 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/47/])
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0
>
> Attachments: CHUKWA-195.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12703898#action_12703898 ]
Jerome Boulon commented on CHUKWA-195:
--------------------------------------
Most M/R are not compatible with Hadoop 0.20, for example the hdfs package has been renamed to dfs and there's a lot of deprecated methods/class that we are using.
This Jira is to upgrade the source code remove all warnings and be compatible with Hadoop 0.20.
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714077#action_12714077 ]
Mac Yang commented on CHUKWA-195:
---------------------------------
Chatted with Owen, the concern was not about which version of hadoop that chukwa runs on. Rather, it's about the build process and the bundling of multiple hadoop jars (currently required to build the client jar).
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714081#action_12714081 ]
Jerome Boulon commented on CHUKWA-195:
--------------------------------------
I agree that moving to H.20 should be the target for C0.2 but not for C0.1.2.
Pig lib directory also contains 2 hadoop jars, .17 & .18 to deal with an API change and still be compatible.
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12703889#action_12703889 ]
Mac Yang commented on CHUKWA-195:
---------------------------------
Some more details here would be helpful.
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716773#action_12716773 ]
Jerome Boulon commented on CHUKWA-195:
--------------------------------------
Another pass will be needed in order to remove all deprecated methods.
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0
>
> Attachments: CHUKWA-195.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713812#action_12713812 ]
Ari Rabkin commented on CHUKWA-195:
-----------------------------------
Just talked to Owen, who thought this might be a blocker for a release.
Thoughts?
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jerome Boulon updated CHUKWA-195:
---------------------------------
Fix Version/s: 0.2.0
Status: Patch Available (was: Open)
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0
>
> Attachments: CHUKWA-195.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jerome Boulon reassigned CHUKWA-195:
------------------------------------
Assignee: Jerome Boulon
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-195) Support Hadoop 0.20 on the backend
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713819#action_12713819 ]
Jerome Boulon commented on CHUKWA-195:
--------------------------------------
1) Are you saying that if we cannot get data from a .20 cluster then it's a blocker?
2) or are you saying that the backend should run on .20?
if 1) it's OK because we are able to collect information from a .20 cluster but it sounds strange that we want to be the first one to move a production application to .20?
> Support Hadoop 0.20 on the backend
> ----------------------------------
>
> Key: CHUKWA-195
> URL: https://issues.apache.org/jira/browse/CHUKWA-195
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.