You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2008/11/21 23:15:44 UTC
[jira] Created: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Update chukwa source code and develop chukwa from public repository
-------------------------------------------------------------------
Key: HADOOP-4709
URL: https://issues.apache.org/jira/browse/HADOOP-4709
Project: Hadoop Core
Issue Type: Bug
Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
Reporter: Eric Yang
Assignee: Eric Yang
New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
- Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
- Added FileAdaptor for streaming small file in one chunk
- Added compression to archive and demux output
- Added unit tests and validation for agent, collector, and demux map reduce job
- Added database loader for loading demux output (sequence file) to jdbc connected database
- Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653518#action_12653518 ]
Owen O'Malley commented on HADOOP-4709:
---------------------------------------
Unfortunately, Yahoo has been using an internal subversion repository for Chukwa. This patch is trying to sync the two repositories. Keeping the hidden repository is destructive to the community and needs to stop. I propose we let this patch in, but put Chukwa on probation and point out (as you have done) that this is *not* acceptable open source development practice.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Status: Patch Available (was: Open)
Same patch with additional partition name and user name removed.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Status: Open (was: Patch Available)
The current patch contains user name which should not be part of the patch.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-2.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Attachment: HADOOP-4709.patch
Apply with patch -p0 < HADOOP-4709.patch in trunk.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-binary.tar.gz, HADOOP-4709.patch
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Attachment: HADOOP-4709-binary.tar.gz
Image files and Apache JSP Taglib 1.1
Instruction:
untar the tarball in trunk, and add files in src/contrib/chukwa/lib/jstl*, src/contrib/chukwa/src/web/hicc/images, src/contrib/chukwa/src/web/hicc/css/images, to SVN.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653389#action_12653389 ]
Doug Cutting commented on HADOOP-4709:
--------------------------------------
Big code drops like this are a bad practice. Rather you should be adding patches issue by issue. Otherwise you're effectively not operating in public, and eliminate the opportunity for others to participate in the process. Before we can add Chukwa committers, we need its contributors to demonstrate that they understand how to collaborate openly. This patch is a step backwards.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654097#action_12654097 ]
Hudson commented on HADOOP-4709:
--------------------------------
Integrated in Hadoop-trunk #680 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/680/])
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Status: Open (was: Patch Available)
Remove author tag
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-2.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654489#action_12654489 ]
Eric Yang commented on HADOOP-4709:
-----------------------------------
Giri,
Please file this as a different bug. The original intention was to utilize the same library version when chukwa is built inside hadoop's contrib directory. In this case, jsp-api.jar should be loaded from hadoop/lib/jsp-2.1/jsp-api-2.1.jar The copy of jsp-api.jar was supplied for building chukwa in standalone mode. This means, the build.xml file need to be changed to pick up jsp-api-*.jar from the proper location.
Thanks
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651677#action_12651677 ]
Hadoop QA commented on HADOOP-4709:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394722/HADOOP-4709.patch
against trunk revision 721415.
-1 @author. The patch appears to contain 2 @author tags which the Hadoop community has agreed to not allow in code contributions.
+1 tests included. The patch appears to include 80 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3666/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3666/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3666/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3666/console
This message is automatically generated.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-binary.tar.gz, HADOOP-4709.patch
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651768#action_12651768 ]
Chris Douglas commented on HADOOP-4709:
---------------------------------------
Does this drop include the other PA issues for Chukwa (HADOOP-4459, HADOOP-4434, and HADOOP-4529)?
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-2.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Attachment: HADOOP-4709-2.patch
Same as above patch and removed author tag.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-2.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Release Note: Contributed by Jerome Boulon, Andy Konwinski, Ariel Rabkin, Eric Yang
Status: Patch Available (was: Open)
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-binary.tar.gz, HADOOP-4709.patch
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654478#action_12654478 ]
Giridharan Kesavan commented on HADOOP-4709:
--------------------------------------------
Clarification:
I was going through the chukwa/build.xml 's package-hadoop target and found that we are trying to copy jsp-api.jar from the hadoop/lib dir but actually the jsp-api. jar resides in chukwa/lib directory.
Can someone please clarify on this?
Also, let me know if this is a bug and if you want me to file a different bug?
Thanks,
Giri
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Status: Patch Available (was: Open)
Same patch with author tag removed.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-2.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4709:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.20.0
Status: Resolved (was: Patch Available)
I just committed this. Thanks Jerome, Eric, Andy, and Ari
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.20.0
>
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Attachment: (was: HADOOP-4709.patch)
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-2.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-4709:
-------------------------------------
Component/s: contrib/chukwa
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4709) Update chukwa source code and
develop chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651795#action_12651795 ]
Eric Yang commented on HADOOP-4709:
-----------------------------------
Yes this drop includes patches from HADOOP 4459, 4434, and 4529.
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-2.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Attachment: HADOOP-4709-3.patch
Same patch with user name and Yahoo specific partition names removed
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Fix Version/s: (was: 0.20.0)
Release Note:
What is new in HADOOP-4709:
Dashboard for visual Hadoop metrics and system metrics.
Database loader for loading chukwa records to jdbc connected database.
FileAdaptor for streaming small file as one record for data processing.
Scripts for capturing tcpdump output and stream to Chukwa for archive.
Improvement
New load blanace algorithm for ChukwaAgent to distribute data to Chukwa Collectors more evenly.
Unit test and validation for agent, collector, and demux map reduce job.
Contributed by Jerome Boulon, Andy Konwinski, Ariel Rabkin, Eric Yang
was:Contributed by Jerome Boulon, Andy Konwinski, Ariel Rabkin, Eric Yang
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4709) Update chukwa source code and develop
chukwa from public repository
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-4709:
------------------------------
Attachment: (was: HADOOP-4709-2.patch)
> Update chukwa source code and develop chukwa from public repository
> -------------------------------------------------------------------
>
> Key: HADOOP-4709
> URL: https://issues.apache.org/jira/browse/HADOOP-4709
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/chukwa
> Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-4709-3.patch, HADOOP-4709-binary.tar.gz
>
>
> New features that were added to Chukwa source code since last time chukwa was committed to SVN repository:
> - Added Hadoop Infrastructure Care Center (UI for visualize data collected by Chukwa)
> - Added FileAdaptor for streaming small file in one chunk
> - Added compression to archive and demux output
> - Added unit tests and validation for agent, collector, and demux map reduce job
> - Added database loader for loading demux output (sequence file) to jdbc connected database
> - Added algorithm to distribute collector load more evenly
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.