You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Created) (JIRA)" <ji...@apache.org> on 2012/01/18 21:54:40 UTC
[jira] [Created] (MAPREDUCE-3691) webservices add support to
compress response
webservices add support to compress response
--------------------------------------------
Key: MAPREDUCE-3691
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Thomas Graves
Assignee: Thomas Graves
Priority: Critical
The web services currently don't support header 'Accept-Encoding: gzip'
Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191475#comment-13191475 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1570 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1570/])
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234989
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13188742#comment-13188742 ]
Thomas Graves commented on MAPREDUCE-3691:
------------------------------------------
Manually tested: (did similar for all rm,nm,app master, history server)
curl --compressed -D header.txt -X GET "http://host.domain.com:8088/ws/v1/cluster/apps"
header:
HTTP/1.1 200 OK
Content-Type: text/plain; charset=utf-8
Content-Type: application/json
Content-Encoding: gzip
Transfer-Encoding: chunked
Server: Jetty(6.1.26)
curl handles decompressing when using the --compressed output so it comes out in json as expected.
----
curl -D header.txt -X GET "http://host.domain.com:8088/ws/v1/cluster/apps"
header:
HTTP/1.1 200 OK
Content-Type: text/plain; charset=utf-8
Content-Type: application/json
Transfer-Encoding: chunked
Server: Jetty(6.1.26)
again output in json no compression
-----
curl -D header.txt -H "Accept-Encoding: gzip" -X GET "http://host.domain.com:8088/ws/v1/cluster/apps"
HTTP/1.1 200 OK
Content-Type: text/plain; charset=utf-8
Content-Type: application/json
Content-Encoding: gzip
Transfer-Encoding: chunked
Server: Jetty(6.1.26)
output comes out in binary gzip
----
curl --compressed -D header.txt -H "Accept: application/xml" -X GET "http://host.domain.com:8088/ws/v1/cluster/apps"
header:
HTTP/1.1 200 OK
Content-Type: text/plain; charset=utf-8
Content-Type: application/xml
Content-Encoding: gzip
Content-Length: 479
Server: Jetty(6.1.26)
output comes out in xml as curl handles decompressing
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191492#comment-13191492 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #405 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/405/])
MAPREDUCE-3702 and MAPREDUCE-3691 - merging r1234991 and r1234989 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234994
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191474#comment-13191474 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1643 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1643/])
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234989
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191530#comment-13191530 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1589 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1589/])
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234989
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192116#comment-13192116 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #148 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/148/])
MAPREDUCE-3702 and MAPREDUCE-3691 - merging r1234991 and r1234989 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234994
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190267#comment-13190267 ]
Thomas Graves commented on MAPREDUCE-3691:
------------------------------------------
note comments above about tests.
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13188706#comment-13188706 ]
Thomas Graves commented on MAPREDUCE-3691:
------------------------------------------
jersey has a built in support for a GZIP content encoding filter that just needs to be configured on.
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192135#comment-13192135 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #170 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/170/])
MAPREDUCE-3702 and MAPREDUCE-3691 - merging r1234991 and r1234989 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234994
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13189021#comment-13189021 ]
Hadoop QA commented on MAPREDUCE-3691:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12511041/MAPREDUCE-3691.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1627//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1627//console
This message is automatically generated.
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3691:
-------------------------------------
Status: Patch Available (was: Open)
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192094#comment-13192094 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #935 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/935/])
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234989
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3691:
-------------------------------------
Attachment: MAPREDUCE-3691.patch
Unfortunately I don't see an easy way to add a unit test for this. The test framework now is setup to test particular web services, like RM, NM, etc. And there is no unit test framework in place for the core webapp functionality.
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13189591#comment-13189591 ]
Hadoop QA commented on MAPREDUCE-3691:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12511041/MAPREDUCE-3691.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1643//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1643//console
This message is automatically generated.
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192147#comment-13192147 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #968 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/968/])
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234989
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191508#comment-13191508 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #420 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/420/])
MAPREDUCE-3702 and MAPREDUCE-3691 - merging r1234991 and r1234989 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234994
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191483#comment-13191483 ]
Hudson commented on MAPREDUCE-3691:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #395 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/395/])
MAPREDUCE-3702 and MAPREDUCE-3691 - merging r1234991 and r1234989 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1234994
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/amfilter/AmIpFilter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/amfilter/TestAmFilter.java
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3691) webservices add support to
compress response
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3691:
-------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.1
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Patch looks good. I just committed this. Thanks Thomas!
> webservices add support to compress response
> --------------------------------------------
>
> Key: MAPREDUCE-3691
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3691
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3691.patch
>
>
> The web services currently don't support header 'Accept-Encoding: gzip'
> Given that the responses have a lot of duplicate data like the property names in JSON or the tag names in XML, it should
> compress very well, and would save on bandwidth and download time when fetching a potentially large response, like the
> ones from ws/v1/cluster/apps and ws/v1/history/mapreduce/jobs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira