You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Jeremy Lewi (JIRA)" <ji...@apache.org> on 2011/08/18 17:52:27 UTC
[jira] [Created] (AVRO-878) TestWordCount.testProjection is broken
TestWordCount.testProjection is broken
--------------------------------------
Key: AVRO-878
URL: https://issues.apache.org/jira/browse/AVRO-878
Project: Avro
Issue Type: Test
Affects Versions: 1.6.0
Reporter: Jeremy Lewi
Assignee: Jeremy Lewi
TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Doug Cutting (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13121362#comment-13121362 ]
Doug Cutting commented on AVRO-878:
-----------------------------------
On trunk it should work to use 'mvn clean test' from the top-level of the project. I don't recommend installing snapshot versions as it can create a lot of confusion while developing.
The failures in the logs you sent were in TestProtocolHttp, TestProtocolHttps and TestProtocolNetty. In all cases the underlying exception was an inability of a test client to connect to a test server running on localhost. I don't know what causes this in your case.
Can you please try this with Java 1.6? Are there any other Fedora uses who can reproduce this?
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Jeremy Lewi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13100974#comment-13100974 ]
Jeremy Lewi commented on AVRO-878:
----------------------------------
I'm not that familiar with surefire reports so I just ziped up all the surefire reports for the ipc module and attached them to this ticket.
I'm running Fedora 15.
java -version
java version "1.7.0"
Java(TM) SE Runtime Environment (build 1.7.0-b147)
Java HotSpot(TM) 64-Bit Server VM (build 21.0-b17, mixed mode)
javac -version
javac 1.7.0
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-878) TestWordCount.testProjection is broken
Posted by "Jeremy Lewi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeremy Lewi updated AVRO-878:
-----------------------------
Attachment: lewi-ipc-reports.tar.gz
Here are the surefire reports for ipc.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-878) TestWordCount.testProjection is broken
Posted by "Jeremy Lewi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeremy Lewi updated AVRO-878:
-----------------------------
Attachment: AVRO-878.patch
Here's a patch. I changed the schema and updated the test testProjection
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Scott Carey (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125567#comment-13125567 ]
Scott Carey commented on AVRO-878:
----------------------------------
We should at some point test and be confident Java 7 works. But not until 7 update 2. The loop predication bugs in the original Java 7 release have a chance of hitting some of the optimized loops we have in the binary decoder or encoder. With update 2 due out shortly, there is little reason to test much until then.
I expect that I will be using Avro in a Java 7 environment at the beginning of 2012.
I think a ticket specific to Java 7 issues is preferable to morphing this one.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Jeremy Lewi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123890#comment-13123890 ]
Jeremy Lewi commented on AVRO-878:
----------------------------------
I tried it with Java 1.6 and all tests passed.
I also removed the snapshot from my local repository.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Jeremy Lewi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087893#comment-13087893 ]
Jeremy Lewi commented on AVRO-878:
----------------------------------
Thanks for explaining the test; I was clearly mistaken about what it was supposed to do.
This test is failing on trunk for me. Am I the only one?
It relates to 570 only in that I was getting test failures in mapred when checking my patch for 570; since I'm getting this test failure on trunk I don't think its due to the code in the patch for AVRO-570 and I wanted to make note of this.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089675#comment-13089675 ]
Doug Cutting commented on AVRO-878:
-----------------------------------
This test passes for me on Linux. Can you provide more details of how it fails for you?
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-878) TestWordCount.testProjection is broken
Posted by "Doug Cutting (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-878:
------------------------------
Status: Open (was: Patch Available)
This patch is no longer valid.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-878) TestWordCount.testProjection is broken
Posted by "Jeremy Lewi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeremy Lewi updated AVRO-878:
-----------------------------
Attachment: TEST-org.apache.avro.mapred.TestWordCount.xml
Here's the surefire output for TestWordCount.
Perhaps, I'm misusing maven and therefore pulling in the wrong dependencies so here's what I did.
1. cd AVRO/lang/java
2. mvn install -D skipTests
3. cd mapred
4 mvn test -X
I ran "mvn test" from the mapred subdirectory because if I tried to run from the "java" directory, I got test failures in the "ipc" package and this caused the tests for subsequent packages to be skipped.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-878) TestWordCount.testProjection is broken
Posted by "Jeremy Lewi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeremy Lewi updated AVRO-878:
-----------------------------
Fix Version/s: 1.6.0
Status: Patch Available (was: Open)
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087825#comment-13087825 ]
Doug Cutting commented on AVRO-878:
-----------------------------------
The intent of this test is to use a different schema and show that things still work. The key field is absent in the new schema and is ignored in the data read, and the rank field is not present so its default value is used. 'svn blame' shows that this test was added in AVRO-534 to check that a different schema may be used. How is this causing problems for AVRO-570?
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-878) TestWordCount.testProjection is broken
Posted by "Jeremy Lewi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeremy Lewi updated AVRO-878:
-----------------------------
Attachment: TEST-org.apache.avro.mapred.TestWordCount.xml
Here's the surefire output for TestWordCount.
Perhaps, I'm misusing maven and therefore pulling in the wrong dependencies so here's what I did.
1. cd AVRO/lang/java
2. mvn install -D skipTests
3. cd mapred
4 mvn test -X
I ran "mvn test" from the mapred subdirectory because if I tried to run from the "java" directory, I got test failures in the "ipc" package and this caused the tests for subsequent packages to be skipped.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Doug Cutting (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125216#comment-13125216 ]
Doug Cutting commented on AVRO-878:
-----------------------------------
So should we resolve this as "Not a problem" or should we keep it open as a problem when running under Java 7? Is Java 7 a platform that Avro needs to support at this point?
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (AVRO-878) TestWordCount.testProjection is broken
Posted by "Doug Cutting (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting resolved AVRO-878.
-------------------------------
Resolution: Not A Problem
Fix Version/s: (was: 1.6.0)
Assignee: (was: Jeremy Lewi)
Closing this as "Not a problem" for now, since we don't yet expect things to work on Java 7. Filed AVRO-926 to address Java 7 issues at some point in the future.
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml, lewi-ipc-reports.tar.gz
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-878) TestWordCount.testProjection is
broken
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098416#comment-13098416 ]
Doug Cutting commented on AVRO-878:
-----------------------------------
What tests fail in the IPC package? What OS & Java are you using?
> TestWordCount.testProjection is broken
> --------------------------------------
>
> Key: AVRO-878
> URL: https://issues.apache.org/jira/browse/AVRO-878
> Project: Avro
> Issue Type: Test
> Affects Versions: 1.6.0
> Reporter: Jeremy Lewi
> Assignee: Jeremy Lewi
> Fix For: 1.6.0
>
> Attachments: AVRO-878.patch, TEST-org.apache.avro.mapred.TestWordCount.xml, TEST-org.apache.avro.mapred.TestWordCount.xml
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> TestWordCount.testProjection in avro/mapred/TestWordCount.java is broken. It appears to be using the wrong schema to read the output of the map reduce job.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira