You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Andrey Klochkov (JIRA)" <ji...@apache.org> on 2012/07/16 21:48:34 UTC
[jira] [Created] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Andrey Klochkov created HADOOP-8599:
---------------------------------------
Summary: Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
Key: HADOOP-8599
URL: https://issues.apache.org/jira/browse/HADOOP-8599
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.0-alpha, 0.23.1, 1.0.3
Reporter: Andrey Klochkov
When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415745#comment-13415745 ]
Hudson commented on HADOOP-8599:
--------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2551 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2551/])
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. (Revision 1362295)
Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362295
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGetFileBlockLocations.java
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415750#comment-13415750 ]
Hudson commented on HADOOP-8599:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #2486 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2486/])
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. (Revision 1362295)
Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362295
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGetFileBlockLocations.java
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Kihwal Lee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420985#comment-13420985 ]
Kihwal Lee commented on HADOOP-8599:
------------------------------------
MAPREDUCE-4470 has been filed.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416100#comment-13416100 ]
Hudson commented on HADOOP-8599:
--------------------------------
Integrated in Hadoop-Hdfs-trunk #1106 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1106/])
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. (Revision 1362295)
Result = FAILURE
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362295
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGetFileBlockLocations.java
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed HADOOP-8599.
---------------------------------
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415699#comment-13415699 ]
Hadoop QA commented on HADOOP-8599:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12536733/HADOOP-8859-branch-0.23.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1198//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1198//console
This message is automatically generated.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Matt Foley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated HADOOP-8599:
-------------------------------
Target Version/s: 0.23.3, 3.0.0, 2.2.0-alpha (was: 1.1.0, 0.23.2, 2.0.1-alpha)
Fixed Target Versions to be consistent with Fix Versions.
Removed 1.1.0 target and opened HADOOP-8612 for backport.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Andrey Klochkov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415576#comment-13415576 ]
Andrey Klochkov commented on HADOOP-8599:
-----------------------------------------
The build https://builds.apache.org/job/Hadoop-Common-0.23-Build/312/ failed due to this bug, this is the failure log:
{code}
org.apache.hadoop.fs.TestGetFileBlockLocations.testGetFileBlockLocations2
Failing for the past 1 build (Since #312 )
Took 0.29 sec.
Stacktrace
junit.framework.AssertionFailedError: null
at junit.framework.Assert.fail(Assert.java:47)
at junit.framework.Assert.assertTrue(Assert.java:20)
at junit.framework.Assert.assertTrue(Assert.java:27)
at org.apache.hadoop.fs.TestGetFileBlockLocations.oneTest(TestGetFileBlockLocations.java:90)
at org.apache.hadoop.fs.TestGetFileBlockLocations.__CLR3_0_2h1r7rc12wg(TestGetFileBlockLocations.java:136)
at org.apache.hadoop.fs.TestGetFileBlockLocations.testGetFileBlockLocations2(TestGetFileBlockLocations.java:131)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175)
at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:81)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68)
Standard Output
2012-07-15 09:13:27,734 INFO util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(50)) - Loaded the native-hadoop library
{code}
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Andrey Klochkov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrey Klochkov updated HADOOP-8599:
------------------------------------
Attachment: HADOOP-8859-branch-0.23.patch
The patch fixes the condition of going beyond EOF in the FileSystem.getFileBlockLocations by changing
{code}
if (file.getLen() < start) {
return new BlockLocation[0];
{code}
to
{code}
if (file.getLen() <= start) {
return new BlockLocation[0];
{code}
An additional assert is added to the unit tests to verify the case.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416145#comment-13416145 ]
Hudson commented on HADOOP-8599:
--------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #316 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/316/])
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. (Revision 1362297)
Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362297
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGetFileBlockLocations.java
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416211#comment-13416211 ]
Hudson commented on HADOOP-8599:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk #1139 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1139/])
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. (Revision 1362295)
Result = FAILURE
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362295
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGetFileBlockLocations.java
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415766#comment-13415766 ]
Hudson commented on HADOOP-8599:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2507 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2507/])
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. (Revision 1362295)
Result = FAILURE
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362295
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGetFileBlockLocations.java
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Andrey Klochkov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrey Klochkov updated HADOOP-8599:
------------------------------------
Assignee: Andrey Klochkov
Status: Patch Available (was: Open)
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0-alpha, 0.23.1, 1.0.3
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415739#comment-13415739 ]
Todd Lipcon commented on HADOOP-8599:
-------------------------------------
+1, looks good to me. Thanks Andrey.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Mariappan Asokan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423158#comment-13423158 ]
Mariappan Asokan commented on HADOOP-8599:
------------------------------------------
Can someone take a look at MAPREDUCE-4470 and propose a proper fix or retract HADOOP-8599 from the trunk? This is causing the trunk build to fail for more than a week. I think returning a 0 split for an empty input is not a good idea. The original behavior of 1 split with size 0 was good. Can others jump in and comment on this?
Thanks.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Kihwal Lee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420983#comment-13420983 ]
Kihwal Lee commented on HADOOP-8599:
------------------------------------
I think TestCombineFileInputFormat.testForEmptyFile started failing after this. The split size on an empty input file used to be 1, but it's now 0.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Shinochika9861 (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474588#comment-13474588 ]
Shinochika9861 commented on HADOOP-8599:
----------------------------------------
Thank you for your attention not sending so many junk mails to the mailing list. It's infliction.
Sent from iPhone.
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8599) Non empty response from
FileSystem.getFileBlockLocations when asking for data beyond the end of
file
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HADOOP-8599:
--------------------------------
Resolution: Fixed
Fix Version/s: 2.2.0-alpha
3.0.0
0.23.3
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
> Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8599
> URL: https://issues.apache.org/jira/browse/HADOOP-8599
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 1.0.3, 0.23.1, 2.0.0-alpha
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8859-branch-0.23.patch
>
>
> When FileSystem.getFileBlockLocations(file,start,len) is called with "start" argument equal to the file size, the response is not empty. There is a test TestGetFileBlockLocations.testGetFileBlockLocations2 which uses randomly generated "start" and "len" arguments when calling FileSystem.getFileBlockLocations and the test fails randomly (when the generated start value equals to the file size).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira