You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2009/12/23 22:20:29 UTC
[jira] Created: (HBASE-2069) Use the new 'visible' length feature
added by hdfs-814
Use the new 'visible' length feature added by hdfs-814
------------------------------------------------------
Key: HBASE-2069
URL: https://issues.apache.org/jira/browse/HBASE-2069
Project: Hadoop HBase
Issue Type: Bug
Reporter: stack
Fix For: 0.21.0
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2069) Use the new 'visible' length feature
added by hdfs-814
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806122#action_12806122 ]
stack commented on HBASE-2069:
------------------------------
@Ryan Thats what Dhruba said over in hdfs-814 when the issue was initially filed. Check it out for how we eventually got to getVisibleLength.
> Use the new 'visible' length feature added by hdfs-814
> ------------------------------------------------------
>
> Key: HBASE-2069
> URL: https://issues.apache.org/jira/browse/HBASE-2069
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Fix For: 0.21.0
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2069) Use the new 'visible' length feature
added by hdfs-814
Posted by "ryan rawson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806087#action_12806087 ]
ryan rawson commented on HBASE-2069:
------------------------------------
i didnt realize we had to use a special API to read back a improperly closed file!
What happens when you use the 'normal' API to read a file that was not properly closed? You don't get all the data unless you use this API?
Really?
> Use the new 'visible' length feature added by hdfs-814
> ------------------------------------------------------
>
> Key: HBASE-2069
> URL: https://issues.apache.org/jira/browse/HBASE-2069
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Fix For: 0.21.0
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2069) Use the new 'visible' length feature
added by hdfs-814
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805984#action_12805984 ]
dhruba borthakur commented on HBASE-2069:
-----------------------------------------
The getVisibileLength API is an HDFS API (and not a FileSystem API). This API can be used to get the length of a file even when the writer of the file did not close it cleanly. This happens when a region server dies suddenly. When a hbase region server dies, a new region server can read upto the end of the unclosed-HLog using this API.
> Use the new 'visible' length feature added by hdfs-814
> ------------------------------------------------------
>
> Key: HBASE-2069
> URL: https://issues.apache.org/jira/browse/HBASE-2069
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Fix For: 0.21.0
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2069) Use the new 'visible' length feature
added by hdfs-814
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794457#action_12794457 ]
dhruba borthakur commented on HBASE-2069:
-----------------------------------------
This would require casting the output stream to org.apache.hadoop.hdfs.DFSOutputStream (HDFS-814) to invoke the new API. Is this acceptable? This new API is not part of the org.apache.hadoop.fs APIs
> Use the new 'visible' length feature added by hdfs-814
> ------------------------------------------------------
>
> Key: HBASE-2069
> URL: https://issues.apache.org/jira/browse/HBASE-2069
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Fix For: 0.21.0
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2069) Use the new 'visible' length feature
added by hdfs-814
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794522#action_12794522 ]
Andrew Purtell commented on HBASE-2069:
---------------------------------------
We already cast FileSystem to DistributedFileSystem as appropriate, so I don't see why not.
> Use the new 'visible' length feature added by hdfs-814
> ------------------------------------------------------
>
> Key: HBASE-2069
> URL: https://issues.apache.org/jira/browse/HBASE-2069
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Fix For: 0.21.0
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2069) Use the new 'visible' length feature
added by hdfs-814
Posted by "Lars George (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805851#action_12805851 ]
Lars George commented on HBASE-2069:
------------------------------------
Sorry for asking, but where is that used? During a split in HLog? Just would like to get some context. Thanks!
> Use the new 'visible' length feature added by hdfs-814
> ------------------------------------------------------
>
> Key: HBASE-2069
> URL: https://issues.apache.org/jira/browse/HBASE-2069
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Fix For: 0.21.0
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.