You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Yang Yun (JIRA)" <ji...@apache.org> on 2017/12/26 08:45:00 UTC

[jira] [Updated] (HDFS-12964) Read a opened file timely and effectively when it's being written by other

     [ https://issues.apache.org/jira/browse/HDFS-12964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yang Yun updated HDFS-12964:
----------------------------
    Attachment: HADOOP-12964.001.patch

Add new DFSSpinInputStream extended from DFSInputStream. If the file is being written by somebody else, DFSSpinInputStream will keep updating the file's length information if the reading goes beyond the current EOF. And also add cache for the requests of RefreshLocatedBlocks to Namenode and the connections to Datanode.

> Read a opened file timely and effectively when it's being written by other
> --------------------------------------------------------------------------
>
>                 Key: HDFS-12964
>                 URL: https://issues.apache.org/jira/browse/HDFS-12964
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs-client
>            Reporter: Yang Yun
>            Priority: Critical
>         Attachments: HADOOP-12964.001.patch
>
>
> One thread opens a HDFS file and keep writing.  Another thread opens same file and keep reading it at the same time, also want to get the newest content of file. that happen at in many environments, for example, talos message transmission. And it also require the new content can be read timely and effectively, for there maybe many tasks are working in same time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org