You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ivan Veselovsky (JIRA)" <ji...@apache.org> on 2016/07/05 13:06:10 UTC

[jira] [Comment Edited] (IGNITE-3343) IGFS: Do not query secondary file system properties during create/append/mkdirs.

    [ https://issues.apache.org/jira/browse/IGNITE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361624#comment-15361624 ] 

Ivan Veselovsky edited comment on IGNITE-3343 at 7/5/16 1:06 PM:
-----------------------------------------------------------------

Possibly the following meant: fields  IgfsEntryInfo#props;  IgfsEntryInfo##accessTime , modificationTime should not be used for files in dual paths.
1) create/append/mkdirs: only append makes secondary fs read call to get the actual length. Other calls do the write operation directly without the read call.
2) info/listFiles : performed directly on secondary fs, the result is not cached in meta cache except the file id itself.


was (Author: iveselovskiy):
Possibly the following meant: fields  IgfsEntryInfo#props;  IgfsEntryInfo##accessTime , modificationTime are not used for files in dual paths.
1) create/append/mkdirs: only append makes secondary fs call to get length. Other calls do the operation directly.
2) info/listFiles : performed directly on secondary fs, the result is not cached.

> IGFS: Do not query secondary file system properties during create/append/mkdirs.
> --------------------------------------------------------------------------------
>
>                 Key: IGNITE-3343
>                 URL: https://issues.apache.org/jira/browse/IGNITE-3343
>             Project: Ignite
>          Issue Type: Improvement
>          Components: IGFS
>    Affects Versions: 1.6
>            Reporter: Vladimir Ozerov
>            Assignee: Ivan Veselovsky
>            Priority: Critical
>             Fix For: 1.7
>
>
> Currently when we create something in a secondary file system, we perform additional calls to the secondary file system to get file/directory info. This significantly slows down structural operations, while usually it is not really needed in most cases.
> We should do the following:
> 1) Do not write modification time, access time and properties for DUAL entries. Instead, we should propagate "info" and "listFiles" calls to secondary file system right away.
> 2) For {{create()}} we do not need length, as the file is either created from scratch, or truncated.
> 3) For {{append()}} we need to know current length, so the second file system call appears to be inevitable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)