You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ivan Veselovsky (JIRA)" <ji...@apache.org> on 2016/07/05 13:06:10 UTC
[jira] [Comment Edited] (IGNITE-3343) IGFS: Do not query secondary
file system properties during create/append/mkdirs.
[ https://issues.apache.org/jira/browse/IGNITE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361624#comment-15361624 ]
Ivan Veselovsky edited comment on IGNITE-3343 at 7/5/16 1:06 PM:
-----------------------------------------------------------------
Possibly the following meant: fields IgfsEntryInfo#props; IgfsEntryInfo##accessTime , modificationTime should not be used for files in dual paths.
1) create/append/mkdirs: only append makes secondary fs read call to get the actual length. Other calls do the write operation directly without the read call.
2) info/listFiles : performed directly on secondary fs, the result is not cached in meta cache except the file id itself.
was (Author: iveselovskiy):
Possibly the following meant: fields IgfsEntryInfo#props; IgfsEntryInfo##accessTime , modificationTime are not used for files in dual paths.
1) create/append/mkdirs: only append makes secondary fs call to get length. Other calls do the operation directly.
2) info/listFiles : performed directly on secondary fs, the result is not cached.
> IGFS: Do not query secondary file system properties during create/append/mkdirs.
> --------------------------------------------------------------------------------
>
> Key: IGNITE-3343
> URL: https://issues.apache.org/jira/browse/IGNITE-3343
> Project: Ignite
> Issue Type: Improvement
> Components: IGFS
> Affects Versions: 1.6
> Reporter: Vladimir Ozerov
> Assignee: Ivan Veselovsky
> Priority: Critical
> Fix For: 1.7
>
>
> Currently when we create something in a secondary file system, we perform additional calls to the secondary file system to get file/directory info. This significantly slows down structural operations, while usually it is not really needed in most cases.
> We should do the following:
> 1) Do not write modification time, access time and properties for DUAL entries. Instead, we should propagate "info" and "listFiles" calls to secondary file system right away.
> 2) For {{create()}} we do not need length, as the file is either created from scratch, or truncated.
> 3) For {{append()}} we need to know current length, so the second file system call appears to be inevitable.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)