You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Dmitriy Pavlov (JIRA)" <ji...@apache.org> on 2018/01/18 09:51:00 UTC
[jira] [Comment Edited] (IGNITE-6341) Use direct IO or libaio for
file page store where applicable
[ https://issues.apache.org/jira/browse/IGNITE-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16330305#comment-16330305 ]
Dmitriy Pavlov edited comment on IGNITE-6341 at 1/18/18 9:50 AM:
-----------------------------------------------------------------
Ignite Direct IO plugin will be added to optional lib automatically to Apache-ignite-fabric-2.x.x-bin\libs\optional\ignite-direct-io\direct-io-2.x.x.jar
To enable Direct IO it is sufficient to place lib to ignite classpath on Linux system.
When plugin is applied following messages will be produced
{noformat}
Configured plugins:
^-- Ignite Native I/O Plugin [Direct I/O]
^-- Copyright(C) Apache Software Foundation
{noformat}
Following message will be produced for successful setup:
{noformat}
Page size configuration for storage path [/data/teamcity/tmpfs/work/db/node00-3a1415b8-aa54-4a63-a40a-c75ad48dd6b8]: 4096; Linux memory page size: 4096; Selected FS block size : 4096.
Selected FS block size : 4096
Direct IO is enabled for block IO operations on aligned memory structures. [block size = 4096, durable memory page size = 4096]
{noformat}
Following test suites were added for checking Direct IO functionality using existing PDS tests:
[IgnitePds1DirectIo|https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteTests24Java8_IgnitePds1DirectIo]
[IgnitePds2DirectIo|https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteTests24Java8_IgnitePds2DirectIo]
Runs may be triggered by [RunAllPds|https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteTests24Java8_RunAllPds]
Example of run of PR code:
[https://ci.ignite.apache.org/viewLog.html?buildId=1044741]
[~agoncharuk], could you please review and merge changes from PR [https://github.com/apache/ignite/pull/3226] ?
was (Author: dpavlov):
Ignite Direct IO plugin will be added to optional lib automatically to Apache-ignite-fabric-2.x.x-bin\libs\optional\ignite-direct-io\direct-io-2.x.x.jar
To enable Direct IO it is sufficient to place lib to ignite classpath on Linux system.
When plugin is applied following messages will be produced
{noformat}
Configured plugins:
^-- Ignite Native I/O Plugin [Direct I/O]
^-- Copyright(C) Apache Software Foundation{noformat}
Following message will be produced for successful setup:
{noformat}
Page size configuration for storage path [/data/teamcity/tmpfs/work/db/node00-3a1415b8-aa54-4a63-a40a-c75ad48dd6b8]: 4096; Linux memory page size: 4096; Selected FS block size : 4096.
Selected FS block size : 4096
Direct IO is enabled for block IO operations on aligned memory structures. [block size = 4096, durable memory page size = 4096]{noformat}
Following test suites were added for checking Direct IO functionality using existing PDS tests:
[https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteTests24Java8_IgnitePds1DirectIo]
[https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteTests24Java8_IgnitePds2DirectIo]
Runs may be triggered by [https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteTests24Java8_RunAllPds]
Example of run of PR code:
[https://ci.ignite.apache.org/viewLog.html?buildId=1044741]
[~agoncharuk], could you please review and merge changes from PR [https://github.com/apache/ignite/pull/3226] ?
> Use direct IO or libaio for file page store where applicable
> ------------------------------------------------------------
>
> Key: IGNITE-6341
> URL: https://issues.apache.org/jira/browse/IGNITE-6341
> Project: Ignite
> Issue Type: Improvement
> Components: persistence
> Reporter: Andrey Gura
> Assignee: Dmitriy Pavlov
> Priority: Major
> Fix For: 2.4
>
>
> Need try to use direct IO or libaio for page store because once data buffer is serialized, we can write it as disk pages (this will also make it easier if we decide to open file as a block device).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)