You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2019/12/18 07:42:00 UTC
[jira] [Commented] (FLINK-15305) MemoryMappedBoundedDataTest fails
with IOException on ppc64le
[ https://issues.apache.org/jira/browse/FLINK-15305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998886#comment-16998886 ]
Yingjie Cao commented on FLINK-15305:
-------------------------------------
I guess this is because that the page size on your platform is 65536 bytes. Flink round down the input mmap region size (10_000 for the test case) by the following method:
{code:java}
private static int alignSize(int maxRegionSize) {
checkArgument(maxRegionSize >= PAGE_SIZE);
return maxRegionSize - (maxRegionSize % PAGE_SIZE);
}{code}
Except for decreasing the buffer size, increasing the mmap region can also fix the problem.
You can check whether the page size on your platform is 65536 bytes or not.
> MemoryMappedBoundedDataTest fails with IOException on ppc64le
> -------------------------------------------------------------
>
> Key: FLINK-15305
> URL: https://issues.apache.org/jira/browse/FLINK-15305
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Environment: arch: ppc64le
> os: rhel 7.6
> jdk: 8
> mvn: 3.3.9
> Reporter: Siddhesh Ghadi
> Priority: Major
> Attachments: surefire-report.txt
>
>
> By reducing the buffer size from 76_687 to 60_787 in flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/BoundedDataTestBase.java:164, test passes. Any thoughts on this approach?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)