You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Kouhei Sutou (Jira)" <ji...@apache.org> on 2022/10/12 21:06:00 UTC
[jira] [Commented] (ARROW-18000) [Plasma][C++] plasma-store-server start with -h , occur bus error
[ https://issues.apache.org/jira/browse/ARROW-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616690#comment-17616690 ]
Kouhei Sutou commented on ARROW-18000:
--------------------------------------
https://arrow.apache.org/docs/python/plasma.html#using-plasma-with-huge-pages
It seems that you need to crate a new filesystem to use huge page.
> [Plasma][C++] plasma-store-server start with -h , occur bus error
> -----------------------------------------------------------------
>
> Key: ARROW-18000
> URL: https://issues.apache.org/jira/browse/ARROW-18000
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++ - Plasma
> Environment: [root@02a40e9b75b6 release]# free
> total used free shared buff/cache available
> Mem: 12979512 6299224 1163552 369948 5516736 5990072
> Swap: 4194304 16480 4177824
> [root@02a40e9b75b6 release]# uname -a
> Linux 02a40e9b75b6 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
> Reporter: xingwang li
> Priority: Major
>
> use plasma as a shared-memory ,
> start with these args:
> ./plasma-store-server -m 1000000 -s /tmp/test -d /dev/shm -h
> occurs bus error
> /home/arrow/arrow/cpp/src/plasma/store.cc:1277: Allowing the Plasma store to use up to 0.001GB of memory.
> /home/arrow/arrow/cpp/src/plasma/store.cc:1300: Starting object store with directory /dev/shm and huge page support enabled
> /home/arrow/arrow/cpp/src/plasma/store.cc:1328: hugepage enable , SetMallocGranularity.
> /home/arrow/arrow/cpp/src/plasma/store.cc:1349: starting server listening on /tmp/test
> /home/arrow/arrow/cpp/src/plasma/store.cc:1154: new PlasmaStore...
> /home/arrow/arrow/cpp/src/plasma/store.cc:1163: Memalign...pointer
> /home/arrow/arrow/cpp/src/plasma/plasma_allocator.cc:34: Memalign,alignment=64;bytes=997952
> internal memalign
> internal malloc req = 998056,nb = 997968,min_chunk_size = 32,chunk_overhead = 8
> Bus error
>
> env:
> [root@02a40e9b75b6 release]# free
> total used free shared buff/cache available
> Mem: 12979512 6299224 1163552 369948 5516736 5990072
> Swap: 4194304 16480 4177824
> [root@02a40e9b75b6 release]# uname -a
> Linux 02a40e9b75b6 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
--
This message was sent by Atlassian Jira
(v8.20.10#820010)