You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crail.apache.org by 朱博弘 <zh...@mails.tsinghua.edu.cn> on 2020/02/19 12:25:33 UTC
question about crail
Hi,I'm a student in Tsinghua university, i'm trying to deploy Crail, but i ran into some issues, could you please help me?
it seems that the storage limit is set to 1GB, and i can't find the right way to configure it, my crail-site.conf is like this:
//////////////////////////////////////////////////////////////////////////////////////////////////////////////
crail.namenode.address crail://aep4-ib0:9060
crail.cachepath /dev/hugepages/cache
crail.cachelimit 10737418240
crail.blocksize 1048576
crail.statistics true
crail.regionsize 1073741824
crail.namenode.rpctype org.apache.crail.namenode.rpc.darpc.DaRPCNameNode
crail.buffersize 1048576
crail.slicesize 524288
crail.debug false
crail.user root
crail.storage.types org.apache.crail.storage.rdma.RdmaStorageTier
crail.storage.rdma.interface ib0
crail.storage.rdma.datapath /mnt/pm/crail
crail.storage.rdma.storagelimit 10737418240
crail.storage.rdma.allocationsize 10737418240
crail.storage.rdma.localmap false
/////////////////////////////////////////////////////////////////////////
as you can see , i'm trying to deploy crail with rdma enabled ,
also , i find that ,Crail dosen't work on directories with "-o dax" flag enabled during mount phase,
any feed back will be much appreciated ,
Thank you.
have a nice day.
Re: question about crail
Posted by Lou DeGenaro <lo...@gmail.com>.
I new too. Presently I'm testing with namenode and datanode in docker
containers. Here's how I start in order to get 4GB storage:
# docker run -it --network host -e NAMENODE_HOST=sgt-pepper -e
DATAPATH=/tmp/hugepages/data -e CACHEPATH=/tmp/hugepages/cache -e
STORAGELIMIT=4294967296 apache/incubator-crail:1.2 namenode
# docker run -it --network host -e NAMENODE_HOST=sgt-pepper -e
DATAPATH=/tmp/hugepages/data -e CACHEPATH=/tmp/hugepages/cache -e
STORAGELIMIT=4294967296 apache/incubator-crail:1.2 datanode
Hope this helps.
Lou.
On Wed, Feb 19, 2020 at 12:30 PM 朱博弘 <zh...@mails.tsinghua.edu.cn> wrote:
> Hi,I'm a student in Tsinghua university, i'm trying to deploy Crail, but i
> ran into some issues, could you please help me?
>
> it seems that the storage limit is set to 1GB, and i can't find the right
> way to configure it, my crail-site.conf is like this:
>
>
> //////////////////////////////////////////////////////////////////////////////////////////////////////////////
>
> crail.namenode.address crail://aep4-ib0:9060
> crail.cachepath /dev/hugepages/cache
> crail.cachelimit 10737418240
> crail.blocksize 1048576
> crail.statistics true
> crail.regionsize 1073741824
> crail.namenode.rpctype
> org.apache.crail.namenode.rpc.darpc.DaRPCNameNode
> crail.buffersize 1048576
> crail.slicesize 524288
> crail.debug false
> crail.user root
> crail.storage.types
> org.apache.crail.storage.rdma.RdmaStorageTier
> crail.storage.rdma.interface ib0
> crail.storage.rdma.datapath /mnt/pm/crail
> crail.storage.rdma.storagelimit 10737418240
> crail.storage.rdma.allocationsize 10737418240
> crail.storage.rdma.localmap false
> /////////////////////////////////////////////////////////////////////////
> as you can see , i'm trying to deploy crail with rdma enabled ,
> also , i find that ,Crail dosen't work on directories with "-o dax" flag
> enabled during mount phase,
> any feed back will be much appreciated ,
> Thank you.
> have a nice day.