You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@vcl.apache.org by Dmitri Chebotarov <dc...@gmu.edu> on 2012/10/18 14:54:00 UTC
Re: VCL / HPC Clusters
Hello
I'm testing HPC cluster options using VCL's image/subimage. The Linux HPC image that I've created for tests has OpenMPI and OpenBLAS libraries installed, it also has HPL benchmark to measure cluster performance in GFlops. Use of OpenMPI/HPL requires a list of cluster nodes. At this point I need to manually generate the list - list of all computers which are part of current cluster reservation.
Is there a way VCL could create a list of nodes during reservation in /root dir?
May be it already creates such list in a different location?
Thanks.
On Oct 11, 2012, at 16:54 , Dmitri Chebotarov <dc...@gmu.edu> wrote:
> Hello
>
> We may start to offer HPC with VCL and I'm looking for a general information on what VCL can do in this area.
> Could anyone share info if you are using VCL to provision your HPC clusters?
> I think I understand technical side, i.e. how to create image with sub-image(s). Also we have xCAT configured to provision on physical nodes.
>
> What application(s) do you run on HPC cluster?
> Are those Linux or Windows HPC nodes? Mixed?
> Do you run HPC nodes as VMs or those physical nodes only?
> How end-user gets access to HPC cluster environment?
> ...
>
>
> --
> Thank you,
>
> Dmitri Chebotarov
> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
> 223 Aquia Building, Ffx, MSN: 1B5
> Phone: (703) 993-6175
> Fax: (703) 993-3404
>
>
>
>
--
Thank you,
Dmitri Chebotarov
Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
223 Aquia Building, Ffx, MSN: 1B5
Phone: (703) 993-6175
Fax: (703) 993-3404
Re: VCL / HPC Clusters
Posted by Dmitri Chebotarov <dc...@gmu.edu>.
Perfect!
Thank you.
On Oct 18, 2012, at 8:58 , Aaron Peeler <fa...@ncsu.edu> wrote:
> Yes, actually there is a list in /etc/cluster_info
>
> It's format is:
> parent= x.x.x.x
> child= x.x.x.x
> child= x.x.x.x
> child= x.x.x.x
>
> -Aaron
>
>
> On Thu, Oct 18, 2012 at 8:54 AM, Dmitri Chebotarov <dc...@gmu.edu> wrote:
>>
>> Hello
>>
>> I'm testing HPC cluster options using VCL's image/subimage. The Linux HPC image that I've created for tests has OpenMPI and OpenBLAS libraries installed, it also has HPL benchmark to measure cluster performance in GFlops. Use of OpenMPI/HPL requires a list of cluster nodes. At this point I need to manually generate the list - list of all computers which are part of current cluster reservation.
>>
>> Is there a way VCL could create a list of nodes during reservation in /root dir?
>> May be it already creates such list in a different location?
>>
>> Thanks.
>>
>> On Oct 11, 2012, at 16:54 , Dmitri Chebotarov <dc...@gmu.edu> wrote:
>>
>>> Hello
>>>
>>> We may start to offer HPC with VCL and I'm looking for a general information on what VCL can do in this area.
>>> Could anyone share info if you are using VCL to provision your HPC clusters?
>>> I think I understand technical side, i.e. how to create image with sub-image(s). Also we have xCAT configured to provision on physical nodes.
>>>
>>> What application(s) do you run on HPC cluster?
>>> Are those Linux or Windows HPC nodes? Mixed?
>>> Do you run HPC nodes as VMs or those physical nodes only?
>>> How end-user gets access to HPC cluster environment?
>>> ...
>>>
>>>
>>> --
>>> Thank you,
>>>
>>> Dmitri Chebotarov
>>> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
>>> 223 Aquia Building, Ffx, MSN: 1B5
>>> Phone: (703) 993-6175
>>> Fax: (703) 993-3404
>>>
>>>
>>>
>>>
>>
>>
>>
>> --
>> Thank you,
>>
>> Dmitri Chebotarov
>> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
>> 223 Aquia Building, Ffx, MSN: 1B5
>> Phone: (703) 993-6175
>> Fax: (703) 993-3404
>>
>>
>>
>>
>
>
>
> --
> Aaron Peeler
> Program Manager
> Virtual Computing Lab
> NC State University
>
> All electronic mail messages in connection with State business which
> are sent to or received by this account are subject to the NC Public
> Records Law and may be disclosed to third parties.
--
Thank you,
Dmitri Chebotarov
Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
223 Aquia Building, Ffx, MSN: 1B5
Phone: (703) 993-6175
Fax: (703) 993-3404
Re: VCL / HPC Clusters
Posted by Dmitri Chebotarov <dc...@gmu.edu>.
Perfect!
Thank you.
On Oct 18, 2012, at 8:58 , Aaron Peeler <fa...@ncsu.edu> wrote:
> Yes, actually there is a list in /etc/cluster_info
>
> It's format is:
> parent= x.x.x.x
> child= x.x.x.x
> child= x.x.x.x
> child= x.x.x.x
>
> -Aaron
>
>
> On Thu, Oct 18, 2012 at 8:54 AM, Dmitri Chebotarov <dc...@gmu.edu> wrote:
>>
>> Hello
>>
>> I'm testing HPC cluster options using VCL's image/subimage. The Linux HPC image that I've created for tests has OpenMPI and OpenBLAS libraries installed, it also has HPL benchmark to measure cluster performance in GFlops. Use of OpenMPI/HPL requires a list of cluster nodes. At this point I need to manually generate the list - list of all computers which are part of current cluster reservation.
>>
>> Is there a way VCL could create a list of nodes during reservation in /root dir?
>> May be it already creates such list in a different location?
>>
>> Thanks.
>>
>> On Oct 11, 2012, at 16:54 , Dmitri Chebotarov <dc...@gmu.edu> wrote:
>>
>>> Hello
>>>
>>> We may start to offer HPC with VCL and I'm looking for a general information on what VCL can do in this area.
>>> Could anyone share info if you are using VCL to provision your HPC clusters?
>>> I think I understand technical side, i.e. how to create image with sub-image(s). Also we have xCAT configured to provision on physical nodes.
>>>
>>> What application(s) do you run on HPC cluster?
>>> Are those Linux or Windows HPC nodes? Mixed?
>>> Do you run HPC nodes as VMs or those physical nodes only?
>>> How end-user gets access to HPC cluster environment?
>>> ...
>>>
>>>
>>> --
>>> Thank you,
>>>
>>> Dmitri Chebotarov
>>> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
>>> 223 Aquia Building, Ffx, MSN: 1B5
>>> Phone: (703) 993-6175
>>> Fax: (703) 993-3404
>>>
>>>
>>>
>>>
>>
>>
>>
>> --
>> Thank you,
>>
>> Dmitri Chebotarov
>> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
>> 223 Aquia Building, Ffx, MSN: 1B5
>> Phone: (703) 993-6175
>> Fax: (703) 993-3404
>>
>>
>>
>>
>
>
>
> --
> Aaron Peeler
> Program Manager
> Virtual Computing Lab
> NC State University
>
> All electronic mail messages in connection with State business which
> are sent to or received by this account are subject to the NC Public
> Records Law and may be disclosed to third parties.
--
Thank you,
Dmitri Chebotarov
Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
223 Aquia Building, Ffx, MSN: 1B5
Phone: (703) 993-6175
Fax: (703) 993-3404
Re: VCL / HPC Clusters
Posted by Aaron Peeler <fa...@ncsu.edu>.
Yes, actually there is a list in /etc/cluster_info
It's format is:
parent= x.x.x.x
child= x.x.x.x
child= x.x.x.x
child= x.x.x.x
-Aaron
On Thu, Oct 18, 2012 at 8:54 AM, Dmitri Chebotarov <dc...@gmu.edu> wrote:
>
> Hello
>
> I'm testing HPC cluster options using VCL's image/subimage. The Linux HPC image that I've created for tests has OpenMPI and OpenBLAS libraries installed, it also has HPL benchmark to measure cluster performance in GFlops. Use of OpenMPI/HPL requires a list of cluster nodes. At this point I need to manually generate the list - list of all computers which are part of current cluster reservation.
>
> Is there a way VCL could create a list of nodes during reservation in /root dir?
> May be it already creates such list in a different location?
>
> Thanks.
>
> On Oct 11, 2012, at 16:54 , Dmitri Chebotarov <dc...@gmu.edu> wrote:
>
>> Hello
>>
>> We may start to offer HPC with VCL and I'm looking for a general information on what VCL can do in this area.
>> Could anyone share info if you are using VCL to provision your HPC clusters?
>> I think I understand technical side, i.e. how to create image with sub-image(s). Also we have xCAT configured to provision on physical nodes.
>>
>> What application(s) do you run on HPC cluster?
>> Are those Linux or Windows HPC nodes? Mixed?
>> Do you run HPC nodes as VMs or those physical nodes only?
>> How end-user gets access to HPC cluster environment?
>> ...
>>
>>
>> --
>> Thank you,
>>
>> Dmitri Chebotarov
>> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
>> 223 Aquia Building, Ffx, MSN: 1B5
>> Phone: (703) 993-6175
>> Fax: (703) 993-3404
>>
>>
>>
>>
>
>
>
> --
> Thank you,
>
> Dmitri Chebotarov
> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
> 223 Aquia Building, Ffx, MSN: 1B5
> Phone: (703) 993-6175
> Fax: (703) 993-3404
>
>
>
>
--
Aaron Peeler
Program Manager
Virtual Computing Lab
NC State University
All electronic mail messages in connection with State business which
are sent to or received by this account are subject to the NC Public
Records Law and may be disclosed to third parties.
Re: VCL / HPC Clusters
Posted by Aaron Peeler <fa...@ncsu.edu>.
Yes, actually there is a list in /etc/cluster_info
It's format is:
parent= x.x.x.x
child= x.x.x.x
child= x.x.x.x
child= x.x.x.x
-Aaron
On Thu, Oct 18, 2012 at 8:54 AM, Dmitri Chebotarov <dc...@gmu.edu> wrote:
>
> Hello
>
> I'm testing HPC cluster options using VCL's image/subimage. The Linux HPC image that I've created for tests has OpenMPI and OpenBLAS libraries installed, it also has HPL benchmark to measure cluster performance in GFlops. Use of OpenMPI/HPL requires a list of cluster nodes. At this point I need to manually generate the list - list of all computers which are part of current cluster reservation.
>
> Is there a way VCL could create a list of nodes during reservation in /root dir?
> May be it already creates such list in a different location?
>
> Thanks.
>
> On Oct 11, 2012, at 16:54 , Dmitri Chebotarov <dc...@gmu.edu> wrote:
>
>> Hello
>>
>> We may start to offer HPC with VCL and I'm looking for a general information on what VCL can do in this area.
>> Could anyone share info if you are using VCL to provision your HPC clusters?
>> I think I understand technical side, i.e. how to create image with sub-image(s). Also we have xCAT configured to provision on physical nodes.
>>
>> What application(s) do you run on HPC cluster?
>> Are those Linux or Windows HPC nodes? Mixed?
>> Do you run HPC nodes as VMs or those physical nodes only?
>> How end-user gets access to HPC cluster environment?
>> ...
>>
>>
>> --
>> Thank you,
>>
>> Dmitri Chebotarov
>> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
>> 223 Aquia Building, Ffx, MSN: 1B5
>> Phone: (703) 993-6175
>> Fax: (703) 993-3404
>>
>>
>>
>>
>
>
>
> --
> Thank you,
>
> Dmitri Chebotarov
> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
> 223 Aquia Building, Ffx, MSN: 1B5
> Phone: (703) 993-6175
> Fax: (703) 993-3404
>
>
>
>
--
Aaron Peeler
Program Manager
Virtual Computing Lab
NC State University
All electronic mail messages in connection with State business which
are sent to or received by this account are subject to the NC Public
Records Law and may be disclosed to third parties.