You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@singa.apache.org by GitBox <gi...@apache.org> on 2020/11/17 06:07:17 UTC

[GitHub] [singa] naili-xing edited a comment on issue #802: Adding GPU testing to Github workflows

naili-xing edited a comment on issue #802:
URL: https://github.com/apache/singa/issues/802#issuecomment-728705579


   
   
   > > > @moazreyad could you please advise us how to achieve the goal? (Adding GPU testing to Github workflows
   > > > #802), I will ask some RAs to help me for the implementation.
   > > 
   > > 
   > > To achieve this goal, we will need these steps:
   > > First, we need to get github tokens from by opening a ticket at Apache INFRA. Apache has some information about github self hosted runners [here](https://infra.apache.org/self-hosted-runners.html). They don't recommend using it for some security reasons, so we have to explain that GPU build and test is important for SINGA. We also need to make sure the server which will run the github workflows is secure and that the known vulnerabilities of self-hosted runners will not occur in the NUS server. (for example, someone may login to the NUS server and gain access to SINGA github repository admin tokens.)
   > > To complete this step, we may check [this ticket](https://issues.apache.org/jira/browse/INFRA-19875) by Apache Arrow and open a similar one for SINGA.
   > > Second, we create a docker image for the Runner and configure the workflows. If we use Linux, we need to install the [Runner](https://github.com/actions/runner) and its [pre-reqs](https://github.com/actions/runner/blob/main/docs/start/envlinux.md) in the Linux docker machine. The machine should also have the github tokens from the first step. Check the [Apache Arrow implementation](https://github.com/apache/arrow/pull/6512) for more details.
   > 
   > @moazreyad thanks a lot for the information, I will consider it. Also I am thinking about if GPU emulator is another option? https://developer.nvidia.com/nvemulate
   https://stackoverflow.com/questions/40461823/is-it-possible-to-emulate-a-gpu-for-cuda-opencl-unit-testing-purposes
   > 
   > @naili-xing do you think the github actions can access our server to do gpu test, does it need to connect to nus VPN?
   
   I think it needs, if accessing the server from outside of nus, it needs vpn, if access from inside, using nus network, i think there is no needs


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org