You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@singa.apache.org by Mohit Singh <mo...@gmail.com> on 2015/09/28 11:31:55 UTC
Contribute
Hi,
I am new to C++ and deep learning..
But want to learn both.
How do I get started in contributing to singa.
--
Mohit
"When you want success as badly as you want the air, then you will get it.
There is no other secret of success."
-Socrates
Re: Contribute
Posted by Mohit Singh <mo...@gmail.com>.
Sounds good.
I will start reading about GRU / GoogleNet and start from there :)
Will probably ask a lot of questions here :)
Thanks
On Mon, Sep 28, 2015 at 3:46 AM, Wang Wei <wa...@comp.nus.edu.sg> wrote:
> Hi Mohit,
>
> On Mon, Sep 28, 2015 at 6:29 PM, Mohit Singh <mo...@gmail.com> wrote:
>
> > Hi Wang Wei,
> > Thanks for quick response and sharing with the next release cycle.
> > I would be interested in:
> > 1) Getting up to speed on machine learning algorithms part ( so feed
> > forward networks or RNN etc)
> >
> For feed forward networks, SINGA has provided layers for implementing
> AlexNet (imagene2012 paper), VGG (http://arxiv.org/pdf/1409.1556.pdf).
> We need to implement some other layers to support the training of GoogleNet
> (http://arxiv.org/abs/1409.4842).
> For RNN, http://karpathy.github.io/2015/05/21/rnn-effectiveness/ is a good
> application to work on. Both LSTM and GRU are on our plan.
>
> I would suggest you to work on GRU and GoogleNet firstly.
> You can follow the vanilla rnn example
> http://singa.apache.org/docs/rnn.html
> to implement GRU.
>
> 2) Maybe looking into hdfs as input or output sources
> >
> We are going to use HDFS for storing large training datasets.
> It has not yet been decided. Maybe some in-memory storage would be
> considered.
>
> > 3) Python bindings?
> >
> This is to create some wrappers for the Layer, NeuralNet, etc classes. Then
> users can use python scripts to run the SINGA functions.
> For example, after training, you can load the model parameters to extract
> features by passing the data through the network using python scripts.
>
> But right now, want to start by taking something very simple.
> > So far, I have been able to build singa and run CIFAR example locally.
> >
> > Thanks
> >
> >
> > On Mon, Sep 28, 2015 at 3:13 AM, Wang Wei <wa...@comp.nus.edu.sg>
> wrote:
> >
> > > Hi Mohit,
> > >
> > > Thanks for your interest in SINGA.
> > >
> > > Attached is a schedule for our second release.
> > > If you are interested in any topic/feature, then we can discuss in
> detail
> > > on the development.
> > >
> > > Cheers,
> > > Wei Wang
> > >
> > > On Mon, Sep 28, 2015 at 5:31 PM, Mohit Singh <mo...@gmail.com>
> > wrote:
> > >
> > >> Hi,
> > >> I am new to C++ and deep learning..
> > >> But want to learn both.
> > >> How do I get started in contributing to singa.
> > >>
> > >> --
> > >> Mohit
> > >>
> > >> "When you want success as badly as you want the air, then you will get
> > it.
> > >> There is no other secret of success."
> > >> -Socrates
> > >>
> > >
> > >
> >
> >
> > --
> > Mohit
> >
> > "When you want success as badly as you want the air, then you will get
> it.
> > There is no other secret of success."
> > -Socrates
> >
>
--
Mohit
"When you want success as badly as you want the air, then you will get it.
There is no other secret of success."
-Socrates
Re: Contribute
Posted by Wang Wei <wa...@comp.nus.edu.sg>.
Hi Mohit,
On Mon, Sep 28, 2015 at 6:29 PM, Mohit Singh <mo...@gmail.com> wrote:
> Hi Wang Wei,
> Thanks for quick response and sharing with the next release cycle.
> I would be interested in:
> 1) Getting up to speed on machine learning algorithms part ( so feed
> forward networks or RNN etc)
>
For feed forward networks, SINGA has provided layers for implementing
AlexNet (imagene2012 paper), VGG (http://arxiv.org/pdf/1409.1556.pdf).
We need to implement some other layers to support the training of GoogleNet
(http://arxiv.org/abs/1409.4842).
For RNN, http://karpathy.github.io/2015/05/21/rnn-effectiveness/ is a good
application to work on. Both LSTM and GRU are on our plan.
I would suggest you to work on GRU and GoogleNet firstly.
You can follow the vanilla rnn example http://singa.apache.org/docs/rnn.html
to implement GRU.
2) Maybe looking into hdfs as input or output sources
>
We are going to use HDFS for storing large training datasets.
It has not yet been decided. Maybe some in-memory storage would be
considered.
> 3) Python bindings?
>
This is to create some wrappers for the Layer, NeuralNet, etc classes. Then
users can use python scripts to run the SINGA functions.
For example, after training, you can load the model parameters to extract
features by passing the data through the network using python scripts.
But right now, want to start by taking something very simple.
> So far, I have been able to build singa and run CIFAR example locally.
>
> Thanks
>
>
> On Mon, Sep 28, 2015 at 3:13 AM, Wang Wei <wa...@comp.nus.edu.sg> wrote:
>
> > Hi Mohit,
> >
> > Thanks for your interest in SINGA.
> >
> > Attached is a schedule for our second release.
> > If you are interested in any topic/feature, then we can discuss in detail
> > on the development.
> >
> > Cheers,
> > Wei Wang
> >
> > On Mon, Sep 28, 2015 at 5:31 PM, Mohit Singh <mo...@gmail.com>
> wrote:
> >
> >> Hi,
> >> I am new to C++ and deep learning..
> >> But want to learn both.
> >> How do I get started in contributing to singa.
> >>
> >> --
> >> Mohit
> >>
> >> "When you want success as badly as you want the air, then you will get
> it.
> >> There is no other secret of success."
> >> -Socrates
> >>
> >
> >
>
>
> --
> Mohit
>
> "When you want success as badly as you want the air, then you will get it.
> There is no other secret of success."
> -Socrates
>
Re: Contribute
Posted by Mohit Singh <mo...@gmail.com>.
Hi Wang Wei,
Thanks for quick response and sharing with the next release cycle.
I would be interested in:
1) Getting up to speed on machine learning algorithms part ( so feed
forward networks or RNN etc)
2) Maybe looking into hdfs as input or output sources
3) Python bindings?
But right now, want to start by taking something very simple.
So far, I have been able to build singa and run CIFAR example locally.
Thanks
On Mon, Sep 28, 2015 at 3:13 AM, Wang Wei <wa...@comp.nus.edu.sg> wrote:
> Hi Mohit,
>
> Thanks for your interest in SINGA.
>
> Attached is a schedule for our second release.
> If you are interested in any topic/feature, then we can discuss in detail
> on the development.
>
> Cheers,
> Wei Wang
>
> On Mon, Sep 28, 2015 at 5:31 PM, Mohit Singh <mo...@gmail.com> wrote:
>
>> Hi,
>> I am new to C++ and deep learning..
>> But want to learn both.
>> How do I get started in contributing to singa.
>>
>> --
>> Mohit
>>
>> "When you want success as badly as you want the air, then you will get it.
>> There is no other secret of success."
>> -Socrates
>>
>
>
--
Mohit
"When you want success as badly as you want the air, then you will get it.
There is no other secret of success."
-Socrates
Re: Contribute
Posted by Wang Wei <wa...@comp.nus.edu.sg>.
Hi Mohit,
Thanks for your interest in SINGA.
Attached is a schedule for our second release.
If you are interested in any topic/feature, then we can discuss in detail
on the development.
Cheers,
Wei Wang
On Mon, Sep 28, 2015 at 5:31 PM, Mohit Singh <mo...@gmail.com> wrote:
> Hi,
> I am new to C++ and deep learning..
> But want to learn both.
> How do I get started in contributing to singa.
>
> --
> Mohit
>
> "When you want success as badly as you want the air, then you will get it.
> There is no other secret of success."
> -Socrates
>