You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Sudhi Seshachala <su...@yahoo.com> on 2006/07/17 15:21:45 UTC
Vertical Search (Nutch) for Opensource Jobs- http://www.myopensourcejobs.com
Hello Nutchians,
Please visit the site http://www.myopensourcejobs.com. The site is built using LAMP and Nutch.
I use the Nutch crawler to crawl jobs from commercial sites such as Hotjobs, DICE and CareerBuilder (As of today), specifically for opensource skill sets. Basically the site filters jobs on opensource skills.
The CMS is Drupal which is LAMP based. The vertical search is based on Nutch and I call it "Hoodukoo" (In one of the Indian (Read as Sout East Asia or Indian Sub continent - India) ) means "Search" . The CMS uses the web services nutch exposes in form of RSS. I have written custom parse plugins, index plugin and query plugin. In addition for crawling, I have customized the process of crawling.
Eventual goal is to make the jobs site one point portal for folks to search jobs on opensource skills. I strongly believe 5-10 years now, Opensource will be more stronger than now and will be in a position to compete with commercial skills.
Though commercial job sites does cover the opensource skills, it does not filter the way highly talented folks from Opensource domain would look for.
I do understand, there are typically 3 tiers of folks in oepnsource domain.
Tier 1 - They dont search for jobs. Jobs search for them. They can be easlily hired because of their network.
Tier 2 - They will have to search a bit harder than Tier 1. But because they contribute in Opensource and carved a name for themselves, they too can get into jobs with any of the companies without that much of a search.
Tier 3 - Myopensourcejobs targets tier 3. Pretty much every one from college students and people who have adopted oepnsource in some fashion or the other in their professional life would be visiting the jobs site. Best option is they should be visiting Myopensourcejobs.com.
So In summary Myopensourcejobs would target for 20% of the folks trained and qualified in oepnsource skill sets.
My immediate target is to get some space to host the code base, If any one can offer me the space or point me to the right resource(Other than sourceforge and java-net) I w ill be very greateful.
If any one have ideas to contribute or join me in the efforts to deliver the first truely opensource jobs portal, please feel free to drop me a mail.
Last but not the least, please visit the site and let me know the critisisms you guys have. Believe me it is precious to me and will try to fix the problems.
By the way, site is "Pre-alpha".
Thanks
Sudhi
Currently deployed on Linix (Fedora core 2) on Godaddy. I would like to have my own servers. But the problem is I do not have a source to approach for it. Sourceforge and Java-net, has made project qualification very hard.
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
Re: Vertical Search (Nutch) for Opensource Jobs- http://www.myopensourcejobs.com
Posted by Sudhi Seshachala <su...@yahoo.com>.
Yes. That is there in the plan. For now, if some one has to post jobs, they could just send an email via "Contact Us" Rest assured, Job, if it falls to the category we will make it part of the search.
WRT, the ADs, I am working to get the CMS support job relavant ads.
I really appreciate your feedback. Please do feel free to do so.
Thanks
Sudhi
"pepone.onrez" <pe...@gmail.com> wrote:
HI Sudhi
I found your site realy interesting. I think can be interesting to put
a form for submit new jobs to your site.
and maybe you must think in add same banners ads to rentavilce the server
On 7/18/06, Sudhi Seshachala wrote:
> Thanks.
> I have written PArse plugins which pretty customizes the crawling and parses according to the rules defined in PArse plugin. I have a index and Query plugin specific to the domain I operate and that is about it.
>
> Frankly I dont even have servers (Looking if some one can donate me to run my crawlers). I have two machines running legacy fedora core2.
>
> Hope that helps.
>
> Thanks
> Sudhi
>
> Nutch Newbie wrote:
> Good work!
>
> On 7/17/06, Sudhi Seshachala wrote:
> In addition for crawling, I have customized the process of crawling.
> >
>
> Just curious what do you mean by customized process of crawling?
>
> Best of luck with your site.
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
>
--
play tetris http://pepone.on-rez.com/tetris
run gentoo http://gentoo-notes.blogspot.com/
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
Re: Vertical Search (Nutch) for Opensource Jobs- http://www.myopensourcejobs.com
Posted by "pepone.onrez" <pe...@gmail.com>.
HI Sudhi
I found your site realy interesting. I think can be interesting to put
a form for submit new jobs to your site.
and maybe you must think in add same banners ads to rentavilce the server
On 7/18/06, Sudhi Seshachala <su...@yahoo.com> wrote:
> Thanks.
> I have written PArse plugins which pretty customizes the crawling and parses according to the rules defined in PArse plugin. I have a index and Query plugin specific to the domain I operate and that is about it.
>
> Frankly I dont even have servers (Looking if some one can donate me to run my crawlers). I have two machines running legacy fedora core2.
>
> Hope that helps.
>
> Thanks
> Sudhi
>
> Nutch Newbie <nu...@gmail.com> wrote:
> Good work!
>
> On 7/17/06, Sudhi Seshachala wrote:
> In addition for crawling, I have customized the process of crawling.
> >
>
> Just curious what do you mean by customized process of crawling?
>
> Best of luck with your site.
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
>
--
play tetris http://pepone.on-rez.com/tetris
run gentoo http://gentoo-notes.blogspot.com/
Re: Vertical Search (Nutch) for Opensource Jobs- http://www.myopensourcejobs.com
Posted by Sudhi Seshachala <su...@yahoo.com>.
Thanks.
I have written PArse plugins which pretty customizes the crawling and parses according to the rules defined in PArse plugin. I have a index and Query plugin specific to the domain I operate and that is about it.
Frankly I dont even have servers (Looking if some one can donate me to run my crawlers). I have two machines running legacy fedora core2.
Hope that helps.
Thanks
Sudhi
Nutch Newbie <nu...@gmail.com> wrote:
Good work!
On 7/17/06, Sudhi Seshachala wrote:
In addition for crawling, I have customized the process of crawling.
>
Just curious what do you mean by customized process of crawling?
Best of luck with your site.
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
Re: Vertical Search (Nutch) for Opensource Jobs- http://www.myopensourcejobs.com
Posted by Nutch Newbie <nu...@gmail.com>.
Good work!
On 7/17/06, Sudhi Seshachala <su...@yahoo.com> wrote:
In addition for crawling, I have customized the process of crawling.
>
Just curious what do you mean by customized process of crawling?
Best of luck with your site.
Re: Vertical Search (Nutch) for Opensource Jobs- http://www.myopensourcejobs.com
Posted by William Surowiec <ws...@gmail.com>.
Very nice.
I visited the site, searched for nlp and found 5 listings!
How often will the crawl run? How hard was it getting the app to run on
GoDaddy? Do you run the crawl from GoDaddy or elsewhere and then either
upload or reference your index site?
Thank you, and please tell me how I can help - this is useful.
Bill