You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Halil Ibrahim Simsek <ha...@simsek.email> on 2015/03/11 11:58:03 UTC

Help for GSoC 2015

Hello

I would like to apply Google Summer Of Code this year for Nutch project. Can you please inform me about the subjects that I can pick. Any help will be appreciated. Thanks.

Halil 

Re: Help for GSoC 2015

Posted by Halil Ibrahim Simsek <ha...@simsek.email>.
Hello Talat,

Sure I will. I applied the program. 

Halil

27.03.2015, 12:00, "Talat Uyarer" <ta...@uyarer.com>:
> Hi Halil,
>
> This is awesome. Do you consider add some benchmarks for JSoup vs NekoHtml ?
>
> Talat
>
> 2015-03-26 22:07 GMT+02:00 Halil Ibrahim Simsek <ha...@simsek.email>:
>>  Hello Talat,
>>
>>  Thanks for the reply. I looked Nutch's GSoC page and JIRA issues. Except NUTCH-1936 and NUTCH-1219 there is not any other issue for GSoC, but there are some tasks at Nutch2Roadmap page[1]. I can pick "HTML5 support" from proposed tasks. When I searched about this subject, found this mail archive[2].
>>
>>  I did some search and study about the task and Nutch 2.x code, I think I can use jsoup to give this support. I made a short to do list for the task. Kindly see below,
>>
>>  - Integrating jsoup.
>>  - Making all the tests compatible for new parser which have already written for neko and tagsoup.
>>  - Writing new unit tests for new parser.
>>  - Testing parse filters if they are compatible with new parser and in case of any noncompatibility situation, resolving it.
>>  - Implementing a new plugin which will be able to extract all the new tags came with html5 like <article>, <details> etc.
>>
>>  My proposal is nearly ready. Kindly advise me if above mentioned list is okay. Regarding your reply I will be finalizing my proposal and will apply to GSoC.
>>
>>  Thanks,
>>  Halil
>>
>>  [1] http://wiki.apache.org/nutch/Nutch2Roadmap
>>  [2] http://mail-archives.apache.org/mod_mbox/nutch-dev/201405.mbox/%3C5367EB6E.3020205@googlemail.com%3E
>>
>>  11.03.2015, 15:25, "Talat Uyarer" <ta...@uyarer.com>:
>>>  Hi Halil,
>>>
>>>  ASAP I will update our GSoc Page. After than you can see some
>>>  additional projects. BTW You can look up our Jira and You can select
>>>  your issues that can be GSoC project.
>>>
>>>  [1] https://wiki.apache.org/nutch/GoogleSummerOfCode
>>>
>>>  Talat
>>>
>>>  2015-03-11 12:58 GMT+02:00 Halil Ibrahim Simsek <ha...@simsek.email>:
>>>>   Hello
>>>>
>>>>   I would like to apply Google Summer Of Code this year for Nutch project. Can you please inform me about the subjects that I can pick. Any help will be appreciated. Thanks.
>>>>
>>>>   Halil
>>>  --
>>>  Talat UYARER
>>>  Websitesi: http://talat.uyarer.com
>>>  Twitter: http://twitter.com/talatuyarer
>>>  Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304

Re: Help for GSoC 2015

Posted by Talat Uyarer <ta...@uyarer.com>.
Hi Halil,

This is awesome. Do you consider add some benchmarks for JSoup vs NekoHtml ?

Talat


2015-03-26 22:07 GMT+02:00 Halil Ibrahim Simsek <ha...@simsek.email>:
> Hello Talat,
>
> Thanks for the reply. I looked Nutch's GSoC page and JIRA issues. Except NUTCH-1936 and NUTCH-1219 there is not any other issue for GSoC, but there are some tasks at Nutch2Roadmap page[1]. I can pick "HTML5 support" from proposed tasks. When I searched about this subject, found this mail archive[2].
>
> I did some search and study about the task and Nutch 2.x code, I think I can use jsoup to give this support. I made a short to do list for the task. Kindly see below,
>
> - Integrating jsoup.
> - Making all the tests compatible for new parser which have already written for neko and tagsoup.
> - Writing new unit tests for new parser.
> - Testing parse filters if they are compatible with new parser and in case of any noncompatibility situation, resolving it.
> - Implementing a new plugin which will be able to extract all the new tags came with html5 like <article>, <details> etc.
>
> My proposal is nearly ready. Kindly advise me if above mentioned list is okay. Regarding your reply I will be finalizing my proposal and will apply to GSoC.
>
>
> Thanks,
> Halil
>
> [1] http://wiki.apache.org/nutch/Nutch2Roadmap
> [2] http://mail-archives.apache.org/mod_mbox/nutch-dev/201405.mbox/%3C5367EB6E.3020205@googlemail.com%3E
>
>
>
> 11.03.2015, 15:25, "Talat Uyarer" <ta...@uyarer.com>:
>> Hi Halil,
>>
>> ASAP I will update our GSoc Page. After than you can see some
>> additional projects. BTW You can look up our Jira and You can select
>> your issues that can be GSoC project.
>>
>> [1] https://wiki.apache.org/nutch/GoogleSummerOfCode
>>
>> Talat
>>
>> 2015-03-11 12:58 GMT+02:00 Halil Ibrahim Simsek <ha...@simsek.email>:
>>>  Hello
>>>
>>>  I would like to apply Google Summer Of Code this year for Nutch project. Can you please inform me about the subjects that I can pick. Any help will be appreciated. Thanks.
>>>
>>>  Halil
>>
>> --
>> Talat UYARER
>> Websitesi: http://talat.uyarer.com
>> Twitter: http://twitter.com/talatuyarer
>> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304



-- 
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304

Re: Help for GSoC 2015

Posted by Halil Ibrahim Simsek <ha...@simsek.email>.
Hello Talat,

Thanks for the reply. I looked Nutch's GSoC page and JIRA issues. Except NUTCH-1936 and NUTCH-1219 there is not any other issue for GSoC, but there are some tasks at Nutch2Roadmap page[1]. I can pick "HTML5 support" from proposed tasks. When I searched about this subject, found this mail archive[2]. 

I did some search and study about the task and Nutch 2.x code, I think I can use jsoup to give this support. I made a short to do list for the task. Kindly see below,

- Integrating jsoup.
- Making all the tests compatible for new parser which have already written for neko and tagsoup.
- Writing new unit tests for new parser.
- Testing parse filters if they are compatible with new parser and in case of any noncompatibility situation, resolving it.
- Implementing a new plugin which will be able to extract all the new tags came with html5 like <article>, <details> etc.

My proposal is nearly ready. Kindly advise me if above mentioned list is okay. Regarding your reply I will be finalizing my proposal and will apply to GSoC. 


Thanks,
Halil

[1] http://wiki.apache.org/nutch/Nutch2Roadmap
[2] http://mail-archives.apache.org/mod_mbox/nutch-dev/201405.mbox/%3C5367EB6E.3020205@googlemail.com%3E



11.03.2015, 15:25, "Talat Uyarer" <ta...@uyarer.com>:
> Hi Halil,
>
> ASAP I will update our GSoc Page. After than you can see some
> additional projects. BTW You can look up our Jira and You can select
> your issues that can be GSoC project.
>
> [1] https://wiki.apache.org/nutch/GoogleSummerOfCode
>
> Talat
>
> 2015-03-11 12:58 GMT+02:00 Halil Ibrahim Simsek <ha...@simsek.email>:
>>  Hello
>>
>>  I would like to apply Google Summer Of Code this year for Nutch project. Can you please inform me about the subjects that I can pick. Any help will be appreciated. Thanks.
>>
>>  Halil
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304

Re: Help for GSoC 2015

Posted by Talat Uyarer <ta...@uyarer.com>.
Hi Halil,

ASAP I will update our GSoc Page. After than you can see some
additional projects. BTW You can look up our Jira and You can select
your issues that can be GSoC project.

[1] https://wiki.apache.org/nutch/GoogleSummerOfCode

Talat

2015-03-11 12:58 GMT+02:00 Halil Ibrahim Simsek <ha...@simsek.email>:
> Hello
>
> I would like to apply Google Summer Of Code this year for Nutch project. Can you please inform me about the subjects that I can pick. Any help will be appreciated. Thanks.
>
> Halil



-- 
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304