Resolve by IP

[Marcel Haazen <ma...@simac.com.INVALID>]

Hi,
I'm trying to crawl a specific domain but I cant use DNS for that ATM due to some difficulties is there an property I can set per site to specify what IP it should resolve to?
I'm using Nutch 2.3.


Best Regards,

Marcel Haazen
trainee engineer

RE: Resolve by IP

[Marcel Haazen <ma...@simac.com.INVALID>]

Thank you Markus,
I'm going to try this and get back the results after the testing.

Met vriendelijke groet,

Marcel Haazen
Trainee Engineer 

-----Oorspronkelijk bericht-----
Van: Markus Jelsma <ma...@openindex.io> 
Verzonden: dinsdag 14 april 2020 13:02
Aan: user@nutch.apache.org
Onderwerp: RE: Resolve by IP

Hello Marcel,

You can use your /etc/hosts file for that purpose, assuming you are on Linux.

Regards,
Markus
 
-----Original message-----
> From:Marcel Haazen <ma...@simac.com.INVALID>
> Sent: Tuesday 14th April 2020 12:12
> To: user@nutch.apache.org
> Subject: Resolve by IP
> 
> Hi,
> I'm trying to crawl a specific domain but I cant use DNS for that ATM due to some difficulties is there an property I can set per site to specify what IP it should resolve to?
> I'm using Nutch 2.3.
> 
> 
> Best Regards,
> 
> Marcel Haazen
> trainee engineer
> 
> 

RE: Resolve by IP

[Markus Jelsma <ma...@openindex.io>]

Hello Marcel,

You can use your /etc/hosts file for that purpose, assuming you are on Linux.

Regards,
Markus
 
-----Original message-----
> From:Marcel Haazen <ma...@simac.com.INVALID>
> Sent: Tuesday 14th April 2020 12:12
> To: user@nutch.apache.org
> Subject: Resolve by IP
> 
> Hi,
> I'm trying to crawl a specific domain but I cant use DNS for that ATM due to some difficulties is there an property I can set per site to specify what IP it should resolve to?
> I'm using Nutch 2.3.
> 
> 
> Best Regards,
> 
> Marcel Haazen
> trainee engineer
> 
>