tstamp and date field -- future dates???

[James Sullivan <ja...@gmail.com>]

Is anybody else having an issue with future dates showing up in tstamp and
date fields in Solr with the more recent 2.x builds?

This is a known issue
NUTCH-1475<https://issues.apache.org/jira/browse/NUTCH-1475> but
it seemed to have been fixed for awhile without extra patching but has
resurfaced some time in the last six months or so.  Not a big deal as the
work around is simple but I would be interested if there were changes in
the fetchtime/tstamp area in that time frame. I am running a non stock
Nutch (using adaptiveFetchschedule instead of default, etc.) so the problem
may well just be with my particular configuration

RE: tstamp and date field -- future dates???

[j....@thomsonreuters.com]

Hi John,

No problem and thanks for your incredible responsiveness.

Recently updated the patch in https://issues.apache.org/jira/browse/NUTCH-1475 to take into account Sebastien's recommendation.
https://issues.apache.org/jira/secure/attachment/12548141/index-more-2x.patch

Thanks

James

________________________________________
From: Lewis John Mcgibbney [lewis.mcgibbney@gmail.com]
Sent: Friday, June 14, 2013 7:55 AM
To: user@nutch.apache.org
Subject: Re: tstamp and date field -- future dates???

Hi James,
Can you please point us to the patch and we will try to get it in to the
codebase?
Thanks... and sorry if we didn't look into the patch yet.
Lewis


On Thu, Jun 13, 2013 at 4:29 AM, James Sullivan <
james.brian.sullivan@gmail.com> wrote:

> Please ignore this E-mail. It only happens in the specific case when the
> web site being crawled does not set last modified in the header. I have
> already submitted a patch for this specific case.
>
> On Thu, Jun 13, 2013 at 10:49 AM, James Sullivan <
> james.brian.sullivan@gmail.com> wrote:
>
> > Is anybody else having an issue with future dates showing up in tstamp
> and
> > date fields in Solr with the more recent 2.x builds?
> >
> > This is a known issue NUTCH-1475<
> https://issues.apache.org/jira/browse/NUTCH-1475> but
> > it seemed to have been fixed for awhile without extra patching but has
> > resurfaced some time in the last six months or so.  Not a big deal as the
> > work around is simple but I would be interested if there were changes in
> > the fetchtime/tstamp area in that time frame. I am running a non stock
> > Nutch (using adaptiveFetchschedule instead of default, etc.) so the
> problem
> > may well just be with my particular configuration
> >
> >
>



--
*Lewis*

Re: tstamp and date field -- future dates???

[Lewis John Mcgibbney <le...@gmail.com>]

Hi James,
Can you please point us to the patch and we will try to get it in to the
codebase?
Thanks... and sorry if we didn't look into the patch yet.
Lewis


On Thu, Jun 13, 2013 at 4:29 AM, James Sullivan <
james.brian.sullivan@gmail.com> wrote:

> Please ignore this E-mail. It only happens in the specific case when the
> web site being crawled does not set last modified in the header. I have
> already submitted a patch for this specific case.
>
> On Thu, Jun 13, 2013 at 10:49 AM, James Sullivan <
> james.brian.sullivan@gmail.com> wrote:
>
> > Is anybody else having an issue with future dates showing up in tstamp
> and
> > date fields in Solr with the more recent 2.x builds?
> >
> > This is a known issue NUTCH-1475<
> https://issues.apache.org/jira/browse/NUTCH-1475> but
> > it seemed to have been fixed for awhile without extra patching but has
> > resurfaced some time in the last six months or so.  Not a big deal as the
> > work around is simple but I would be interested if there were changes in
> > the fetchtime/tstamp area in that time frame. I am running a non stock
> > Nutch (using adaptiveFetchschedule instead of default, etc.) so the
> problem
> > may well just be with my particular configuration
> >
> >
>



-- 
*Lewis*

Re: tstamp and date field -- future dates???

[James Sullivan <ja...@gmail.com>]

Please ignore this E-mail. It only happens in the specific case when the
web site being crawled does not set last modified in the header. I have
already submitted a patch for this specific case.

On Thu, Jun 13, 2013 at 10:49 AM, James Sullivan <
james.brian.sullivan@gmail.com> wrote:

> Is anybody else having an issue with future dates showing up in tstamp and
> date fields in Solr with the more recent 2.x builds?
>
> This is a known issue NUTCH-1475<https://issues.apache.org/jira/browse/NUTCH-1475> but
> it seemed to have been fixed for awhile without extra patching but has
> resurfaced some time in the last six months or so.  Not a big deal as the
> work around is simple but I would be interested if there were changes in
> the fetchtime/tstamp area in that time frame. I am running a non stock
> Nutch (using adaptiveFetchschedule instead of default, etc.) so the problem
> may well just be with my particular configuration
>
>