You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by Tim Allison <ta...@apache.org> on 2018/11/20 23:04:29 UTC

1.20?

All,
   POI 4.0.1 will be out shortly with some important bug fixes.  What would
you all think of targeting 1st/2nd week of December for 1.20?

     Cheers,
         Tim

Re: Fwd: 1.20?

Posted by Andreas Lehmkuehler <an...@lehmi.de>.
Am 27.11.18 um 02:33 schrieb Tim Allison:
> Sounds great.  Thank you!  Let me know when I should kick off the
> regression tests.
I always forget about that oppertunity. It makes sense to run the test before 
cutting a new release ;-)

Please run the test as soon as possible.

Thanks in advance!
Andreas


> On Sun, Nov 25, 2018 at 5:01 AM Andreas Lehmkuehler <an...@lehmi.de> wrote:
>>
>> Am 24.11.18 um 10:15 schrieb Tilman Hausherr:
>>> Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
>>>> How about cutting a release next week or a week later?
>> I'm going to cut the release next Tuesday the 27th.
>>
>> If there are any objections I postpone the release to the following Monday the
>> 3th of December.
>>
>>
>> Andreas
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
>> For additional commands, e-mail: dev-help@pdfbox.apache.org
>>
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: dev-help@pdfbox.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Sounds great.  Thank you!  Let me know when I should kick off the
regression tests.
On Sun, Nov 25, 2018 at 5:01 AM Andreas Lehmkuehler <an...@lehmi.de> wrote:
>
> Am 24.11.18 um 10:15 schrieb Tilman Hausherr:
> > Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
> >> How about cutting a release next week or a week later?
> I'm going to cut the release next Tuesday the 27th.
>
> If there are any objections I postpone the release to the following Monday the
> 3th of December.
>
>
> Andreas
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: dev-help@pdfbox.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Andreas Lehmkuehler <an...@lehmi.de>.
Sounds good enough for me. I'm going to cut the release this evening in about 
10-11 hours from now.

Thanks Tim!

Andreas


Am 28.11.18 um 03:40 schrieb Tim Allison:
> Looks good.  One file has fewer pages: govdocs1/229/229205.pdf
> 
> Based on the content diffs, it looks like I compared 2.0.13-SNAPSHOT
> against 2.0.11 (/data4/batch_runs/tika_1_19-rc1).  We upgraded to
> 2.0.12 in 1.19.1.  Given that I don't see any differences, I think
> we're good.  However, I'm happy to re-run with 2.0.12 as the baseline.
> 
> The reports are here:
> http://162.242.228.174/reports/reports_pdfbox_2_0_13-pre-rc.tgz
> On Tue, Nov 27, 2018 at 1:22 PM Andreas Lehmkuehler <an...@lehmi.de> wrote:
>>
>> Am 25.11.18 um 11:01 schrieb Andreas Lehmkuehler:
>>> Am 24.11.18 um 10:15 schrieb Tilman Hausherr:
>>>> Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
>>>>> How about cutting a release next week or a week later?
>>> I'm going to cut the release next Tuesday the 27th.
>> I'm going to postpone the preparations until we have hopefully positive test
>> results from Tim
>>
>> Andreas
>>
>>>
>>> If there are any objections I postpone the release to the following Monday the
>>> 3th of December.
>>>
>>>
>>> Andreas
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
>>> For additional commands, e-mail: dev-help@pdfbox.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
>> For additional commands, e-mail: dev-help@pdfbox.apache.org
>>
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: dev-help@pdfbox.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Looks good.  One file has fewer pages: govdocs1/229/229205.pdf

Based on the content diffs, it looks like I compared 2.0.13-SNAPSHOT
against 2.0.11 (/data4/batch_runs/tika_1_19-rc1).  We upgraded to
2.0.12 in 1.19.1.  Given that I don't see any differences, I think
we're good.  However, I'm happy to re-run with 2.0.12 as the baseline.

The reports are here:
http://162.242.228.174/reports/reports_pdfbox_2_0_13-pre-rc.tgz
On Tue, Nov 27, 2018 at 1:22 PM Andreas Lehmkuehler <an...@lehmi.de> wrote:
>
> Am 25.11.18 um 11:01 schrieb Andreas Lehmkuehler:
> > Am 24.11.18 um 10:15 schrieb Tilman Hausherr:
> >> Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
> >>> How about cutting a release next week or a week later?
> > I'm going to cut the release next Tuesday the 27th.
> I'm going to postpone the preparations until we have hopefully positive test
> results from Tim
>
> Andreas
>
> >
> > If there are any objections I postpone the release to the following Monday the
> > 3th of December.
> >
> >
> > Andreas
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> > For additional commands, e-mail: dev-help@pdfbox.apache.org
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: dev-help@pdfbox.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Andreas Lehmkuehler <an...@lehmi.de>.
Am 25.11.18 um 11:01 schrieb Andreas Lehmkuehler:
> Am 24.11.18 um 10:15 schrieb Tilman Hausherr:
>> Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
>>> How about cutting a release next week or a week later? 
> I'm going to cut the release next Tuesday the 27th.
I'm going to postpone the preparations until we have hopefully positive test 
results from Tim

Andreas

> 
> If there are any objections I postpone the release to the following Monday the 
> 3th of December.
> 
> 
> Andreas
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: dev-help@pdfbox.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Andreas Lehmkuehler <an...@lehmi.de>.
Am 24.11.18 um 10:15 schrieb Tilman Hausherr:
> Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
>> How about cutting a release next week or a week later? 
I'm going to cut the release next Tuesday the 27th.

If there are any objections I postpone the release to the following Monday the 
3th of December.


Andreas

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Tilman Hausherr <TH...@t-online.de>.
Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
> How about cutting a release next week or a week later? 

+1

Tilman


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Maruan Sahyoun <sa...@fileaffairs.de>.
 
> Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
> > Am 21.11.18 um 13:33 schrieb Tim Allison:
> > > All,
> > > 
> > >    Tika's next release may be in the 1st/2nd week of December. Do we any
> > > sense of when we'll want to release PDFBox 2.0.13?  Thank you.
> > I've checked the 2.0.13 JIRA tickets and there are already more than 
> > 40 resolved ones, IMHO enough to czt a new release.
> > 
> > How about cutting a release next week or a week later?
> > 
> > @Tilman
> > Is there any unfinished work which should be part of the next release?
> 
> No. The signature stuff I'm working on is sortof open-ended but the 
> example is still useable as it is, it will be the first release with an 
> example that does an online revocation check.
> 
> There's only one issue open which is for you or Maruan:
> 
> https://issues.apache.org/jira/browse/PDFBOX-4369
> 
> It would be nice to also add the other new features of ExtractText 
> ("-alwaysNext", "-rotationMagic") to the website.

I'll take care of that
Maruan

> 
> Tilman
> 
> 
> 
> > Andreas
> > 
> > >           Cheers,
> > > 
> > >                      Tim
> > > 
> > > ---------- Forwarded message ---------
> > > From: Chris Mattmann <ma...@apache.org>
> > > Date: Tue, Nov 20, 2018 at 6:21 PM
> > > Subject: Re: 1.20?
> > > To: dev@tika.apache.org <de...@tika.apache.org>
> > > 
> > > 
> > > Love it and I can align tika-python with that too ☺
> > > 
> > > 
> > > 
> > > 
> > > 
> > > 
> > > 
> > > From: Tim Allison <ta...@apache.org>
> > > Reply-To: "dev@tika.apache.org" <de...@tika.apache.org>
> > > Date: Tuesday, November 20, 2018 at 3:04 PM
> > > To: "dev@tika.apache.org" <de...@tika.apache.org>
> > > Subject: 1.20?
> > > 
> > > 
> > > 
> > > All,
> > > 
> > >     POI 4.0.1 will be out shortly with some important bug fixes.  
> > > What would
> > > 
> > > you all think of targeting 1st/2nd week of December for 1.20?
> > > 
> > > 
> > > 
> > >       Cheers,
> > > 
> > >           Tim
> > > 
> > 
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> > For additional commands, e-mail: dev-help@pdfbox.apache.org
> > 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: dev-help@pdfbox.apache.org
> 
-- 
Maruan Sahyoun

FileAffairs GmbH
Josef-Schappe-Straße 21
40882 Ratingen

Tel: +49 (2102) 89497 88
Fax: +49 (2102) 89497 91
sahyoun@fileaffairs.de
www.fileaffairs.de

Geschäftsführer: Maruan Sahyoun
Handelsregister: AG Düsseldorf, HRB 53837
UST.-ID: DE248275827


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Tilman Hausherr <TH...@t-online.de>.
Am 24.11.2018 um 08:53 schrieb Andreas Lehmkuehler:
> Am 21.11.18 um 13:33 schrieb Tim Allison:
>> All,
>>
>>    Tika's next release may be in the 1st/2nd week of December. Do we any
>> sense of when we'll want to release PDFBox 2.0.13?  Thank you.
> I've checked the 2.0.13 JIRA tickets and there are already more than 
> 40 resolved ones, IMHO enough to czt a new release.
>
> How about cutting a release next week or a week later?
>
> @Tilman
> Is there any unfinished work which should be part of the next release?


No. The signature stuff I'm working on is sortof open-ended but the 
example is still useable as it is, it will be the first release with an 
example that does an online revocation check.

There's only one issue open which is for you or Maruan:

https://issues.apache.org/jira/browse/PDFBOX-4369

It would be nice to also add the other new features of ExtractText 
("-alwaysNext", "-rotationMagic") to the website.

Tilman



>
> Andreas
>
>>
>>           Cheers,
>>
>>                      Tim
>>
>> ---------- Forwarded message ---------
>> From: Chris Mattmann <ma...@apache.org>
>> Date: Tue, Nov 20, 2018 at 6:21 PM
>> Subject: Re: 1.20?
>> To: dev@tika.apache.org <de...@tika.apache.org>
>>
>>
>> Love it and I can align tika-python with that too ☺
>>
>>
>>
>>
>>
>>
>>
>> From: Tim Allison <ta...@apache.org>
>> Reply-To: "dev@tika.apache.org" <de...@tika.apache.org>
>> Date: Tuesday, November 20, 2018 at 3:04 PM
>> To: "dev@tika.apache.org" <de...@tika.apache.org>
>> Subject: 1.20?
>>
>>
>>
>> All,
>>
>>     POI 4.0.1 will be out shortly with some important bug fixes.  
>> What would
>>
>> you all think of targeting 1st/2nd week of December for 1.20?
>>
>>
>>
>>       Cheers,
>>
>>           Tim
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: dev-help@pdfbox.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Re: Fwd: 1.20?

Posted by Andreas Lehmkuehler <an...@lehmi.de>.
Am 21.11.18 um 13:33 schrieb Tim Allison:
> All,
> 
>    Tika's next release may be in the 1st/2nd week of December.  Do we any
> sense of when we'll want to release PDFBox 2.0.13?  Thank you.
I've checked the 2.0.13 JIRA tickets and there are already more than 40 resolved 
ones, IMHO enough to czt a new release.

How about cutting a release next week or a week later?

@Tilman
Is there any unfinished work which should be part of the next release?

Andreas

> 
>           Cheers,
> 
>                      Tim
> 
> ---------- Forwarded message ---------
> From: Chris Mattmann <ma...@apache.org>
> Date: Tue, Nov 20, 2018 at 6:21 PM
> Subject: Re: 1.20?
> To: dev@tika.apache.org <de...@tika.apache.org>
> 
> 
> Love it and I can align tika-python with that too ☺
> 
> 
> 
> 
> 
> 
> 
> From: Tim Allison <ta...@apache.org>
> Reply-To: "dev@tika.apache.org" <de...@tika.apache.org>
> Date: Tuesday, November 20, 2018 at 3:04 PM
> To: "dev@tika.apache.org" <de...@tika.apache.org>
> Subject: 1.20?
> 
> 
> 
> All,
> 
>     POI 4.0.1 will be out shortly with some important bug fixes.  What would
> 
> you all think of targeting 1st/2nd week of December for 1.20?
> 
> 
> 
>       Cheers,
> 
>           Tim
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org


Fwd: 1.20?

Posted by Tim Allison <ta...@apache.org>.
All,

  Tika's next release may be in the 1st/2nd week of December.  Do we any
sense of when we'll want to release PDFBox 2.0.13?  Thank you.

         Cheers,

                    Tim

---------- Forwarded message ---------
From: Chris Mattmann <ma...@apache.org>
Date: Tue, Nov 20, 2018 at 6:21 PM
Subject: Re: 1.20?
To: dev@tika.apache.org <de...@tika.apache.org>


Love it and I can align tika-python with that too ☺







From: Tim Allison <ta...@apache.org>
Reply-To: "dev@tika.apache.org" <de...@tika.apache.org>
Date: Tuesday, November 20, 2018 at 3:04 PM
To: "dev@tika.apache.org" <de...@tika.apache.org>
Subject: 1.20?



All,

   POI 4.0.1 will be out shortly with some important bug fixes.  What would

you all think of targeting 1st/2nd week of December for 1.20?



     Cheers,

         Tim

Re: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Thank you, again, Luís Filipe Nassif!  There's no point in having
reports unless we pay attention to them :P.  I reverted junrar to
where it was in 1.19.1. I also reverted jackcess based on the reports.

All,
  On the theory that it isn't a great idea to push to production on a
Friday.  I'm going to let the recent changes rest over the weekend.
I'll rerun some tests on a subset of the regression corpus on Monday
and then roll rc1.  If anyone wants to kick the tires on the recent
version changes, including parsers that depend on the upgraded guava,
that'd be great!

Onward!

Cheers,

           Tim

On Thu, Dec 13, 2018 at 5:34 PM Tim Allison <ta...@apache.org> wrote:
>
> Let me actually take a look before answering. Sorry!
>
> On Thu, Dec 13, 2018 at 5:30 PM Tim Allison <ta...@apache.org> wrote:
>>
>>  Thank you for reading the reports!!!
>>
>> The files are very likely broken.  I can take a look.  The change was
>> probably because of an "upgrade" to junrar.  Should I revert to the
>> version we used in 1.19.1?
>> On Thu, Dec 13, 2018 at 1:34 PM Luís Filipe Nassif <lf...@gmail.com> wrote:
>> >
>> > Hi Tim,
>> >
>> > Reading your great reports, I also saw some new exceptions with RAR files
>> > in likely broken folder, but seems tika was able to extract some text from
>> > them before. Do you know if those files are really broken and why tika
>> > extracted text from them before?
>> >
>> > Thank you,
>> > Luis
>> >
>> > Em qui, 13 de dez de 2018 às 13:02, Tim Allison <ta...@apache.org>
>> > escreveu:
>> >
>> > > Reports are here:
>> > >
>> > > http://162.242.228.174/reports/tika_1_20-pre-rc1.zip
>> > >
>> > > I'm going to revert the mp4 parser, and commit the few dependency
>> > > upgrades I ran.
>> > >
>> > > The _major_ difference in content for ppt is explained by the
>> > > duplication of header/footer info.  To confirm this, note that the
>> > > values for "num_unique_tokens_a" and "num_unique_tokens_b" are
>> > > identical for nearly all ppt->ppt, but there are far more tokens in
>> > > "num_tokens_a" vs "num_tokens_b".
>> > >
>> > > I also see that we're losing content in x-java and x-groovy, etc., but
>> > > that's because we're now suppressing the style markup that our parser
>> > > was (incorrectly, IMHO, inserting) -- check the values in
>> > > "top_10_unique_token_diffs_a", e.g.: rgb: 15 | color: 14 | font: 9 |
>> > > 0,0,0: 4 | background: 4 | 147,147,147: 3 | 247,247,247: 3 | bold: 3 |
>> > > weight: 3 | family: 2
>> > >
>> > > In short, I think we're good to go.  Will roll rc1 later today or
>> > > (more likely) tomorrow unless there are objections.
>> > > On Mon, Dec 10, 2018 at 9:37 PM Tim Allison <ta...@apache.org> wrote:
>> > > >
>> > > > Any blockers on 1.20?  I'm going to kick off the regression tests
>> > > shortly.
>> > > > On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:
>> > > > >
>> > > > > Hi,
>> > > > > On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:
>> > > > >
>> > > > > > Dave,
>> > > > > >   Should I try to get the Docker plugin working again?
>> > > > > >
>> > > > >
>> > > > > That would be great. I think I may have went down the wrong path
>> > > building
>> > > > > an image at package time, as there doesn't seem to be an easy way to
>> > > > > publish it as an Apache labelled org on Dockerhub unless it builds from
>> > > > > source.
>> > > > >
>> > > > > I have some time over the weekend, so could update to where I got to
>> > > and
>> > > > > see what you think.
>> > > > >
>> > > > > Cheers,
>> > > > > Dave
>> > >

Re: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Reports on mp4s, junrar, msaccess and a random subset of the
regression corpus are available here:
http://162.242.228.174/reports/reports_tika_1_20-rc1_subset.tgz


On Thu, Dec 13, 2018 at 5:34 PM Tim Allison <ta...@apache.org> wrote:
>
> Let me actually take a look before answering. Sorry!
>
> On Thu, Dec 13, 2018 at 5:30 PM Tim Allison <ta...@apache.org> wrote:
>>
>>  Thank you for reading the reports!!!
>>
>> The files are very likely broken.  I can take a look.  The change was
>> probably because of an "upgrade" to junrar.  Should I revert to the
>> version we used in 1.19.1?
>> On Thu, Dec 13, 2018 at 1:34 PM Luís Filipe Nassif <lf...@gmail.com> wrote:
>> >
>> > Hi Tim,
>> >
>> > Reading your great reports, I also saw some new exceptions with RAR files
>> > in likely broken folder, but seems tika was able to extract some text from
>> > them before. Do you know if those files are really broken and why tika
>> > extracted text from them before?
>> >
>> > Thank you,
>> > Luis
>> >
>> > Em qui, 13 de dez de 2018 às 13:02, Tim Allison <ta...@apache.org>
>> > escreveu:
>> >
>> > > Reports are here:
>> > >
>> > > http://162.242.228.174/reports/tika_1_20-pre-rc1.zip
>> > >
>> > > I'm going to revert the mp4 parser, and commit the few dependency
>> > > upgrades I ran.
>> > >
>> > > The _major_ difference in content for ppt is explained by the
>> > > duplication of header/footer info.  To confirm this, note that the
>> > > values for "num_unique_tokens_a" and "num_unique_tokens_b" are
>> > > identical for nearly all ppt->ppt, but there are far more tokens in
>> > > "num_tokens_a" vs "num_tokens_b".
>> > >
>> > > I also see that we're losing content in x-java and x-groovy, etc., but
>> > > that's because we're now suppressing the style markup that our parser
>> > > was (incorrectly, IMHO, inserting) -- check the values in
>> > > "top_10_unique_token_diffs_a", e.g.: rgb: 15 | color: 14 | font: 9 |
>> > > 0,0,0: 4 | background: 4 | 147,147,147: 3 | 247,247,247: 3 | bold: 3 |
>> > > weight: 3 | family: 2
>> > >
>> > > In short, I think we're good to go.  Will roll rc1 later today or
>> > > (more likely) tomorrow unless there are objections.
>> > > On Mon, Dec 10, 2018 at 9:37 PM Tim Allison <ta...@apache.org> wrote:
>> > > >
>> > > > Any blockers on 1.20?  I'm going to kick off the regression tests
>> > > shortly.
>> > > > On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:
>> > > > >
>> > > > > Hi,
>> > > > > On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:
>> > > > >
>> > > > > > Dave,
>> > > > > >   Should I try to get the Docker plugin working again?
>> > > > > >
>> > > > >
>> > > > > That would be great. I think I may have went down the wrong path
>> > > building
>> > > > > an image at package time, as there doesn't seem to be an easy way to
>> > > > > publish it as an Apache labelled org on Dockerhub unless it builds from
>> > > > > source.
>> > > > >
>> > > > > I have some time over the weekend, so could update to where I got to
>> > > and
>> > > > > see what you think.
>> > > > >
>> > > > > Cheers,
>> > > > > Dave
>> > >

Re: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Let me actually take a look before answering. Sorry!

On Thu, Dec 13, 2018 at 5:30 PM Tim Allison <ta...@apache.org> wrote:

>  Thank you for reading the reports!!!
>
> The files are very likely broken.  I can take a look.  The change was
> probably because of an "upgrade" to junrar.  Should I revert to the
> version we used in 1.19.1?
> On Thu, Dec 13, 2018 at 1:34 PM Luís Filipe Nassif <lf...@gmail.com>
> wrote:
> >
> > Hi Tim,
> >
> > Reading your great reports, I also saw some new exceptions with RAR files
> > in likely broken folder, but seems tika was able to extract some text
> from
> > them before. Do you know if those files are really broken and why tika
> > extracted text from them before?
> >
> > Thank you,
> > Luis
> >
> > Em qui, 13 de dez de 2018 às 13:02, Tim Allison <ta...@apache.org>
> > escreveu:
> >
> > > Reports are here:
> > >
> > > http://162.242.228.174/reports/tika_1_20-pre-rc1.zip
> > >
> > > I'm going to revert the mp4 parser, and commit the few dependency
> > > upgrades I ran.
> > >
> > > The _major_ difference in content for ppt is explained by the
> > > duplication of header/footer info.  To confirm this, note that the
> > > values for "num_unique_tokens_a" and "num_unique_tokens_b" are
> > > identical for nearly all ppt->ppt, but there are far more tokens in
> > > "num_tokens_a" vs "num_tokens_b".
> > >
> > > I also see that we're losing content in x-java and x-groovy, etc., but
> > > that's because we're now suppressing the style markup that our parser
> > > was (incorrectly, IMHO, inserting) -- check the values in
> > > "top_10_unique_token_diffs_a", e.g.: rgb: 15 | color: 14 | font: 9 |
> > > 0,0,0: 4 | background: 4 | 147,147,147: 3 | 247,247,247: 3 | bold: 3 |
> > > weight: 3 | family: 2
> > >
> > > In short, I think we're good to go.  Will roll rc1 later today or
> > > (more likely) tomorrow unless there are objections.
> > > On Mon, Dec 10, 2018 at 9:37 PM Tim Allison <ta...@apache.org>
> wrote:
> > > >
> > > > Any blockers on 1.20?  I'm going to kick off the regression tests
> > > shortly.
> > > > On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:
> > > > >
> > > > > Hi,
> > > > > On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org>
> wrote:
> > > > >
> > > > > > Dave,
> > > > > >   Should I try to get the Docker plugin working again?
> > > > > >
> > > > >
> > > > > That would be great. I think I may have went down the wrong path
> > > building
> > > > > an image at package time, as there doesn't seem to be an easy way
> to
> > > > > publish it as an Apache labelled org on Dockerhub unless it builds
> from
> > > > > source.
> > > > >
> > > > > I have some time over the weekend, so could update to where I got
> to
> > > and
> > > > > see what you think.
> > > > >
> > > > > Cheers,
> > > > > Dave
> > >
>

Re: 1.20?

Posted by Tim Allison <ta...@apache.org>.
 Thank you for reading the reports!!!

The files are very likely broken.  I can take a look.  The change was
probably because of an "upgrade" to junrar.  Should I revert to the
version we used in 1.19.1?
On Thu, Dec 13, 2018 at 1:34 PM Luís Filipe Nassif <lf...@gmail.com> wrote:
>
> Hi Tim,
>
> Reading your great reports, I also saw some new exceptions with RAR files
> in likely broken folder, but seems tika was able to extract some text from
> them before. Do you know if those files are really broken and why tika
> extracted text from them before?
>
> Thank you,
> Luis
>
> Em qui, 13 de dez de 2018 às 13:02, Tim Allison <ta...@apache.org>
> escreveu:
>
> > Reports are here:
> >
> > http://162.242.228.174/reports/tika_1_20-pre-rc1.zip
> >
> > I'm going to revert the mp4 parser, and commit the few dependency
> > upgrades I ran.
> >
> > The _major_ difference in content for ppt is explained by the
> > duplication of header/footer info.  To confirm this, note that the
> > values for "num_unique_tokens_a" and "num_unique_tokens_b" are
> > identical for nearly all ppt->ppt, but there are far more tokens in
> > "num_tokens_a" vs "num_tokens_b".
> >
> > I also see that we're losing content in x-java and x-groovy, etc., but
> > that's because we're now suppressing the style markup that our parser
> > was (incorrectly, IMHO, inserting) -- check the values in
> > "top_10_unique_token_diffs_a", e.g.: rgb: 15 | color: 14 | font: 9 |
> > 0,0,0: 4 | background: 4 | 147,147,147: 3 | 247,247,247: 3 | bold: 3 |
> > weight: 3 | family: 2
> >
> > In short, I think we're good to go.  Will roll rc1 later today or
> > (more likely) tomorrow unless there are objections.
> > On Mon, Dec 10, 2018 at 9:37 PM Tim Allison <ta...@apache.org> wrote:
> > >
> > > Any blockers on 1.20?  I'm going to kick off the regression tests
> > shortly.
> > > On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:
> > > >
> > > > Hi,
> > > > On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:
> > > >
> > > > > Dave,
> > > > >   Should I try to get the Docker plugin working again?
> > > > >
> > > >
> > > > That would be great. I think I may have went down the wrong path
> > building
> > > > an image at package time, as there doesn't seem to be an easy way to
> > > > publish it as an Apache labelled org on Dockerhub unless it builds from
> > > > source.
> > > >
> > > > I have some time over the weekend, so could update to where I got to
> > and
> > > > see what you think.
> > > >
> > > > Cheers,
> > > > Dave
> >

Re: 1.20?

Posted by Luís Filipe Nassif <lf...@gmail.com>.
Hi Tim,

Reading your great reports, I also saw some new exceptions with RAR files
in likely broken folder, but seems tika was able to extract some text from
them before. Do you know if those files are really broken and why tika
extracted text from them before?

Thank you,
Luis

Em qui, 13 de dez de 2018 às 13:02, Tim Allison <ta...@apache.org>
escreveu:

> Reports are here:
>
> http://162.242.228.174/reports/tika_1_20-pre-rc1.zip
>
> I'm going to revert the mp4 parser, and commit the few dependency
> upgrades I ran.
>
> The _major_ difference in content for ppt is explained by the
> duplication of header/footer info.  To confirm this, note that the
> values for "num_unique_tokens_a" and "num_unique_tokens_b" are
> identical for nearly all ppt->ppt, but there are far more tokens in
> "num_tokens_a" vs "num_tokens_b".
>
> I also see that we're losing content in x-java and x-groovy, etc., but
> that's because we're now suppressing the style markup that our parser
> was (incorrectly, IMHO, inserting) -- check the values in
> "top_10_unique_token_diffs_a", e.g.: rgb: 15 | color: 14 | font: 9 |
> 0,0,0: 4 | background: 4 | 147,147,147: 3 | 247,247,247: 3 | bold: 3 |
> weight: 3 | family: 2
>
> In short, I think we're good to go.  Will roll rc1 later today or
> (more likely) tomorrow unless there are objections.
> On Mon, Dec 10, 2018 at 9:37 PM Tim Allison <ta...@apache.org> wrote:
> >
> > Any blockers on 1.20?  I'm going to kick off the regression tests
> shortly.
> > On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:
> > >
> > > Hi,
> > > On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:
> > >
> > > > Dave,
> > > >   Should I try to get the Docker plugin working again?
> > > >
> > >
> > > That would be great. I think I may have went down the wrong path
> building
> > > an image at package time, as there doesn't seem to be an easy way to
> > > publish it as an Apache labelled org on Dockerhub unless it builds from
> > > source.
> > >
> > > I have some time over the weekend, so could update to where I got to
> and
> > > see what you think.
> > >
> > > Cheers,
> > > Dave
>

Re: 1.20?

Posted by Chris Mattmann <ma...@apache.org>.
Roll forward! Yay!

 

 

 

From: Tim Allison <ta...@apache.org>
Reply-To: "dev@tika.apache.org" <de...@tika.apache.org>
Date: Thursday, December 13, 2018 at 7:02 AM
To: "dev@tika.apache.org" <de...@tika.apache.org>
Subject: Re: 1.20?

 

Reports are here:

 

http://162.242.228.174/reports/tika_1_20-pre-rc1.zip

 

I'm going to revert the mp4 parser, and commit the few dependency

upgrades I ran.

 

The _major_ difference in content for ppt is explained by the

duplication of header/footer info.  To confirm this, note that the

values for "num_unique_tokens_a" and "num_unique_tokens_b" are

identical for nearly all ppt->ppt, but there are far more tokens in

"num_tokens_a" vs "num_tokens_b".

 

I also see that we're losing content in x-java and x-groovy, etc., but

that's because we're now suppressing the style markup that our parser

was (incorrectly, IMHO, inserting) -- check the values in

"top_10_unique_token_diffs_a", e.g.: rgb: 15 | color: 14 | font: 9 |

0,0,0: 4 | background: 4 | 147,147,147: 3 | 247,247,247: 3 | bold: 3 |

weight: 3 | family: 2

 

In short, I think we're good to go.  Will roll rc1 later today or

(more likely) tomorrow unless there are objections.

On Mon, Dec 10, 2018 at 9:37 PM Tim Allison <ta...@apache.org> wrote:

 

Any blockers on 1.20?  I'm going to kick off the regression tests shortly.

On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:

> 

> Hi,

> On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:

> 

> > Dave,

> >   Should I try to get the Docker plugin working again?

> >

> 

> That would be great. I think I may have went down the wrong path building

> an image at package time, as there doesn't seem to be an easy way to

> publish it as an Apache labelled org on Dockerhub unless it builds from

> source.

> 

> I have some time over the weekend, so could update to where I got to and

> see what you think.

> 

> Cheers,

> Dave

 


Re: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Reports are here:

http://162.242.228.174/reports/tika_1_20-pre-rc1.zip

I'm going to revert the mp4 parser, and commit the few dependency
upgrades I ran.

The _major_ difference in content for ppt is explained by the
duplication of header/footer info.  To confirm this, note that the
values for "num_unique_tokens_a" and "num_unique_tokens_b" are
identical for nearly all ppt->ppt, but there are far more tokens in
"num_tokens_a" vs "num_tokens_b".

I also see that we're losing content in x-java and x-groovy, etc., but
that's because we're now suppressing the style markup that our parser
was (incorrectly, IMHO, inserting) -- check the values in
"top_10_unique_token_diffs_a", e.g.: rgb: 15 | color: 14 | font: 9 |
0,0,0: 4 | background: 4 | 147,147,147: 3 | 247,247,247: 3 | bold: 3 |
weight: 3 | family: 2

In short, I think we're good to go.  Will roll rc1 later today or
(more likely) tomorrow unless there are objections.
On Mon, Dec 10, 2018 at 9:37 PM Tim Allison <ta...@apache.org> wrote:
>
> Any blockers on 1.20?  I'm going to kick off the regression tests shortly.
> On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:
> >
> > Hi,
> > On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:
> >
> > > Dave,
> > >   Should I try to get the Docker plugin working again?
> > >
> >
> > That would be great. I think I may have went down the wrong path building
> > an image at package time, as there doesn't seem to be an easy way to
> > publish it as an Apache labelled org on Dockerhub unless it builds from
> > source.
> >
> > I have some time over the weekend, so could update to where I got to and
> > see what you think.
> >
> > Cheers,
> > Dave

Re: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Any blockers on 1.20?  I'm going to kick off the regression tests shortly.
On Fri, Nov 30, 2018 at 7:39 PM <lo...@gmail.com> wrote:
>
> Hi,
> On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:
>
> > Dave,
> >   Should I try to get the Docker plugin working again?
> >
>
> That would be great. I think I may have went down the wrong path building
> an image at package time, as there doesn't seem to be an easy way to
> publish it as an Apache labelled org on Dockerhub unless it builds from
> source.
>
> I have some time over the weekend, so could update to where I got to and
> see what you think.
>
> Cheers,
> Dave

Re: 1.20?

Posted by lo...@gmail.com.
Hi,
On Wed, 21 Nov 2018 at 13:00, Tim Allison <ta...@apache.org> wrote:

> Dave,
>   Should I try to get the Docker plugin working again?
>

That would be great. I think I may have went down the wrong path building
an image at package time, as there doesn't seem to be an easy way to
publish it as an Apache labelled org on Dockerhub unless it builds from
source.

I have some time over the weekend, so could update to where I got to and
see what you think.

Cheers,
Dave

Re: 1.20?

Posted by Tim Allison <ta...@apache.org>.
Dave,
  Should I try to get the Docker plugin working again?

On Tue, Nov 20, 2018 at 6:21 PM Chris Mattmann <ma...@apache.org> wrote:

> Love it and I can align tika-python with that too ☺
>
>
>
>
>
>
>
> From: Tim Allison <ta...@apache.org>
> Reply-To: "dev@tika.apache.org" <de...@tika.apache.org>
> Date: Tuesday, November 20, 2018 at 3:04 PM
> To: "dev@tika.apache.org" <de...@tika.apache.org>
> Subject: 1.20?
>
>
>
> All,
>
>    POI 4.0.1 will be out shortly with some important bug fixes.  What would
>
> you all think of targeting 1st/2nd week of December for 1.20?
>
>
>
>      Cheers,
>
>          Tim
>
>
>
>

Re: 1.20?

Posted by Chris Mattmann <ma...@apache.org>.
Love it and I can align tika-python with that too ☺

 

 

 

From: Tim Allison <ta...@apache.org>
Reply-To: "dev@tika.apache.org" <de...@tika.apache.org>
Date: Tuesday, November 20, 2018 at 3:04 PM
To: "dev@tika.apache.org" <de...@tika.apache.org>
Subject: 1.20?

 

All,

   POI 4.0.1 will be out shortly with some important bug fixes.  What would

you all think of targeting 1st/2nd week of December for 1.20?

 

     Cheers,

         Tim

 


Re: 1.20?

Posted by Lewis John McGibbney <le...@apache.org>.
+1 would be nice to get the recent ENVI work released as well folks. 

On 2018/11/20 23:04:29, Tim Allison <ta...@apache.org> wrote: 
> All,
>    POI 4.0.1 will be out shortly with some important bug fixes.  What would
> you all think of targeting 1st/2nd week of December for 1.20?
> 
>      Cheers,
>          Tim
>