You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pdfbox.apache.org by Aravind Swarana <ar...@gmail.com> on 2020/08/10 18:19:33 UTC
Paragraph identification in apache pdf box
Hi,
I wanted to extract text as paragraphs using Apache PDFBox. I came to know
from my reading that extracting text from PDF is not that simple.
I have extracted Paragraphs from pdf using PDFBox API but they are not that
great.
Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose PDF
which is extracting paragraphs with very minimal error.
I'm trying to implement a similar algorithm for Apache PDFBox. Can you guys
suggest any recent Research paper or open source library which has
efficient paragraph Identification algorithms. I'll need to evaluate and
implement them.
So far I found :
https://github.com/elacin/PDFExtract (There were some errors Observed while
evaluating this and not as perfect as Aspose)
https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
apache pdf box)
I just need some suggestions whether there are any other algorithms I can
look at and implement them ?
Thanks & regards,
Aravind Swarna
Re: Paragraph identification in apache pdf box
Posted by Tilman Hausherr <TH...@t-online.de>.
Am 11.08.2020 um 10:22 schrieb Aravind Swarana:
> Hi Tilman,
>
> Thank you so much for your reply..
> I have seen Icecite, it was buggy it seems. Apache pdf box algorithm is far
> better. Can you know of something else ?
No.
I doubt icecite is buggy because it was part of a master thesis and also
a conference paper, but I didn't test it myself.
The PDFTextStripper has some tweaks (indentThreshold, dropThreshold,
spacingTolerance, averageCharTolerance) which you could try.
Tilman
>
> Thanks & regards,
> Aravind Swarna
>
>
> On Mon, Aug 10, 2020 at 11:59 PM Aravind Swarana <ar...@gmail.com>
> wrote:
>
>> Missed Analysis Attachment
>>
>>
>> Thanks & regards,
>> Aravind Swarna
>>
>>
>> On Mon, Aug 10, 2020 at 11:49 PM Aravind Swarana <ar...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I wanted to extract text as paragraphs using Apache PDFBox. I came to
>>> know from my reading that extracting text from PDF is not that simple.
>>>
>>> I have extracted Paragraphs from pdf using PDFBox API but they are not
>>> that great.
>>>
>>> Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose
>>> PDF which is extracting paragraphs with very minimal error.
>>>
>>> I'm trying to implement a similar algorithm for Apache PDFBox. Can you
>>> guys suggest any recent Research paper or open source library which has
>>> efficient paragraph Identification algorithms. I'll need to evaluate and
>>> implement them.
>>>
>>> So far I found :
>>> https://github.com/elacin/PDFExtract (There were some errors Observed
>>> while evaluating this and not as perfect as Aspose)
>>>
>>> https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
>>> apache pdf box)
>>>
>>> I just need some suggestions whether there are any other algorithms I can
>>> look at and implement them ?
>>>
>>>
>>>
>>>
>>> Thanks & regards,
>>> Aravind Swarna
>>>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: users-help@pdfbox.apache.org
Re: Paragraph identification in apache pdf box
Posted by Aravind Swarana <ar...@gmail.com>.
Hi Tilman,
Thank you so much for your reply..
I have seen Icecite, it was buggy it seems. Apache pdf box algorithm is far
better. Can you know of something else ?
Thanks & regards,
Aravind Swarna
On Mon, Aug 10, 2020 at 11:59 PM Aravind Swarana <ar...@gmail.com>
wrote:
> Missed Analysis Attachment
>
>
> Thanks & regards,
> Aravind Swarna
>
>
> On Mon, Aug 10, 2020 at 11:49 PM Aravind Swarana <ar...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I wanted to extract text as paragraphs using Apache PDFBox. I came to
>> know from my reading that extracting text from PDF is not that simple.
>>
>> I have extracted Paragraphs from pdf using PDFBox API but they are not
>> that great.
>>
>> Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose
>> PDF which is extracting paragraphs with very minimal error.
>>
>> I'm trying to implement a similar algorithm for Apache PDFBox. Can you
>> guys suggest any recent Research paper or open source library which has
>> efficient paragraph Identification algorithms. I'll need to evaluate and
>> implement them.
>>
>> So far I found :
>> https://github.com/elacin/PDFExtract (There were some errors Observed
>> while evaluating this and not as perfect as Aspose)
>>
>> https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
>> apache pdf box)
>>
>> I just need some suggestions whether there are any other algorithms I can
>> look at and implement them ?
>>
>>
>>
>>
>> Thanks & regards,
>> Aravind Swarna
>>
>
Re: Paragraph identification in apache pdf box
Posted by Aravind Swarana <ar...@gmail.com>.
Missed Analysis Attachment
Thanks & regards,
Aravind Swarna
On Mon, Aug 10, 2020 at 11:49 PM Aravind Swarana <ar...@gmail.com>
wrote:
> Hi,
>
> I wanted to extract text as paragraphs using Apache PDFBox. I came to know
> from my reading that extracting text from PDF is not that simple.
>
> I have extracted Paragraphs from pdf using PDFBox API but they are not
> that great.
>
> Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose PDF
> which is extracting paragraphs with very minimal error.
>
> I'm trying to implement a similar algorithm for Apache PDFBox. Can you
> guys suggest any recent Research paper or open source library which has
> efficient paragraph Identification algorithms. I'll need to evaluate and
> implement them.
>
> So far I found :
> https://github.com/elacin/PDFExtract (There were some errors Observed
> while evaluating this and not as perfect as Aspose)
>
> https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
> apache pdf box)
>
> I just need some suggestions whether there are any other algorithms I can
> look at and implement them ?
>
>
>
>
> Thanks & regards,
> Aravind Swarna
>
Re: Paragraph identification in apache pdf box
Posted by Peter Murray-Rust <pe...@googlemail.com.INVALID>.
Our own experience is that paragraph identification and other local
structures is dependent on the corpus / type of document. We use GROBID
https://github.com/kermitt2/grobid for scholarly papers as it has been
trained on them. It's a very active project. The result is TEI-XML , a
standard in academia.
I wasn't clear whether you are using thePDF character stream or bitmaps. We
are working on extracting components from scientific diagrams such as
plots, graphs, etc. https://github.com/petermr/ami3 . It's still a work in
progress but we are making good progress.
Tables , lists, and diagrams are harder than flowing text, and scientific
text (with sub and superscripts, styles, unusual symbols) is harder than
(say) newspaper articles.
Happy to hear from people who want to collaborate on this type of activity.
On Wed, Aug 12, 2020 at 10:57 AM Aravind Swarana <ar...@gmail.com>
wrote:
> Ok, I think buying aspose works..I'll go ahead with that..Thank you
>
> On 2020/08/11 19:23:11, Tilman Hausherr <TH...@t-online.de> wrote:
> > Am 11.08.2020 um 10:15 schrieb Aravind Swarana:
> > > Hi ,
> > > I tried icecite, it is very buggy and Apache pdf box paragraph
> Identification works even better. Any other solutions.. or any one know how
> Aspose PDF does it internally ?
> >
> >
> > If Aspose works for you, then you should buy / license it. It's probably
> > cheaper than to work out your own algorithm.
> >
> > No, I don't know how Aspose works.
> >
> > Tilman
> >
> >
> >
> > >
> > > On 2020/08/10 18:32:58, Tilman Hausherr <TH...@t-online.de> wrote:
> > >> Maybe icecite?
> > >>
> > >> https://github.com/ckorzen/icecite
> > >>
> > >> Tilman
> > >>
> > >> Am 10.08.2020 um 20:19 schrieb Aravind Swarana:
> > >>> Hi,
> > >>>
> > >>> I wanted to extract text as paragraphs using Apache PDFBox. I came
> to know
> > >>> from my reading that extracting text from PDF is not that simple.
> > >>>
> > >>> I have extracted Paragraphs from pdf using PDFBox API but they are
> not that
> > >>> great.
> > >>>
> > >>> Meanwhile I have evaluated a Paid version of PDF Parsing called
> Aspose PDF
> > >>> which is extracting paragraphs with very minimal error.
> > >>>
> > >>> I'm trying to implement a similar algorithm for Apache PDFBox. Can
> you guys
> > >>> suggest any recent Research paper or open source library which has
> > >>> efficient paragraph Identification algorithms. I'll need to evaluate
> and
> > >>> implement them.
> > >>>
> > >>> So far I found :
> > >>> https://github.com/elacin/PDFExtract (There were some errors
> Observed while
> > >>> evaluating this and not as perfect as Aspose)
> > >>>
> > >>> https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based
> on
> > >>> apache pdf box)
> > >>>
> > >>> I just need some suggestions whether there are any other algorithms
> I can
> > >>> look at and implement them ?
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> Thanks & regards,
> > >>> Aravind Swarna
> > >>>
> > >>
> > >> ---------------------------------------------------------------------
> > >> To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> > >> For additional commands, e-mail: users-help@pdfbox.apache.org
> > >>
> > >>
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> > > For additional commands, e-mail: users-help@pdfbox.apache.org
> > >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> > For additional commands, e-mail: users-help@pdfbox.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: users-help@pdfbox.apache.org
>
>
--
Peter Murray-Rust
Founder ContentMine.org
and
Reader Emeritus in Molecular Informatics
Dept. Of Chemistry, University of Cambridge, CB2 1EW, UK
Re: Paragraph identification in apache pdf box
Posted by Aravind Swarana <ar...@gmail.com>.
Ok, I think buying aspose works..I'll go ahead with that..Thank you
On 2020/08/11 19:23:11, Tilman Hausherr <TH...@t-online.de> wrote:
> Am 11.08.2020 um 10:15 schrieb Aravind Swarana:
> > Hi ,
> > I tried icecite, it is very buggy and Apache pdf box paragraph Identification works even better. Any other solutions.. or any one know how Aspose PDF does it internally ?
>
>
> If Aspose works for you, then you should buy / license it. It's probably
> cheaper than to work out your own algorithm.
>
> No, I don't know how Aspose works.
>
> Tilman
>
>
>
> >
> > On 2020/08/10 18:32:58, Tilman Hausherr <TH...@t-online.de> wrote:
> >> Maybe icecite?
> >>
> >> https://github.com/ckorzen/icecite
> >>
> >> Tilman
> >>
> >> Am 10.08.2020 um 20:19 schrieb Aravind Swarana:
> >>> Hi,
> >>>
> >>> I wanted to extract text as paragraphs using Apache PDFBox. I came to know
> >>> from my reading that extracting text from PDF is not that simple.
> >>>
> >>> I have extracted Paragraphs from pdf using PDFBox API but they are not that
> >>> great.
> >>>
> >>> Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose PDF
> >>> which is extracting paragraphs with very minimal error.
> >>>
> >>> I'm trying to implement a similar algorithm for Apache PDFBox. Can you guys
> >>> suggest any recent Research paper or open source library which has
> >>> efficient paragraph Identification algorithms. I'll need to evaluate and
> >>> implement them.
> >>>
> >>> So far I found :
> >>> https://github.com/elacin/PDFExtract (There were some errors Observed while
> >>> evaluating this and not as perfect as Aspose)
> >>>
> >>> https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
> >>> apache pdf box)
> >>>
> >>> I just need some suggestions whether there are any other algorithms I can
> >>> look at and implement them ?
> >>>
> >>>
> >>>
> >>>
> >>> Thanks & regards,
> >>> Aravind Swarna
> >>>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> >> For additional commands, e-mail: users-help@pdfbox.apache.org
> >>
> >>
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> > For additional commands, e-mail: users-help@pdfbox.apache.org
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: users-help@pdfbox.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: users-help@pdfbox.apache.org
Re: Paragraph identification in apache pdf box
Posted by Tilman Hausherr <TH...@t-online.de>.
Am 11.08.2020 um 10:15 schrieb Aravind Swarana:
> Hi ,
> I tried icecite, it is very buggy and Apache pdf box paragraph Identification works even better. Any other solutions.. or any one know how Aspose PDF does it internally ?
If Aspose works for you, then you should buy / license it. It's probably
cheaper than to work out your own algorithm.
No, I don't know how Aspose works.
Tilman
>
> On 2020/08/10 18:32:58, Tilman Hausherr <TH...@t-online.de> wrote:
>> Maybe icecite?
>>
>> https://github.com/ckorzen/icecite
>>
>> Tilman
>>
>> Am 10.08.2020 um 20:19 schrieb Aravind Swarana:
>>> Hi,
>>>
>>> I wanted to extract text as paragraphs using Apache PDFBox. I came to know
>>> from my reading that extracting text from PDF is not that simple.
>>>
>>> I have extracted Paragraphs from pdf using PDFBox API but they are not that
>>> great.
>>>
>>> Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose PDF
>>> which is extracting paragraphs with very minimal error.
>>>
>>> I'm trying to implement a similar algorithm for Apache PDFBox. Can you guys
>>> suggest any recent Research paper or open source library which has
>>> efficient paragraph Identification algorithms. I'll need to evaluate and
>>> implement them.
>>>
>>> So far I found :
>>> https://github.com/elacin/PDFExtract (There were some errors Observed while
>>> evaluating this and not as perfect as Aspose)
>>>
>>> https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
>>> apache pdf box)
>>>
>>> I just need some suggestions whether there are any other algorithms I can
>>> look at and implement them ?
>>>
>>>
>>>
>>>
>>> Thanks & regards,
>>> Aravind Swarna
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
>> For additional commands, e-mail: users-help@pdfbox.apache.org
>>
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: users-help@pdfbox.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: users-help@pdfbox.apache.org
Re: Paragraph identification in apache pdf box
Posted by Aravind Swarana <ar...@gmail.com>.
Hi ,
I tried icecite, it is very buggy and Apache pdf box paragraph Identification works even better. Any other solutions.. or any one know how Aspose PDF does it internally ?
On 2020/08/10 18:32:58, Tilman Hausherr <TH...@t-online.de> wrote:
> Maybe icecite?
>
> https://github.com/ckorzen/icecite
>
> Tilman
>
> Am 10.08.2020 um 20:19 schrieb Aravind Swarana:
> > Hi,
> >
> > I wanted to extract text as paragraphs using Apache PDFBox. I came to know
> > from my reading that extracting text from PDF is not that simple.
> >
> > I have extracted Paragraphs from pdf using PDFBox API but they are not that
> > great.
> >
> > Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose PDF
> > which is extracting paragraphs with very minimal error.
> >
> > I'm trying to implement a similar algorithm for Apache PDFBox. Can you guys
> > suggest any recent Research paper or open source library which has
> > efficient paragraph Identification algorithms. I'll need to evaluate and
> > implement them.
> >
> > So far I found :
> > https://github.com/elacin/PDFExtract (There were some errors Observed while
> > evaluating this and not as perfect as Aspose)
> >
> > https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
> > apache pdf box)
> >
> > I just need some suggestions whether there are any other algorithms I can
> > look at and implement them ?
> >
> >
> >
> >
> > Thanks & regards,
> > Aravind Swarna
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
> For additional commands, e-mail: users-help@pdfbox.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: users-help@pdfbox.apache.org
Re: Paragraph identification in apache pdf box
Posted by Tilman Hausherr <TH...@t-online.de>.
Maybe icecite?
https://github.com/ckorzen/icecite
Tilman
Am 10.08.2020 um 20:19 schrieb Aravind Swarana:
> Hi,
>
> I wanted to extract text as paragraphs using Apache PDFBox. I came to know
> from my reading that extracting text from PDF is not that simple.
>
> I have extracted Paragraphs from pdf using PDFBox API but they are not that
> great.
>
> Meanwhile I have evaluated a Paid version of PDF Parsing called Aspose PDF
> which is extracting paragraphs with very minimal error.
>
> I'm trying to implement a similar algorithm for Apache PDFBox. Can you guys
> suggest any recent Research paper or open source library which has
> efficient paragraph Identification algorithms. I'll need to evaluate and
> implement them.
>
> So far I found :
> https://github.com/elacin/PDFExtract (There were some errors Observed while
> evaluating this and not as perfect as Aspose)
>
> https://github.com/BMKEG/lapdftext/wiki/System-Overview (Not based on
> apache pdf box)
>
> I just need some suggestions whether there are any other algorithms I can
> look at and implement them ?
>
>
>
>
> Thanks & regards,
> Aravind Swarna
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: users-help@pdfbox.apache.org