You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ctakes.apache.org by "Chen, Pei" <Pe...@childrens.harvard.edu> on 2013/04/05 17:26:38 UTC
cTAKES Dependency Parser / SRL updates
Hi,
I am planning to update the existing ctakes-dependency-parser ClearParser (which is no longer supported) implementation with Jinho's new ClearNLP parser and SRL. The models have been retrained with more data (MiPaq and SHARP) and much improved (1/4 memory footprint and faster). Note that the current default pipeline actually has the SRL component commented out.
I am planning to replace the existing code in trunk. Please let me know if you have any objections or if you need the existing dependency parser code for some reason. Otherwise, I would like to avoid supporting a dependency on a lib that is no longer supported with the same functionality.
--Pei
Re: cTAKES Dependency Parser / SRL updates
Posted by Steven Bethard <st...@Colorado.EDU>.
On Apr 5, 2013, at 9:26 AM, "Chen, Pei" <Pe...@childrens.harvard.edu> wrote:
> I am planning to update the existing ctakes-dependency-parser ClearParser (which is no longer supported) implementation with Jinho's new ClearNLP parser and SRL. The models have been retrained with more data (MiPaq and SHARP) and much improved (1/4 memory footprint and faster). Note that the current default pipeline actually has the SRL component commented out.
>
> I am planning to replace the existing code in trunk. Please let me know if you have any objections or if you need the existing dependency parser code for some reason. Otherwise, I would like to avoid supporting a dependency on a lib that is no longer supported with the same functionality.
+1 for getting rid of the unsupported ClearParser and replacing it with the actively developed ClearNLP.
Thanks for working on this!
Steve
RE: cTAKES Dependency Parser / SRL updates
Posted by "Finan, Sean" <Se...@childrens.harvard.edu>.
Excellent news, Thanks Pei (and Jinho)
-----Original Message-----
From: Chen, Pei [mailto:Pei.Chen@childrens.harvard.edu]
Sent: Friday, April 05, 2013 1:04 PM
To: dev@ctakes.apache.org
Subject: RE: cTAKES Dependency Parser / SRL updates
Thanks. This has been done in trunk now since r. 1465043 [For those who need the previous version, we can create a branch from the previous revision if really required.] (There were some logical changes as we sat down and worked on it together with Jinho the other day.) Feel free to give it a try.
--Pei
> -----Original Message-----
> From: Lee Becker [mailto:lee.becker@gmail.com]
> Sent: Friday, April 05, 2013 11:59 AM
> To: dev@ctakes.apache.org
> Subject: Re: cTAKES Dependency Parser / SRL updates
>
> On Fri, Apr 5, 2013 at 9:26 AM, Chen, Pei
> <Pe...@childrens.harvard.edu>wrote:
>
> > I am planning to update the existing ctakes-dependency-parser
> > ClearParser (which is no longer supported) implementation with
> > Jinho's new ClearNLP parser and SRL. The models have been retrained
> > with more data (MiPaq and
> > SHARP) and much improved (1/4 memory footprint and faster). Note
> > that the current default pipeline actually has the SRL component
> > commented
> out.
> >
> > I am planning to replace the existing code in trunk. Please let me
> > know if you have any objections or if you need the existing
> > dependency parser code for some reason. Otherwise, I would like to
> > avoid supporting a dependency on a lib that is no longer supported
> > with the
> same functionality.
> >
>
> Hi Pei,
>
> If you need an example of how to prepare the data to go into ClearNLP
> and how to take it back out, you can look at how ClearTK wraps ClearNLP.
>
> This is the code currently in the master branch of ClearTK. Because it
> only operates on the ClearTK typesystem it may be easier to read.
> https://code.google.com/p/cleartk/source/browse/#git%2Fcleartk-
> clearnlp%2Fsrc%2Fmain%2Fjava%2Forg%2Fcleartk%2Fclearnlp
>
> This is the code in the branch for issue-359 that is aiming to make
> the wrappers more generic so that people can use their own type
> system, like say cTAKES tokens and relationships. These APIs are a
> work in progress, but they might provide a useful path since cTAKES
> already depends on ClearTK in parts, this might be a faster path as
> all you would need to do would be to implement your own version of
> TokenOps, DependencyOps, and SrlOps, and then you would create new
> classes that extend *_ImplBase. I would be curious to know if they
> are currently general enough to support a type system like the one in cTAKES.
> https://code.google.com/p/cleartk/source/browse/?name=issue-
> 359#git%2Fcleartk-
> clearnlp%2Fsrc%2Fmain%2Fjava%2Forg%2Fcleartk%2Fclearnlp
>
> Let me know if you have any questions, Lee
RE: cTAKES Dependency Parser / SRL updates
Posted by "Chen, Pei" <Pe...@childrens.harvard.edu>.
Thanks. This has been done in trunk now since r. 1465043
[For those who need the previous version, we can create a branch from the previous revision if really required.]
(There were some logical changes as we sat down and worked on it together with Jinho the other day.)
Feel free to give it a try.
--Pei
> -----Original Message-----
> From: Lee Becker [mailto:lee.becker@gmail.com]
> Sent: Friday, April 05, 2013 11:59 AM
> To: dev@ctakes.apache.org
> Subject: Re: cTAKES Dependency Parser / SRL updates
>
> On Fri, Apr 5, 2013 at 9:26 AM, Chen, Pei
> <Pe...@childrens.harvard.edu>wrote:
>
> > I am planning to update the existing ctakes-dependency-parser
> > ClearParser (which is no longer supported) implementation with Jinho's
> > new ClearNLP parser and SRL. The models have been retrained with more
> > data (MiPaq and
> > SHARP) and much improved (1/4 memory footprint and faster). Note that
> > the current default pipeline actually has the SRL component commented
> out.
> >
> > I am planning to replace the existing code in trunk. Please let me
> > know if you have any objections or if you need the existing dependency
> > parser code for some reason. Otherwise, I would like to avoid
> > supporting a dependency on a lib that is no longer supported with the
> same functionality.
> >
>
> Hi Pei,
>
> If you need an example of how to prepare the data to go into ClearNLP and
> how to take it back out, you can look at how ClearTK wraps ClearNLP.
>
> This is the code currently in the master branch of ClearTK. Because it only
> operates on the ClearTK typesystem it may be easier to read.
> https://code.google.com/p/cleartk/source/browse/#git%2Fcleartk-
> clearnlp%2Fsrc%2Fmain%2Fjava%2Forg%2Fcleartk%2Fclearnlp
>
> This is the code in the branch for issue-359 that is aiming to make the
> wrappers more generic so that people can use their own type system, like
> say cTAKES tokens and relationships. These APIs are a work in progress, but
> they might provide a useful path since cTAKES already depends on ClearTK in
> parts, this might be a faster path as all you would need to do would be to
> implement your own version of TokenOps, DependencyOps, and SrlOps, and
> then you would create new classes that extend *_ImplBase. I would be
> curious to know if they are currently general enough to support a type
> system like the one in cTAKES.
> https://code.google.com/p/cleartk/source/browse/?name=issue-
> 359#git%2Fcleartk-
> clearnlp%2Fsrc%2Fmain%2Fjava%2Forg%2Fcleartk%2Fclearnlp
>
> Let me know if you have any questions,
> Lee
Re: cTAKES Dependency Parser / SRL updates
Posted by Lee Becker <le...@gmail.com>.
On Fri, Apr 5, 2013 at 9:26 AM, Chen, Pei <Pe...@childrens.harvard.edu>wrote:
> I am planning to update the existing ctakes-dependency-parser ClearParser
> (which is no longer supported) implementation with Jinho's new ClearNLP
> parser and SRL. The models have been retrained with more data (MiPaq and
> SHARP) and much improved (1/4 memory footprint and faster). Note that the
> current default pipeline actually has the SRL component commented out.
>
> I am planning to replace the existing code in trunk. Please let me know
> if you have any objections or if you need the existing dependency parser
> code for some reason. Otherwise, I would like to avoid supporting a
> dependency on a lib that is no longer supported with the same functionality.
>
Hi Pei,
If you need an example of how to prepare the data to go into ClearNLP and
how to take it back out, you can look at how ClearTK wraps ClearNLP.
This is the code currently in the master branch of ClearTK. Because it only
operates on the ClearTK typesystem it may be easier to read.
https://code.google.com/p/cleartk/source/browse/#git%2Fcleartk-clearnlp%2Fsrc%2Fmain%2Fjava%2Forg%2Fcleartk%2Fclearnlp
This is the code in the branch for issue-359 that is aiming to make the
wrappers more generic so that people can use their own type system, like
say cTAKES tokens and relationships. These APIs are a work in progress,
but they might provide a useful path since cTAKES already depends on
ClearTK in parts, this might be a faster path as all you would need to do
would be to implement your own version of TokenOps, DependencyOps, and
SrlOps, and then you would create new classes that extend *_ImplBase. I
would be curious to know if they are currently general enough to support a
type system like the one in cTAKES.
https://code.google.com/p/cleartk/source/browse/?name=issue-359#git%2Fcleartk-clearnlp%2Fsrc%2Fmain%2Fjava%2Forg%2Fcleartk%2Fclearnlp
Let me know if you have any questions,
Lee