You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oodt.apache.org by Sanjaya Medonsa <sa...@gmail.com> on 2013/06/25 13:45:32 UTC
Config File for ExternMetExtractor
Hi,
I am working on ingesting output generated by Airavata workflow execution
into OODT file server. I am reusing the capabilities available in OODT
PGETaskInstance class. I am referring
https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help to set
up the AutoDetectProductCrawler. I am looking for sample config file
to ExternMetExtractor.
Could someone please share a sample config file?
Best Regards,
Sanjaya
Re: Config File for ExternMetExtractor
Posted by Sanjaya Medonsa <sa...@gmail.com>.
Thanks Rishi! That really helps and I was able to resolve the issue with
configuration.
Best Regards,
Sanjaya
On Wed, Jun 26, 2013 at 10:03 PM, Verma, Rishi (398J) <
Rishi.Verma@jpl.nasa.gov> wrote:
> Hi Sanjaya,
>
> The page you referred to (OODT crawler wiki page) contains an example
> config file called "katextractor.config". You probably already looked at
> this, but it really does reflect the basic structure of most extern config
> files.
>
> Also, you can find another short example at:
> http://oodt.apache.org/components/maven/metadata/user/basic.html#existing
>
> I would also take a look at the code for the ExternConfigReader class,
> which reads in the config file. Looking at this would give you detailed
> information on which keys are read and in which order.
>
> https://svn.apache.org/repos/asf/oodt/trunk/metadata/src/main/java/org/apache/oodt/cas/metadata/extractors/ExternConfigReader.java
>
> Hope that helps!
>
> Thanks,
> Rishi
>
> On Jun 25, 2013, at 4:45 AM, Sanjaya Medonsa wrote:
>
> > Hi,
> > I am working on ingesting output generated by Airavata workflow execution
> > into OODT file server. I am reusing the capabilities available in OODT
> > PGETaskInstance class. I am referring
> > https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help to
> set
> > up the AutoDetectProductCrawler. I am looking for sample config file
> > to ExternMetExtractor.
> > Could someone please share a sample config file?
> >
> > Best Regards,
> > Sanjaya
>
>
Re: Config File for ExternMetExtractor
Posted by Sanjaya Medonsa <sa...@gmail.com>.
Thanks Rishi! That really helps and I was able to resolve the issue with
configuration.
Best Regards,
Sanjaya
On Wed, Jun 26, 2013 at 10:03 PM, Verma, Rishi (398J) <
Rishi.Verma@jpl.nasa.gov> wrote:
> Hi Sanjaya,
>
> The page you referred to (OODT crawler wiki page) contains an example
> config file called "katextractor.config". You probably already looked at
> this, but it really does reflect the basic structure of most extern config
> files.
>
> Also, you can find another short example at:
> http://oodt.apache.org/components/maven/metadata/user/basic.html#existing
>
> I would also take a look at the code for the ExternConfigReader class,
> which reads in the config file. Looking at this would give you detailed
> information on which keys are read and in which order.
>
> https://svn.apache.org/repos/asf/oodt/trunk/metadata/src/main/java/org/apache/oodt/cas/metadata/extractors/ExternConfigReader.java
>
> Hope that helps!
>
> Thanks,
> Rishi
>
> On Jun 25, 2013, at 4:45 AM, Sanjaya Medonsa wrote:
>
> > Hi,
> > I am working on ingesting output generated by Airavata workflow execution
> > into OODT file server. I am reusing the capabilities available in OODT
> > PGETaskInstance class. I am referring
> > https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help to
> set
> > up the AutoDetectProductCrawler. I am looking for sample config file
> > to ExternMetExtractor.
> > Could someone please share a sample config file?
> >
> > Best Regards,
> > Sanjaya
>
>
Re: Config File for ExternMetExtractor
Posted by "Verma, Rishi (398J)" <Ri...@jpl.nasa.gov>.
Hi Sanjaya,
The page you referred to (OODT crawler wiki page) contains an example config file called "katextractor.config". You probably already looked at this, but it really does reflect the basic structure of most extern config files.
Also, you can find another short example at: http://oodt.apache.org/components/maven/metadata/user/basic.html#existing
I would also take a look at the code for the ExternConfigReader class, which reads in the config file. Looking at this would give you detailed information on which keys are read and in which order.
https://svn.apache.org/repos/asf/oodt/trunk/metadata/src/main/java/org/apache/oodt/cas/metadata/extractors/ExternConfigReader.java
Hope that helps!
Thanks,
Rishi
On Jun 25, 2013, at 4:45 AM, Sanjaya Medonsa wrote:
> Hi,
> I am working on ingesting output generated by Airavata workflow execution
> into OODT file server. I am reusing the capabilities available in OODT
> PGETaskInstance class. I am referring
> https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help to set
> up the AutoDetectProductCrawler. I am looking for sample config file
> to ExternMetExtractor.
> Could someone please share a sample config file?
>
> Best Regards,
> Sanjaya
Re: Config File for ExternMetExtractor
Posted by "Verma, Rishi (398J)" <Ri...@jpl.nasa.gov>.
Hi Sanjaya,
The page you referred to (OODT crawler wiki page) contains an example config file called "katextractor.config". You probably already looked at this, but it really does reflect the basic structure of most extern config files.
Also, you can find another short example at: http://oodt.apache.org/components/maven/metadata/user/basic.html#existing
I would also take a look at the code for the ExternConfigReader class, which reads in the config file. Looking at this would give you detailed information on which keys are read and in which order.
https://svn.apache.org/repos/asf/oodt/trunk/metadata/src/main/java/org/apache/oodt/cas/metadata/extractors/ExternConfigReader.java
Hope that helps!
Thanks,
Rishi
On Jun 25, 2013, at 4:45 AM, Sanjaya Medonsa wrote:
> Hi,
> I am working on ingesting output generated by Airavata workflow execution
> into OODT file server. I am reusing the capabilities available in OODT
> PGETaskInstance class. I am referring
> https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help to set
> up the AutoDetectProductCrawler. I am looking for sample config file
> to ExternMetExtractor.
> Could someone please share a sample config file?
>
> Best Regards,
> Sanjaya