You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Lewis John Mcgibbney <le...@gmail.com> on 2015/01/10 03:02:00 UTC

nutchpy

Hi Folks,
Just wanted to make folk aware of some work Continuum Analytics have been
doing on bringing Nutch to the Python community.

https://github.com/ContinuumIO/nutchpy

Comtinuum are the folks behind most of the scientific Python stuff you've
ever used. If you've used Python before, then you've used code written by
Continuum.

Thanks
Lewis


-- 
*Lewis*

Re: nutchpy

Posted by Andy Ray Terrel <an...@gmail.com>.
Thanks for the bug report. I've tracked in our issues:
https://github.com/ContinuumIO/nutchpy/issues/8

-- Andy

On Fri, Jan 9, 2015 at 8:43 PM, Shadi Saleh <pr...@gmail.com> wrote:

> Dear all,
>
> I added to file :
>
> nutchpy/seqreader-app/pom.xml
>
>
> the following:
>
>    <plugin>
>
>       <groupId>org.apache.maven.plugins</groupId>
>
>       <artifactId>maven-compiler-plugin</artifactId>
>
>       <configuration>
>
>         <compilerVersion>1.5</compilerVersion>
>
>         <source>1.5</source>
>
>         <target>1.5</target>
>
>       </configuration>
>
>     </plugin>
>
>
>
> And it works now, thanks.
>
>
> On Sat, Jan 10, 2015 at 3:34 AM, Mattmann, Chris A (3980) <
> chris.a.mattmann@jpl.nasa.gov> wrote:
>
> >
> >
> > Sent from my iPhone
> >
> > Begin forwarded message:
> >
> > From: Shadi Saleh <pr...@gmail.com>>
> > Date: January 9, 2015 at 6:28:11 PM PST
> > To: user <us...@nutch.apache.org>>
> > Subject: Re: nutchpy
> > Reply-To: <us...@nutch.apache.org>>
> >
> > Thanks, I got this error while installing
> >
> > [INFO] Scanning for projects...
> >
> > [INFO]
> >
> >
> > [INFO]
> > ------------------------------------------------------------------------
> >
> > [INFO] Building seqreader-app 1.0-SNAPSHOT
> >
> > [INFO]
> > ------------------------------------------------------------------------
> >
> > [INFO]
> >
> > [INFO] --- maven-resources-plugin:2.3:resources (default-resources) @
> > seqreader-app ---
> >
> > [WARNING] Using platform encoding (ANSI_X3.4-1968 actually) to copy
> > filtered resources, i.e. build is platform dependent!
> >
> > [INFO] skip non existing resourceDirectory
> > /root/py_nutch/nutchpy/seqreader-app/src/main/resources
> >
> > [INFO]
> >
> > [INFO] --- maven-compiler-plugin:2.0.2:compile (default-compile) @
> > seqreader-app ---
> >
> > [INFO] Compiling 5 source files to
> > /root/py_nutch/nutchpy/seqreader-app/target/classes
> >
> > [INFO]
> > ------------------------------------------------------------------------
> >
> > [INFO] BUILD FAILURE
> >
> > [INFO]
> > ------------------------------------------------------------------------
> >
> > [INFO] Total time: 1.213s
> >
> > [INFO] Finished at: Sat Jan 10 03:23:39 EST 2015
> >
> > [INFO] Final Memory: 9M/153M
> >
> > [INFO]
> > ------------------------------------------------------------------------
> >
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-compiler-plugin:2.0.2:compile
> > (default-compile) on project seqreader-app: Compilation failure:
> > Compilation failure:
> >
> > [ERROR]
> >
> >
> /root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/LinkReader.java:[21,25]
> > error: generics are not supported in -source 1.3
> >
> > [ERROR]
> >
> > [ERROR] (use -source 5 or higher to enable generics)
> >
> > [ERROR]
> >
> >
> /root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/SequenceReader.java:[47,12]
> > error: generics are not supported in -source 1.3
> >
> > [ERROR]
> >
> > [ERROR] (use -source 5 or higher to enable generics)
> >
> > [ERROR]
> >
> >
> /root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/NodeReader.java:[21,25]
> > error: generics are not supported in -source 1.3
> >
> > [ERROR] -> [Help 1]
> >
> > [ERROR]
> >
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> >
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >
> > [ERROR]
> >
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> >
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> >
> > Traceback (most recent call last):
> >
> >  File "setup.py", line 132, in <module>
> >
> >    shutil.copy(jar_file,java_lib_dir)
> >
> >  File "/usr/lib/python2.7/shutil.py", line 119, in copy
> >
> >    copyfile(src, dst)
> >
> >  File "/usr/lib/python2.7/shutil.py", line 82, in copyfile
> >
> >    with open(src, 'rb') as fsrc:
> >
> > IOError: [Errno 2] No such file or directory:
> >
> 'seqreader-app/target/seqreader-app-1.0-SNAPSHOT-jar-with-dependencies.jar'
> >
> >
> >
> >
> > On Sat, Jan 10, 2015 at 3:21 AM, Mattmann, Chris A (3980) <
> > chris.a.mattmann@jpl.nasa.gov<ma...@jpl.nasa.gov>>
> > wrote:
> >
> > Yep it's awesome work funded by the DARPA memex project and our team.
> > Cc'ing Andy Terrel for awareness thanks Lewis!
> >
> > Sent from my iPhone
> >
> > On Jan 9, 2015, at 6:04 PM, Lewis John Mcgibbney <
> > lewis.mcgibbney@gmail.com<ma...@gmail.com>> wrote:
> >
> > Hi Folks,
> > Just wanted to make folk aware of some work Continuum Analytics have been
> > doing on bringing Nutch to the Python community.
> >
> > https://github.com/ContinuumIO/nutchpy
> >
> > Comtinuum are the folks behind most of the scientific Python stuff you've
> > ever used. If you've used Python before, then you've used code written by
> > Continuum.
> >
> > Thanks
> > Lewis
> >
> >
> > --
> > *Lewis*
> >
> >
> >
> >
> > --
> >
> >
> >
> >
> > *Shadi SalehPh.D StudentInstitute of Formal and Applied
> LinguisticsFaculty
> > of Mathematics and Physics*
> > *-Charles University in Prague*
> >
> > *16017 Prague 6 - Czech Republic Mob +420773515578*
> >
>
>
>
> --
>
>
>
>
> *Shadi SalehPh.D StudentInstitute of Formal and Applied LinguisticsFaculty
> of Mathematics and Physics*
> *-Charles University in Prague*
>
> *16017 Prague 6 - Czech Republic Mob +420773515578*
>

Re: nutchpy

Posted by Shadi Saleh <pr...@gmail.com>.
Dear all,

I added to file :

nutchpy/seqreader-app/pom.xml


the following:

   <plugin>

      <groupId>org.apache.maven.plugins</groupId>

      <artifactId>maven-compiler-plugin</artifactId>

      <configuration>

        <compilerVersion>1.5</compilerVersion>

        <source>1.5</source>

        <target>1.5</target>

      </configuration>

    </plugin>



And it works now, thanks.


On Sat, Jan 10, 2015 at 3:34 AM, Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov> wrote:

>
>
> Sent from my iPhone
>
> Begin forwarded message:
>
> From: Shadi Saleh <pr...@gmail.com>>
> Date: January 9, 2015 at 6:28:11 PM PST
> To: user <us...@nutch.apache.org>>
> Subject: Re: nutchpy
> Reply-To: <us...@nutch.apache.org>>
>
> Thanks, I got this error while installing
>
> [INFO] Scanning for projects...
>
> [INFO]
>
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Building seqreader-app 1.0-SNAPSHOT
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO]
>
> [INFO] --- maven-resources-plugin:2.3:resources (default-resources) @
> seqreader-app ---
>
> [WARNING] Using platform encoding (ANSI_X3.4-1968 actually) to copy
> filtered resources, i.e. build is platform dependent!
>
> [INFO] skip non existing resourceDirectory
> /root/py_nutch/nutchpy/seqreader-app/src/main/resources
>
> [INFO]
>
> [INFO] --- maven-compiler-plugin:2.0.2:compile (default-compile) @
> seqreader-app ---
>
> [INFO] Compiling 5 source files to
> /root/py_nutch/nutchpy/seqreader-app/target/classes
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 1.213s
>
> [INFO] Finished at: Sat Jan 10 03:23:39 EST 2015
>
> [INFO] Final Memory: 9M/153M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:compile
> (default-compile) on project seqreader-app: Compilation failure:
> Compilation failure:
>
> [ERROR]
>
> /root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/LinkReader.java:[21,25]
> error: generics are not supported in -source 1.3
>
> [ERROR]
>
> [ERROR] (use -source 5 or higher to enable generics)
>
> [ERROR]
>
> /root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/SequenceReader.java:[47,12]
> error: generics are not supported in -source 1.3
>
> [ERROR]
>
> [ERROR] (use -source 5 or higher to enable generics)
>
> [ERROR]
>
> /root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/NodeReader.java:[21,25]
> error: generics are not supported in -source 1.3
>
> [ERROR] -> [Help 1]
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
>
> Traceback (most recent call last):
>
>  File "setup.py", line 132, in <module>
>
>    shutil.copy(jar_file,java_lib_dir)
>
>  File "/usr/lib/python2.7/shutil.py", line 119, in copy
>
>    copyfile(src, dst)
>
>  File "/usr/lib/python2.7/shutil.py", line 82, in copyfile
>
>    with open(src, 'rb') as fsrc:
>
> IOError: [Errno 2] No such file or directory:
> 'seqreader-app/target/seqreader-app-1.0-SNAPSHOT-jar-with-dependencies.jar'
>
>
>
>
> On Sat, Jan 10, 2015 at 3:21 AM, Mattmann, Chris A (3980) <
> chris.a.mattmann@jpl.nasa.gov<ma...@jpl.nasa.gov>>
> wrote:
>
> Yep it's awesome work funded by the DARPA memex project and our team.
> Cc'ing Andy Terrel for awareness thanks Lewis!
>
> Sent from my iPhone
>
> On Jan 9, 2015, at 6:04 PM, Lewis John Mcgibbney <
> lewis.mcgibbney@gmail.com<ma...@gmail.com>> wrote:
>
> Hi Folks,
> Just wanted to make folk aware of some work Continuum Analytics have been
> doing on bringing Nutch to the Python community.
>
> https://github.com/ContinuumIO/nutchpy
>
> Comtinuum are the folks behind most of the scientific Python stuff you've
> ever used. If you've used Python before, then you've used code written by
> Continuum.
>
> Thanks
> Lewis
>
>
> --
> *Lewis*
>
>
>
>
> --
>
>
>
>
> *Shadi SalehPh.D StudentInstitute of Formal and Applied LinguisticsFaculty
> of Mathematics and Physics*
> *-Charles University in Prague*
>
> *16017 Prague 6 - Czech Republic Mob +420773515578*
>



-- 




*Shadi SalehPh.D StudentInstitute of Formal and Applied LinguisticsFaculty
of Mathematics and Physics*
*-Charles University in Prague*

*16017 Prague 6 - Czech Republic Mob +420773515578*

Fwd: nutchpy

Posted by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>.

Sent from my iPhone

Begin forwarded message:

From: Shadi Saleh <pr...@gmail.com>>
Date: January 9, 2015 at 6:28:11 PM PST
To: user <us...@nutch.apache.org>>
Subject: Re: nutchpy
Reply-To: <us...@nutch.apache.org>>

Thanks, I got this error while installing

[INFO] Scanning for projects...

[INFO]


[INFO]
------------------------------------------------------------------------

[INFO] Building seqreader-app 1.0-SNAPSHOT

[INFO]
------------------------------------------------------------------------

[INFO]

[INFO] --- maven-resources-plugin:2.3:resources (default-resources) @
seqreader-app ---

[WARNING] Using platform encoding (ANSI_X3.4-1968 actually) to copy
filtered resources, i.e. build is platform dependent!

[INFO] skip non existing resourceDirectory
/root/py_nutch/nutchpy/seqreader-app/src/main/resources

[INFO]

[INFO] --- maven-compiler-plugin:2.0.2:compile (default-compile) @
seqreader-app ---

[INFO] Compiling 5 source files to
/root/py_nutch/nutchpy/seqreader-app/target/classes

[INFO]
------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO]
------------------------------------------------------------------------

[INFO] Total time: 1.213s

[INFO] Finished at: Sat Jan 10 03:23:39 EST 2015

[INFO] Final Memory: 9M/153M

[INFO]
------------------------------------------------------------------------

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:2.0.2:compile
(default-compile) on project seqreader-app: Compilation failure:
Compilation failure:

[ERROR]
/root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/LinkReader.java:[21,25]
error: generics are not supported in -source 1.3

[ERROR]

[ERROR] (use -source 5 or higher to enable generics)

[ERROR]
/root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/SequenceReader.java:[47,12]
error: generics are not supported in -source 1.3

[ERROR]

[ERROR] (use -source 5 or higher to enable generics)

[ERROR]
/root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/NodeReader.java:[21,25]
error: generics are not supported in -source 1.3

[ERROR] -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions,
please read the following articles:

[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

Traceback (most recent call last):

 File "setup.py", line 132, in <module>

   shutil.copy(jar_file,java_lib_dir)

 File "/usr/lib/python2.7/shutil.py", line 119, in copy

   copyfile(src, dst)

 File "/usr/lib/python2.7/shutil.py", line 82, in copyfile

   with open(src, 'rb') as fsrc:

IOError: [Errno 2] No such file or directory:
'seqreader-app/target/seqreader-app-1.0-SNAPSHOT-jar-with-dependencies.jar'




On Sat, Jan 10, 2015 at 3:21 AM, Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov<ma...@jpl.nasa.gov>> wrote:

Yep it's awesome work funded by the DARPA memex project and our team.
Cc'ing Andy Terrel for awareness thanks Lewis!

Sent from my iPhone

On Jan 9, 2015, at 6:04 PM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com<ma...@gmail.com>> wrote:

Hi Folks,
Just wanted to make folk aware of some work Continuum Analytics have been
doing on bringing Nutch to the Python community.

https://github.com/ContinuumIO/nutchpy

Comtinuum are the folks behind most of the scientific Python stuff you've
ever used. If you've used Python before, then you've used code written by
Continuum.

Thanks
Lewis


--
*Lewis*




--




*Shadi SalehPh.D StudentInstitute of Formal and Applied LinguisticsFaculty
of Mathematics and Physics*
*-Charles University in Prague*

*16017 Prague 6 - Czech Republic Mob +420773515578*

Re: nutchpy

Posted by Shadi Saleh <pr...@gmail.com>.
Thanks, I got this error while installing

[INFO] Scanning for projects...

[INFO]


[INFO]
------------------------------------------------------------------------

[INFO] Building seqreader-app 1.0-SNAPSHOT

[INFO]
------------------------------------------------------------------------

[INFO]

[INFO] --- maven-resources-plugin:2.3:resources (default-resources) @
seqreader-app ---

[WARNING] Using platform encoding (ANSI_X3.4-1968 actually) to copy
filtered resources, i.e. build is platform dependent!

[INFO] skip non existing resourceDirectory
/root/py_nutch/nutchpy/seqreader-app/src/main/resources

[INFO]

[INFO] --- maven-compiler-plugin:2.0.2:compile (default-compile) @
seqreader-app ---

[INFO] Compiling 5 source files to
/root/py_nutch/nutchpy/seqreader-app/target/classes

[INFO]
------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO]
------------------------------------------------------------------------

[INFO] Total time: 1.213s

[INFO] Finished at: Sat Jan 10 03:23:39 EST 2015

[INFO] Final Memory: 9M/153M

[INFO]
------------------------------------------------------------------------

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:2.0.2:compile
(default-compile) on project seqreader-app: Compilation failure:
Compilation failure:

[ERROR]
/root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/LinkReader.java:[21,25]
error: generics are not supported in -source 1.3

[ERROR]

[ERROR] (use -source 5 or higher to enable generics)

[ERROR]
/root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/SequenceReader.java:[47,12]
error: generics are not supported in -source 1.3

[ERROR]

[ERROR] (use -source 5 or higher to enable generics)

[ERROR]
/root/py_nutch/nutchpy/seqreader-app/src/main/java/com/continuumio/seqreaderapp/NodeReader.java:[21,25]
error: generics are not supported in -source 1.3

[ERROR] -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions,
please read the following articles:

[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

Traceback (most recent call last):

  File "setup.py", line 132, in <module>

    shutil.copy(jar_file,java_lib_dir)

  File "/usr/lib/python2.7/shutil.py", line 119, in copy

    copyfile(src, dst)

  File "/usr/lib/python2.7/shutil.py", line 82, in copyfile

    with open(src, 'rb') as fsrc:

IOError: [Errno 2] No such file or directory:
'seqreader-app/target/seqreader-app-1.0-SNAPSHOT-jar-with-dependencies.jar'




On Sat, Jan 10, 2015 at 3:21 AM, Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov> wrote:

> Yep it's awesome work funded by the DARPA memex project and our team.
> Cc'ing Andy Terrel for awareness thanks Lewis!
>
> Sent from my iPhone
>
> > On Jan 9, 2015, at 6:04 PM, Lewis John Mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
> >
> > Hi Folks,
> > Just wanted to make folk aware of some work Continuum Analytics have been
> > doing on bringing Nutch to the Python community.
> >
> > https://github.com/ContinuumIO/nutchpy
> >
> > Comtinuum are the folks behind most of the scientific Python stuff you've
> > ever used. If you've used Python before, then you've used code written by
> > Continuum.
> >
> > Thanks
> > Lewis
> >
> >
> > --
> > *Lewis*
>



-- 




*Shadi SalehPh.D StudentInstitute of Formal and Applied LinguisticsFaculty
of Mathematics and Physics*
*-Charles University in Prague*

*16017 Prague 6 - Czech Republic Mob +420773515578*

Re: nutchpy

Posted by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>.
Yep it's awesome work funded by the DARPA memex project and our team. Cc'ing Andy Terrel for awareness thanks Lewis!

Sent from my iPhone

> On Jan 9, 2015, at 6:04 PM, Lewis John Mcgibbney <le...@gmail.com> wrote:
> 
> Hi Folks,
> Just wanted to make folk aware of some work Continuum Analytics have been
> doing on bringing Nutch to the Python community.
> 
> https://github.com/ContinuumIO/nutchpy
> 
> Comtinuum are the folks behind most of the scientific Python stuff you've
> ever used. If you've used Python before, then you've used code written by
> Continuum.
> 
> Thanks
> Lewis
> 
> 
> -- 
> *Lewis*