You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Pat Ferrel <pa...@occamsmachete.com> on 2015/03/27 17:54:35 UTC
Require Java 7 and Hadoop 2.x?
Aren’t current Mahout 0.9 users on hadoop 1.2.1 by definition? Probably most on Java 6 too.
Unless there is some strong reason it seems like we should support both of those for at least one release, shouldn’t we?
I have a hadoop 1.2.1 cluster, which has a hadoop job that is not Hadoop 2 compatible so I’m stuck there for the time being. Compiling Mahout for this now gives an error over the H2 API “isDirectory”, which I think used to be “isDir” for H1. Has that API been deprecated in H2? Are we forced to chose either/or?
On Mar 27, 2015, at 9:31 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
It should, Hadoop supports it long term and lots of people stuck there with projects that haven’t been upgraded (Mahout comes to mind).
On Mar 27, 2015, at 9:26 AM, Stevo Slavić <ss...@gmail.com> wrote:
Have to check but I doubt that build supports hadoop 1.x any more.
On Fri, Mar 27, 2015 at 5:15 PM, Suneel Marthi <su...@gmail.com>
wrote:
> This is the Java version, gotta use Java 7
>
> On Fri, Mar 27, 2015 at 12:08 PM, Pat Ferrel <pa...@occamsmachete.com>
> wrote:
>
>> Latest source for Spark 1.1.0 and Hadoop 1.2.1
>>
>> Build complains about the move to
>> <maven.compiler.target>1.7</maven.compiler.target> I think this was upped
>> from 1.6 but not sure if that’s what the error is about.
>>
>> I’m on Java 6 no this machine if that matters.
>>
>> Actual error:
>>
>> [INFO] Mahout Build Tools ................................ SUCCESS
> [3.512s]
>> [INFO] Apache Mahout ..................................... SUCCESS
> [0.603s]
>> [INFO] Mahout Math ....................................... FAILURE
> [6.453s]
>> [INFO] Mahout MapReduce Legacy ........................... SKIPPED
>> [INFO] Mahout Integration ................................ SKIPPED
>> [INFO] Mahout Examples ................................... SKIPPED
>> [INFO] Mahout Release Package ............................ SKIPPED
>> [INFO] Mahout Math Scala bindings ........................ SKIPPED
>> [INFO] Mahout Spark bindings ............................. SKIPPED
>> [INFO] Mahout Spark bindings shell ....................... SKIPPED
>> [INFO] Mahout H2O backend ................................ SKIPPED
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 11.609s
>> [INFO] Finished at: Fri Mar 27 08:55:35 PDT 2015
>> [INFO] Final Memory: 24M/310M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-compiler-plugin:3.2:compile
>> (default-compile) on project mahout-math: Fatal error compiling: invalid
>> target release: 1.7 -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>>
>>
>
Re: Require Java 7 and Hadoop 2.x?
Posted by Ted Dunning <te...@gmail.com>.
There are subtle API incompatibilities.
Unfortunate. But true.
On Fri, Mar 27, 2015 at 10:16 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> As I said in the other thread forcing Java 7 is not as big a deal as
> forcing Hadoop 1.2.1. Is there some new part of 2.X that we need? Or some
> forced API incompatability?
>
>
> On Mar 27, 2015, at 9:58 AM, Suneel Marthi <su...@gmail.com>
> wrote:
>
> TED??? please jump in.
>
> On Fri, Mar 27, 2015 at 12:54 PM, Pat Ferrel <pa...@occamsmachete.com>
> wrote:
>
> > Aren’t current Mahout 0.9 users on hadoop 1.2.1 by definition? Probably
> > most on Java 6 too.
> >
> > Unless there is some strong reason it seems like we should support both
> of
> > those for at least one release, shouldn’t we?
> >
> > I have a hadoop 1.2.1 cluster, which has a hadoop job that is not Hadoop
> 2
> > compatible so I’m stuck there for the time being. Compiling Mahout for
> this
> > now gives an error over the H2 API “isDirectory”, which I think used to
> be
> > “isDir” for H1. Has that API been deprecated in H2? Are we forced to
> chose
> > either/or?
> >
> >
> > On Mar 27, 2015, at 9:31 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> >
> > It should, Hadoop supports it long term and lots of people stuck there
> > with projects that haven’t been upgraded (Mahout comes to mind).
> >
> > On Mar 27, 2015, at 9:26 AM, Stevo Slavić <ss...@gmail.com> wrote:
> >
> > Have to check but I doubt that build supports hadoop 1.x any more.
> >
> > On Fri, Mar 27, 2015 at 5:15 PM, Suneel Marthi <su...@gmail.com>
> > wrote:
> >
> >> This is the Java version, gotta use Java 7
> >>
> >> On Fri, Mar 27, 2015 at 12:08 PM, Pat Ferrel <pa...@occamsmachete.com>
> >> wrote:
> >>
> >>> Latest source for Spark 1.1.0 and Hadoop 1.2.1
> >>>
> >>> Build complains about the move to
> >>> <maven.compiler.target>1.7</maven.compiler.target> I think this was
> > upped
> >>> from 1.6 but not sure if that’s what the error is about.
> >>>
> >>> I’m on Java 6 no this machine if that matters.
> >>>
> >>> Actual error:
> >>>
> >>> [INFO] Mahout Build Tools ................................ SUCCESS
> >> [3.512s]
> >>> [INFO] Apache Mahout ..................................... SUCCESS
> >> [0.603s]
> >>> [INFO] Mahout Math ....................................... FAILURE
> >> [6.453s]
> >>> [INFO] Mahout MapReduce Legacy ........................... SKIPPED
> >>> [INFO] Mahout Integration ................................ SKIPPED
> >>> [INFO] Mahout Examples ................................... SKIPPED
> >>> [INFO] Mahout Release Package ............................ SKIPPED
> >>> [INFO] Mahout Math Scala bindings ........................ SKIPPED
> >>> [INFO] Mahout Spark bindings ............................. SKIPPED
> >>> [INFO] Mahout Spark bindings shell ....................... SKIPPED
> >>> [INFO] Mahout H2O backend ................................ SKIPPED
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD FAILURE
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 11.609s
> >>> [INFO] Finished at: Fri Mar 27 08:55:35 PDT 2015
> >>> [INFO] Final Memory: 24M/310M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-compiler-plugin:3.2:compile
> >>> (default-compile) on project mahout-math: Fatal error compiling:
> invalid
> >>> target release: 1.7 -> [Help 1]
> >>> [ERROR]
> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the
> >>> -e switch.
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>>
> >>>
> >>
> >
> >
> >
>
>
Re: Require Java 7 and Hadoop 2.x?
Posted by Pat Ferrel <pa...@occamsmachete.com>.
As I said in the other thread forcing Java 7 is not as big a deal as forcing Hadoop 1.2.1. Is there some new part of 2.X that we need? Or some forced API incompatability?
On Mar 27, 2015, at 9:58 AM, Suneel Marthi <su...@gmail.com> wrote:
TED??? please jump in.
On Fri, Mar 27, 2015 at 12:54 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> Aren’t current Mahout 0.9 users on hadoop 1.2.1 by definition? Probably
> most on Java 6 too.
>
> Unless there is some strong reason it seems like we should support both of
> those for at least one release, shouldn’t we?
>
> I have a hadoop 1.2.1 cluster, which has a hadoop job that is not Hadoop 2
> compatible so I’m stuck there for the time being. Compiling Mahout for this
> now gives an error over the H2 API “isDirectory”, which I think used to be
> “isDir” for H1. Has that API been deprecated in H2? Are we forced to chose
> either/or?
>
>
> On Mar 27, 2015, at 9:31 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
>
> It should, Hadoop supports it long term and lots of people stuck there
> with projects that haven’t been upgraded (Mahout comes to mind).
>
> On Mar 27, 2015, at 9:26 AM, Stevo Slavić <ss...@gmail.com> wrote:
>
> Have to check but I doubt that build supports hadoop 1.x any more.
>
> On Fri, Mar 27, 2015 at 5:15 PM, Suneel Marthi <su...@gmail.com>
> wrote:
>
>> This is the Java version, gotta use Java 7
>>
>> On Fri, Mar 27, 2015 at 12:08 PM, Pat Ferrel <pa...@occamsmachete.com>
>> wrote:
>>
>>> Latest source for Spark 1.1.0 and Hadoop 1.2.1
>>>
>>> Build complains about the move to
>>> <maven.compiler.target>1.7</maven.compiler.target> I think this was
> upped
>>> from 1.6 but not sure if that’s what the error is about.
>>>
>>> I’m on Java 6 no this machine if that matters.
>>>
>>> Actual error:
>>>
>>> [INFO] Mahout Build Tools ................................ SUCCESS
>> [3.512s]
>>> [INFO] Apache Mahout ..................................... SUCCESS
>> [0.603s]
>>> [INFO] Mahout Math ....................................... FAILURE
>> [6.453s]
>>> [INFO] Mahout MapReduce Legacy ........................... SKIPPED
>>> [INFO] Mahout Integration ................................ SKIPPED
>>> [INFO] Mahout Examples ................................... SKIPPED
>>> [INFO] Mahout Release Package ............................ SKIPPED
>>> [INFO] Mahout Math Scala bindings ........................ SKIPPED
>>> [INFO] Mahout Spark bindings ............................. SKIPPED
>>> [INFO] Mahout Spark bindings shell ....................... SKIPPED
>>> [INFO] Mahout H2O backend ................................ SKIPPED
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 11.609s
>>> [INFO] Finished at: Fri Mar 27 08:55:35 PDT 2015
>>> [INFO] Final Memory: 24M/310M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-compiler-plugin:3.2:compile
>>> (default-compile) on project mahout-math: Fatal error compiling: invalid
>>> target release: 1.7 -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>>> -e switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>>
>>>
>>
>
>
>
Re: Require Java 7 and Hadoop 2.x?
Posted by Ted Dunning <te...@gmail.com>.
I haven't heard of many people still on Java 6. *(except in this thread,
of course). It shouldn't be a big deal forcing that.
Hadoop 2 is probably close enough that we should be able to jump forward
with our next release. I certainly know of a significant number of
non-upgraded installs, but adding a bit more pressure to upgrade would be a
good thing for the world at large, probably.
On Fri, Mar 27, 2015 at 9:58 AM, Suneel Marthi <su...@gmail.com>
wrote:
> TED??? please jump in.
>
> On Fri, Mar 27, 2015 at 12:54 PM, Pat Ferrel <pa...@occamsmachete.com>
> wrote:
>
> > Aren’t current Mahout 0.9 users on hadoop 1.2.1 by definition? Probably
> > most on Java 6 too.
> >
> > Unless there is some strong reason it seems like we should support both
> of
> > those for at least one release, shouldn’t we?
> >
> > I have a hadoop 1.2.1 cluster, which has a hadoop job that is not Hadoop
> 2
> > compatible so I’m stuck there for the time being. Compiling Mahout for
> this
> > now gives an error over the H2 API “isDirectory”, which I think used to
> be
> > “isDir” for H1. Has that API been deprecated in H2? Are we forced to
> chose
> > either/or?
> >
> >
> > On Mar 27, 2015, at 9:31 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> >
> > It should, Hadoop supports it long term and lots of people stuck there
> > with projects that haven’t been upgraded (Mahout comes to mind).
> >
> > On Mar 27, 2015, at 9:26 AM, Stevo Slavić <ss...@gmail.com> wrote:
> >
> > Have to check but I doubt that build supports hadoop 1.x any more.
> >
> > On Fri, Mar 27, 2015 at 5:15 PM, Suneel Marthi <su...@gmail.com>
> > wrote:
> >
> > > This is the Java version, gotta use Java 7
> > >
> > > On Fri, Mar 27, 2015 at 12:08 PM, Pat Ferrel <pa...@occamsmachete.com>
> > > wrote:
> > >
> > >> Latest source for Spark 1.1.0 and Hadoop 1.2.1
> > >>
> > >> Build complains about the move to
> > >> <maven.compiler.target>1.7</maven.compiler.target> I think this was
> > upped
> > >> from 1.6 but not sure if that’s what the error is about.
> > >>
> > >> I’m on Java 6 no this machine if that matters.
> > >>
> > >> Actual error:
> > >>
> > >> [INFO] Mahout Build Tools ................................ SUCCESS
> > > [3.512s]
> > >> [INFO] Apache Mahout ..................................... SUCCESS
> > > [0.603s]
> > >> [INFO] Mahout Math ....................................... FAILURE
> > > [6.453s]
> > >> [INFO] Mahout MapReduce Legacy ........................... SKIPPED
> > >> [INFO] Mahout Integration ................................ SKIPPED
> > >> [INFO] Mahout Examples ................................... SKIPPED
> > >> [INFO] Mahout Release Package ............................ SKIPPED
> > >> [INFO] Mahout Math Scala bindings ........................ SKIPPED
> > >> [INFO] Mahout Spark bindings ............................. SKIPPED
> > >> [INFO] Mahout Spark bindings shell ....................... SKIPPED
> > >> [INFO] Mahout H2O backend ................................ SKIPPED
> > >> [INFO]
> > >>
> ------------------------------------------------------------------------
> > >> [INFO] BUILD FAILURE
> > >> [INFO]
> > >>
> ------------------------------------------------------------------------
> > >> [INFO] Total time: 11.609s
> > >> [INFO] Finished at: Fri Mar 27 08:55:35 PDT 2015
> > >> [INFO] Final Memory: 24M/310M
> > >> [INFO]
> > >>
> ------------------------------------------------------------------------
> > >> [ERROR] Failed to execute goal
> > >> org.apache.maven.plugins:maven-compiler-plugin:3.2:compile
> > >> (default-compile) on project mahout-math: Fatal error compiling:
> invalid
> > >> target release: 1.7 -> [Help 1]
> > >> [ERROR]
> > >> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the
> > >> -e switch.
> > >> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > >> [ERROR]
> > >>
> > >>
> > >
> >
> >
> >
>
Re: Require Java 7 and Hadoop 2.x?
Posted by Suneel Marthi <su...@gmail.com>.
TED??? please jump in.
On Fri, Mar 27, 2015 at 12:54 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> Aren’t current Mahout 0.9 users on hadoop 1.2.1 by definition? Probably
> most on Java 6 too.
>
> Unless there is some strong reason it seems like we should support both of
> those for at least one release, shouldn’t we?
>
> I have a hadoop 1.2.1 cluster, which has a hadoop job that is not Hadoop 2
> compatible so I’m stuck there for the time being. Compiling Mahout for this
> now gives an error over the H2 API “isDirectory”, which I think used to be
> “isDir” for H1. Has that API been deprecated in H2? Are we forced to chose
> either/or?
>
>
> On Mar 27, 2015, at 9:31 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
>
> It should, Hadoop supports it long term and lots of people stuck there
> with projects that haven’t been upgraded (Mahout comes to mind).
>
> On Mar 27, 2015, at 9:26 AM, Stevo Slavić <ss...@gmail.com> wrote:
>
> Have to check but I doubt that build supports hadoop 1.x any more.
>
> On Fri, Mar 27, 2015 at 5:15 PM, Suneel Marthi <su...@gmail.com>
> wrote:
>
> > This is the Java version, gotta use Java 7
> >
> > On Fri, Mar 27, 2015 at 12:08 PM, Pat Ferrel <pa...@occamsmachete.com>
> > wrote:
> >
> >> Latest source for Spark 1.1.0 and Hadoop 1.2.1
> >>
> >> Build complains about the move to
> >> <maven.compiler.target>1.7</maven.compiler.target> I think this was
> upped
> >> from 1.6 but not sure if that’s what the error is about.
> >>
> >> I’m on Java 6 no this machine if that matters.
> >>
> >> Actual error:
> >>
> >> [INFO] Mahout Build Tools ................................ SUCCESS
> > [3.512s]
> >> [INFO] Apache Mahout ..................................... SUCCESS
> > [0.603s]
> >> [INFO] Mahout Math ....................................... FAILURE
> > [6.453s]
> >> [INFO] Mahout MapReduce Legacy ........................... SKIPPED
> >> [INFO] Mahout Integration ................................ SKIPPED
> >> [INFO] Mahout Examples ................................... SKIPPED
> >> [INFO] Mahout Release Package ............................ SKIPPED
> >> [INFO] Mahout Math Scala bindings ........................ SKIPPED
> >> [INFO] Mahout Spark bindings ............................. SKIPPED
> >> [INFO] Mahout Spark bindings shell ....................... SKIPPED
> >> [INFO] Mahout H2O backend ................................ SKIPPED
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] BUILD FAILURE
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] Total time: 11.609s
> >> [INFO] Finished at: Fri Mar 27 08:55:35 PDT 2015
> >> [INFO] Final Memory: 24M/310M
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [ERROR] Failed to execute goal
> >> org.apache.maven.plugins:maven-compiler-plugin:3.2:compile
> >> (default-compile) on project mahout-math: Fatal error compiling: invalid
> >> target release: 1.7 -> [Help 1]
> >> [ERROR]
> >> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> >> -e switch.
> >> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >> [ERROR]
> >>
> >>
> >
>
>
>
Re: Require Java 7 and Hadoop 2.x?
Posted by Pat Ferrel <pa...@occamsmachete.com>.
I’m all for adding any needed support for java 7 and making Hadoop 2 the default but do they also have to be required?
On Mar 27, 2015, at 9:54 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
Aren’t current Mahout 0.9 users on hadoop 1.2.1 by definition? Probably most on Java 6 too.
Unless there is some strong reason it seems like we should support both of those for at least one release, shouldn’t we?
I have a hadoop 1.2.1 cluster, which has a hadoop job that is not Hadoop 2 compatible so I’m stuck there for the time being. Compiling Mahout for this now gives an error over the H2 API “isDirectory”, which I think used to be “isDir” for H1. Has that API been deprecated in H2? Are we forced to chose either/or?
On Mar 27, 2015, at 9:31 AM, Pat Ferrel <pa...@occamsmachete.com> wrote:
It should, Hadoop supports it long term and lots of people stuck there with projects that haven’t been upgraded (Mahout comes to mind).
On Mar 27, 2015, at 9:26 AM, Stevo Slavić <ss...@gmail.com> wrote:
Have to check but I doubt that build supports hadoop 1.x any more.
On Fri, Mar 27, 2015 at 5:15 PM, Suneel Marthi <su...@gmail.com>
wrote:
> This is the Java version, gotta use Java 7
>
> On Fri, Mar 27, 2015 at 12:08 PM, Pat Ferrel <pa...@occamsmachete.com>
> wrote:
>
>> Latest source for Spark 1.1.0 and Hadoop 1.2.1
>>
>> Build complains about the move to
>> <maven.compiler.target>1.7</maven.compiler.target> I think this was upped
>> from 1.6 but not sure if that’s what the error is about.
>>
>> I’m on Java 6 no this machine if that matters.
>>
>> Actual error:
>>
>> [INFO] Mahout Build Tools ................................ SUCCESS
> [3.512s]
>> [INFO] Apache Mahout ..................................... SUCCESS
> [0.603s]
>> [INFO] Mahout Math ....................................... FAILURE
> [6.453s]
>> [INFO] Mahout MapReduce Legacy ........................... SKIPPED
>> [INFO] Mahout Integration ................................ SKIPPED
>> [INFO] Mahout Examples ................................... SKIPPED
>> [INFO] Mahout Release Package ............................ SKIPPED
>> [INFO] Mahout Math Scala bindings ........................ SKIPPED
>> [INFO] Mahout Spark bindings ............................. SKIPPED
>> [INFO] Mahout Spark bindings shell ....................... SKIPPED
>> [INFO] Mahout H2O backend ................................ SKIPPED
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 11.609s
>> [INFO] Finished at: Fri Mar 27 08:55:35 PDT 2015
>> [INFO] Final Memory: 24M/310M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-compiler-plugin:3.2:compile
>> (default-compile) on project mahout-math: Fatal error compiling: invalid
>> target release: 1.7 -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>>
>>
>