You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Hui Wen Han (JIRA)" <ji...@apache.org> on 2010/04/07 13:31:33 UTC
[jira] Created: (MAHOUT-368) should package core ,math and
collections to one Jar package for hadoop recommendations
should package core ,math and collections to one Jar package for hadoop recommendations
---------------------------------------------------------------------------------------
Key: MAHOUT-368
URL: https://issues.apache.org/jira/browse/MAHOUT-368
Project: Mahout
Issue Type: Improvement
Components: Collaborative Filtering
Affects Versions: 0.4
Reporter: Hui Wen Han
Fix For: 0.4
should package core ,math and collections to one Jar package for org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.
because RecommenderJob used classes (for example org.apache.mahout.math.VectorWritable )of the math module of mahout project,
but math and core module is the separated jar package.
so when work on the hadoop env ,the class of math module can not load to classloader in the datanode.
it will cause class not found exception.
the work around is package all mahout classes to one package manually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAHOUT-368) should package core ,math and
collections to one Jar package for hadoop recommendations
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved MAHOUT-368.
------------------------------
Resolution: Not A Problem
Assignee: Sean Owen
Yes exactly, that's already created for you. Just use the .job file -- it's a .jar file.
> should package core ,math and collections to one Jar package for hadoop recommendations
> ---------------------------------------------------------------------------------------
>
> Key: MAHOUT-368
> URL: https://issues.apache.org/jira/browse/MAHOUT-368
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Fix For: 0.4
>
>
> should package core ,math and collections to one Jar package for org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.
> because RecommenderJob used classes (for example org.apache.mahout.math.VectorWritable )of the math module of mahout project,
> but math and core module is the separated jar package.
> so when work on the hadoop env ,the class of math module can not load to classloader in the datanode.
> it will cause class not found exception.
> the work around is package all mahout classes to one package manually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-368) should package core ,math and
collections to one Jar package for hadoop recommendations
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854443#action_12854443 ]
Hui Wen Han commented on MAHOUT-368:
------------------------------------
how to import the full jar to one maven project ?
maybe add one POM task for it.
> should package core ,math and collections to one Jar package for hadoop recommendations
> ---------------------------------------------------------------------------------------
>
> Key: MAHOUT-368
> URL: https://issues.apache.org/jira/browse/MAHOUT-368
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Fix For: 0.4
>
>
> should package core ,math and collections to one Jar package for org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.
> because RecommenderJob used classes (for example org.apache.mahout.math.VectorWritable )of the math module of mahout project,
> but math and core module is the separated jar package.
> so when work on the hadoop env ,the class of math module can not load to classloader in the datanode.
> it will cause class not found exception.
> the work around is package all mahout classes to one package manually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-368) should package core ,math and
collections to one Jar package for hadoop recommendations
Posted by "Robin Anil (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854429#action_12854429 ]
Robin Anil commented on MAHOUT-368:
-----------------------------------
check out the mahout-examples.job in examples/target its the jar file you need
> should package core ,math and collections to one Jar package for hadoop recommendations
> ---------------------------------------------------------------------------------------
>
> Key: MAHOUT-368
> URL: https://issues.apache.org/jira/browse/MAHOUT-368
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> should package core ,math and collections to one Jar package for org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.
> because RecommenderJob used classes (for example org.apache.mahout.math.VectorWritable )of the math module of mahout project,
> but math and core module is the separated jar package.
> so when work on the hadoop env ,the class of math module can not load to classloader in the datanode.
> it will cause class not found exception.
> the work around is package all mahout classes to one package manually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-368) should package core ,math and
collections to one Jar package for hadoop recommendations
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854447#action_12854447 ]
Sean Owen commented on MAHOUT-368:
----------------------------------
The .job file is used with Hadoop, not Maven.
To use Mahout in Maven, just reference it as a dependency in your project pom file.
To create a .job file that has your classes as well, you would need to use the JAR tool to add the .class files to the .job file. Or maybe your Maven POM can use the same tricks we do to generate such a '.job' file.
> should package core ,math and collections to one Jar package for hadoop recommendations
> ---------------------------------------------------------------------------------------
>
> Key: MAHOUT-368
> URL: https://issues.apache.org/jira/browse/MAHOUT-368
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Fix For: 0.4
>
>
> should package core ,math and collections to one Jar package for org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.
> because RecommenderJob used classes (for example org.apache.mahout.math.VectorWritable )of the math module of mahout project,
> but math and core module is the separated jar package.
> so when work on the hadoop env ,the class of math module can not load to classloader in the datanode.
> it will cause class not found exception.
> the work around is package all mahout classes to one package manually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.