You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Hui Wen Han (JIRA)" <ji...@apache.org> on 2010/08/11 18:24:18 UTC
[jira] Created: (MAHOUT-463) Boolean Data can not get any
recommendation by run RecommnenderJob
Boolean Data can not get any recommendation by run RecommnenderJob
------------------------------------------------------------------
Key: MAHOUT-463
URL: https://issues.apache.org/jira/browse/MAHOUT-463
Project: Mahout
Issue Type: Test
Components: Collaborative Filtering
Affects Versions: 0.4
Reporter: Hui Wen Han
Fix For: 0.4
Boolean Preference Data can not get any recommendation by run RecommnenderJob,
but It can get data using the build in about Aprl.
It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897655#action_12897655 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
Setting the prefValue to 0 obviously won't work, setting it to 1 is the right thing to do.
It is not true that DistributedUncenteredZeroAssumingCosineVectorSimilarity always gives 1 for boolean data, have a look at line 27 in org.apache.mahout.math.hadoop.similarity.vector.DistributedUncenteredZeroAssumingCosineVectorSimilarityTest if you need a proof.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897624#action_12897624 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
Extended the patch to make PrefsToItemUserMatrixMapper ignore preferenceValues contained in the input when "--booleanData" is set to true. This is available as an option for ItemSimilarityJob now too.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897662#action_12897662 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
/**
* distributed implementation of cosine similarity that does not center its data
*/
public class DistributedUncenteredCosineVectorSimilarity extends AbstractDistributedVectorSimilarity {
@Override
protected double doComputeResult(int rowA, int rowB, Iterable<Cooccurrence> cooccurrences, double weightOfVectorA,
double weightOfVectorB, int numberOfColumns) {
int n = 0;
double sumXY = 0.0;
double sumX2 = 0.0;
double sumY2 = 0.0;
for (Cooccurrence cooccurrence : cooccurrences) {
double x = cooccurrence.getValueA();
double y = cooccurrence.getValueB();
sumXY += x * y;
sumX2 += x * x;
sumY2 += y * y;
n++;
}
if (n == 0) {
return Double.NaN;
}
double denominator = Math.sqrt(sumX2) * Math.sqrt(sumY2);
if (denominator == 0.0) {
// One or both vectors has -all- the same values;
// can't really say much similarity under this measure
return Double.NaN;
}
return sumXY / denominator;
}
}
this one will always return 1.0
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (MAHOUT-463) Boolean Data can not get
any recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897678#action_12897678 ]
Hui Wen Han edited comment on MAHOUT-463 at 8/12/10 6:31 AM:
-------------------------------------------------------------
Sorry DistributedUncenteredZeroAssumingCosineVectorSimilarity does not always return 1.
If n users like ItemA, m users like ItemB,p users like both ItemA and ItemB,
DistributedUncenteredZeroAssumingCosineVectorSimilarity return p/(m*n).
it also can use for Boolean data, but we can provide a simple one , return (p*p)/(m*n),no so much computing.
was (Author: huiwenhan):
Sorry DistributedUncenteredZeroAssumingCosineVectorSimilarity does not always return 1.
If n users like ItemA, m users like ItemB,p users like both ItemA and ItemB,
DistributedUncenteredZeroAssumingCosineVectorSimilarity return p/m*n.
it also can use for Boolean data, but we can provide a simple one , return p*p/m*n,no so much computing.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897601#action_12897601 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
in Classs PrefsToItemUserMatrixMapper:
public class PrefsToItemUserMatrixMapper
extends Mapper<LongWritable,Text,VarIntWritable,DistributedRowMatrix.MatrixEntryWritable> {
@Override
protected void map(LongWritable key, Text value, Context ctx)
throws IOException, InterruptedException {
String[] tokens = TasteHadoopUtils.splitPrefTokens(value.toString());
long userID = Long.parseLong(tokens[0]);
long itemID = Long.parseLong(tokens[1]);
float prefValue = tokens.length > 2 ? Float.parseFloat(tokens[2]) : 1.0f;
int row = TasteHadoopUtils.idToIndex(itemID);
int column = TasteHadoopUtils.idToIndex(userID);
DistributedRowMatrix.MatrixEntryWritable entry = new DistributedRowMatrix.MatrixEntryWritable();
entry.setRow(row);
entry.setCol(column);
entry.setVal(prefValue);
ctx.write(new VarIntWritable(row), entry);
}
}
if it's boolean data ,also need set prefValue =1.0f
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (MAHOUT-463) Boolean Data can not get
any recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897327#action_12897327 ]
Hui Wen Han edited comment on MAHOUT-463 at 8/11/10 12:59 PM:
--------------------------------------------------------------
I have tried SIMILARITY_COOCCURRENCE and SIMILARITY_TANIMOTO_COEFFICIENT
all preference has same prefValue 1.0f
was (Author: huiwenhan):
I have tried SIMILARITY_COOCCURRENCE and SIMILARITY_TANIMOTO_COEFFICIENT
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897665#action_12897665 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
Yes, this one will return 1 but thats not the one you previously mentioned.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (MAHOUT-463) Boolean Data can not get
any recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897601#action_12897601 ]
Hui Wen Han edited comment on MAHOUT-463 at 8/12/10 3:13 AM:
-------------------------------------------------------------
in Classs PrefsToItemUserMatrixMapper:
public class PrefsToItemUserMatrixMapper
extends Mapper<LongWritable,Text,VarIntWritable,DistributedRowMatrix.MatrixEntryWritable> {
@Override
protected void map(LongWritable key, Text value, Context ctx)
throws IOException, InterruptedException {
String[] tokens = TasteHadoopUtils.splitPrefTokens(value.toString());
long userID = Long.parseLong(tokens[0]);
long itemID = Long.parseLong(tokens[1]);
float prefValue = tokens.length > 2 ? Float.parseFloat(tokens[2]) : 1.0f;
int row = TasteHadoopUtils.idToIndex(itemID);
int column = TasteHadoopUtils.idToIndex(userID);
DistributedRowMatrix.MatrixEntryWritable entry = new DistributedRowMatrix.MatrixEntryWritable();
entry.setRow(row);
entry.setCol(column);
entry.setVal(prefValue);
ctx.write(new VarIntWritable(row), entry);
}
}
if it's boolean data ,also need set prefValue =1.0f
was (Author: huiwenhan):
in Classs PrefsToItemUserMatrixMapper:
public class PrefsToItemUserMatrixMapper
extends Mapper<LongWritable,Text,VarIntWritable,DistributedRowMatrix.MatrixEntryWritable> {
@Override
protected void map(LongWritable key, Text value, Context ctx)
throws IOException, InterruptedException {
String[] tokens = TasteHadoopUtils.splitPrefTokens(value.toString());
long userID = Long.parseLong(tokens[0]);
long itemID = Long.parseLong(tokens[1]);
float prefValue = tokens.length > 2 ? Float.parseFloat(tokens[2]) : 1.0f;
int row = TasteHadoopUtils.idToIndex(itemID);
int column = TasteHadoopUtils.idToIndex(userID);
DistributedRowMatrix.MatrixEntryWritable entry = new DistributedRowMatrix.MatrixEntryWritable();
entry.setRow(row);
entry.setCol(column);
entry.setVal(prefValue);
ctx.write(new VarIntWritable(row), entry);
}
}
if it's boolean data ,also need set prefValue =1.0f
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897664#action_12897664 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
/**
* Licensed to the Apache Software Foundation (ASF) under one or more
* contributor license agreements. See the NOTICE file distributed with
* this work for additional information regarding copyright ownership.
* The ASF licenses this file to You under the Apache License, Version 2.0
* (the "License"); you may not use this file except in compliance with
* the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
package org.apache.mahout.math.hadoop.similarity.vector;
import org.apache.mahout.math.hadoop.similarity.Cooccurrence;
/**
* distributed implementation of euclidean distance as vector similarity measure
*/
public class DistributedEuclideanDistanceVectorSimilarity extends AbstractDistributedVectorSimilarity {
@Override
protected double doComputeResult(int rowA, int rowB, Iterable<Cooccurrence> cooccurrences, double weightOfVectorA,
double weightOfVectorB, int numberOfColumns) {
double n = 0.0;
double sumXYdiff2 = 0.0;
for (Cooccurrence cooccurrence : cooccurrences) {
double diff = cooccurrence.getValueA() - cooccurrence.getValueB();
sumXYdiff2 += diff * diff;
n++;
}
return n / (1.0 + Math.sqrt(sumXYdiff2));
}
}
this one is always return n (=cooccurrence.size())
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved MAHOUT-463.
------------------------------
Assignee: Sean Owen
Resolution: Fixed
Submitted Sebastian's patch as it seemed reasonable and he's reporting success.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Han Hui Wen
> Assignee: Sean Owen
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897604#action_12897604 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
I see the point in your last comment, you want to be able to give the job input with preference values and to make it treat that as if it were just boolean.
That's a good idea and I will add that to the patch, but it doesn't explain why there was no recommendation output for you.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897344#action_12897344 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
Can you provide more details please?
How did your input data look like?
With what parameters did you run the job?
Did you encounter exceptions or unexpected output?
What was the resulting data and what did you expect?
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (MAHOUT-463) Boolean Data can not get
any recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897604#action_12897604 ]
Sebastian Schelter edited comment on MAHOUT-463 at 8/12/10 3:30 AM:
--------------------------------------------------------------------
I see the point in your last comment, you want to be able to give the job input with preference values and make it treat that as if the input was just boolean.
That's a good idea and I will add that to the patch, but it doesn't explain why there was no recommendation output for you.
was (Author: ssc):
I see the point in your last comment, you want to be able to give the job input with preference values and to make it treat that as if it were just boolean.
That's a good idea and I will add that to the patch, but it doesn't explain why there was no recommendation output for you.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897667#action_12897667 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
For boolean data:
If n users like ItemA, m users like ItemB,p users like both ItemA and ItemB,
then the similarityValue can simply set set to p/(m+n-p).
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897636#action_12897636 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
Because I set the prefValue=0 for Boolean Data ,
it may cause all similarityValue =0.
If we set the prefValue=1.0f for boolean data,
similarityValue of DistributedUncenteredZeroAssumingCosineVectorSimilarity will be 1.0
other arithmetic also set similarityValue to 1.0
So the RowSimilarityJob does not make sense.
Maybe we need new similarity arithmetic for boolean data.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897675#action_12897675 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
In Class AbstractDistributedVectorSimilarity
/**
* computes the number of elements in the {@link Iterator}
*/
protected int countElements(Iterator<?> iterator) {
int count = 0;
while (iterator.hasNext()) {
count++;
iterator.next();
}
return count;
}
countElements may cause performance issue,
Can we change it to array or list ,then we just get the length of array or size of list ?
also change some mapper and reducer class to use array or list ?
I am doing a test , the RowSimilarityJob-CooccurrencesMapper-SimilarityReducer used about 2 hours,
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897672#action_12897672 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
Thanks, Boolean data should use DistributedTanimotoCoefficientVectorSimilarity .
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897670#action_12897670 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
Yes, that is what DistributedTanimotoCoefficientVectorSimilarity is doing
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897585#action_12897585 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
Attached a patch that provides a unit test for recommending from boolean input data and correctly excludes already known items in this case.
Hui, if you apply the patch and have a look a org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest.testCompleteJobBoolean() you should see that boolean recommendations work.
Maybe there's something with your input data?
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Schelter updated MAHOUT-463:
--------------------------------------
Attachment: MAHOUT-463.patch
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Ted Dunning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897385#action_12897385 ]
Ted Dunning commented on MAHOUT-463:
------------------------------------
This is still not enough information for anybody to help you.
Can you say more about your input data? What did you expect to see?
How parse was the data? How large?
What command did you use to run the program?
Are you sure that the input data was where you thought? How do you know?
Are you sure you looked in the right place for the the output data? How do you know?
{quote}
but It can get data using the build in about Aprl.
{quote}
Also, what did you mean by this? Is Aprl = April? Does build = Mahout?
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (MAHOUT-463) Boolean Data can not get
any recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897585#action_12897585 ]
Sebastian Schelter edited comment on MAHOUT-463 at 8/12/10 1:57 AM:
--------------------------------------------------------------------
Attached a patch that provides a unit test for recommending from boolean input data and correctly excludes already known items in this case.
Hui, if you apply the patch and have a look a org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest.testCompleteJobBoolean() you should see that boolean recommendations work.
Maybe there's something wrong with your input data?
was (Author: ssc):
Attached a patch that provides a unit test for recommending from boolean input data and correctly excludes already known items in this case.
Hui, if you apply the patch and have a look a org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest.testCompleteJobBoolean() you should see that boolean recommendations work.
Maybe there's something with your input data?
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897683#action_12897683 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
If you want to propose alternative implementations for similarity measures please create a new ticket for that too and provide a patch containing the implementation.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (MAHOUT-463) Boolean Data can not get
any recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897678#action_12897678 ]
Hui Wen Han edited comment on MAHOUT-463 at 8/12/10 6:31 AM:
-------------------------------------------------------------
Sorry DistributedUncenteredZeroAssumingCosineVectorSimilarity does not always return 1.
If n users like ItemA, m users like ItemB,p users like both ItemA and ItemB,
DistributedUncenteredZeroAssumingCosineVectorSimilarity return p/m*n.
it also can use for Boolean data, but we can provide a simple one , return p*p/m*n,no so much computing.
was (Author: huiwenhan):
Sorry DistributedUncenteredZeroAssumingCosineVectorSimilarity does not always return 1.
If n users like ItemA, m users like ItemB,p users like both ItemA and ItemB,
DistributedUncenteredZeroAssumingCosineVectorSimilarity return (p*p)/m*n.
it also can use for Boolean data, but we can provide a simple one ,no so much computing.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hui Wen Han updated MAHOUT-463:
-------------------------------
Summary: Boolean Data can not get any recommendation by running RecommnenderJob (was: Boolean Data can not get any recommendation by run RecommnenderJob)
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (MAHOUT-463) Boolean Data can not get
any recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897664#action_12897664 ]
Hui Wen Han edited comment on MAHOUT-463 at 8/12/10 6:04 AM:
-------------------------------------------------------------
package org.apache.mahout.math.hadoop.similarity.vector;
import org.apache.mahout.math.hadoop.similarity.Cooccurrence;
/**
* distributed implementation of euclidean distance as vector similarity measure
*/
public class DistributedEuclideanDistanceVectorSimilarity extends AbstractDistributedVectorSimilarity {
@Override
protected double doComputeResult(int rowA, int rowB, Iterable<Cooccurrence> cooccurrences, double weightOfVectorA,
double weightOfVectorB, int numberOfColumns) {
double n = 0.0;
double sumXYdiff2 = 0.0;
for (Cooccurrence cooccurrence : cooccurrences) {
double diff = cooccurrence.getValueA() - cooccurrence.getValueB();
sumXYdiff2 += diff * diff;
n++;
}
return n / (1.0 + Math.sqrt(sumXYdiff2));
}
}
this one is always return n (=cooccurrence.size())
was (Author: huiwenhan):
/**
* Licensed to the Apache Software Foundation (ASF) under one or more
* contributor license agreements. See the NOTICE file distributed with
* this work for additional information regarding copyright ownership.
* The ASF licenses this file to You under the Apache License, Version 2.0
* (the "License"); you may not use this file except in compliance with
* the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
package org.apache.mahout.math.hadoop.similarity.vector;
import org.apache.mahout.math.hadoop.similarity.Cooccurrence;
/**
* distributed implementation of euclidean distance as vector similarity measure
*/
public class DistributedEuclideanDistanceVectorSimilarity extends AbstractDistributedVectorSimilarity {
@Override
protected double doComputeResult(int rowA, int rowB, Iterable<Cooccurrence> cooccurrences, double weightOfVectorA,
double weightOfVectorB, int numberOfColumns) {
double n = 0.0;
double sumXYdiff2 = 0.0;
for (Cooccurrence cooccurrence : cooccurrences) {
double diff = cooccurrence.getValueA() - cooccurrence.getValueB();
sumXYdiff2 += diff * diff;
n++;
}
return n / (1.0 + Math.sqrt(sumXYdiff2));
}
}
this one is always return n (=cooccurrence.size())
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897678#action_12897678 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
Sorry DistributedUncenteredZeroAssumingCosineVectorSimilarity does not always return 1.
If n users like ItemA, m users like ItemB,p users like both ItemA and ItemB,
DistributedUncenteredZeroAssumingCosineVectorSimilarity return (p*p)/m*n.
it also can use for Boolean data, but we can provide a simple one ,no so much computing.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897682#action_12897682 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
Hui, please file a new jira ticket for your concerns about AbstractDistributedVectorSimilarity. It's something completely different then the original cause for that ticket here.
Additionally please provide detailed information about why you consider this a performance issue.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by run RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897327#action_12897327 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
I have tried SIMILARITY_COOCCURRENCE and SIMILARITY_TANIMOTO_COEFFICIENT
> Boolean Data can not get any recommendation by run RecommnenderJob
> ------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897369#action_12897369 ]
Hui Wen Han commented on MAHOUT-463:
------------------------------------
The data is boolean Data that the prefValue is null,
I run the RecommenderJob used --booleanData = true.
there is no error and exception.
RowSimilarityJob does not output any data.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898452#action_12898452 ]
Hudson commented on MAHOUT-463:
-------------------------------
Integrated in Mahout-Quality #186 (See [http://hudson.zones.apache.org/hudson/job/Mahout-Quality/186/])
MAHOUT-463
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Han Hui Wen
> Assignee: Sean Owen
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897390#action_12897390 ]
Sebastian Schelter commented on MAHOUT-463:
-------------------------------------------
I wrote a small unit test and I encountered quite the opposite behavior as described by Hui.
When using boolean data the already known items were not filtered out. I will create a patch for this soon. But the rest of the recommendation process worked.
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-463) Boolean Data can not get any
recommendation by running RecommnenderJob
Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Schelter updated MAHOUT-463:
--------------------------------------
Attachment: MAHOUT-463-2.patch
> Boolean Data can not get any recommendation by running RecommnenderJob
> ----------------------------------------------------------------------
>
> Key: MAHOUT-463
> URL: https://issues.apache.org/jira/browse/MAHOUT-463
> Project: Mahout
> Issue Type: Test
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Fix For: 0.4
>
> Attachments: MAHOUT-463-2.patch, MAHOUT-463.patch
>
>
> Boolean Preference Data can not get any recommendation by run RecommnenderJob,
> but It can get data using the build in about Aprl.
> It seems that it can not get any data by running RowSimilarityJob
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.