You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Isabel Drost (JIRA)" <ji...@apache.org> on 2009/09/04 18:11:57 UTC

[jira] Created: (MAHOUT-172) When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs

When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs
---------------------------------------------------------------------------------------------------------------------------------

                 Key: MAHOUT-172
                 URL: https://issues.apache.org/jira/browse/MAHOUT-172
             Project: Mahout
          Issue Type: Bug
          Components: Clustering
    Affects Versions: 0.1
            Reporter: Isabel Drost
             Fix For: 0.2


I tried running the reuters example of lda on a hadoop cluster today. Seems like the implementation tries to read all files in output/state-* which fails if in that directory "_logs" is found.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAHOUT-172) When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs

Posted by "Isabel Drost (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12754692#action_12754692 ] 

Isabel Drost commented on MAHOUT-172:
-------------------------------------

Committing on Monday.

> When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-172
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-172
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.1
>            Reporter: Isabel Drost
>            Assignee: Isabel Drost
>             Fix For: 0.2
>
>         Attachments: lda.patch
>
>
> I tried running the reuters example of lda on a hadoop cluster today. Seems like the implementation tries to read all files in output/state-* which fails if in that directory "_logs" is found.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAHOUT-172) When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs

Posted by "David Hall (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12754588#action_12754588 ] 

David Hall commented on MAHOUT-172:
-----------------------------------

Sorry, just noticed this issue!

Looks good to me.

-- David

> When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-172
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-172
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.1
>            Reporter: Isabel Drost
>             Fix For: 0.2
>
>         Attachments: lda.patch
>
>
> I tried running the reuters example of lda on a hadoop cluster today. Seems like the implementation tries to read all files in output/state-* which fails if in that directory "_logs" is found.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAHOUT-172) When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs

Posted by "Isabel Drost (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Isabel Drost updated MAHOUT-172:
--------------------------------

    Attachment: lda.patch

The patch extends the url pattern to not match everything in the output directory but only stuff that starts with part* - since the lda job seems to run fine for me.

> When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-172
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-172
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.1
>            Reporter: Isabel Drost
>             Fix For: 0.2
>
>         Attachments: lda.patch
>
>
> I tried running the reuters example of lda on a hadoop cluster today. Seems like the implementation tries to read all files in output/state-* which fails if in that directory "_logs" is found.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (MAHOUT-172) When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs

Posted by "Isabel Drost (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Isabel Drost reassigned MAHOUT-172:
-----------------------------------

    Assignee: Isabel Drost

> When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-172
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-172
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.1
>            Reporter: Isabel Drost
>            Assignee: Isabel Drost
>             Fix For: 0.2
>
>         Attachments: lda.patch
>
>
> I tried running the reuters example of lda on a hadoop cluster today. Seems like the implementation tries to read all files in output/state-* which fails if in that directory "_logs" is found.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (MAHOUT-172) When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs

Posted by "Isabel Drost (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Isabel Drost resolved MAHOUT-172.
---------------------------------

    Resolution: Fixed

fixed in revision 814495

> When running on a Hadoop cluster LDA fails with Caused by: java.io.IOException: Cannot open filename /user/*/output/state-*/_logs
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-172
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-172
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.1
>            Reporter: Isabel Drost
>            Assignee: Isabel Drost
>             Fix For: 0.2
>
>         Attachments: lda.patch
>
>
> I tried running the reuters example of lda on a hadoop cluster today. Seems like the implementation tries to read all files in output/state-* which fails if in that directory "_logs" is found.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.