You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Stephen Chu (JIRA)" <ji...@apache.org> on 2012/06/06 09:55:22 UTC
[jira] [Created] (BIGTOP-611) Add HBase TestImportTsv
Stephen Chu created BIGTOP-611:
----------------------------------
Summary: Add HBase TestImportTsv
Key: BIGTOP-611
URL: https://issues.apache.org/jira/browse/BIGTOP-611
Project: Bigtop
Issue Type: Test
Components: Tests
Reporter: Stephen Chu
Assignee: Stephen Chu
Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated BIGTOP-611:
-------------------------------
Attachment: (was: BIGTOP-611.patch)
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290452#comment-13290452 ]
Roman Shaposhnik commented on BIGTOP-611:
-----------------------------------------
Stephen, thanks a lot for following up on this. I believe we can totally do the Maven property thing.
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Wing Yew Poon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290275#comment-13290275 ]
Wing Yew Poon commented on BIGTOP-611:
--------------------------------------
We need permission to use MovieLens data.
Lacking that permission, we should use different data.
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
> Attachments: BIGTOP-611.patch
>
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Wing Yew Poon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wing Yew Poon updated BIGTOP-611:
---------------------------------
Assignee: Wing Yew Poon (was: Stephen Chu)
The psv file came from MovieLens. I can't remember which size download I got it from. It is the list of movies in the dataset. The tsv file I produced by replacing the '|' separators in the psv file with tabs.
It is simpler not to use those files. I'm going to generate new files with random data. I don't think we need to obtain any permission in that case.
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Wing Yew Poon
> Labels: test
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated BIGTOP-611:
-------------------------------
Attachment: BIGTOP-611.patch
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
> Attachments: BIGTOP-611.patch
>
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Wing Yew Poon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290298#comment-13290298 ]
Wing Yew Poon commented on BIGTOP-611:
--------------------------------------
The MovieLens README contains the usage license/conditions. It says,
"The user may not redistribute the data without separate permission."
I believe that publishing data to a public repository constitutes redistribution.
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
> Attachments: BIGTOP-611.patch
>
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290785#comment-13290785 ]
Stephen Chu commented on BIGTOP-611:
------------------------------------
I'll look into how to do the Maven property thing.
Wing Yew, where did you find the MovieLens .tsv files? I'm having trouble finding where they're hosted on the MovieLens/GroupLens websites.
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Wing Yew Poon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wing Yew Poon updated BIGTOP-611:
---------------------------------
Attachment: BIGTOP-611.txt
TestImportTsv and associated resource files.
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Wing Yew Poon
> Labels: test
> Attachments: BIGTOP-611.txt
>
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290278#comment-13290278 ]
Stephen Chu commented on BIGTOP-611:
------------------------------------
I'll ask for permission.
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
> Attachments: BIGTOP-611.patch
>
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-611) Add HBase TestImportTsv
Posted by "Johnny Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290292#comment-13290292 ]
Johnny Zhang commented on BIGTOP-611:
-------------------------------------
is this related to license ?
> Add HBase TestImportTsv
> -----------------------
>
> Key: BIGTOP-611
> URL: https://issues.apache.org/jira/browse/BIGTOP-611
> Project: Bigtop
> Issue Type: Test
> Components: Tests
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Labels: test
> Attachments: BIGTOP-611.patch
>
>
> Add a test for HBase's importtsv tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira