You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2010/03/23 04:55:27 UTC
[jira] Created: (CASSANDRA-913) Add Hive support for Cassandra
Add Hive support for Cassandra
------------------------------
Key: CASSANDRA-913
URL: https://issues.apache.org/jira/browse/CASSANDRA-913
Project: Cassandra
Issue Type: New Feature
Components: Contrib
Reporter: Jonathan Ellis
Hive is a project that runs SQL queries against Hadoop map/reduce clusters. HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (CASSANDRA-913) Add Hive support
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-913.
--------------------------------------
Resolution: Duplicate
closing in favor of HIVE-1434
> Add Hive support
> ----------------
>
> Key: CASSANDRA-913
> URL: https://issues.apache.org/jira/browse/CASSANDRA-913
> Project: Cassandra
> Issue Type: New Feature
> Components: Contrib
> Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters. (For analytics; it is too high-latency to run applications against Hive directly). HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-913) Add Hive support
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856291#action_12856291 ]
John Sichi commented on CASSANDRA-913:
--------------------------------------
Regarding HIVE-705, all files under hbase-handler constitute the HBase support, and the rest is Hive infrastructure refactoring, so you can use that split for reviewing them separately.
> Add Hive support
> ----------------
>
> Key: CASSANDRA-913
> URL: https://issues.apache.org/jira/browse/CASSANDRA-913
> Project: Cassandra
> Issue Type: New Feature
> Components: Contrib
> Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters. (For analytics; it is too high-latency to run applications against Hive directly). HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CASSANDRA-913) Add Hive support
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-913:
-------------------------------------
Description:
http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters. (For analytics; it is too high-latency to run applications against Hive directly). HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
was:
Hive is a project that runs SQL queries against Hadoop map/reduce clusters. HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
Summary: Add Hive support (was: Add Hive support for Cassandra)
> Add Hive support
> ----------------
>
> Key: CASSANDRA-913
> URL: https://issues.apache.org/jira/browse/CASSANDRA-913
> Project: Cassandra
> Issue Type: New Feature
> Components: Contrib
> Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters. (For analytics; it is too high-latency to run applications against Hive directly). HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-913) Add Hive support
Posted by "p shirish reddy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857201#action_12857201 ]
p shirish reddy commented on CASSANDRA-913:
-------------------------------------------
I have submitted the proposal for the same as a part of GSOC project. The link to the proposal is http://socghop.appspot.com/gsoc/student_proposal/private/google/gsoc2010/shirish_reddy_89/t127072582147. I'd like suggestions and comments.
> Add Hive support
> ----------------
>
> Key: CASSANDRA-913
> URL: https://issues.apache.org/jira/browse/CASSANDRA-913
> Project: Cassandra
> Issue Type: New Feature
> Components: Contrib
> Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters. (For analytics; it is too high-latency to run applications against Hive directly). HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CASSANDRA-913) Add Hive support
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856294#action_12856294 ]
Jonathan Ellis commented on CASSANDRA-913:
------------------------------------------
Awesome, thanks for pointing that out!
> Add Hive support
> ----------------
>
> Key: CASSANDRA-913
> URL: https://issues.apache.org/jira/browse/CASSANDRA-913
> Project: Cassandra
> Issue Type: New Feature
> Components: Contrib
> Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters. (For analytics; it is too high-latency to run applications against Hive directly). HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CASSANDRA-913) Add Hive support
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851442#action_12851442 ]
Jonathan Ellis commented on CASSANDRA-913:
------------------------------------------
Starting points:
The Cassandra inputformat for Hadoop is in org.apache.cassandra.hadoop.ColumnFamilyInputFormat; the record reader and input split are in the same package. There's an example of using these in contrib/word_count, and Pig integration in contrib/pig.
You can look at the .7 patch to HIVE-705 to see how HBase support was added. Unfortunately this is not split into "Hive infrastructure refactoring" and "HBase support," they are all mixed in together.
> Add Hive support
> ----------------
>
> Key: CASSANDRA-913
> URL: https://issues.apache.org/jira/browse/CASSANDRA-913
> Project: Cassandra
> Issue Type: New Feature
> Components: Contrib
> Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters. (For analytics; it is too high-latency to run applications against Hive directly). HIVE-705 added support for backends other than HDFS, with HBase as the first. Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.