You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2010/03/23 04:55:27 UTC

[jira] Created: (CASSANDRA-913) Add Hive support for Cassandra

Add Hive support for Cassandra
------------------------------

                 Key: CASSANDRA-913
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-913
             Project: Cassandra
          Issue Type: New Feature
          Components: Contrib
            Reporter: Jonathan Ellis


Hive is a project that runs SQL queries against Hadoop map/reduce clusters.  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.

The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.

I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (CASSANDRA-913) Add Hive support

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis resolved CASSANDRA-913.
--------------------------------------

    Resolution: Duplicate

closing in favor of HIVE-1434

> Add Hive support
> ----------------
>
>                 Key: CASSANDRA-913
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-913
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Contrib
>            Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters.  (For analytics; it is too high-latency to run applications against Hive directly).  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-913) Add Hive support

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856291#action_12856291 ] 

John Sichi commented on CASSANDRA-913:
--------------------------------------

Regarding HIVE-705, all files under hbase-handler constitute the HBase support, and the rest is Hive infrastructure refactoring, so you can use that split for reviewing them separately.


> Add Hive support
> ----------------
>
>                 Key: CASSANDRA-913
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-913
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Contrib
>            Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters.  (For analytics; it is too high-latency to run applications against Hive directly).  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (CASSANDRA-913) Add Hive support

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-913:
-------------------------------------

    Description: 
http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters.  (For analytics; it is too high-latency to run applications against Hive directly).  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.

The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.

I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

  was:
Hive is a project that runs SQL queries against Hadoop map/reduce clusters.  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.

The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.

I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

        Summary: Add Hive support  (was: Add Hive support for Cassandra)

> Add Hive support
> ----------------
>
>                 Key: CASSANDRA-913
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-913
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Contrib
>            Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters.  (For analytics; it is too high-latency to run applications against Hive directly).  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-913) Add Hive support

Posted by "p shirish reddy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857201#action_12857201 ] 

p shirish reddy commented on CASSANDRA-913:
-------------------------------------------

I have submitted the proposal for the same as a part of GSOC project. The link to the proposal is http://socghop.appspot.com/gsoc/student_proposal/private/google/gsoc2010/shirish_reddy_89/t127072582147. I'd like suggestions and comments.


> Add Hive support
> ----------------
>
>                 Key: CASSANDRA-913
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-913
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Contrib
>            Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters.  (For analytics; it is too high-latency to run applications against Hive directly).  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (CASSANDRA-913) Add Hive support

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856294#action_12856294 ] 

Jonathan Ellis commented on CASSANDRA-913:
------------------------------------------

Awesome, thanks for pointing that out!

> Add Hive support
> ----------------
>
>                 Key: CASSANDRA-913
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-913
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Contrib
>            Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters.  (For analytics; it is too high-latency to run applications against Hive directly).  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (CASSANDRA-913) Add Hive support

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851442#action_12851442 ] 

Jonathan Ellis commented on CASSANDRA-913:
------------------------------------------

Starting points:

The Cassandra inputformat for Hadoop is in org.apache.cassandra.hadoop.ColumnFamilyInputFormat; the record reader and input split are in the same package.  There's an example of using these in contrib/word_count, and Pig integration in contrib/pig.

You can look at the .7 patch to HIVE-705 to see how HBase support was added.  Unfortunately this is not split into "Hive infrastructure refactoring" and "HBase support," they are all mixed in together.

> Add Hive support
> ----------------
>
>                 Key: CASSANDRA-913
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-913
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Contrib
>            Reporter: Jonathan Ellis
>
> http://hadoop.apache.org/hive/ is a project that runs SQL queries against Hadoop map/reduce clusters.  (For analytics; it is too high-latency to run applications against Hive directly).  HIVE-705 added support for backends other than HDFS, with HBase as the first.  Cassandra support should be doable too now.
> The Hive storage backends are described in http://wiki.apache.org/hadoop/Hive/StorageHandlers and the HBase backend specifically in http://wiki.apache.org/hadoop/Hive/HBaseIntegration.
> I also note that John Sichi, author of the HBase backend, seems like a helpful guy and I imagine would be totally cool with answering questions about implementation details.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.