[jira] [Commented] (STORM-2075) Storm SQL Phase III

["Jungtaek Lim (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STORM-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15484071#comment-15484071 ] 

Jungtaek Lim commented on STORM-2075:
-------------------------------------

Below is Trident support for external modules.

|| module || producer || consumer ||
| Cassandra | N/A | State |
| Druid | N/A | State |
| ElasticSearch | N/A | State |
| EventHubs | Opaque/Transactional Spout | N/A |
| HBase | N/A | State |
| HDFS | N/A | State |
| Hive | N/A | State |
| JDBC | N/A | State |
| Kafka | Opaque/Transactional Spout | State |
| Kafka-Client (New) | N/A | N/A |
| Kinesis | N/A | N/A |
| Mongo | N/A | State |
| MQTT | N/A | BaseFunction |
| OpenTSDB | N/A | State |
| Redis | N/A | State |
| Solr | N/A | State |

Btw, I found that storm-sql-kafka provides BaseFunction via State. To maximize performance we should support State directly.

> Storm SQL Phase III
> -------------------
>
>                 Key: STORM-2075
>                 URL: https://issues.apache.org/jira/browse/STORM-2075
>             Project: Apache Storm
>          Issue Type: Epic
>          Components: storm-sql
>            Reporter: Jungtaek Lim
>
> This epic tracks the effort of the phase III development of StormSQL.
> For now Storm SQL only supports Kafka as a data source, which is limited for normal use cases. We would need to support others as well. Candidates are external modules.
> And also consider supporting State since Trident provides a way to set / get in batch manner to only State. Current way (each) does insert a row 1 by 1.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)