[jira] [Commented] (STORM-1778) Scheme Extension Framework for KafkaDataSource and support for CSV format

["Chuanlei Ni (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STORM-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279756#comment-15279756 ] 

Chuanlei Ni commented on STORM-1778:
------------------------------------

Now KafkaDatasourcesProvider only support messages in json format while the message format is diverse in reality such as raw log text, and sometimes csv format.

We can modify the KafkaDataSourceProvider to support multiple message formats by identifying the scheme class name when defining external table. such as 

CREATE EXTERNAL TABLE Orders (xx,xxx) LOCATION xx TBLPROPERTIES '{"scheme": "org.apache.storm.sql.kafka.JsonScheme"}' 

> Scheme Extension Framework for KafkaDataSource and support for CSV format
> -------------------------------------------------------------------------
>
>                 Key: STORM-1778
>                 URL: https://issues.apache.org/jira/browse/STORM-1778
>             Project: Apache Storm
>          Issue Type: Improvement
>          Components: storm-sql
>            Reporter: Chuanlei Ni
>            Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)