You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/04/02 06:48:42 UTC

[jira] [Commented] (FLINK-4676) Merge flink-batch-connectors and flink-streaming-connectors modules

    [ https://issues.apache.org/jira/browse/FLINK-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952558#comment-15952558 ] 

ASF GitHub Bot commented on FLINK-4676:
---------------------------------------

Github user prabhu1984 commented on the issue:

    https://github.com/apache/flink/pull/2897
  
    Hi @fhueske, 
    
    Can you please post some simple example on how to read a Hive table on flink through flink-hcatalog connector?
    
    Thanks
    Prabhu
    



> Merge flink-batch-connectors and flink-streaming-connectors modules
> -------------------------------------------------------------------
>
>                 Key: FLINK-4676
>                 URL: https://issues.apache.org/jira/browse/FLINK-4676
>             Project: Flink
>          Issue Type: Task
>          Components: Batch Connectors and Input/Output Formats, Build System, Streaming Connectors
>    Affects Versions: 1.2.0
>            Reporter: Fabian Hueske
>            Assignee: Fabian Hueske
>            Priority: Minor
>             Fix For: 1.2.0
>
>
> We have two separate Maven modules for batch and streaming connectors (flink-batch-connectors and flink-streaming-connectors) that contain modules for the individual external systems and storage formats such as HBase, Cassandra, Avro, Elasticsearch, etc.
> Some of these systems can be used in streaming as well as batch jobs as for instance HBase, Cassandra, and Elasticsearch. 
> However, due to the separate main modules for streaming and batch connectors, we currently need to decide where to put a connector. 
> For example, the flink-connector-cassandra module is located in flink-streaming-connectors but includes a CassandraInputFormat and CassandraOutputFormat (i.e., a batch source and sink).
> This issue is about merging flink-batch-connectors and flink-streaming-connectors into a joint flink-connectors module.
> Names of moved modules should not be changed (although this leads to an inconsistent naming scheme: flink-connector-cassandra vs. flink-hbase) to keep the change of code structure transparent to users. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)