You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/04/02 06:48:42 UTC
[jira] [Commented] (FLINK-4676) Merge flink-batch-connectors and
flink-streaming-connectors modules
[ https://issues.apache.org/jira/browse/FLINK-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952558#comment-15952558 ]
ASF GitHub Bot commented on FLINK-4676:
---------------------------------------
Github user prabhu1984 commented on the issue:
https://github.com/apache/flink/pull/2897
Hi @fhueske,
Can you please post some simple example on how to read a Hive table on flink through flink-hcatalog connector?
Thanks
Prabhu
> Merge flink-batch-connectors and flink-streaming-connectors modules
> -------------------------------------------------------------------
>
> Key: FLINK-4676
> URL: https://issues.apache.org/jira/browse/FLINK-4676
> Project: Flink
> Issue Type: Task
> Components: Batch Connectors and Input/Output Formats, Build System, Streaming Connectors
> Affects Versions: 1.2.0
> Reporter: Fabian Hueske
> Assignee: Fabian Hueske
> Priority: Minor
> Fix For: 1.2.0
>
>
> We have two separate Maven modules for batch and streaming connectors (flink-batch-connectors and flink-streaming-connectors) that contain modules for the individual external systems and storage formats such as HBase, Cassandra, Avro, Elasticsearch, etc.
> Some of these systems can be used in streaming as well as batch jobs as for instance HBase, Cassandra, and Elasticsearch.
> However, due to the separate main modules for streaming and batch connectors, we currently need to decide where to put a connector.
> For example, the flink-connector-cassandra module is located in flink-streaming-connectors but includes a CassandraInputFormat and CassandraOutputFormat (i.e., a batch source and sink).
> This issue is about merging flink-batch-connectors and flink-streaming-connectors into a joint flink-connectors module.
> Names of moved modules should not be changed (although this leads to an inconsistent naming scheme: flink-connector-cassandra vs. flink-hbase) to keep the change of code structure transparent to users.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)