You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/07/25 14:48:00 UTC

[jira] [Commented] (FLINK-9833) End-to-end test: SQL Client with unified source/sink/format

    [ https://issues.apache.org/jira/browse/FLINK-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555784#comment-16555784 ] 

ASF GitHub Bot commented on FLINK-9833:
---------------------------------------

twalthr opened a new pull request #6422: [FLINK-9833] [e2e] Add a SQL Client end-to-end test with unified source/sink/format
URL: https://github.com/apache/flink/pull/6422
 
 
   ## What is the purpose of the change
   
   This PR adds a SQL Client end-to-end test with Kafka/Filesystem and Avro/JSON/CSV components. It reads JSON from Kafka, uses a UDF for transformation, writes to Kafka Avro, reads from Kafka Avro, and writes to Filesystem CSV again.
   
   It also tests the available SQL jars for correctness.
   
   ## Brief change log
   
   - End-to-end test added
   
   
   ## Verifying this change
   
   - End-to-end test added
   
   ## Does this pull request potentially affect one of the following parts:
   
     - Dependencies (does it add or upgrade a dependency): no
     - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no
     - The serializers: no
     - The runtime per-record code paths (performance sensitive): no
     - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: no
     - The S3 file system connector: no
   
   ## Documentation
   
     - Does this pull request introduce a new feature? no
     - If yes, how is the feature documented? not applicable
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> End-to-end test: SQL Client with unified source/sink/format
> -----------------------------------------------------------
>
>                 Key: FLINK-9833
>                 URL: https://issues.apache.org/jira/browse/FLINK-9833
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table API &amp; SQL
>            Reporter: Timo Walther
>            Assignee: Timo Walther
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 1.6.0
>
>
> After FLINK-8858 is resolved we can add an end-to-end test for the SQL Client. The test should perform the following steps:
> - Put JSON data into Kafka
> - Submit and execute a {{INSERT INTO}} statement that reads from a Kafka connector with JSON format, does some ETL, and writes to Kafka with Avro format
> - Validate Avro data 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)