You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/11/07 15:14:01 UTC

[jira] [Commented] (DRILL-4779) Kafka storage plugin support

    [ https://issues.apache.org/jira/browse/DRILL-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242157#comment-16242157 ] 

ASF GitHub Bot commented on DRILL-4779:
---------------------------------------

GitHub user akumarb2010 opened a pull request:

    https://github.com/apache/drill/pull/1027

    DRILL-4779 : Kafka storage plugin

    This PR contains Kafka support with JSON message format.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/akumarb2010/incubator-drill master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/1027.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1027
    
----
commit f3397816ad07f85a08f53b964213ecf9f96b56b8
Author: Batchu <ab...@mtvl140e6a9fb.local>
Date:   2016-12-20T16:28:40Z

    Starting on kafka module

commit f5c9ff3f0863cf743e922fc6c39ccfebc4b7df4d
Author: Batchu <ab...@mtvl140e6a9fb.local>
Date:   2016-12-26T21:16:19Z

    Initial Kafka integration code

commit 8d7403f49f1acb601e6d90d1a2cb640a4df0e05c
Author: Batchu <ab...@mtvl140e6a9fb.local>
Date:   2016-12-26T23:41:05Z

    Kafka plugin src clean up

commit 08992ea73c239e8b6996436b7984e87ee12b534d
Author: Anil Kumar Batchu <ak...@gmail.com>
Date:   2016-12-26T23:45:19Z

    Initial Kafka plugin code base

commit 8ec1e187efcdd3123db03fda7c0e038503246a46
Author: Anil Kumar Batchu <ak...@gmail.com>
Date:   2017-01-08T06:07:06Z

    Initial Kafka plugin code base

commit a11af5542079b891975c95d4b2c6b562e7a61386
Author: Anil Kumar Batchu <ak...@gmail.com>
Date:   2017-01-08T06:22:12Z

    Initial Kafka plugin code base

commit e22d10e82857888e7fb9a723b7781a20d6581d69
Author: Anil Kumar Batchu <ak...@gmail.com>
Date:   2017-03-04T06:40:25Z

    Initial Kafka plugin code base issues

commit 990f479db43156dad296033ca57ee4cf0f497b69
Author: Anil Kumar Batchu <ak...@gmail.com>
Date:   2017-03-04T06:48:00Z

    Initial Kafka plugin code base issues

commit 5d565c4d843373f8c168c9255d108140677e58b0
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-04T11:00:30Z

    Updating Kafka storage plugin and its affected classes, adding schema related classes

commit aec67b863da49293d96a53d5332998ffaf890115
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-04T11:07:17Z

    Adding license

commit 84e7eaa0de6ae90244df1fb4960d97876076ffc6
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-04T11:34:40Z

    Adding bootstrap-storage-plugins.json and drill-module.conf

commit 0fa26c856996474442c2deb038226e1765c67ac4
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-04T13:18:49Z

    Cleaning pom and adding kafka-storage in bin.xml

commit 2c96e9ff9e0c68ae76e9b9b16b712b0f5a7fcea8
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-04T13:25:24Z

    fixing drill-module.conf by updating package to kafka

commit a30640c60586b12b3c4ec6a6316fc6dab84a6d3f
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-04T14:04:40Z

    fixing spelling mistakes

commit ccd8de3f86e407852ea9ce9e032caf86542ea482
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-05T09:41:15Z

    Formatting the code using Apache eclipse formatter

commit dcc018acac3cb07f2fe0d5c33a6c50c03e2ebc59
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-05T09:44:28Z

    moving Kafka schema factory to schema package

commit 2987afbcfeb47cb7d7a29643015979d293ebcc72
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-05T15:20:03Z

    Adding message format in storage plugin config

commit b6bc9c34aa7b2c9299a593e2138e0e9dc30edeb9
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-05T16:00:53Z

    updating storage-plugins.json, drill-module.conf and adding loggers

commit 97f62d43da48a284de318cd21543f03c3f10e73f
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-05T16:19:34Z

    Adding debug message

commit 30ac2ae6b623ba5279e3085549e5fa5ad2a44a23
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-03-05T16:26:53Z

    updating debug message

commit fdd84d19dcfa03913a307d041c0cdf7421095e71
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-03-05T16:29:19Z

    Adding avro support to kafka plugin

commit d301f3ee07d16800ec54316d5dd48c398c09a1ec
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-03-05T16:29:44Z

    Merge branch 'master' of https://github.com/akumarb2010/incubator-drill

commit c922ea9ea7ea31b252150f357e153f64edd8fbb5
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-03-25T18:16:05Z

    Adding avro support to kafka plugin DRILL-4779

commit d00aa38cf51bec1dcdefa7f6e44f918ce761f912
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-03-25T20:17:06Z

    KafkaRecordReader implementation DRILL-4779

commit 318ebc120bd0f2d4790a920806110db2494e1668
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-03-26T05:15:29Z

    KafkaRecordReader implementation DRILL-4779

commit 0e142a9758223761124632dc844ba8c75bca913f
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-04-02T06:33:06Z

    Adding storage config in Groupscan and fixing rat issues

commit e797a221b799a154a4c8f55a590b12b18ed9f31c
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-04-02T06:43:12Z

    Checkstyle issues

commit f700b4b1074fe7dfefc82c9895e7ad4041762d4b
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-04-02T06:43:35Z

    Merge branch 'master' of https://github.com/akumarb2010/incubator-drill

commit 686cd5367d232f1259c521341e28f048119c6648
Author: akumarb2010 <ak...@gmail.com>
Date:   2017-04-02T07:08:17Z

    Checkstyle issues

commit 3943d821169aed800b65f29db17422ee7e995328
Author: Venkata Siva Kamesh <bv...@banl141bbfbf5.local>
Date:   2017-04-03T03:45:45Z

    Fixing kafka storage registration issue

----


> Kafka storage plugin support
> ----------------------------
>
>                 Key: DRILL-4779
>                 URL: https://issues.apache.org/jira/browse/DRILL-4779
>             Project: Apache Drill
>          Issue Type: New Feature
>          Components: Storage - Other
>    Affects Versions: 1.11.0
>            Reporter: B Anil Kumar
>            Assignee: B Anil Kumar
>              Labels: doc-impacting
>             Fix For: 1.12.0
>
>
> Implement Kafka storage plugin will enable the strong SQL support for Kafka.
> Initially implementation can target for supporting text, json and avro message types



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)