You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Yash Sharma <ya...@gmail.com> on 2017/09/29 02:25:11 UTC

[Streaming] Requesting more Committers for Spark-Kinesis integration

Hi Fellow Spark developers/ PMC Members,
I am a new member of the community and have started my tiny contributions
to Spark-Kinesis Integration. I am trying to fill in the gaps in making
spark operate with Kinesis as nicely as Kafka.

I am writing this mail to highlight an issue with the kinesis module in the
Spark external modules [1]. I've started working on the improvements since
April 2017 [2]. The PR's take a long time getting reviewed, and since its a
small module we do not have enough committers with knowledge of the working
of the module. Currently its only 2 people @budde <https://github.com/budde>
 @brkyvz <https://github.com/brkyvz> who are able to help me out with the
PR's, @brkyvz being the only committer. I would request adding more
committers to the module and we can have more and frequent iterations on
the PR's.

I believe @budde has a great knowledge of the internals of the module and
would make a good fit for the role. Meanwhile I would start reviewing more
PR's on this module to help out other contributors.

I understand that this coming from a new contributor might sound silly but
I felt this problem should be highlighted.

Best Regards,
Yash



1.
https://github.com/yssharma/spark/tree/cef5cdece2bd2a7c95e19493c511d602c1b46461/external/kinesis-asl
2.
http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-Kinesis-integration-needs-improvements-td21272.html