[jira] [Work logged] (BEAM-13175) Implement missing KinesisIO.Write for aws2

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-13175?focusedWorklogId=735467&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-735467 ]

ASF GitHub Bot logged work on BEAM-13175:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 02/Mar/22 17:57
            Start Date: 02/Mar/22 17:57
    Worklog Time Spent: 10m 
      Work Description: aromanenko-dev commented on pull request #16077:
URL: https://github.com/apache/beam/pull/16077#issuecomment-1057214170


   @mosche Great progress, many thanks for details!
   
   > I'm enforcing Beam's version of Netty over the more recent one used by AWS. In my tests this worked very well.
   
   I think it should be fine.
   
   > Another change is the output type of the writer. As recommended [here](https://docs.google.com/document/d/1V2FkGGunVgvLwi1dKHr-7mtDuwYjTuvuESV_oPzVnfQ/edit?resourcekey=0-KvfQq-5iCcMlu3f3MFJ-GQ#heading=h.xl97lw3dyot7) i changed it from Void to Result to allow for future backwards compatible changes. Currently the writer is fail fast (after retries of course), but adding a deadletter output would make sense...
   
   Totally agree with that.
   
   > The next step is to provide a more powerful internal partitioner that is aware of hashkey ranges assigned to KinesisShards.
   
   Do you think it would make sense to do as a separate PR?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 735467)
    Time Spent: 8h 20m  (was: 8h 10m)

> Implement missing KinesisIO.Write for aws2
> ------------------------------------------
>
>                 Key: BEAM-13175
>                 URL: https://issues.apache.org/jira/browse/BEAM-13175
>             Project: Beam
>          Issue Type: New Feature
>          Components: io-java-aws
>            Reporter: Moritz Mack
>            Assignee: Moritz Mack
>            Priority: P2
>              Labels: aws-sdk-v2
>          Time Spent: 8h 20m
>  Remaining Estimate: 0h
>
> The Kinesis Producer library KPL isn't available for aws2. Hence, we cannot trivially port the old KinesisIO.Write over.
> But at the same time KPL also doesn't align with the ideas behind SDFs. So it's a good opportunity to implement it properly.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)