[jira] [Commented] (SAMZA-693) Add simple HDFS Producer system to Samza

["Eli Reisman (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SAMZA-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634595#comment-14634595 ] 

Eli Reisman commented on SAMZA-693:
-----------------------------------

Hey I've been reformatting the patch, refactoring the writer and compression codec to be more pluggable. I am still working through a couple issues while beefing up the unit tests, but will post the updated patch here and RB soon. I'll take a look at adding the doc too, good idea.

About issue #2 above (the fatal git error) I have been running the patches with --no-prefix to remove the first (a/... b/...) path element in the diff. I can submit the next version without removing the leading path elements if that would help?


> Add simple HDFS Producer system to Samza
> ----------------------------------------
>
>                 Key: SAMZA-693
>                 URL: https://issues.apache.org/jira/browse/SAMZA-693
>             Project: Samza
>          Issue Type: Sub-task
>          Components: yarn
>            Reporter: Eli Reisman
>            Assignee: Eli Reisman
>            Priority: Trivial
>         Attachments: SAMZA-693-1.patch, SAMZA-693-2.patch, SAMZA-693-3.patch
>
>
> Add a simple HDFS producer and related utilities. I've been using a version of this. Initial patch comes with a very basic test and it's own subproject setup which may or may not be what we want?
> Thanks!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)