You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/11/18 02:39:59 UTC

[jira] [Commented] (NIFI-2275) PutAzureEventHub Processor Should expose partition key

    [ https://issues.apache.org/jira/browse/NIFI-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675522#comment-15675522 ] 

ASF GitHub Bot commented on NIFI-2275:
--------------------------------------

Github user ijokarumawak commented on the issue:

    https://github.com/apache/nifi/pull/676
  
    Hello @apsaltis thanks for contributing the PR!
    Excuse us for taking long for you to get any feedback. One reason I guess is that the PR title doesn't have corresponding JIRA number, we usually look for the JIRA having 'patch available' state to review. I searched the JIRA and found [NIFI-2275](https://issues.apache.org/jira/browse/NIFI-2275).
    
    If NIFI-2275 is the right one, please update the PR title, and update the JIRA by clicking the 'Submit Patch' button to proceed the JIRA to patch available state.
    
    I reviewed the code briefly, though. One thing I would like you to update is the name of the new property descriptor, related comment and code. 'Partition Key' and 'Partition Id' are used inconsistent way. I think those all should be 'Partition Key'. It seems the actual partition Id will be determined by EventHubClient library by hashing the partition key.
    
    I wonder if it'd be more useful to support expression language with Partition Key, since the processor accepts incoming flow files, user may want to assign Partition Key based on flow file attributes.
    
    Currently, PutAzureEventHub processor doesn't have Test class. I'd be happy to have one even if it only does simple property checks. It'd be a good starting point and make subsequent contribution easier.
    
    Also, Travis build failed with an unrelated error. Please rebase the branch with the latest master so that it can pass Travis build. 
    
    Thanks!


> PutAzureEventHub Processor Should expose partition key
> ------------------------------------------------------
>
>                 Key: NIFI-2275
>                 URL: https://issues.apache.org/jira/browse/NIFI-2275
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>    Affects Versions: 1.0.0
>            Reporter: Andrew Psaltis
>            Assignee: Andrew Psaltis
>
> Currently the PutAzureEventHub does not allow the user to set a partition key, nor does it use a default key for messages that are being sent. Therefore, the processor should do two things:
> 1. Provide a property that allows the user to set a partition key
> 2. If the partition key property is not set to use a guid as the default. This will allow the data to be evenly spread amongst the partitions.
> 3. Emit the partition key as attribute so that it is available to other processors and in the provenance data. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)