[jira] [Commented] (METRON-1573) Enhance KAFKA_* functions to return partition and offset details

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/METRON-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505661#comment-16505661 ] 

ASF GitHub Bot commented on METRON-1573:
----------------------------------------

Github user james-sirota commented on the issue:

    https://github.com/apache/metron/pull/1030
  
    When I try:
    
    [Stellar]>>> KAFKA_PUT("mytopic", "{ message! }")
    [{partition=0, offset=0, topic=mytopic, timestamp=1528428506817}]
    [Stellar]>>> KAFKA_PUT("mytopic", "{ message! }")
    [{partition=0, offset=1, topic=mytopic, timestamp=1528428552606}]
    [Stellar]>>> KAFKA_TAIL("mytopic")
    []
    [Stellar]>>> KAFKA_GET("mytopic")
    []
    
    So nothing is pulled back.  But the topic and the data does exist:
    
    
    /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --topic mytopic --zookeeper localhost:2181 --from-beginning
    
    { message! }
    { message! }



> Enhance KAFKA_* functions to return partition and offset details
> ----------------------------------------------------------------
>
>                 Key: METRON-1573
>                 URL: https://issues.apache.org/jira/browse/METRON-1573
>             Project: Metron
>          Issue Type: Improvement
>            Reporter: Nick Allen
>            Assignee: Nick Allen
>            Priority: Major
>
> The KAFKA_* functions currently simply return the value of the message.  There are often times when it would be useful to get more detailed information including the message partition, offset, key, etc.  
> The functions should be enhanced to allow a user to optionally get a more detailed view.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)