[GitHub] [incubator-druid] jimj opened a new issue #8916: Kinesis Indexing does not honor `transformSpec` of the `dataSchema`

[GitBox <gi...@apache.org>]

jimj opened a new issue #8916: Kinesis Indexing does not honor `transformSpec` of the `dataSchema`
URL: https://github.com/apache/incubator-druid/issues/8916
 
 
   Please provide a detailed title (e.g. "Broker crashes when using TopN query with Bound filter" instead of just "Broker crashes").
   
   ### Affected Version
   0.16-incubating
   
   ### Description
   I have a kinesis-indexing task that contains a transformSpec with filters.  
   
   ```
   "transformSpec": {
     "filter": {
       "type": "or",
       "fields": [{
           "type": "selector",
           "dimension": "eventType",
           "value": "foo"
         }, {
           "type": "selector",
           "dimension": "eventType",
           "value": "bar"
         }
       ]
     }
   }
   ```
   
   However, every available eventType coming into my kinesis stream ends up in the Druid dataset.
   
   The docs don't really call out this as supported or unsupported either way.  The `dataSchema` examples for Kinesis & Kafka don't contain a `transformSpec` explicitly, but the documentation also links to the default `dataSchema` documentation which does make it seem like `transformSpec` should be generically available.
   
   Is this a bug or intended behavior of Druid?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org