[GitHub] [incubator-druid] a2l007 opened a new issue #8778: Missing dimensions/metrics are parsed as empty values for delimited text files

[GitBox <gi...@apache.org>]

a2l007 opened a new issue #8778: Missing dimensions/metrics are parsed as empty values for delimited text files
URL: https://github.com/apache/incubator-druid/issues/8778
 
 
   ### Affected Version
   
   0.14.0-incubating. Also reproducible in master
   
   ### Description
   With `-Ddruid.generic.useDefaultValueForNull=false` nulls and empty values should be handled differently. However for delimited text files, it looks like null/missing values are being parsed as empty values.
   For example with the following dimension & metric spec and CSV data:
   ```
    "dimensionsSpec" : {
               "dimensions" : [ "dim1", "dim2", "dim3"]
             }
   
   "metricsSpec" : [
           {
             "name" : "metric1",
             "type" : "count",
              "fieldName" : "metric1"
          },
           {
             "name" : "metric2",
             "type" : "longSum",
             "fieldName" : "metric2"
           }
         ]
   ```
   Data:
   
   `2019-07-04T03:46:58.771Z,,"value2","value3",,82`
   
   `dim1` would be stored as `""` instead of `null` and `metric1` would be stored as `0` instead of `null` even though they are missing values.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org