[GitHub] [kylin] hit-lacus commented on issue #944: KYLIN-4246 Fix for null value and non-exist value in json parser.

[GitBox <gi...@apache.org>]

hit-lacus commented on issue #944: KYLIN-4246 Fix for null value and non-exist value in json parser.
URL: https://github.com/apache/kylin/pull/944#issuecomment-554588676
 
 
   > Here is my test
   
   
   1. Prepare following sample as input of kafka producer
   ```json
   ### Complete message without null value
   {"required_dimension_1" : 1, "optional_dimension_1": "a", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 2, "optional_dimension_1": "a", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 3, "optional_dimension_1": "a", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 4, "optional_dimension_1": "a", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 5, "optional_dimension_1": "a", "measure_1" : 100, "ts":1573866250450}
   
   ### Complete message with some null value 
   {"required_dimension_1" : 1, "optional_dimension_1": "", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 2, "optional_dimension_1": "NULL", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 3, "optional_dimension_1": "null", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 4, "optional_dimension_1": null, "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 5, "optional_dimension_1": null, "measure_1" : 100, "ts":1573866250450}
   
   ### Miss optional_dimension_1 field in message
   {"required_dimension_1" : 1, "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 2, "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 3, "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 4, "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 5, "measure_1" : 100, "ts":1573866250450}
   
   
   ### Wrong data type in message
   {"required_dimension_1" : 1, "optional_dimension_1": "d", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 2, "optional_dimension_1": "d", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 3, "optional_dimension_1": "d", "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 4, "optional_dimension_1": ["dd", "ddd", "dddd"], "measure_1" : 100, "ts":1573866250450}
   {"required_dimension_1" : 5, "optional_dimension_1": {"d": 100, "dd": 100}, "measure_1" : 100, "ts":1573866250450}
   ```
   
   2. create model and cube in Kylin
   3. Send them via `sh bin/kafka-console-producer.sh --broker-list cdh-master:9092,cdh-worker-1:9092,cdh-worker-2:9092 --topic 4246`.
   4. Test my query.
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services