You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/03/19 14:18:18 UTC
[GitHub] [incubator-pinot] pabrahamusa opened a new issue #6699: JSON Index - Parser fails for some normal JSONs
pabrahamusa opened a new issue #6699:
URL: https://github.com/apache/incubator-pinot/issues/6699
I have a JSON which looks like the one below. But JSON parser fails with errors
```
{
"message": "\"Executing query =: \"",
"messageobj": "{\"statement\":\"select sysdate from dual\",\"binds\":{},\"opts\":{\"outFormat\":4002,\"autoCommit\":true}}",
"executionContext": "{\"system\":\"test\",\"subsystem\":\"operations\",\"capability\":\"checksettings\",\"resource\":\"simplefireconsumer-hsh\",\"transactionid\":\"10ba4d0d-0a63-4a40-be70-92c2a7837e3c\",\"username\":\"--REDACTED--\",\"urlpath\":\"/operations/checksettings/v1/simplefireconsumer-hsh/healthcheck\",\"requestheaders\":{\"host\":\"145.72.134.21:3000\",\"user-agent\":\"kube-probe/1.16+\",\"accept-encoding\":\"gzip\",\"connection\":\"close\",\"messageauditid\":\"23cf3b61-acc7-42a7-8fac-2f22506f4652\"}}",
"transactionid": "10ba4d0d-0a63-4a40-be70-92c2a7837e3c",
"correlationid": "",
"sessionid": "",
"sender": "",
"system": "test",
"subsystem": "operations",
"capability": "checksettings",
"resource": "simplefireconsumer-hsh",
"urlpath": "/operations/checksettings/v1/simplefireconsumer-hsh/healthcheck",
"testloggerversion": "2.0",
"level": "info",
"timestamp": "2021-03-19T04:39:43.822Z"
}
```
JSON errors
server java.lang.IndexOutOfBoundsException: Index: 6279, Size: 1
at java.util.ArrayList.get(ArrayList.java:435) ~[?:1.8.0_282]
shaded.com.fasterxml.jackson.core.JsonParseException: Unexpected character ('/' (code 47)): maybe a (non-standard) comment? (not recognized as one since Feature 'ALLOW_COMMENTS' not enabled for parser)
Is it possible to have a dirty XML parser option as well. Where it parses whatever value it can and just skips the really bad ones?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #6699: JSON Index - Parser fails for some normal JSONs
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #6699:
URL: https://github.com/apache/incubator-pinot/issues/6699#issuecomment-803009052
Can you please elaborate more on which operation has caused the exception? I am able to parse the JSON posted here without any exception.
Yes, we can add an option for data ingestion to put default value if the parsing encounters exception.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] pabrahamusa commented on issue #6699: JSON Index - Parser fails for some normal JSONs
Posted by GitBox <gi...@apache.org>.
pabrahamusa commented on issue #6699:
URL: https://github.com/apache/incubator-pinot/issues/6699#issuecomment-804481147
@Jackie-Jiang I will enable the JSON index and try again and post more examples. How can I add an option for data ingestion to put default value and skip parsing if there are any formatting errors?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org