You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/09/08 10:31:10 UTC
[GitHub] [pinot] richardstartin opened a new issue #7411: User provided JsonPaths should be validated/rejected at startup
richardstartin opened a new issue #7411:
URL: https://github.com/apache/pinot/issues/7411
In a profile from a system where invalid JSON paths were configured, a lot of time (> 20%) was spent during ingestion throwing at least one JSON path validation exception per row. The operator of a properly configured deployment should ensure that JSON paths are valid, but this is a poor failure mode and it would be better to reject the transformation and log very clearly that the JSON path failed validation and won't be applied.
<img width="1460" alt="Screenshot 2021-09-08 at 11 29 42" src="https://user-images.githubusercontent.com/16439049/132493754-00f0f8e5-27dc-4579-916a-c5de756fee23.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] richardstartin commented on issue #7411: User provided JsonPaths should be validated/rejected at startup
Posted by GitBox <gi...@apache.org>.
richardstartin commented on issue #7411:
URL: https://github.com/apache/pinot/issues/7411#issuecomment-915269328
I managed to reproduce this with a valid JSON path and it's more of a library issue, closing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] richardstartin closed issue #7411: User provided JsonPaths should be validated/rejected at startup
Posted by GitBox <gi...@apache.org>.
richardstartin closed issue #7411:
URL: https://github.com/apache/pinot/issues/7411
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org