You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datasketches.apache.org by "jhsenjaliya (via GitHub)" <gi...@apache.org> on 2024/02/05 03:10:01 UTC
[I] array index error on ReqSketch (datasketches-java)
jhsenjaliya opened a new issue, #502:
URL: https://github.com/apache/datasketches-java/issues/502
ReqSketch often throws error on small dataset.
only thing I explicitly set is `setHighRankAccuracy(true)`
```
java.lang.NegativeArraySizeException: -464
at org.apache.datasketches.req.ReqCompactor.toByteArray(ReqCompactor.java:295)
at org.apache.datasketches.req.ReqSerDe.toByteArray(ReqSerDe.java:305)
at org.apache.datasketches.req.ReqSketch.toByteArray(ReqSketch.java:418)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org
Re: [I] array index error on ReqSketch (datasketches-java)
Posted by "will-lauer (via GitHub)" <gi...@apache.org>.
will-lauer commented on issue #502:
URL: https://github.com/apache/datasketches-java/issues/502#issuecomment-1928055498
Do you have an example of a dataset that triggers this behavior for you that we can use for validation?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org
Re: [I] array index error on ReqSketch (datasketches-java)
Posted by "jhsenjaliya (via GitHub)" <gi...@apache.org>.
jhsenjaliya commented on issue #502:
URL: https://github.com/apache/datasketches-java/issues/502#issuecomment-1953280642
closing the issue for now. Looks like its related to the framework that is using this class whiile serialization.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org
Re: [I] array index error on ReqSketch (datasketches-java)
Posted by "jhsenjaliya (via GitHub)" <gi...@apache.org>.
jhsenjaliya commented on issue #502:
URL: https://github.com/apache/datasketches-java/issues/502#issuecomment-1928613235
unfortunately I was not able to reproduce with the same dataset on single process,
this is while serialization, so let me gather more info with some debug logs. Thanks for chiming in though
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org
Re: [I] array index error on ReqSketch (datasketches-java)
Posted by "jhsenjaliya (via GitHub)" <gi...@apache.org>.
jhsenjaliya commented on issue #502:
URL: https://github.com/apache/datasketches-java/issues/502#issuecomment-2105060777
This seems to be random actually, I thought this is due to multi threaded distributed environment where serialization is performed, but I am seeing this even in a single thread and single node. and can not figure out why the negative index would ever happen. The error comes from "ReqCompactor.java:295" on ( version 5.0.2 ) where bytes are negative that are calculated via function `getSerializationBytes()`
-- still trying to figure out how to debug this. would really appreciate any help. Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org
Re: [I] array index error on ReqSketch (datasketches-java)
Posted by "jhsenjaliya (via GitHub)" <gi...@apache.org>.
jhsenjaliya closed issue #502: array index error on ReqSketch
URL: https://github.com/apache/datasketches-java/issues/502
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org