You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/12/03 21:41:10 UTC

[GitHub] [incubator-pinot] fx19880617 commented on issue #6277: Creating segment larger than 8GB will fail due to gzip limitation

fx19880617 commented on issue #6277:
URL: https://github.com/apache/incubator-pinot/issues/6277#issuecomment-738336236


   > Also @kishoreg had said on Slack:
   > 
   > > after 2gb, we typically run into JVM limits on offset length etc.
   > 
   > So maybe adding a warning if the tar output size is > 2GB?
   
   This 2G limit is on per column size not entire segment 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org