You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "jkolash (via GitHub)" <gi...@apache.org> on 2025/06/11 16:17:45 UTC
[PR] This hacky fix shows an improvement in memory ussage for iceberg#13297 [iceberg]
jkolash opened a new pull request, #13298:
URL: https://github.com/apache/iceberg/pull/13298
The program was able to run to completion, but there were still leaks.
<img width="1351" alt="image" src="https://github.com/user-attachments/assets/975f51a2-9167-41be-9987-2269ed035d07" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] This hacky fix shows an improvement in memory usage for iceberg#13297 [iceberg]
Posted by "jkolash (via GitHub)" <gi...@apache.org>.
jkolash closed pull request #13298: This hacky fix shows an improvement in memory usage for iceberg#13297
URL: https://github.com/apache/iceberg/pull/13298
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] This hacky fix shows an improvement in memory usage for iceberg#13297 [iceberg]
Posted by "jkolash (via GitHub)" <gi...@apache.org>.
jkolash commented on PR #13298:
URL: https://github.com/apache/iceberg/pull/13298#issuecomment-3084053337
This is a bug in spark not in iceberg. This should be fixed in https://github.com/apache/spark/pull/51503
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] This hacky fix shows an improvement in memory usage for iceberg#13297 [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #13298:
URL: https://github.com/apache/iceberg/pull/13298#issuecomment-3064360294
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] This hacky fix shows an improvement in memory usage for iceberg#13297 [iceberg]
Posted by "jkolash (via GitHub)" <gi...@apache.org>.
jkolash commented on PR #13298:
URL: https://github.com/apache/iceberg/pull/13298#issuecomment-2963764217
Running with the additional set of changes makes it so heap never even reaches 8 gigs.
<img width="672" alt="image" src="https://github.com/user-attachments/assets/7007e7b9-a414-4f2f-8128-89df9f910c85" />
I ran this while doing zoom so it ran longer, but these changes dramatically reduce the amount of memory used for what I was doing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org