You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/06/25 11:37:00 UTC
[jira] [Work logged] (HADOOP-18313) AliyunOSS: AliyunOSSBlockOutputStream should not mark the temporary file for deletion
[ https://issues.apache.org/jira/browse/HADOOP-18313?focusedWorklogId=784791&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-784791 ]
ASF GitHub Bot logged work on HADOOP-18313:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 25/Jun/22 11:36
Start Date: 25/Jun/22 11:36
Worklog Time Spent: 10m
Work Description: wujinhu opened a new pull request, #4502:
URL: https://github.com/apache/hadoop/pull/4502
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g., 'HADOOP-17799. Your PR title ...'.
-->
### Description of PR
Jira issue: https://issues.apache.org/jira/browse/HADOOP-18313
### How was this patch tested?
New unit tests.
### For code changes:
- [X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [X] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
Issue Time Tracking
-------------------
Worklog Id: (was: 784791)
Remaining Estimate: 0h
Time Spent: 10m
> AliyunOSS: AliyunOSSBlockOutputStream should not mark the temporary file for deletion
> -------------------------------------------------------------------------------------
>
> Key: HADOOP-18313
> URL: https://issues.apache.org/jira/browse/HADOOP-18313
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/oss
> Affects Versions: 2.10.2, 3.2.3, 3.3.3
> Reporter: wujinhu
> Assignee: wujinhu
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> AliyunOSSBlockOutputStream buffers data in local directory before uploading to OSS. It uses LocalDirAllocator.createTmpFileForWrite which will create a temp file on this directory and invoke DeleteOnExitHook.add to add the path to a set and will be deleted on VM exit through a shutdown hook. However, the size of set will be growing if the VM does not exit.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org