You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "lujie (Jira)" <ji...@apache.org> on 2022/05/14 08:27:00 UTC
[jira] [Updated] (MAPREDUCE-7382) sensitive inform may leak due to crash
[ https://issues.apache.org/jira/browse/MAPREDUCE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lujie updated MAPREDUCE-7382:
-----------------------------
Priority: Critical (was: Major)
> sensitive inform may leak due to crash
> --------------------------------------
>
> Key: MAPREDUCE-7382
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7382
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: lujie
> Priority: Critical
>
> current, we implement processDoneFiles in JobHistoryEventHandler like:
>
>
> {code:java}
> // try {
> String doneSummaryFileName = getTempFileName(JobHistoryUtils
> .getIntermediateSummaryFileName(jobId));
> qualifiedSummaryDoneFile = doneDirFS.makeQualified(new Path(
> doneDirPrefixPath, doneSummaryFileName));
> summaryFileOut = doneDirFS.create(qualifiedSummaryDoneFile, true);
> summaryFileOut.writeUTF(mi.getJobSummary().getJobSummaryString());
> summaryFileOut.close();
> doneDirFS.setPermission(qualifiedSummaryDoneFile, new FsPermission(
> JobHistoryUtils.HISTORY_INTERMEDIATE_FILE_PERMISSIONS));
> } catch (IOException e) {
> LOG.info("Unable to write out JobSummaryInfo to ["
> + qualifiedSummaryDoneFile + "]", e);
> throw e;
> } {code}
>
>
> wihle node crash before setPermission, we may leak SummaryDoneFile.
>
> code should be like:
>
> {code:java}
> try {
> String doneSummaryFileName = getTempFileName(JobHistoryUtils
> .getIntermediateSummaryFileName(jobId));
> qualifiedSummaryDoneFile = doneDirFS.makeQualified(new Path(
> doneDirPrefixPath, doneSummaryFileName));
> summaryFileOut = doneDirFS.create(qualifiedSummaryDoneFile, true);
> doneDirFS.setPermission(qualifiedSummaryDoneFile, new FsPermission( JobHistoryUtils.HISTORY_INTERMEDIATE_FILE_PERMISSIONS)); summaryFileOut.writeUTF(mi.getJobSummary().getJobSummaryString());
> summaryFileOut.close();
>
> } catch (IOException e) {
> LOG.info("Unable to write out JobSummaryInfo to ["
> + qualifiedSummaryDoneFile + "]", e);
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org