You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "KWON BYUNGCHANG (Jira)" <ji...@apache.org> on 2026/05/22 09:33:00 UTC
[jira] [Updated] (HDFS-17926) Automatically create home directory for users
[ https://issues.apache.org/jira/browse/HDFS-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
KWON BYUNGCHANG updated HDFS-17926:
-----------------------------------
Description:
Currently, HDFS does not automatically create a user's home directory (e.g., `/user/<user>`). This requires administrators to manually create home directories, which adds operational overhead and can cause failures for user-facing tools (e.g., MapReduce job submission, Hive, Spark) that assume the home directory exists.
This JIRA tracks the development of automatic home directory creation so that when a user's home directory does not yet exist, HDFS creates it automatically with appropriate ownership (`<username>:<supergroup>`) and permissions (`drwx------`).
*Motivation:*
- Reduces administrative burden for large multi-tenant clusters
- Prevents job failures caused by missing home directories
- Aligns with the behavior expected by higher-level ecosystem tools
*Background:*
This feature was originally developed and added to an internal fork of Apache Hadoop 3.1.2, and has been running in production for over a year.
We plan to port the implementation to 3.5.0 and share the patch here.
was:
Currently, HDFS does not automatically create a user's home directory (e.g., `/user/<user>`). This requires administrators to manually create home directories, which adds operational overhead and can cause failures for user-facing tools (e.g., MapReduce job submission, Hive, Spark) that assume the home directory exists.
This JIRA tracks the development of automatic home directory creation so that when a user's home directory does not yet exist, HDFS creates it automatically with appropriate ownership (`<username>:<supergroup>`) and permissions (`drwx------`).
**Motivation:**
- Reduces administrative burden for large multi-tenant clusters
- Prevents job failures caused by missing home directories
- Aligns with the behavior expected by higher-level ecosystem tools
> Automatically create home directory for users
> ---------------------------------------------
>
> Key: HDFS-17926
> URL: https://issues.apache.org/jira/browse/HDFS-17926
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namenode
> Reporter: KWON BYUNGCHANG
> Priority: Major
>
> Currently, HDFS does not automatically create a user's home directory (e.g., `/user/<user>`). This requires administrators to manually create home directories, which adds operational overhead and can cause failures for user-facing tools (e.g., MapReduce job submission, Hive, Spark) that assume the home directory exists.
> This JIRA tracks the development of automatic home directory creation so that when a user's home directory does not yet exist, HDFS creates it automatically with appropriate ownership (`<username>:<supergroup>`) and permissions (`drwx------`).
> *Motivation:*
> - Reduces administrative burden for large multi-tenant clusters
> - Prevents job failures caused by missing home directories
> - Aligns with the behavior expected by higher-level ecosystem tools
>
> *Background:*
> This feature was originally developed and added to an internal fork of Apache Hadoop 3.1.2, and has been running in production for over a year.
> We plan to port the implementation to 3.5.0 and share the patch here.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org