You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Yida Wu (Jira)" <ji...@apache.org> on 2021/09/09 17:19:00 UTC
[jira] [Resolved] (IMPALA-10429) Add Support for specifying HDFS
path in 'scratch_dirs' startup option
[ https://issues.apache.org/jira/browse/IMPALA-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yida Wu resolved IMPALA-10429.
------------------------------
Fix Version/s: Impala 4.1.0
Resolution: Fixed
> Add Support for specifying HDFS path in 'scratch_dirs' startup option
> ---------------------------------------------------------------------
>
> Key: IMPALA-10429
> URL: https://issues.apache.org/jira/browse/IMPALA-10429
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Yida Wu
> Assignee: Yida Wu
> Priority: Major
> Fix For: Impala 4.1.0
>
>
> We support HDFS scratch space as a test-only feature, but we only support a fixed HDFS default path, no matter what input HDFS path is. The reason is the format of the port number in the HDFS path contradicts the way we are using for analyzing priority and size limit, like hdfs://xxx:1:10000, it needs some extra efforts to have a general parsing logic for the HDFS path.
> The JIRA is to track this spill to HDFS limitation if we need to support a flexible HDFS scratch space input.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org