You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2016/03/17 23:09:33 UTC
[jira] [Created] (HIVE-13303) spill to YARN directories, not tmp,
when available
Sergey Shelukhin created HIVE-13303:
---------------------------------------
Summary: spill to YARN directories, not tmp, when available
Key: HIVE-13303
URL: https://issues.apache.org/jira/browse/HIVE-13303
Project: Hive
Issue Type: Bug
Reporter: Sergey Shelukhin
RowContainer::setupWriter, HybridHashTableContainer::spillPartition, (KeyValueContainer|ObjectContainer)::setupOutput, VectorMapJoinRowBytesContainer::setupOutputFileStreams create files in tmp. Maybe some other code does it too, those are the ones I see on the execution path. When there are multiple YARN output directories and multiple tasks running on a machine, it's better to use the YARN directories. The only question is cleanup.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)