You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/01/07 04:03:00 UTC
[jira] [Resolved] (SPARK-26531) How to setup Apache Spark to use
local hard disk when data does not fit in RAM in local mode?
[ https://issues.apache.org/jira/browse/SPARK-26531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-26531.
----------------------------------
Resolution: Invalid
Questions should go to mailing list. You could have a better answer there.
> How to setup Apache Spark to use local hard disk when data does not fit in RAM in local mode?
> ---------------------------------------------------------------------------------------------
>
> Key: SPARK-26531
> URL: https://issues.apache.org/jira/browse/SPARK-26531
> Project: Spark
> Issue Type: Question
> Components: Spark Core
> Affects Versions: 2.2.0
> Environment: Ubuntu 16.04
> Hive 2.3.0
> Spark 2.0.0
>
> Reporter: Lê Văn Thanh
> Priority: Major
>
> Hello ,
> I have a table with 10GB data and 4GB free RAM , I tried to select data from this table to other table with ORC format but I got an error about memory limit ( I'm running the query SELECT in console ) .
> How to setup Apache Spark to use local hard disk when data does not fit in RAM in local mode?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org