You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Nicholas Chammas (JIRA)" <ji...@apache.org> on 2016/04/20 04:28:25 UTC
[jira] [Comment Edited] (SPARK-6527) sc.binaryFiles can not access
files on s3
[ https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249141#comment-15249141 ]
Nicholas Chammas edited comment on SPARK-6527 at 4/20/16 2:27 AM:
------------------------------------------------------------------
Did the s3a suggestion work? If not, did anybody file an issue as Steve suggested?
was (Author: nchammas):
Did the s3a suggestion work? If not, did anybody file an issue as Steve suggested with more detail?
> sc.binaryFiles can not access files on s3
> -----------------------------------------
>
> Key: SPARK-6527
> URL: https://issues.apache.org/jira/browse/SPARK-6527
> Project: Spark
> Issue Type: Bug
> Components: EC2, Input/Output
> Affects Versions: 1.2.0, 1.3.0
> Environment: I am running Spark on EC2
> Reporter: Zhao Zhang
> Priority: Minor
>
> The sc.binaryFIles() can not access the files stored on s3. It can correctly list the number of files, but report "file does not exist" when processing them. I also tried sc.textFile() which works fine.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org