You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2017/07/11 23:52:02 UTC
[jira] [Closed] (SPARK-21379) skip.header.line.count is ignored in
HiveContext
[ https://issues.apache.org/jira/browse/SPARK-21379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun closed SPARK-21379.
---------------------------------
Resolution: Won't Fix
Hi, [~spurusothaman@uk.imshealth.com].
This is a duplication of the previous issue which is closed as 'Won't Fix'.
At that time, I created a PR. If you need, you can get a PR on that issue.
> skip.header.line.count is ignored in HiveContext
> ------------------------------------------------
>
> Key: SPARK-21379
> URL: https://issues.apache.org/jira/browse/SPARK-21379
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.0
> Reporter: Suresh Purusothaman
>
> We have an issue with Spark Job Server and Hive Context that it ignores the table level property setting to exclude the header record. This causes an issue that the header record is loaded into target table.
> The source external table references a Text file. The target table is Parquet file.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org