You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Suresh Purusothaman (JIRA)" <ji...@apache.org> on 2017/07/11 23:11:00 UTC
[jira] [Updated] (SPARK-21379) skip.header.line.count is ignored in
HiveContext
[ https://issues.apache.org/jira/browse/SPARK-21379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Purusothaman updated SPARK-21379:
----------------------------------------
Description:
We have an issue with Spark Job Server and Hive Context that it ignores the table level property setting to exclude the header record. This causes an issue that the header record is loaded into target table.
The source external table references a Text file. The target table is Parquet file.
was:We have an issue with Spark Job Server and Hive Context that it ignores the table level property setting to exclude the header record. This causes an issue that the header record is loaded into target table.
> skip.header.line.count is ignored in HiveContext
> ------------------------------------------------
>
> Key: SPARK-21379
> URL: https://issues.apache.org/jira/browse/SPARK-21379
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.0
> Reporter: Suresh Purusothaman
>
> We have an issue with Spark Job Server and Hive Context that it ignores the table level property setting to exclude the header record. This causes an issue that the header record is loaded into target table.
> The source external table references a Text file. The target table is Parquet file.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org