You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/04/06 03:19:00 UTC
[jira] [Resolved] (SPARK-23863) Wholetext mode should not add line
breaks
[ https://issues.apache.org/jira/browse/SPARK-23863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-23863.
----------------------------------
Resolution: Invalid
> Wholetext mode should not add line breaks
> -----------------------------------------
>
> Key: SPARK-23863
> URL: https://issues.apache.org/jira/browse/SPARK-23863
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: chencheng
> Priority: Major
> Fix For: 2.3.1
>
>
> We merged multiple files in the Text format. When using the select count(1) to count the merged results, we found that the result of the merged wholetext mode was inconsistent with that of the normal mode.
> E.g:
> Combine 10 text files with a total of 100 lines. When the wholeTextMode parameter of the buildReader method is set to true, the result of select count(1) will be 110.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org