You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2017/11/13 12:19:16 UTC

spark git commit: [MINOR][CORE] Using bufferedInputStream for dataDeserializeStream

Repository: spark
Updated Branches:
  refs/heads/master 209b9361a -> 176ae4d53


[MINOR][CORE] Using bufferedInputStream for dataDeserializeStream

## What changes were proposed in this pull request?

Small fix. Using bufferedInputStream for dataDeserializeStream.

## How was this patch tested?

Existing UT.

Author: Xianyang Liu <xi...@intel.com>

Closes #19735 from ConeyLiu/smallfix.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/176ae4d5
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/176ae4d5
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/176ae4d5

Branch: refs/heads/master
Commit: 176ae4d53e0269cfc2cfa62d3a2991e28f5a9182
Parents: 209b936
Author: Xianyang Liu <xi...@intel.com>
Authored: Mon Nov 13 06:19:13 2017 -0600
Committer: Sean Owen <so...@cloudera.com>
Committed: Mon Nov 13 06:19:13 2017 -0600

----------------------------------------------------------------------
 .../main/scala/org/apache/spark/serializer/SerializerManager.scala | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/176ae4d5/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala b/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
index 311383e..1d4b05c 100644
--- a/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
+++ b/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
@@ -206,7 +206,7 @@ private[spark] class SerializerManager(
     val autoPick = !blockId.isInstanceOf[StreamBlockId]
     getSerializer(classTag, autoPick)
       .newInstance()
-      .deserializeStream(wrapForCompression(blockId, inputStream))
+      .deserializeStream(wrapForCompression(blockId, stream))
       .asIterator.asInstanceOf[Iterator[T]]
   }
 }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org