[jira] [Commented] (CRUNCH-583) Scrunch classloader failure in distcache

["Tom White (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CRUNCH-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044756#comment-15044756 ] 

Tom White commented on CRUNCH-583:
----------------------------------

The following shows the problem:

{code}
import org.apache.crunch.scrunch._

val pipeline = new Pipeline(new org.apache.crunch.impl.mr.MRPipeline(classOf[org.apache.hadoop.conf.Configuration], new org.apache.hadoop.conf.Configuration()))
val pcol: PCollection[String] = pipeline.readTextFile("/tmp/in")
pcol.materialize.foreach(println) // works

case class content(val a: Int) 
val pcolc: PCollection[content] = pcol.map(s => content(s.toInt))
pcolc.materialize.foreach(println) // fails
{code}

Where the file _/tmp/in_ contains a few lines of integer values.

> Scrunch classloader failure in distcache
> ----------------------------------------
>
>                 Key: CRUNCH-583
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-583
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core, Scrunch
>    Affects Versions: 0.13.0
>            Reporter: Tom White
>            Assignee: Tom White
>
> This is the same as CRUNCH-571, but in DistCache.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)