You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by "Gabriel Reid (JIRA)" <ji...@apache.org> on 2014/06/15 14:28:01 UTC
[jira] [Commented] (CRUNCH-420) Breakpoints Not Working
[ https://issues.apache.org/jira/browse/CRUNCH-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031866#comment-14031866 ]
Gabriel Reid commented on CRUNCH-420:
-------------------------------------
Yep, that looks like a bug to me. You can get it to work as you expect by calling {{materialize().iterator()}} instead of just {{materialize()}} on the PCollection in question, but I believe it's wrong that the call to materialize isn't currently having the same effect.
I've taken a look, and haven't quite spotted how to fix it yet, but I'll keep going on it unless [~jwills] knows how to deal with this off the top of his head.
> Breakpoints Not Working
> -----------------------
>
> Key: CRUNCH-420
> URL: https://issues.apache.org/jira/browse/CRUNCH-420
> Project: Crunch
> Issue Type: Bug
> Environment: Crunch 0.8.2
> Reporter: Allan Shoup
> Attachments: Breakpoint2IT.java, testBreakpoint_plan.png
>
>
> Reading through CRUNCH-294, it looks like materialize is supposed to function as a breakpoint to the planner. I've seen several plans where it appeared to me a particular DoFn shouldn't have been repeated, but it was.
> I'll attach some supporting material.
--
This message was sent by Atlassian JIRA
(v6.2#6252)