You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by "Charles Pritchard (JIRA)" <ji...@apache.org> on 2014/10/06 19:59:35 UTC
[jira] [Created] (CRUNCH-474) Reduce dependencies on MapReduce
library in standard MemPipeline
Charles Pritchard created CRUNCH-474:
----------------------------------------
Summary: Reduce dependencies on MapReduce library in standard MemPipeline
Key: CRUNCH-474
URL: https://issues.apache.org/jira/browse/CRUNCH-474
Project: Crunch
Issue Type: Bug
Reporter: Charles Pritchard
There are currently dependencies on the MapReduce library that could be removed or otherwise re-wired in the MemPipeline method.
Currently MemPipeline relies on setting up tasks to match Hadoop libraries without using any of their functionality, beyond the counters. Crunch may be useful in areas where data is processed without Hadoop.
As an aside, the Avro writables have completely unused references to Hadoop in their import statements.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)