You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Pallavi Rao (JIRA)" <ji...@apache.org> on 2016/02/18 07:19:18 UTC
[jira] [Commented] (FALCON-1834) Allow stream entities and support
stream processing in Falcon processes
[ https://issues.apache.org/jira/browse/FALCON-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151792#comment-15151792 ]
Pallavi Rao commented on FALCON-1834:
-------------------------------------
Most big data processing involves both stream processing and batch processing. Falcon can be enhanced to add a new "stream" entity. Users should then be able to define a process that consumes from a stream input, and processes data on a user provided stream processing engine (storm, spark-streaming). The process should be able to output to either a stream entity or a feed.
Initially, the value add this will bring is that all of the users' datasets, processing and schemas can be managed and operated using a single platform.
> Allow stream entities and support stream processing in Falcon processes
> -----------------------------------------------------------------------
>
> Key: FALCON-1834
> URL: https://issues.apache.org/jira/browse/FALCON-1834
> Project: Falcon
> Issue Type: New Feature
> Components: general
> Reporter: Pallavi Rao
> Labels: gsoc2016
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)