[jira] [Closed] (METAMODEL-240) MetaModel in distributed environment.

["Kasper Sørensen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/METAMODEL-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kasper Sørensen closed METAMODEL-240.
-------------------------------------
    Resolution: Information Provided
      Assignee: Kasper Sørensen

Hi Pawan,

Ah, now I understand. No MetaModel does not have that capability. I would rely on frameworks such as Hadoop, Mesos, Spark, Flink etc. to provide that. I do also know that the guys at Stratio, ([~ardlema] and more) have made some adaptors that allow Spark to use MetaModel as the source of a DataFrame that is then processed in a distributed manner. But I don't think that's available yet. I also know that we at Human Inference have built a distributed runner on top of MetaModel which uses LIMIT and OFFSET windows on individual nodes to have multiple nodes process the same large datasets in parallel. But it's all custom work.

> MetaModel in distributed environment. 
> --------------------------------------
>
>                 Key: METAMODEL-240
>                 URL: https://issues.apache.org/jira/browse/METAMODEL-240
>             Project: Apache MetaModel
>          Issue Type: New Feature
>            Reporter: Pawan Pawar
>            Assignee: Kasper Sørensen
>
> Hi team is it possible to use meta model in distributed mode?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)