You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Denis Magda (JIRA)" <ji...@apache.org> on 2016/01/15 09:30:41 UTC

[jira] [Updated] (IGNITE-2391) IGFS + Ignite MR works slower than Hadoop (Hortonswork) MR

     [ https://issues.apache.org/jira/browse/IGNITE-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Denis Magda updated IGNITE-2391:
--------------------------------
    Description: 
A performance test of IGFS MR vs Traditional HDFS (Hortonswork) MR and performance here was actually worse using IGFS MR.

5 ignite nodes on the 5 data nodes were setup, each also with 64GB ram.

The same sample search via Hunk was done, making sure Hunk initiated the MR stage. The only change in both runs was only to run IGFS MR or Traditional MR over HDFS
 
Traditional MR over HDFS.
This search has completed in 54.701seconds.

IGFS MR
This search has completed in 75.959seconds.

  was:
A performance test of IGFS MR vs Traditional HDFS (Hortonswork) MR and performance here was actually worse using IGFS MR (quite shockingly)

5 ignite nodes on the 5 data nodes were setup, each also with 64GB ram.

The same sample search via Hunk was done, making sure Hunk initiated the MR stage. The only change in both runs was only to run IGFS MR or Traditional MR over HDFS
 
Traditional MR over HDFS.
This search has completed in 54.701seconds.

IGFS MR
This search has completed in 75.959seconds.


> IGFS + Ignite MR works slower than Hadoop (Hortonswork) MR
> ----------------------------------------------------------
>
>                 Key: IGNITE-2391
>                 URL: https://issues.apache.org/jira/browse/IGNITE-2391
>             Project: Ignite
>          Issue Type: Bug
>          Components: IGFS
>    Affects Versions: 1.5
>            Reporter: Denis Magda
>            Priority: Blocker
>             Fix For: 1.6
>
>
> A performance test of IGFS MR vs Traditional HDFS (Hortonswork) MR and performance here was actually worse using IGFS MR.
> 5 ignite nodes on the 5 data nodes were setup, each also with 64GB ram.
> The same sample search via Hunk was done, making sure Hunk initiated the MR stage. The only change in both runs was only to run IGFS MR or Traditional MR over HDFS
>  
> Traditional MR over HDFS.
> This search has completed in 54.701seconds.
> IGFS MR
> This search has completed in 75.959seconds.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)