You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Dong Yang (JIRA)" <ji...@apache.org> on 2011/04/22 15:32:05 UTC

[jira] [Created] (MAPREDUCE-2446) HCE 2.0

HCE 2.0
-------

                 Key: MAPREDUCE-2446
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2446
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/streaming, pipes, task
            Reporter: Dong Yang


Enhancing MapReduce by Task-level Optimization. Except for yielding speedups of up to 130% on original Streaming Program, Hce 2.0 provides some more flexible programming interfaces including c++, java, python, etc.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2446) HCE 2.0

Posted by "jostey (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120754#comment-13120754 ] 

jostey commented on MAPREDUCE-2446:
-----------------------------------

hi,Dong,I want to know whether the new version of HEC is an open source? I couldn't find any download link...Could you tell me when is it available?
                
> HCE 2.0
> -------
>
>                 Key: MAPREDUCE-2446
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2446
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/streaming, pipes, task
>            Reporter: Dong Yang
>
> Enhancing MapReduce by Task-level Optimization. Except for yielding speedups of up to 130% on original Streaming Program, Hce 2.0 provides some more flexible programming interfaces including c++, java, python, etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2446) HCE 2.0

Posted by "chao li (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478758#comment-13478758 ] 

chao li commented on MAPREDUCE-2446:
------------------------------------

/usr/include/bits/xopen_lim.h:95:6: 错误:标识符“(”前缺少二元运算符
/usr/include/bits/xopen_lim.h:98:7: 错误:标识符“(”前缺少二元运算符
/usr/include/bits/xopen_lim.h:122:6: 错误:标识符“(”前缺少二元运算符
make[2]: *** [CompressionFactory.o] 错误 1
make[2]: Leaving directory `/root/hadoop_hce_v1/hadoop-0.20.3/src/c++/hce/impl/Compress'
make[1]: *** [all-recursive] 错误 1
make[1]: Leaving directory `/root/hadoop_hce_v1/hadoop-0.20.3/src/c++/hce/impl'

How can I confirm this error?
                
> HCE 2.0
> -------
>
>                 Key: MAPREDUCE-2446
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2446
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/streaming, pipes, task
>            Reporter: Dong Yang
>
> Enhancing MapReduce by Task-level Optimization. Except for yielding speedups of up to 130% on original Streaming Program, Hce 2.0 provides some more flexible programming interfaces including c++, java, python, etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2446) HCE 2.0

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044703#comment-13044703 ] 

Ning Zhang commented on MAPREDUCE-2446:
---------------------------------------

Dong, nice results. Can you elaborate more on what are the additional changes to HCE v1 (MAPREDUCE-1270)? Was the 130% speedup due to a new implementation of shuffling and sorting in C++?

> HCE 2.0
> -------
>
>                 Key: MAPREDUCE-2446
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2446
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/streaming, pipes, task
>            Reporter: Dong Yang
>
> Enhancing MapReduce by Task-level Optimization. Except for yielding speedups of up to 130% on original Streaming Program, Hce 2.0 provides some more flexible programming interfaces including c++, java, python, etc.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira