[jira] [Commented] (HAMA-700) BSPPartitioner should be configurable to be optional and allow input format conversion

["Edward J. Yoon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13860028#comment-13860028 ] 

Edward J. Yoon commented on HAMA-700:
-------------------------------------

NOTE:

I just found why TestPipes (summation job) unit test fails. Despite
partitioner class is not specified for summation example, Partitioning
Job launched.

      if ((numTasks > 0 && numTasks != numSplits)
          || (job.getConfiguration().getBoolean(
              Constants.ENABLE_RUNTIME_PARTITIONING, false) && job
              .getConfiguration().get(Constants.RUNTIME_PARTITIONING_CLASS)
!= null)) {
           ....
      }

Above "if" condition determines whether partitioning job should be run
or not. Partitioning job should be run only when "BSP-based runtime
partitioning" is enabled and partitioner is specified.

I'll fix this to TRUNK directly.

> BSPPartitioner should be configurable to be optional and allow input format conversion
> --------------------------------------------------------------------------------------
>
>                 Key: HAMA-700
>                 URL: https://issues.apache.org/jira/browse/HAMA-700
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp core
>            Reporter: Suraj Menon
>            Assignee: Suraj Menon
>             Fix For: 0.6.1
>
>         Attachments: HAMA-700-v1.patch, HAMA-700.patch.v2, HAMA-700.patch_Jan7
>
>
> There should be a provisioning for skipping the PartitionRunner if needed. Also we can have a RecordConverter interface so that the PartitionRunner can read the input in any format and create new splits. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)