[jira] [Commented] (TEZ-2190) TestOrderedWordCount fails when generateSplitsInClient set to true

["Bikas Saha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355656#comment-14355656 ] 

Bikas Saha commented on TEZ-2190:
---------------------------------

I believe that is by design because the following code in DAG.java during dag building takes care of setting parallelism based on data source descriptor number of shards. So the bug might be somewhere else?
{code}      if (dataSources.size() == 1) {
        DataSourceDescriptor dataSource = dataSources.get(0);
        if (vertexParallelism == -1 && dataSource.getNumberOfShards() > -1) {
          vertexParallelism = dataSource.getNumberOfShards();
        }
        if (vertexLocationHint == null && dataSource.getLocationHint() != null) {
          vertexLocationHint = dataSource.getLocationHint();
        }
      }{code}

> TestOrderedWordCount fails when generateSplitsInClient set to true
> ------------------------------------------------------------------
>
>                 Key: TEZ-2190
>                 URL: https://issues.apache.org/jira/browse/TEZ-2190
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>            Assignee: Hitesh Shah
>         Attachments: TEZ-2190.1.patch
>
>
> numTasks for the map stage is unset in this scenario leading to the following error:
> {code}
> java.lang.IllegalStateException: initialmap has -1 tasks but does not have input initializers, 1-1 uninited sources or custom vertex manager to set it at runtime
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)