[jira] [Commented] (PHOENIX-3115) Create e2e workflow test for async secondary mr based index building

["Loknath Priyatham Teja Singamsetty (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PHOENIX-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404389#comment-15404389 ] 

Loknath Priyatham Teja Singamsetty  commented on PHOENIX-3115:
--------------------------------------------------------------

Written E2E tests for async secondary index PhoenixMRJobSubmitter workflows. However there are multiple issues during execution of the same.
 
Fixed:
-  In PhoenixMRJobSubmitter, DriverManager.getConnection("jdbc:phoenix:" + zkQuorum) fails without returning connection, as the zkQuorum is localhost for unit test run. The ideal connection url string should contain the zk client port as well if zkQuorum doesn't have it. Made the necessary changes to fix the same.
- Some of the unit tests which require mr process, doesn't have serverProps.put(QueryServices.ASYNC_INDEX_AUTO_BUILD_ATTRIB, Boolean.toString(false)); Added the same. 
- Another error "connection loss to /yarn-leader-election" because of PhoenixMRJobSubmitter always expecting RM in HA mode. Refactored PhoenixMRJobSubmitter to consider scenarios where RM is non-HA (as per test setup) 

Unresolved:
- Our test env for test cases which uses MapReduceMiniCluster setup is not able to get job details from mapreduce job history web app address with the help of HttpURLConnection. This needs some research on how the yarn config has to be setup. Tried couple of default and customized configs here but wasn't successful.

> Create e2e workflow test for async secondary mr based index building 
> ---------------------------------------------------------------------
>
>                 Key: PHOENIX-3115
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3115
>             Project: Phoenix
>          Issue Type: Test
>            Reporter: Loknath Priyatham Teja Singamsetty 
>            Assignee: Loknath Priyatham Teja Singamsetty 
>
> Need for e2e workflow test for async secondary mr based index building 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)