You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Loknath Priyatham Teja Singamsetty (JIRA)" <ji...@apache.org> on 2016/12/01 16:37:58 UTC
[jira] [Commented] (PHOENIX-3511) Async Secondary index MR job
fails for large data > 200 M records
[ https://issues.apache.org/jira/browse/PHOENIX-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15712427#comment-15712427 ]
Loknath Priyatham Teja Singamsetty commented on PHOENIX-3511:
--------------------------------------------------------------
Just checked the code. I agree that we don't need to explicitly set again in PhoenixMRJobSubmitter. However, the default value for this property RENEW_LEASE_THRESHOLD_MILLISECONDS -> "phoenix.scanner.lease.threshold" -> 3 * 60000 /4 which is 0.75 minute which is one of the reason for scanner timeouts while running MR jobs.
Reused this property and for index MR jobs made changes to set it to 10 min instead by default in phoenix.
Updated the latest patch. Please review.
> Async Secondary index MR job fails for large data > 200 M records
> -----------------------------------------------------------------
>
> Key: PHOENIX-3511
> URL: https://issues.apache.org/jira/browse/PHOENIX-3511
> Project: Phoenix
> Issue Type: Bug
> Affects Versions: 4.9.0
> Reporter: Loknath Priyatham Teja Singamsetty
> Assignee: Loknath Priyatham Teja Singamsetty
> Fix For: 4.9.0, 4.9.1
>
> Attachments: phoenix-3511.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)