You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Loknath Priyatham Teja Singamsetty (JIRA)" <ji...@apache.org> on 2016/11/30 18:16:58 UTC
[jira] [Issue Comment Deleted] (PHOENIX-3511) Async Secondary index
MR job fails for large data > 200 M records
[ https://issues.apache.org/jira/browse/PHOENIX-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Loknath Priyatham Teja Singamsetty updated PHOENIX-3511:
---------------------------------------------------------
Comment: was deleted
(was: sure [~jamestaylor]. I went with the existing coding convention. Looks like we need to fix the same in multiple places.
java/org/apache/phoenix/mapreduce/index/automation/PhoenixMRJobCallable.java: conf.set(TableOutputFormat.OUTPUT_TABLE, physicalIndexTable);
java/org/apache/phoenix/mapreduce/index/IndexTool.java: conf.set(TableOutputFormat.OUTPUT_TABLE,
java/org/apache/phoenix/mapreduce/MultiHfileOutputFormat.java: conf.setStrings("io.serializations", conf.get("io.serializations"),
java/org/apache/phoenix/mapreduce/MultiHfileOutputFormat.java: conf.set(tableName, tableDefns);
java/org/apache/phoenix/util/ConfigUtil.java: conf.set(HBASE_MASTER_LOGCLEANER_PLUGINS, "");
java/org/apache/phoenix/util/ConfigUtil.java: conf.set(HConstants.ZOOKEEPER_QUORUM, "localhost");
java/org/apache/phoenix/util/PhoenixMRJobUtil.java: conf.set("hbase.client.retries.number", String.valueOf(CLIENT_RETRIES_NUMBER));
java/org/apache/phoenix/util/PhoenixMRJobUtil.java: conf.set("zookeeper.recovery.retry", String.valueOf(ZOOKEEPER_RECOVERY_RETRY_COUNT));
java/org/apache/phoenix/util/PhoenixMRJobUtil.java: conf.set("hbase.client.pause", String.valueOf(CLIENT_PAUSE_TIME));
java/org/apache/phoenix/util/PhoenixMRJobUtil.java: conf.set(MRJobConfig.QUEUE_NAME,
java/org/apache/phoenix/util/PhoenixMRJobUtil.java: conf.setInt(MRJobConfig.JOB_RUNNING_MAP_LIMIT,
java/org/apache/phoenix/util/PhoenixMRJobUtil.java: conf.setInt(MRJobConfig.MAP_MEMORY_MB, mapMemoryMB);
java/org/apache/phoenix/util/PhoenixMRJobUtil.java: conf.set(MRJobConfig.MAP_JAVA_OPTS, XMX_OPT + ((int) (mapMemoryMB * 0.9)) + "m");)
> Async Secondary index MR job fails for large data > 200 M records
> -----------------------------------------------------------------
>
> Key: PHOENIX-3511
> URL: https://issues.apache.org/jira/browse/PHOENIX-3511
> Project: Phoenix
> Issue Type: Bug
> Affects Versions: 4.9.0
> Reporter: Loknath Priyatham Teja Singamsetty
> Assignee: Loknath Priyatham Teja Singamsetty
> Fix For: 4.9.0, 4.9.1
>
> Attachments: phoenix-3511.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)