You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@phoenix.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2019/01/18 04:46:00 UTC

[jira] [Commented] (PHOENIX-4009) Run UPDATE STATISTICS command by using MR integration on snapshots

    [ https://issues.apache.org/jira/browse/PHOENIX-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745780#comment-16745780 ] 

Hudson commented on PHOENIX-4009:
---------------------------------

ABORTED: Integrated in Jenkins build Phoenix-4.x-HBase-1.4 #47 (See [https://builds.apache.org/job/Phoenix-4.x-HBase-1.4/47/])
PHOENIX-4009 Run UPDATE STATISTICS command by using MR integration on (github: rev e3280f6e8738b78fe865e4a717ef96c66a31b03f)
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedImmutableTxStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixInputFormat.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/NonColumnEncodedImmutableNonTxStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixRecordReader.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/mapreduce/util/PhoenixConfigurationUtilTest.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/NonColumnEncodedImmutableTxStatsCollectorIT.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedMutableTxStatsCollectorIT.java
* (edit) pom.xml
* (add) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/BaseStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/TableSnapshotResultIterator.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/StatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsWriter.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsCollectorFactory.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsCollector.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/NonTxStatsCollectorIT.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/NamespaceEnabledStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/DefaultStatisticsCollector.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedImmutableNonTxStatsCollectorIT.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/TxStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/SnapshotScanner.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsScanner.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/util/PhoenixMapReduceUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ServerUtil.java
* (edit) phoenix-core/pom.xml
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsUtil.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/UpdateStatisticsTool.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/SysTableNamespaceMappedStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/UngroupedAggregateRegionObserver.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedMutableNonTxStatsCollectorIT.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/NamespaceDisabledStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/util/PhoenixConfigurationUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/NoOpStatisticsCollector.java
* (edit) phoenix-pig/src/main/java/org/apache/phoenix/pig/util/PhoenixPigSchemaUtil.java


> Run UPDATE STATISTICS command by using MR integration on snapshots
> ------------------------------------------------------------------
>
>                 Key: PHOENIX-4009
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4009
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Samarth Jain
>            Assignee: Karan Mehta
>            Priority: Major
>         Attachments: PHOENIX-4009.4.x-HBase-1.4.001.patch, PHOENIX-4009.4.x-HBase-1.4.002.patch
>
>          Time Spent: 13h
>  Remaining Estimate: 0h
>
> Now that we have the capability to run queries against table snapshots through our map reduce integration, we can utilize this capability for stats collection too. This would make our stats collection more resilient, resource aware and less resource intensive. The bulk of the plumbing is already in place. We would need to make sure that the integration doesn't barf when the query is an UPDATE STATISTICS command.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)