[jira] [Commented] (PHOENIX-5332) Fix slow running Integration Tests

["Lars Hofhansl (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PHOENIX-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863434#comment-16863434 ] 

Lars Hofhansl commented on PHOENIX-5332:
----------------------------------------

It looks like ChunkedResultIteratorTest (subclasses ParallelStatsDisabledIT) and CoprocessorHConnectionTableFactoryTest (subclasses BaseUniqueNamesOwnClusterIT) are not meant to run with the default tests.

[~tdsilva], do you know why/how they'd run there?


> Fix slow running Integration Tests
> ----------------------------------
>
>                 Key: PHOENIX-5332
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5332
>             Project: Phoenix
>          Issue Type: Test
>            Reporter: Lars Hofhansl
>            Priority: Major
>
> I picked out the slow running tests. From the last (only) successful jenkins run.
> The overall run took 3 hr 9 min (on H26)
> I picked the slow ones in the following way:
> * More than 60s in the default tests
> * More than 120s in the StatsEnabledTests
> * And more than 200s in StatsDisabledTests, etc.
> {code:java}
> [INFO] --- maven-surefire-plugin:2.20:test (default-test) @ phoenix-core ---
> [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.455 s - in org.apache.phoenix.iterate.ChunkedResultIteratorTest
> [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.869 s - in org.apache.phoenix.util.CoprocessorHConnectionTableFactoryTest
> [INFO] --- maven-failsafe-plugin:2.20:integration-test (ParallelStatsEnabledTest) @ phoenix-core ---
> [INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 108.031 s - in org.apache.phoenix.end2end.QueryWithTableSampleIT
> [INFO] Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.746 s - in org.apache.phoenix.end2end.ExplainPlanWithStatsEnabledIT
> [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 222.043 s - in org.apache.phoenix.end2end.TenantSpecificTablesDDLIT
> [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 212.731 s - in org.apache.phoenix.end2end.TenantSpecificTablesDMLIT
> [INFO] --- maven-failsafe-plugin:2.20:integration-test (ParallelStatsDisabledTest) @ phoenix-core ---
> [INFO] Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 501.869 s - in org.apache.phoenix.end2end.AlterTableIT
> [INFO] Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 453.287 s - in org.apache.phoenix.end2end.CastAndCoerceIT
> [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 576.443 s - in org.apache.phoenix.end2end.CaseStatementIT
> [INFO] Tests run: 57, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 395.982 s - in org.apache.phoenix.end2end.DateTimeIT
> [INFO] Tests run: 64, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 560.619 s - in org.apache.phoenix.end2end.DeleteIT
> [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 596.039 s - in org.apache.phoenix.end2end.InQueryIT
> [INFO] Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 330.19 s - in org.apache.phoenix.end2end.NotQueryWithGlobalImmutableIndexesIT
> [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 672.726 s - in org.apache.phoenix.end2end.GroupByIT
> [INFO] Tests run: 70, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 664.045 s - in org.apache.phoenix.end2end.IntArithmeticIT
> [INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 383.414 s - in org.apache.phoenix.end2end.NotQueryWithLocalImmutableIndexesIT
> [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 230.93 s - in org.apache.phoenix.end2end.OrderByWithServerClientSpoolingDisabledIT
> [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 227.712 s - in org.apache.phoenix.end2end.OrderByIT
> [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 228.137 s - in org.apache.phoenix.end2end.OrderByWithSpillingIT
> [INFO] Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 537.589 s - in org.apache.phoenix.end2end.NullIT
> [INFO] Tests run: 48, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 446.558 s - in org.apache.phoenix.end2end.OnDuplicateKeyIT
> [INFO] Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,262.998 s - in org.apache.phoenix.end2end.InListIT
> [INFO] Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 582.677 s - in org.apache.phoenix.end2end.OrphanViewToolIT
> [INFO] Tests run: 55, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 254.14 s - in org.apache.phoenix.end2end.ProductMetricsIT
> [INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 300.546 s - in org.apache.phoenix.end2end.PropertiesInSyncIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 410.912 s - in org.apache.phoenix.end2end.PointInTimeQueryIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 400.997 s - in org.apache.phoenix.end2end.QueryIT
> [INFO] Tests run: 47, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 240.318 s - in org.apache.phoenix.end2end.RowValueConstructorIT
> [INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 285.189 s - in org.apache.phoenix.end2end.SetPropertyOnNonEncodedTableIT
> [INFO] Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 524.262 s - in org.apache.phoenix.end2end.RangeScanIT
> [INFO] Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 283.875 s - in org.apache.phoenix.end2end.SortOrderIT
> [INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 294.88 s - in org.apache.phoenix.end2end.StoreNullsIT
> [INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 240.646 s - in org.apache.phoenix.end2end.VariableLengthPKIT
> [INFO] Tests run: 35, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 336.108 s - in org.apache.phoenix.end2end.UngroupedIT
> [INFO] Tests run: 52, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 434.348 s - in org.apache.phoenix.end2end.UpsertSelectIT
> [INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 265.486 s - in org.apache.phoenix.end2end.index.DropColumnIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 468.432 s - in org.apache.phoenix.end2end.index.GlobalImmutableNonTxIndexIT
> [INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 238.975 s - in org.apache.phoenix.end2end.index.IndexMetadataIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 468.03 s - in org.apache.phoenix.end2end.index.GlobalMutableNonTxIndexIT
> [INFO] Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 249.307 s - in org.apache.phoenix.end2end.index.IndexWithTableSchemaChangeIT
> [INFO] Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 398.894 s - in org.apache.phoenix.end2end.index.IndexUsageIT
> [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 710.764 s - in org.apache.phoenix.end2end.index.GlobalImmutableTxIndexIT
> [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 683.769 s - in org.apache.phoenix.end2end.index.GlobalMutableTxIndexIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 522.919 s - in org.apache.phoenix.end2end.index.LocalImmutableNonTxIndexIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 514.189 s - in org.apache.phoenix.end2end.index.LocalImmutableTxIndexIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 519.565 s - in org.apache.phoenix.end2end.index.LocalMutableNonTxIndexIT
> [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 515.596 s - in org.apache.phoenix.end2end.index.LocalMutableTxIndexIT
> [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 665.824 s - in org.apache.phoenix.end2end.index.MutableIndexSplitForwardScanIT
> [INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 310.472 s - in org.apache.phoenix.end2end.join.HashJoinNoIndexIT
> [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 672.243 s - in org.apache.phoenix.end2end.index.MutableIndexSplitReverseScanIT
> [INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 573.679 s - in org.apache.phoenix.end2end.join.HashJoinGlobalIndexIT
> [INFO] Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 413.78 s - in org.apache.phoenix.end2end.join.SubqueryIT
> [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 376.881 s - in org.apache.phoenix.end2end.join.SortMergeJoinNoIndexIT
> [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 648.02 s - in org.apache.phoenix.end2end.join.SortMergeJoinGlobalIndexIT
> [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 849.373 s - in org.apache.phoenix.end2end.join.HashJoinLocalIndexIT
> [INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 284.452 s - in org.apache.phoenix.end2end.join.SubqueryUsingSortMergeJoinIT
> [INFO] Tests run: 117, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,387.919 s - in org.apache.phoenix.end2end.index.MutableIndexIT
> [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 867.228 s - in org.apache.phoenix.end2end.join.SortMergeJoinLocalIndexIT
> [INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 428.32 s - in org.apache.phoenix.tx.TxCheckpointIT
> [INFO] Tests run: 78, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 726.224 s - in org.apache.phoenix.tx.ParameterizedTransactionIT
> [INFO] --- maven-failsafe-plugin:2.20:integration-test (HBaseManagedTimeTests) @ phoenix-core ---
> [INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 197.833 s - in org.apache.phoenix.end2end.IndexExtendedIT
> [INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 202.324 s - in org.apache.phoenix.end2end.FlappingLocalIndexIT
> [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 219.961 s - in org.apache.phoenix.end2end.IndexBuildTimestampIT
> [INFO] Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 440.555 s - in org.apache.phoenix.end2end.CostBasedDecisionIT
> [INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 271.925 s - in org.apache.phoenix.end2end.PermissionNSEnabledIT
> [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 428.637 s - in org.apache.phoenix.end2end.LocalIndexSplitMergeIT
> [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 429.078 s - in org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT
> [INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 284.159 s - in org.apache.phoenix.end2end.PermissionsCacheIT
> [INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 292.645 s - in org.apache.phoenix.end2end.index.MutableIndexFailureIT
> [WARNING] Tests run: 45, Failures: 0, Errors: 0, Skipped: 18, Time elapsed: 461.384 s - in org.apache.phoenix.end2end.index.ImmutableIndexIT
> [INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 677.407 s - in org.apache.phoenix.end2end.index.LocalIndexIT
> [INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,059.417 s - in org.apache.phoenix.end2end.SystemCatalogCreationOnConnectionIT
> [INFO] Tests run: 35, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 342.872 s - in org.apache.phoenix.end2end.join.SortMergeJoinNoSpoolingIT
> [INFO] Tests run: 31, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 463.565 s - in org.apache.phoenix.end2end.index.PartialIndexRebuilderIT
> [WARNING] Tests run: 26, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 250.928 s - in org.apache.phoenix.schema.stats.NamespaceDisabledStatsCollectorIT
> [WARNING] Tests run: 26, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 275.674 s - in org.apache.phoenix.schema.stats.NamespaceEnabledStatsCollectorIT
> [WARNING] Tests run: 39, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 221.189 s - in org.apache.phoenix.schema.stats.NonTxStatsCollectorIT
> [WARNING] Tests run: 78, Failures: 0, Errors: 0, Skipped: 12, Time elapsed: 388.278 s - in org.apache.phoenix.schema.stats.TxStatsCollectorIT
> [INFO] Tests run: 164, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2,237.378 s - in org.apache.phoenix.end2end.IndexToolIT
> [INFO] --- maven-failsafe-plugin:2.20:integration-test (SplitSystemCatalogTests) @ phoenix-core ---
> [WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 232.007 s - in org.apache.phoenix.end2end.index.ViewIndexIT
> [INFO] Tests run: 112, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,158.968 s - in org.apache.phoenix.end2end.AlterTableWithViewsIT
> [INFO] Tests run: 165, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,226.699 s - in org.apache.phoenix.end2end.ViewIT
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)