You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by Suhas Vasu <su...@gmail.com> on 2015/04/08 16:14:52 UTC
Review Request 32974: Dynamic partitions not getting registered in
Hcat
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32974/
-----------------------------------------------------------
Review request for Falcon.
Repository: falcon-git
Description
-------
While registering dynamic partion in Hcat for a process, java.lang.NoSuchMethodError is thrown.
The StringUtils.repeat(String, String, int) method is present in commons-lang version 2.5 and above. We depend on commons-lang 2.6.
But hive-exec we use, bundles commons-lang 2.4, causing the classpath to mess up and cause the above error.
Diffs
-----
client/pom.xml 81d94c6
client/src/main/java/org/apache/falcon/ResponseHelper.java 666e418
client/src/main/java/org/apache/falcon/cli/FalconCLI.java 958ea62
client/src/main/java/org/apache/falcon/cli/FalconMetadataCLI.java 515d328
client/src/main/java/org/apache/falcon/client/FalconClient.java 15691a6
client/src/main/java/org/apache/falcon/recipe/RecipeTool.java 1a2e2f0
client/src/main/java/org/apache/falcon/resource/EntityList.java d43418c
client/src/main/java/org/apache/falcon/resource/FeedLookupResult.java bc08f00
client/src/main/java/org/apache/falcon/resource/LineageGraphResult.java acf5d11
common/pom.xml ec1d7d1
common/src/main/java/org/apache/falcon/catalog/CatalogPartitionHandler.java f8a3d46
common/src/main/java/org/apache/falcon/entity/EntityUtil.java 3656ae4
common/src/main/java/org/apache/falcon/entity/ExternalId.java c53d83a
common/src/main/java/org/apache/falcon/entity/FeedHelper.java 7f9acc9
common/src/main/java/org/apache/falcon/entity/FileSystemStorage.java a5caf8e
common/src/main/java/org/apache/falcon/entity/ProcessHelper.java 504509d
common/src/main/java/org/apache/falcon/entity/parser/FeedEntityParser.java 448fd70
common/src/main/java/org/apache/falcon/entity/parser/ProcessEntityParser.java 3119b36
common/src/main/java/org/apache/falcon/entity/store/FeedLocationStore.java fefd74b
common/src/main/java/org/apache/falcon/group/FeedGroupMap.java e2dcfce
common/src/main/java/org/apache/falcon/metadata/EntityRelationshipGraphBuilder.java c22bcdb
common/src/main/java/org/apache/falcon/metadata/InstanceRelationshipGraphBuilder.java 87bac69
common/src/main/java/org/apache/falcon/metadata/RelationshipGraphBuilder.java b92224b
common/src/main/java/org/apache/falcon/security/CurrentUser.java 11adccd
common/src/main/java/org/apache/falcon/security/DefaultAuthorizationProvider.java f6da2cf
common/src/main/java/org/apache/falcon/update/UpdateHelper.java 54d799c
common/src/main/java/org/apache/falcon/util/ApplicationProperties.java 6d89199
common/src/main/java/org/apache/falcon/util/FalconRadixUtils.java 573180a
common/src/main/java/org/apache/falcon/util/RadixNode.java 12227cb
common/src/main/java/org/apache/falcon/util/RadixTree.java 436d7f2
common/src/main/java/org/apache/falcon/workflow/WorkflowExecutionContext.java 887cea2
common/src/main/java/org/apache/falcon/workflow/WorkflowJobEndNotificationService.java 90b66c8
common/src/main/resources/startup.properties 4f41548
messaging/src/main/java/org/apache/falcon/messaging/JMSMessageConsumer.java 4df1490
messaging/src/test/java/org/apache/falcon/messaging/FeedProducerTest.java 2f5aa70
messaging/src/test/java/org/apache/falcon/messaging/ProcessProducerTest.java 1cd3310
oozie-el-extensions/pom.xml 0cbc7c0
oozie-el-extensions/src/main/java/org/apache/oozie/extensions/OozieELExtensions.java f3533b8
oozie/src/main/java/org/apache/falcon/logging/LogProvider.java b4eae5d
oozie/src/main/java/org/apache/falcon/oozie/OozieEntityBuilder.java a9d2f57
oozie/src/main/java/org/apache/falcon/oozie/feed/FeedReplicationCoordinatorBuilder.java 04aab29
oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionCoordinatorBuilder.java 0366350
oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionWorkflowBuilder.java 61cc3c2
oozie/src/main/java/org/apache/falcon/service/SharedLibraryHostingService.java ba87a62
oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java f4ffbc1
oozie/src/test/java/org/apache/falcon/oozie/feed/OozieFeedWorkflowBuilderTest.java 1c599b5
oozie/src/test/java/org/apache/falcon/oozie/workflow/FalconPostProcessingTest.java f08949d
pom.xml f19e67d
prism/src/main/java/org/apache/falcon/Main.java de9f657
prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java c0df4d6
prism/src/main/java/org/apache/falcon/resource/AbstractInstanceManager.java 9630a3b
prism/src/main/java/org/apache/falcon/resource/AbstractSchedulableEntityManager.java f7c2f61
prism/src/main/java/org/apache/falcon/resource/admin/AdminResource.java 2798534
prism/src/main/java/org/apache/falcon/resource/metadata/LineageMetadataResource.java 0c6b2b6
prism/src/main/java/org/apache/falcon/resource/metadata/MetadataDiscoveryResource.java d709eb0
prism/src/main/java/org/apache/falcon/security/FalconAuthenticationFilter.java fa13a7d
prism/src/main/java/org/apache/falcon/security/RemoteUserInHeaderBasedAuthenticationHandler.java 1d32e86
prism/src/main/java/org/apache/falcon/util/Servlets.java 37766f0
prism/src/test/java/org/apache/falcon/resource/EntityManagerTest.java 6f75111
replication/src/main/java/org/apache/falcon/replication/FeedReplicator.java aa58aa9
src/conf/startup.properties 70efc9d
Diff: https://reviews.apache.org/r/32974/diff/
Testing
-------
Have tested this locally
Thanks,
Suhas Vasu
Re: Review Request 32974: Dynamic partitions not getting registered
in Hcat
Posted by Ajay Yadava <aj...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32974/#review79347
-----------------------------------------------------------
Ship it!
Ship It!
- Ajay Yadava
On April 8, 2015, 2:14 p.m., Suhas Vasu wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/32974/
> -----------------------------------------------------------
>
> (Updated April 8, 2015, 2:14 p.m.)
>
>
> Review request for Falcon.
>
>
> Repository: falcon-git
>
>
> Description
> -------
>
> While registering dynamic partion in Hcat for a process, java.lang.NoSuchMethodError is thrown.
> The StringUtils.repeat(String, String, int) method is present in commons-lang version 2.5 and above. We depend on commons-lang 2.6.
> But hive-exec we use, bundles commons-lang 2.4, causing the classpath to mess up and cause the above error.
>
>
> Diffs
> -----
>
> client/pom.xml 81d94c6
> client/src/main/java/org/apache/falcon/ResponseHelper.java 666e418
> client/src/main/java/org/apache/falcon/cli/FalconCLI.java 958ea62
> client/src/main/java/org/apache/falcon/cli/FalconMetadataCLI.java 515d328
> client/src/main/java/org/apache/falcon/client/FalconClient.java 15691a6
> client/src/main/java/org/apache/falcon/recipe/RecipeTool.java 1a2e2f0
> client/src/main/java/org/apache/falcon/resource/EntityList.java d43418c
> client/src/main/java/org/apache/falcon/resource/FeedLookupResult.java bc08f00
> client/src/main/java/org/apache/falcon/resource/LineageGraphResult.java acf5d11
> common/pom.xml ec1d7d1
> common/src/main/java/org/apache/falcon/catalog/CatalogPartitionHandler.java f8a3d46
> common/src/main/java/org/apache/falcon/entity/EntityUtil.java 3656ae4
> common/src/main/java/org/apache/falcon/entity/ExternalId.java c53d83a
> common/src/main/java/org/apache/falcon/entity/FeedHelper.java 7f9acc9
> common/src/main/java/org/apache/falcon/entity/FileSystemStorage.java a5caf8e
> common/src/main/java/org/apache/falcon/entity/ProcessHelper.java 504509d
> common/src/main/java/org/apache/falcon/entity/parser/FeedEntityParser.java 448fd70
> common/src/main/java/org/apache/falcon/entity/parser/ProcessEntityParser.java 3119b36
> common/src/main/java/org/apache/falcon/entity/store/FeedLocationStore.java fefd74b
> common/src/main/java/org/apache/falcon/group/FeedGroupMap.java e2dcfce
> common/src/main/java/org/apache/falcon/metadata/EntityRelationshipGraphBuilder.java c22bcdb
> common/src/main/java/org/apache/falcon/metadata/InstanceRelationshipGraphBuilder.java 87bac69
> common/src/main/java/org/apache/falcon/metadata/RelationshipGraphBuilder.java b92224b
> common/src/main/java/org/apache/falcon/security/CurrentUser.java 11adccd
> common/src/main/java/org/apache/falcon/security/DefaultAuthorizationProvider.java f6da2cf
> common/src/main/java/org/apache/falcon/update/UpdateHelper.java 54d799c
> common/src/main/java/org/apache/falcon/util/ApplicationProperties.java 6d89199
> common/src/main/java/org/apache/falcon/util/FalconRadixUtils.java 573180a
> common/src/main/java/org/apache/falcon/util/RadixNode.java 12227cb
> common/src/main/java/org/apache/falcon/util/RadixTree.java 436d7f2
> common/src/main/java/org/apache/falcon/workflow/WorkflowExecutionContext.java 887cea2
> common/src/main/java/org/apache/falcon/workflow/WorkflowJobEndNotificationService.java 90b66c8
> common/src/main/resources/startup.properties 4f41548
> messaging/src/main/java/org/apache/falcon/messaging/JMSMessageConsumer.java 4df1490
> messaging/src/test/java/org/apache/falcon/messaging/FeedProducerTest.java 2f5aa70
> messaging/src/test/java/org/apache/falcon/messaging/ProcessProducerTest.java 1cd3310
> oozie-el-extensions/pom.xml 0cbc7c0
> oozie-el-extensions/src/main/java/org/apache/oozie/extensions/OozieELExtensions.java f3533b8
> oozie/src/main/java/org/apache/falcon/logging/LogProvider.java b4eae5d
> oozie/src/main/java/org/apache/falcon/oozie/OozieEntityBuilder.java a9d2f57
> oozie/src/main/java/org/apache/falcon/oozie/feed/FeedReplicationCoordinatorBuilder.java 04aab29
> oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionCoordinatorBuilder.java 0366350
> oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionWorkflowBuilder.java 61cc3c2
> oozie/src/main/java/org/apache/falcon/service/SharedLibraryHostingService.java ba87a62
> oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java f4ffbc1
> oozie/src/test/java/org/apache/falcon/oozie/feed/OozieFeedWorkflowBuilderTest.java 1c599b5
> oozie/src/test/java/org/apache/falcon/oozie/workflow/FalconPostProcessingTest.java f08949d
> pom.xml f19e67d
> prism/src/main/java/org/apache/falcon/Main.java de9f657
> prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java c0df4d6
> prism/src/main/java/org/apache/falcon/resource/AbstractInstanceManager.java 9630a3b
> prism/src/main/java/org/apache/falcon/resource/AbstractSchedulableEntityManager.java f7c2f61
> prism/src/main/java/org/apache/falcon/resource/admin/AdminResource.java 2798534
> prism/src/main/java/org/apache/falcon/resource/metadata/LineageMetadataResource.java 0c6b2b6
> prism/src/main/java/org/apache/falcon/resource/metadata/MetadataDiscoveryResource.java d709eb0
> prism/src/main/java/org/apache/falcon/security/FalconAuthenticationFilter.java fa13a7d
> prism/src/main/java/org/apache/falcon/security/RemoteUserInHeaderBasedAuthenticationHandler.java 1d32e86
> prism/src/main/java/org/apache/falcon/util/Servlets.java 37766f0
> prism/src/test/java/org/apache/falcon/resource/EntityManagerTest.java 6f75111
> replication/src/main/java/org/apache/falcon/replication/FeedReplicator.java aa58aa9
> src/conf/startup.properties 70efc9d
>
> Diff: https://reviews.apache.org/r/32974/diff/
>
>
> Testing
> -------
>
> Have tested this locally
>
>
> Thanks,
>
> Suhas Vasu
>
>
Re: Review Request 32974: Dynamic partitions not getting registered
in Hcat
Posted by Scott Preece <se...@yahoo.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32974/#review79405
-----------------------------------------------------------
Ship it!
- Scott Preece
On April 8, 2015, 2:14 p.m., Suhas Vasu wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/32974/
> -----------------------------------------------------------
>
> (Updated April 8, 2015, 2:14 p.m.)
>
>
> Review request for Falcon.
>
>
> Repository: falcon-git
>
>
> Description
> -------
>
> While registering dynamic partion in Hcat for a process, java.lang.NoSuchMethodError is thrown.
> The StringUtils.repeat(String, String, int) method is present in commons-lang version 2.5 and above. We depend on commons-lang 2.6.
> But hive-exec we use, bundles commons-lang 2.4, causing the classpath to mess up and cause the above error.
>
>
> Diffs
> -----
>
> client/pom.xml 81d94c6
> client/src/main/java/org/apache/falcon/ResponseHelper.java 666e418
> client/src/main/java/org/apache/falcon/cli/FalconCLI.java 958ea62
> client/src/main/java/org/apache/falcon/cli/FalconMetadataCLI.java 515d328
> client/src/main/java/org/apache/falcon/client/FalconClient.java 15691a6
> client/src/main/java/org/apache/falcon/recipe/RecipeTool.java 1a2e2f0
> client/src/main/java/org/apache/falcon/resource/EntityList.java d43418c
> client/src/main/java/org/apache/falcon/resource/FeedLookupResult.java bc08f00
> client/src/main/java/org/apache/falcon/resource/LineageGraphResult.java acf5d11
> common/pom.xml ec1d7d1
> common/src/main/java/org/apache/falcon/catalog/CatalogPartitionHandler.java f8a3d46
> common/src/main/java/org/apache/falcon/entity/EntityUtil.java 3656ae4
> common/src/main/java/org/apache/falcon/entity/ExternalId.java c53d83a
> common/src/main/java/org/apache/falcon/entity/FeedHelper.java 7f9acc9
> common/src/main/java/org/apache/falcon/entity/FileSystemStorage.java a5caf8e
> common/src/main/java/org/apache/falcon/entity/ProcessHelper.java 504509d
> common/src/main/java/org/apache/falcon/entity/parser/FeedEntityParser.java 448fd70
> common/src/main/java/org/apache/falcon/entity/parser/ProcessEntityParser.java 3119b36
> common/src/main/java/org/apache/falcon/entity/store/FeedLocationStore.java fefd74b
> common/src/main/java/org/apache/falcon/group/FeedGroupMap.java e2dcfce
> common/src/main/java/org/apache/falcon/metadata/EntityRelationshipGraphBuilder.java c22bcdb
> common/src/main/java/org/apache/falcon/metadata/InstanceRelationshipGraphBuilder.java 87bac69
> common/src/main/java/org/apache/falcon/metadata/RelationshipGraphBuilder.java b92224b
> common/src/main/java/org/apache/falcon/security/CurrentUser.java 11adccd
> common/src/main/java/org/apache/falcon/security/DefaultAuthorizationProvider.java f6da2cf
> common/src/main/java/org/apache/falcon/update/UpdateHelper.java 54d799c
> common/src/main/java/org/apache/falcon/util/ApplicationProperties.java 6d89199
> common/src/main/java/org/apache/falcon/util/FalconRadixUtils.java 573180a
> common/src/main/java/org/apache/falcon/util/RadixNode.java 12227cb
> common/src/main/java/org/apache/falcon/util/RadixTree.java 436d7f2
> common/src/main/java/org/apache/falcon/workflow/WorkflowExecutionContext.java 887cea2
> common/src/main/java/org/apache/falcon/workflow/WorkflowJobEndNotificationService.java 90b66c8
> common/src/main/resources/startup.properties 4f41548
> messaging/src/main/java/org/apache/falcon/messaging/JMSMessageConsumer.java 4df1490
> messaging/src/test/java/org/apache/falcon/messaging/FeedProducerTest.java 2f5aa70
> messaging/src/test/java/org/apache/falcon/messaging/ProcessProducerTest.java 1cd3310
> oozie-el-extensions/pom.xml 0cbc7c0
> oozie-el-extensions/src/main/java/org/apache/oozie/extensions/OozieELExtensions.java f3533b8
> oozie/src/main/java/org/apache/falcon/logging/LogProvider.java b4eae5d
> oozie/src/main/java/org/apache/falcon/oozie/OozieEntityBuilder.java a9d2f57
> oozie/src/main/java/org/apache/falcon/oozie/feed/FeedReplicationCoordinatorBuilder.java 04aab29
> oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionCoordinatorBuilder.java 0366350
> oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionWorkflowBuilder.java 61cc3c2
> oozie/src/main/java/org/apache/falcon/service/SharedLibraryHostingService.java ba87a62
> oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java f4ffbc1
> oozie/src/test/java/org/apache/falcon/oozie/feed/OozieFeedWorkflowBuilderTest.java 1c599b5
> oozie/src/test/java/org/apache/falcon/oozie/workflow/FalconPostProcessingTest.java f08949d
> pom.xml f19e67d
> prism/src/main/java/org/apache/falcon/Main.java de9f657
> prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java c0df4d6
> prism/src/main/java/org/apache/falcon/resource/AbstractInstanceManager.java 9630a3b
> prism/src/main/java/org/apache/falcon/resource/AbstractSchedulableEntityManager.java f7c2f61
> prism/src/main/java/org/apache/falcon/resource/admin/AdminResource.java 2798534
> prism/src/main/java/org/apache/falcon/resource/metadata/LineageMetadataResource.java 0c6b2b6
> prism/src/main/java/org/apache/falcon/resource/metadata/MetadataDiscoveryResource.java d709eb0
> prism/src/main/java/org/apache/falcon/security/FalconAuthenticationFilter.java fa13a7d
> prism/src/main/java/org/apache/falcon/security/RemoteUserInHeaderBasedAuthenticationHandler.java 1d32e86
> prism/src/main/java/org/apache/falcon/util/Servlets.java 37766f0
> prism/src/test/java/org/apache/falcon/resource/EntityManagerTest.java 6f75111
> replication/src/main/java/org/apache/falcon/replication/FeedReplicator.java aa58aa9
> src/conf/startup.properties 70efc9d
>
> Diff: https://reviews.apache.org/r/32974/diff/
>
>
> Testing
> -------
>
> Have tested this locally
>
>
> Thanks,
>
> Suhas Vasu
>
>