You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by Sowmya Ramesh <sr...@hortonworks.com> on 2015/10/05 23:48:18 UTC

Review Request 39021: In secure cluster setup Hcat process/feed scheduling or replication fails

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39021/
-----------------------------------------------------------

Review request for Falcon and Venkat Ranganathan.


Bugs: FALCON-1487
    https://issues.apache.org/jira/browse/FALCON-1487


Repository: falcon-git


Description
-------

In secure cluster setup Hcat process/feed scheduling or replication fails


2015-09-04 03:06:06,037 ERROR - [1665833062@qtp-1725008249-183 - 5fae7e43-444e-42c7-8591-1b7977abc759:hrt_qa:POST//entities/submitAndSchedule/process] ~ Unable to schedule workflow (AbstractSchedulableEntityManager:76)

Caused by: org.apache.falcon.FalconException: IO_ERROR : java.net.SocketTimeoutException: Read timed out
	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:234)
	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.schedule(OozieWorkflowEngine.java:172)
	at org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:94)
	... 66 more
Caused by: IO_ERROR : java.net.SocketTimeoutException: Read timed out
	at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:569)
	at org.apache.oozie.client.OozieClient.dryrun(OozieClient.java:829)
	at org.apache.oozie.client.ProxyOozieClient.access$401(ProxyOozieClient.java:48)
	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:177)
	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:174)
	at org.apache.oozie.client.OozieClient.doAs(OozieClient.java:244)
	at org.apache.oozie.client.ProxyOozieClient.dryrun(ProxyOozieClient.java:174)


Diffs
-----

  oozie/src/main/java/org/apache/falcon/oozie/OozieBundleBuilder.java 8026967 

Diff: https://reviews.apache.org/r/39021/diff/


Testing
-------

Manual testing


Thanks,

Sowmya Ramesh


Re: Review Request 39021: In secure cluster setup Hcat process/feed scheduling or replication fails

Posted by Balu Vellanki <bv...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39021/#review101539
-----------------------------------------------------------

Ship it!


Ship It!

- Balu Vellanki


On Oct. 5, 2015, 9:48 p.m., Sowmya Ramesh wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/39021/
> -----------------------------------------------------------
> 
> (Updated Oct. 5, 2015, 9:48 p.m.)
> 
> 
> Review request for Falcon and Venkat Ranganathan.
> 
> 
> Bugs: FALCON-1487
>     https://issues.apache.org/jira/browse/FALCON-1487
> 
> 
> Repository: falcon-git
> 
> 
> Description
> -------
> 
> In secure cluster setup Hcat process/feed scheduling or replication fails
> 
> 
> 2015-09-04 03:06:06,037 ERROR - [1665833062@qtp-1725008249-183 - 5fae7e43-444e-42c7-8591-1b7977abc759:hrt_qa:POST//entities/submitAndSchedule/process] ~ Unable to schedule workflow (AbstractSchedulableEntityManager:76)
> 
> Caused by: org.apache.falcon.FalconException: IO_ERROR : java.net.SocketTimeoutException: Read timed out
> 	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:234)
> 	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.schedule(OozieWorkflowEngine.java:172)
> 	at org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:94)
> 	... 66 more
> Caused by: IO_ERROR : java.net.SocketTimeoutException: Read timed out
> 	at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:569)
> 	at org.apache.oozie.client.OozieClient.dryrun(OozieClient.java:829)
> 	at org.apache.oozie.client.ProxyOozieClient.access$401(ProxyOozieClient.java:48)
> 	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:177)
> 	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:174)
> 	at org.apache.oozie.client.OozieClient.doAs(OozieClient.java:244)
> 	at org.apache.oozie.client.ProxyOozieClient.dryrun(ProxyOozieClient.java:174)
> 
> 
> Diffs
> -----
> 
>   oozie/src/main/java/org/apache/falcon/oozie/OozieBundleBuilder.java 8026967 
> 
> Diff: https://reviews.apache.org/r/39021/diff/
> 
> 
> Testing
> -------
> 
> Manual testing
> 
> 
> Thanks,
> 
> Sowmya Ramesh
> 
>


Re: Review Request 39021: In secure cluster setup Hcat process/feed scheduling or replication fails

Posted by Venkat Ranganathan <n....@live.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39021/#review101607
-----------------------------------------------------------

Ship it!


The issue was that source hcat server properties will not be set for the coordinator and this causes wrong principal to be sent to the server causing checksum errors.

- Venkat Ranganathan


On Oct. 5, 2015, 2:48 p.m., Sowmya Ramesh wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/39021/
> -----------------------------------------------------------
> 
> (Updated Oct. 5, 2015, 2:48 p.m.)
> 
> 
> Review request for Falcon and Venkat Ranganathan.
> 
> 
> Bugs: FALCON-1487
>     https://issues.apache.org/jira/browse/FALCON-1487
> 
> 
> Repository: falcon-git
> 
> 
> Description
> -------
> 
> In secure cluster setup Hcat process/feed scheduling or replication fails
> 
> 
> 2015-09-04 03:06:06,037 ERROR - [1665833062@qtp-1725008249-183 - 5fae7e43-444e-42c7-8591-1b7977abc759:hrt_qa:POST//entities/submitAndSchedule/process] ~ Unable to schedule workflow (AbstractSchedulableEntityManager:76)
> 
> Caused by: org.apache.falcon.FalconException: IO_ERROR : java.net.SocketTimeoutException: Read timed out
> 	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:234)
> 	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.schedule(OozieWorkflowEngine.java:172)
> 	at org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:94)
> 	... 66 more
> Caused by: IO_ERROR : java.net.SocketTimeoutException: Read timed out
> 	at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:569)
> 	at org.apache.oozie.client.OozieClient.dryrun(OozieClient.java:829)
> 	at org.apache.oozie.client.ProxyOozieClient.access$401(ProxyOozieClient.java:48)
> 	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:177)
> 	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:174)
> 	at org.apache.oozie.client.OozieClient.doAs(OozieClient.java:244)
> 	at org.apache.oozie.client.ProxyOozieClient.dryrun(ProxyOozieClient.java:174)
> 
> 
> Diffs
> -----
> 
>   oozie/src/main/java/org/apache/falcon/oozie/OozieBundleBuilder.java 8026967 
> 
> Diff: https://reviews.apache.org/r/39021/diff/
> 
> 
> Testing
> -------
> 
> Manual testing
> 
> 
> Thanks,
> 
> Sowmya Ramesh
> 
>