You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@knox.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/06/11 12:50:00 UTC
[jira] [Work logged] (KNOX-2386) Implement Autodiscovery in Knox
for Flink
[ https://issues.apache.org/jira/browse/KNOX-2386?focusedWorklogId=444252&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444252 ]
ASF GitHub Bot logged work on KNOX-2386:
----------------------------------------
Author: ASF GitHub Bot
Created on: 11/Jun/20 12:49
Start Date: 11/Jun/20 12:49
Worklog Time Spent: 10m
Work Description: smolnar82 opened a new pull request #344:
URL: https://github.com/apache/knox/pull/344
#206 What changes were proposed in this pull request?
Added CM service discovery support for Apache Flink
## How was this patch tested?
Unit testing:
```
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 18:09 min (Wall Clock)
[INFO] Finished at: 2020-06-11T14:17:20+02:00
[INFO] Final Memory: 429M/2075M
[INFO] ------------------------------------------------------------------------
```
Manual testing:
1. deployed Knox with my changes in a running CM cluster
2. updated `Flink Dashboard Port` from 8082 to 9999 and restarted Flink
3. Confirmed that Knox picked-up the change:
```
2020-06-11 04:55:39,891 DEBUG discovery.cm (PollingConfigurationAnalyzer.java:getCurrentServiceConfiguration(470)) - Getting current configuration for FLINK-1 from Cluster 1 @ https://morhidi-secure-1.vpc.cloudera.com:7183
2020-06-11 04:55:40,059 DEBUG discovery.cm (PollingConfigurationAnalyzer.java:hasConfigChanged(250)) - Analyzing current FLINK-1 configuration for changes...
2020-06-11 04:55:40,059 INFO discovery.cm (PollingConfigurationAnalyzer.java:hasConfigurationChanged(539)) - Role property historyserver_web_port value has changed from 8082 to 9999
2020-06-11 04:55:40,059 INFO knox.gateway (DefaultTopologyService.java:onConfigurationChange(968)) - A cluster configuration change was noticed for Cluster 1 @ https://morhidi-secure-1.vpc.cloudera.com:7183
2020-06-11 04:55:40,066 INFO knox.gateway (DefaultTopologyService.java:onConfigurationChange(976)) - Triggering topology regeneration for descriptor /var/lib/knox/gateway/conf/descriptors/cdp-proxy.json because of change to the Cluster 1 @ https://morhidi-secure-1.vpc.cloudera.com:7183 configuration.
```
4. Confirmed that Flink Dashboard was reachable from `cdp-proxy`:
<img width="1678" alt="Screen Shot 2020-06-11 at 1 56 50 PM" src="https://user-images.githubusercontent.com/34065904/84387050-afe9ec80-abf2-11ea-9b3a-baf7cde6991f.png">
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 444252)
Remaining Estimate: 0h
Time Spent: 10m
> Implement Autodiscovery in Knox for Flink
> -----------------------------------------
>
> Key: KNOX-2386
> URL: https://issues.apache.org/jira/browse/KNOX-2386
> Project: Apache Knox
> Issue Type: Task
> Components: Server
> Reporter: Sandor Molnar
> Assignee: Sandor Molnar
> Priority: Major
> Fix For: 1.5.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Add auto-discovery support to Apache Flink.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)