You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Airton Sampaio de Sobral (JIRA)" <ji...@apache.org> on 2018/03/11 19:14:00 UTC
[jira] [Updated] (YARN-8023) REST API doesn't show new application
[ https://issues.apache.org/jira/browse/YARN-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Airton Sampaio de Sobral updated YARN-8023:
-------------------------------------------
Description:
After killing an application using the HADOOP UI, and creating a new one with the same configuration, the brand new one doesn't appear on the API route:
/api/v1/applications?status=running
I've tried the applications path as well (/api/v1/applications) without success.
This happens randomly and it seems that after a really long time, the new instance appears on the API.
On the UI the new application instance appears, and it's working fine. (Print screen on attachment).
On the API it shows the last instance of the application as it's running, but it's dead by one hour!
{code:java}
/api/v1/applications?status=running
{
"id" : "application_1511385973584_0087",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-01-16T19:08:32.275GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-01-16T19:08:34.016GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1516129712275,
"lastUpdatedEpoch" : 1516129714016
}
{code}
Update:
After two hours, the application appeared on the API response:
{code:java}
{
"id" : "application_1511385973584_0154",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-03-10T21:08:30.557GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-03-10T21:08:32.310GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1520716110557,
"lastUpdatedEpoch" : 1520716112310
}
{code}
was:
After killing an application using the HADOOP UI, and creating a new one with the same configuration, the brand new one doesn't appear on the API route:
/api/v1/applications?status=running
I've tried the applications path as well (/api/v1/applications) without success.
This happens randomly and it seems that after a really long time, the new instance appears on the API.
On the UI the new application instance appears, and it's working fine. (Print screen on attachment).
On the API it shows the last instance of the application as it's running, but it's dead by one hour!
{code:java}
/api/v1/applications?status=running
{
"id" : "application_1511385973584_0087",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-01-16T19:08:32.275GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-01-16T19:08:34.016GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1516129712275,
"lastUpdatedEpoch" : 1516129714016
} ]
}
{code}
Update:
After two hours, the application appeared on the API response:
{code:java}
{
"id" : "application_1511385973584_0154",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-03-10T21:08:30.557GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-03-10T21:08:32.310GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1520716110557,
"lastUpdatedEpoch" : 1520716112310
}
{code}
> REST API doesn't show new application
> -------------------------------------
>
> Key: YARN-8023
> URL: https://issues.apache.org/jira/browse/YARN-8023
> Project: Hadoop YARN
> Issue Type: Bug
> Components: api
> Affects Versions: 2.7.3
> Environment: Release label:emr-5.5.0
> Hadoop distribution:Amazon 2.7.3
> Applications:Spark 2.1.0, Hive 2.1.1, Hue 3.12.0
> Reporter: Airton Sampaio de Sobral
> Priority: Major
> Attachments: Screen Shot 2018-03-10 at 5.46.13 PM.png
>
>
> After killing an application using the HADOOP UI, and creating a new one with the same configuration, the brand new one doesn't appear on the API route:
> /api/v1/applications?status=running
> I've tried the applications path as well (/api/v1/applications) without success.
> This happens randomly and it seems that after a really long time, the new instance appears on the API.
> On the UI the new application instance appears, and it's working fine. (Print screen on attachment).
> On the API it shows the last instance of the application as it's running, but it's dead by one hour!
> {code:java}
> /api/v1/applications?status=running
> {
> "id" : "application_1511385973584_0087",
> "name" : "AdActionPaymentKafkaToJDBC",
> "attempts" : [ {
> "attemptId" : "1",
> "startTime" : "2018-01-16T19:08:32.275GMT",
> "endTime" : "1969-12-31T23:59:59.999GMT",
> "lastUpdated" : "2018-01-16T19:08:34.016GMT",
> "duration" : 0,
> "sparkUser" : "hadoop",
> "completed" : false,
> "endTimeEpoch" : -1,
> "startTimeEpoch" : 1516129712275,
> "lastUpdatedEpoch" : 1516129714016
> }
> {code}
>
> Update:
> After two hours, the application appeared on the API response:
>
> {code:java}
> {
> "id" : "application_1511385973584_0154",
> "name" : "AdActionPaymentKafkaToJDBC",
> "attempts" : [ {
> "attemptId" : "1",
> "startTime" : "2018-03-10T21:08:30.557GMT",
> "endTime" : "1969-12-31T23:59:59.999GMT",
> "lastUpdated" : "2018-03-10T21:08:32.310GMT",
> "duration" : 0,
> "sparkUser" : "hadoop",
> "completed" : false,
> "endTimeEpoch" : -1,
> "startTimeEpoch" : 1520716110557,
> "lastUpdatedEpoch" : 1520716112310
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org