You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Vrushali C (JIRA)" <ji...@apache.org> on 2015/03/04 02:43:05 UTC
[jira] [Updated] (YARN-3264) [Storage implementation] Create a POC
only file based storage implementation for ATS writes
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vrushali C updated YARN-3264:
-----------------------------
Attachment: YARN-3264.001.patch
Uploading a patch that contains a FileSystem based backend storage implementation for PoC. The FileSystemTimelineServiceWriterImpl will create files under
/tmp/org.apache.hadoop.yarn.server.timelineservice.storage.FileSystemTimelineServiceWriterImpl/{entity_type}/{entity_id}.thist.
The patch adds to the Distributed Shell test case the check for entities written out by the TimelineAggregator and the TimelineServiceWriter.
This is what I see under /tmp/ if I comment out the deletion in the TestDistributedShell unit test at line 375.
{code}
$ cat /tmp/org.apache.hadoop.yarn.server.timelineservice.storage.FileSystemTimelineServiceWriterImpl/*/*
{"metrics":[],"events":[{"id":"DS_APP_ATTEMPT_START","timestamp":1425432577909,"info":{}}],"id":"appattempt_1425432568784_0001_000001","type":"DS_APP_ATTEMPT","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}
{"metrics":[],"events":[{"id":"DS_APP_ATTEMPT_START","timestamp":1425432578900,"info":{}}],"id":"appattempt_1425432568784_0001_000001","type":"DS_APP_ATTEMPT","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}
{"metrics":[],"events":[{"id":"DS_CONTAINER_START","timestamp":1425432581007,"info":{"Node":"localhost:57638","Resources":"<memory:128, vCores:1>"}}],"id":"container_1425432568784_0001_01_000002","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}
{"metrics":[],"events":[{"id":"DS_CONTAINER_END","timestamp":1425432581954,"info":{"State":"COMPLETE","Exit Status":0}}],"id":"container_1425432568784_0001_01_000002","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}
{"metrics":[],"events":[{"id":"DS_CONTAINER_START","timestamp":1425432581988,"info":{"Node":"localhost:57638","Resources":"<memory:128, vCores:1>"}}],"id":"container_1425432568784_0001_01_000003","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}
{"metrics":[],"events":[{"id":"DS_CONTAINER_END","timestamp":1425432582958,"info":{"State":"COMPLETE","Exit Status":0}}],"id":"container_1425432568784_0001_01_000003","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}
$
{code}
> [Storage implementation] Create a POC only file based storage implementation for ATS writes
> -------------------------------------------------------------------------------------------
>
> Key: YARN-3264
> URL: https://issues.apache.org/jira/browse/YARN-3264
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
> Reporter: Vrushali C
> Assignee: Vrushali C
> Attachments: YARN-3264.001.patch
>
>
> For the PoC, need to create a backend impl for file based storage of entities
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)