[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

["Rohith Sharma K S (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15454227#comment-15454227 ] 

Rohith Sharma K S commented on YARN-5585:
-----------------------------------------

bq. Can we translate the fromId request into some HBase filters so that we can process this request on the storage layer?
Ultimately this will be better way to do rather than at TimelineReader API level. But I am not sure that does HBase filters can support to scan the rows which are less than or greater than id's. I will have look at this with high priority. This make more sense to me. 

bq. but note that this requires some in-memory operation to actually sort all entities, but not only read part of them out from the storage?
This is current behavior. Already entities are sorted using TimelineClient#compareTo in {{TimelineEntityReader#readEntities}}.  Another loop on sorted entities required to achieve this.

bq. he problem with this kind of an approach is that new apps keep on getting added so result may not be latest.
It is fine to me. I agree with Lilu.



> [Atsv2] Add a new filter fromId in REST endpoints
> -------------------------------------------------
>
>                 Key: YARN-5585
>                 URL: https://issues.apache.org/jira/browse/YARN-5585
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelinereader
>            Reporter: Rohith Sharma K S
>            Assignee: Rohith Sharma K S
>
> TimelineReader REST API's provides lot of filters to retrieve the applications. Along with those, it would be good to add new filter i.e fromId so that entities can be retrieved after the fromId. 
> Example : If applications are stored database, app-1 app-2 ... app-10.
> *getApps?limit=5* gives app-1 to app-10. But to retrieve next 5 apps, it is difficult.
> So proposal is to have fromId in the filter like *getApps?limit=5&&fromId=app-5* which gives list of apps from app-6 to app-10. 
> This is very useful for pagination in web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org