You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sdap.apache.org by "Thomas G Loubrieu (Jira)" <ji...@apache.org> on 2021/11/10 22:37:00 UTC

[jira] [Commented] (SDAP-345) Add ability to read time stamp from the filename

    [ https://issues.apache.org/jira/browse/SDAP-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441965#comment-17441965 ] 

Thomas G Loubrieu commented on SDAP-345:
----------------------------------------

To read time from the filename we need:
1. identify and part of the file where the date is. That could be done with a regex or identifying a slice of the filename string with start and end indices.
2. an strptime string (e.g. %Y%m%j).

For this ticket we propose to use the regex for 1. unless the configuration file requires to escape weird characters. 



> Add ability to read time stamp from the filename
> ------------------------------------------------
>
>                 Key: SDAP-345
>                 URL: https://issues.apache.org/jira/browse/SDAP-345
>             Project: Apache Science Data Analytics Platform
>          Issue Type: Improvement
>          Components: granule-ingester
>            Reporter: Joseph C. Jacob
>            Priority: Major
>
> Some datasets lack a time variable and attributes and only indicate the date and/or time in the filename.  In these cases, the ingester needs to be able to extract the time stamp from the filenames according to a new regular expression setting in the collections-config ConfigMap.
> The ingester should read the time stamp from a granule using these 3 methods (in priority order):
>  # From the time variable
>  # From the global attributes (this ticket)
>  # From the filename
> All three were options in the old legacy ningester.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)