You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sdap.apache.org by "Thomas G Loubrieu (Jira)" <ji...@apache.org> on 2021/11/10 22:37:00 UTC
[jira] [Commented] (SDAP-345) Add ability to read time stamp from
the filename
[ https://issues.apache.org/jira/browse/SDAP-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441965#comment-17441965 ]
Thomas G Loubrieu commented on SDAP-345:
----------------------------------------
To read time from the filename we need:
1. identify and part of the file where the date is. That could be done with a regex or identifying a slice of the filename string with start and end indices.
2. an strptime string (e.g. %Y%m%j).
For this ticket we propose to use the regex for 1. unless the configuration file requires to escape weird characters.
> Add ability to read time stamp from the filename
> ------------------------------------------------
>
> Key: SDAP-345
> URL: https://issues.apache.org/jira/browse/SDAP-345
> Project: Apache Science Data Analytics Platform
> Issue Type: Improvement
> Components: granule-ingester
> Reporter: Joseph C. Jacob
> Priority: Major
>
> Some datasets lack a time variable and attributes and only indicate the date and/or time in the filename. In these cases, the ingester needs to be able to extract the time stamp from the filenames according to a new regular expression setting in the collections-config ConfigMap.
> The ingester should read the time stamp from a granule using these 3 methods (in priority order):
> # From the time variable
> # From the global attributes (this ticket)
> # From the filename
> All three were options in the old legacy ningester.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)