You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@climate.apache.org by MJJoyce <gi...@git.apache.org> on 2014/10/19 23:27:01 UTC
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
GitHub user MJJoyce opened a pull request:
https://github.com/apache/climate/pull/115
CLIMATE-518 - Add ESGF Datasource
Add initial ESGF Datasource integration. A future issue will address the multiple-file dataset loads. At the moment, anything that is more than 1 file will not be downloaded and loaded.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MJJoyce/climate esgf-integration
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/climate/pull/115.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #115
----
commit 22192f5effb56aa36d7613d70c43992b799d5dcc
Author: Michael Joyce <jo...@apache.org>
Date: 2014-09-15T14:24:43Z
Update gitignore so setup.py develop artifacts are ignored
commit 7d3c237c57305629e588e84bd2f5c46e6dc87edd
Author: Michael Joyce <jo...@apache.org>
Date: 2014-09-15T15:01:22Z
CLIMATE-519 - Rework ESGF integration module structuring
The ESGF module is now part of the OCW package.
commit 79464c74823c7234eb44c6af1b4d8bf29a8e4cd9
Author: Michael Joyce <jo...@apache.org>
Date: 2014-09-15T15:06:04Z
CLIMATE-519 - Rework ESGF helper module import structuring
Update ESGF module imports to reflect new package/module structuring.
commit 3b30be75530baaa0a69d3686b527a402795169ff
Author: Michael Joyce <jo...@apache.org>
Date: 2014-09-15T15:12:01Z
CLIMATE-520 - Add ESGF module to setup.py
commit 51a019c344f039346bcf524df4a381659059318e
Author: Michael Joyce <jo...@apache.org>
Date: 2014-09-21T11:38:59Z
CLIMATE-518 - Add initial ESGF data_source
commit f625cf82e4f0165bbbcfe484221e3a565b88f2ce
Author: Michael Joyce <jo...@apache.org>
Date: 2014-10-09T16:15:38Z
CLIMATE-518 - Add documentation to ESGF data_source
commit 2cc0401e178e9d40153860a46a1395b1f834f6ec
Author: Michael Joyce <jo...@apache.org>
Date: 2014-10-09T16:19:25Z
CLIMATE-518 - Add ESGF data_source to Sphinx build
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by OCWJenkins <gi...@git.apache.org>.
Github user OCWJenkins commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-59666463
Merged build finished. Test Passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by cgoodale <gi...@git.apache.org>.
Github user cgoodale commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-60190016
Mike do you have code that is partially working but throwing errors? Or a code snippet example that demonstrates the multi-file issue with 2 files?
Can the local.py support multiple NetCDF files? <== Perhaps this is the root cause.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by MJJoyce <gi...@git.apache.org>.
Github user MJJoyce commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-60399083
Hi Cam. I spent some more time poking around with this and isolated my problem. It seemed like a NetCDF4 problem at first but eventually I worked out that it's simply a problem with us defaulting the elevation index to 0 when we load a dataset. Many of the ESGF datasets had a lot of elevation levels (>20) and a number of the early ones were either all 0s or fill values. I'm looking to address this in CLIMATE-538 by adding an optional parameter when loading a dataset with ocw.data_source.local.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by OCWJenkins <gi...@git.apache.org>.
Github user OCWJenkins commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-59666399
Merged build triggered. Test Failed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by OCWJenkins <gi...@git.apache.org>.
Github user OCWJenkins commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-60404581
Merged build finished. Test Passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/climate/pull/115
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by OCWJenkins <gi...@git.apache.org>.
Github user OCWJenkins commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-60404229
Merged build triggered. Test Failed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by OCWJenkins <gi...@git.apache.org>.
Github user OCWJenkins commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-59666406
Merged build started. Test Failed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by MJJoyce <gi...@git.apache.org>.
Github user MJJoyce commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-60178255
Heads up on this. I've found and since fixed a bug in this implementation but I am fighting with a NetCDF4 problem. Will update this PR soon with more info. Please refrain from merging until then.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] climate pull request: CLIMATE-518 - Add ESGF Datasource
Posted by OCWJenkins <gi...@git.apache.org>.
Github user OCWJenkins commented on the pull request:
https://github.com/apache/climate/pull/115#issuecomment-60404423
Merged build started. Test Failed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---