Repository navigation
Feature/earthdata downloader - #169
Merged
Merged
Conversation
It was out of date (L3 path gives 404, L2 points to the superseded PGC0, cycles hard-coded) and unused. SWOT L2 now comes from NASA Earthdata. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
New provider bluemath_tk.downloaders.earthdata: CMR granule search (paged with CMR-Search-After; time range, bbox, updated_since), HTTPS downloads with the Earthdata login from ~/.netrc, parallel and resumable, checked against the CMR size and checksum. Product SWOT with dataset L2_LR_SSH_WINDWAVE_D (files saved by month of the pass start). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
netCDF-C/HDF5 are not thread safe. Parallel downloads (CSIRO, Earthdata) validate files from several threads at once, which gave HDF errors and segfaults (a SWOT download job crashed after 13 s). A lock serialises the netCDF4 open; the new test segfaults without it. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
"~" is USERPROFILE on Windows, not HOME, so the test's temporary ~/.netrc was not found there. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.