During 2021-2022 PO.DAAC has been in the process of migrating its data archive to the Earthdata Cloud, hosted in Amazon Web Services (AWS). During this transition, some data continued to be available from the on premise archive, while some data has also been available from and within the Earthdata Cloud.
The transition is set to end March 31, 2023 at which point the PO.DAAC archive has been migrated to the Earthdata Cloud (in AWS)
PO.DAAC data is being migrated to the cloud in a set of five phases. The datasets and migration dates are below, but dates may be refined over time. For up to date information, please subscribe to the PO.DAAC mailing list. If you are having trouble finding a collection below, the transition date is also listed on each collection’s landing page.
The dates listed in the table below are the dates when on-premise access to the collections will no longer be available. At some point before the date below, discoverability (i.e. they won’t show up on collection landing pages) of the on-premise end points will be turned off, while access to them will remain until the final date. Remember that while the endpoints to the data are changing from on-premise to cloud endpoints, download capabilities remain unaffected for the data user. Users will always be able to download data from PO.DAAC.
You will notice there will be some duplicate collections available. For example, if you search for "MUR-JPL-L4-GLOB-v4.1" in Earthdata Search, you will see two collections. One of these is our normal, on-premise collection, while the other is the cloud hosted collection.
The PO.DAAC Web Portal will label cloud hosted datasets as CLOUD ENABLED in an orange rectangle. This will let you know, at a glance, which datasets are cloud-enabled from the dataset search and dataset landing pages. For now, check out the Migration FAQ “How do I know if a collection is in the cloud or not?” below.
In the near future, we will be removing discoverability of the “on-premise” collection and only the cloud version will be available, and you will not see duplicates.
As we approach March 31, 2023 and the completion of the transition, more and more of the datasets will only show up once, with the “Cloud Enabled” badge.
The following are select tutorials that may be helpful in transitioning to cloud endpoints. More tutorials can be found on the PO.DAAC Github or accompanying PO.DAAC Cookbook (which is the curated view of the PO.DAAC Github and also includes cheatsheets, guides, additional information and tutorials).
| User Goal | Cloud Tutorial or Tool |
|---|---|
|
Find Collections |
|
|
Find Granules |
|
|
Browse / Download Whole Granules |
|
|
Subscribe to Granules |
|
|
Direct In-Region Cloud Access |
|
|
Access Data in zarr Cloud Optimized Format |
|
|
Bulk Download |
|
|
Transform: How do I subset L2 data? |
|
|
Transform: How do I use OPeNDAP in the Cloud? |
PO.DAAC migration to the Earthdata Cloud is targeted to complete by March 31, 2023. Users are encouraged to transition their legacy data access scripts and methods for compatibility with cloud data access endpoints at their earliest convenience, as PO.DAAC Drive and the legacy data access tools and services (specifically LAS, CWS, THREDDS) will retire on Mar 31, 2023.
There are several ways to see the PO.DAAC cloud collections.
For public collections, you can use Earthdata Search and the PO.DAAC Web portal filter options.
The PO.DAAC Web Portal will also label datasets as CLOUD ENABLED in an orange rectangle. This will let you know, at a glance, which datasets are cloud-enabled from the dataset search and dataset landing pages.
On Earthdata Search, you can use the ‘Available from AWS Cloud’ feature, as well as searching using the key word ‘POCLOUD’. But for PO.DAAC Cloud collections only, we’ve built a PO.DAAC Cloud Search Portal (again, make sure you’re logged in!).
To ensure a successful transition for all PO.DAAC users, the PO.DAAC in the CLOUD Forum can be used as the primary entry point to help address technical issues and concerns. Our User Services team (podaac@podaac.jpl.nasa.gov) is also standing by to support. Several resources are also available:
Data search and access
Recommended tool for data downloading and subscribing
Data recipes and tutorials for PO.DAAC datasets, tools & services
General Information about Earthdata Cloud (in AWS)
For more answers to frequently asked questions, please see the Cloud FAQ.
If your question is not here feel free to submit it to us via Forum or by emailing to podaac@podaac.jpl.nasa.gov
