Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERA5 data cannot be downloaded in mintpy-(jupyter notebook) #66

Open
zhangxing-sigma opened this issue Oct 23, 2024 · 4 comments
Open

Comments

@zhangxing-sigma
Copy link

Unable to download ERA5 data in correct-troposphere step. Unable to download data due to update of CDS URL and key. Unable to connect to new URL, always connected to old URL during operation.
error:
You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2
WARNING: the 1 attempt to download failed, retry it.

https://cds.climate.copernicus.eu/api/v2 is old URL

Copy link

codeautopilot bot commented Oct 23, 2024

Your repository exceeds the current size limit of 4MB. You can fix this by ignoring files/folders: https://docs.codeautopilot.com/configuring-autopilot#excluding-files-and-folders

Disclaimer: This comment was entirely generated using AI. Be aware that the information provided may be incorrect.

Current plan usage: 0.00%

Have feedback or need help?
Discord
Documentation
[email protected]

@zhangxing-sigma
Copy link
Author

script:
correct_tropo = "Perform" in tropo_choice.value or "Rerun" in tropo_choice.value
era5_path = mint_path/"ERA5"
timeseries_era5_path = mint_path/"timeseries_ERA5.h5"
inputs_era5_path = mint_path/"inputs/ERA5.h5"

if "Delete" in tropo_choice.value:
for f in [timeseries_era5_path, inputs_era5_path]:
try:
f.unlink()
except FileNotFoundError:
pass
try:
shutil.rmtree(era5_path)
except FileNotFoundError:
pass

if correct_tropo:
set_troposhperic_correction_mintpy(config_path, "pyaps")
!smallbaselineApp.py $config_path --work-dir {mint_path} --dostep load_data
!smallbaselineApp.py $config_path --work-dir {mint_path} --dostep correct_troposphere
else:
set_troposhperic_correction_mintpy(config_path, "no")
!smallbaselineApp.py $config_path --work-dir {mint_path} --dostep load_data
full error:
downloading weather model data using PyAPS ...
number of grib files to download: 7

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2
WARNING: the 1 attempt to download failed, retry it.

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2
WARNING: the 2 attempt to download failed, retry it.

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2


WARNING: downloading failed for 3 times, stop trying and continue.


@EJFielding
Copy link

Are you using the most recent version of MintPy and PyAPS3?

@zhangxing-sigma
Copy link
Author

I have used the latest PyAPS3, but the problem still persists and I am unable to download it.
I saw the new announcement released by CDS, do you want to replace the URL.

Today 26th September 2024, CDS-Beta has officially become the new CDS:

https://cds.climate.copernicus.eu/
The legacy system is now decommissioned and no longer accessible. All API requests attempting to retrieve data from the legacy system will systematically fail. However, no further support will be provided on the legacy system.

If you are a CDS-beta API user, requests will be automatically redirected from the beta URL to the proper one until 20th October 2024. You are advised to update the URL in your .cdsapirc file at your earliest convenience by 20th October 2024 (login here 228 to check URL to use in .cdsapirc file).

url: [https://cds-beta.climate.copernicus.eu/api to (https://cds-beta.climate.copernicus.eu/api) → url: https://cds.climate.copernicus.eu/api
key: xx-xx-xx-xx-xx

Following the CDS-Beta phase, the new CDS is in its early days of full operations and still undergoing enhancements and fine tuning. Some disruptions are to be expected with the implementation of improvements. Some issues are yet to be fully addressed: for example we are aware of unexpectedly long queue times and are actively working at improving the situation.

We thank you all again for your patience during this significant modernisation of our Data Stores and eagerly await for your constructive feedback 9. Your feedback is key to improve the user experience on the new CDS for the benefit of everyone.

Thank you.

ECMWF Support
on behalf of the Data Stores team

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants