After years of mostly remote interactions, we are excited for the Pangeo Community to convene at SciPy2022 in Austin, TX. SciPy Conference 2022, Austin -- Scientific Computing with Python 2022 Welcome to SciPy 2022 SciPy 2022, the 21st annual Scientific Computing with Python conference, will be held in…www.scipy2022.scipy.org At the same time, recent political events have dimmed our community’s enthusiasm for traveling to Texas, a state where a woman’s right to choose has now been eliminated. …

The Pangeo community is coming together at the upcoming Ocean Sciences 2022 virtual meeting around an exciting session called Open Ocean Science. This blog post gives a rundown of the session. …

Three new papers lay out the opportunities and challenges — Pangeo got involved in cloud computing almost by accident. In our original 2017 NSF proposal, the program manager asked us to trim our budget. So we removed the servers we had planned to buy and instead asked to be included in the NSF BIGDATA program (now defunct), which provided direct…

New Funding and New Directions — On behalf of the Pangeo Steering Council TLDR: Pangeo is launching new efforts in the areas of education, cloud data storage, and machine learning. We are pivoting away from directly operating cloud-based JupyterHubs, migrating this role to new service providers in this space. A Brief History of Pangeo The Pangeo project effectively began in 2016…

This short blog post is a technical followup to a post from earlier this year: Advising and Collaborating during a Pandemic and Sabbatical The 2020–2021 academic year is shaping up to be drastically different from those that came before it, both in general…medium.com In that post, I shared the following about my struggles with collaboration / project management tools, and the need for a better system, particular given the fact that we are now all working remotely thanks…

The 2020–2021 academic year is shaping up to be drastically different from those that came before it, both in general and for me particularly. …

by Ryan Abernathey and Tom Augspurger TLDR: this post describes a new python library called rechunker, which performs efficient on-disk rechunking of chunked array storage formats. Rechunker allows you to write code like this: from rechunker import rechunk target_chunks = (100, 10, 1) max_mem = "2GB" plan = rechunk(source_array, target_chunks, max_mem…

Ryan Abernathey wrote this post, with input from the rest of the Pangeo Steering Council. On the 10th of June, 2020, a historic event brought academia, science, and tech together for a strike in solidarity with the anti-racist Black Lives Matter movement. This event was sparked by the tragic deaths…

By Ryan Abernathey & Joe Hamman — Anyone working with large-scale Earth System data today faces the same general problems: The data we want to work with are huge (typical analyses involve several TB at least) The data we need are produced and distributed by many different organizations (NASA, NOAA, ESGF, Copernicus, etc.) We want to apply…