Community-Impact | 2i2c

BIDS joins the mybinder.org federation with help from 2i2c

Thu, 09 Apr 2026 00:00:00 +0000

The Berkeley Institute for Data Science (BIDS) has joined the mybinder.org federation, contributing a new node alongside 2i2c and GESIS. BIDS is the birthplace of mybinder.org, so it’s great to see them back as an active federation member.

We helped out with development, setup, and operations for the new federation member on OVH. Here’s the initiative we just closed out ».

This is a win for the resilience of mybinder.org - the BIDS node runs on a different cloud provider than the existing nodes, reducing the risk that a single provider outage takes down the whole service.

Read the full details on the Jupyter blog.

STRUDEL enables rapid scientific GUI prototyping in partnership with 2i2c

Tue, 27 Jan 2026 00:00:00 +0000

What happened #

The STRUDEL team hosted an all-day workshop with over thirty participants prototyping web applications using the STRUDEL Design System and AI assistants in a custom hub environment designed and managed by 2i2c. By the end of the day, all of the participants had a working prototype that incorporated their own data (or dummy data) into complex flows facilitated by the STRUDEL Design System.

After a brief introduction to STRUDEL, participants were guided on setting up their personal coding environments using the STRUDEL Hub that 2i2c managed. The hub was configured to launch a unique code repository for each participant that was set up pre-workshop on the strudel-workshops GitHub organization.

“Having a startup environment was very nice, as often getting a good development environment set up is half the battle for smaller projects.”

The hub used VS Code for the Web, pre-configured with the Cline AI assistant extension. Participants configured Cline with a shared API key generated by the STRUDEL team via OpenRouter. OpenRouter enabled the team to load credits into a shared account and API key that, in turn, enabled participants to use premium models inside of Cline.

“Super easy to set up Cline in the VM, I appreciated that”

The day was split up into four sprints during which participants worked on different parts of their user interface application, with the majority of the participants working entirely in the 2i2c environment.

“I just want to express my gratitude for such an awesome day today. The workshop was really well structured and facilitated, and I learned a lot. Thank you so much for letting me come!”

Why we’re excited about this #

We think it’s a great example of setting up a complex environment once, and then providing rapid access to these environments via a centralized hub.

This setup accelerated prototyping by removing the burden of setting up a development environment. The setup enabled participants, many of whom had never coded a web application or used an AI coding assistant before, to work seamlessly towards the goals of their design and development projects. The work they produced may continue beyond the workshop and have an impact on scientific discovery and operations.

This setup is a valuable mechanism for encouraging people to build within a pre-existing design system. Being able to launch repositories that are preconfigured with design system tools and templates is a powerful way to promote the adoption of a design system and its embedded patterns and best practices.

It’s also an interesting example of non-Jupyter interfaces orchestrated on a JupyterHub. The combination of VS Code for the Web, Cline, and OpenRouter represent a stack that can be easily transferable to other similar workshops. OpenRouter enabled the workshop team to manage the costs of AI usage entirely themselves.

In all, the participants and instructors were allowed to focus on their work instead of managing and setting up their infrastructure.

Links to learn more #

Learn more about the workshop on the STRUDEL website: strudel.science/engage/news/10-23-2025-building-scientific-uis-with-strudel-and-ai-assistants/
Explore STRUDEL + AI assistant tips and tricks: strudel-science/strudel-kit/blob/main/docs/docs/usage-with-ai.md

Acknowledgements #

We would like to thank all workshop participants. STRUDEL is an open source project housed at the Berkeley Institute for Data Science (BIDS) at the University of California, Berkeley. The STRUDEL team includes members of the Lawrence Berkeley National Lab Scientific Data (SciData) Division UX team, Superbloom Design, The Carpentries, and 2i2c. The project is generously funded by the Alfred P. Sloan Foundation, Liz Vu & Josh Greenberg Program Officers, grants G-2022-19360, G-2023-21098, and G-2024-22557.

April joins the Jupyter Community Building Working Group

Fri, 23 Jan 2026 00:00:00 +0000

We’re pleased to share that our People Operations Lead, April Johnson, has joined the Jupyter Community Building Working Group!

This kind of work reflects how we think about foundational contributions and upstream support: strengthening the social infrastructure that helps open source communities grow and thrive, not just contributing code and running infrastructure. April brings deep experience building teams and communities, and we’re proud to support her upstream efforts in this way.

Acknowledgements #

Thanks to the Jupyter Community Building Working Group for their leadership in building a stronger Jupyter community, and for welcoming April

Supporting NASA Openscapes Champions with Cloud Infrastructure

Sun, 30 Nov 2025 00:00:00 +0000

Openscapes ran a NASA Champions program in November, bringing 30 participants together to learn about NASA Earthdata and the earthaccess Python library. We provided JupyterHub infrastructure for hands-on breakout sessions - a good example of using shared infrastructure to facilitate learning and collaboration in remote events.

They used their JupyterHub for co-working, where participants practiced streaming techniques for accessing cloud data without downloading. Multiple NASA Data Centers (NSIDC, ORNL, ASDC, PO.DAAC) collaborated to co-teach using the shared environment, succeeding despite the event happening the day after a government shutdown.

They also used this to grow the OpenScapes community by getting attendees to join their slack and sign up for their December Earth Access hack day. It’s a great example of leveraging shared community infrastructure to help newcomers learn quickly and join a science community.

Read their full event summary to learn how they structured the program and engaged their community.

Debisree Ray on her positive JupyterCon 2025 experience

Mon, 17 Nov 2025 00:00:00 +0000

We spotted a great post by Debisree Ray about JupyterCon 2025 on the Women in Technology blog. It’s full of thoughtful reflections about the community and the conference, and we wanted to share a few highlights.

Image from Debisree Ray’s post

On the JupyterLab Extensions workshop:

I chose to attend Developing JupyterLab Extensions, led by the Jupyter core contributors. It was one of the most practical, empowering workshops I’ve attended.

Once you understand the architecture, building a JupyterLab extension feels less intimidating and more like unlocking a creative superpower.

On the community spirit:

On the first day, while setting up my extension environment, I got stuck during execution — and before I knew it, several attendees (not just instructors!) jumped in to troubleshoot with me. That moment captured the true spirit of JupyterCon: a room full of brilliant people who genuinely want to help one another succeed.

The openness, kindness, and inclusiveness of this community are unmatched. Everyone — from first-time contributors to long-time maintainers — collaborates with respect and a sense of curiosity.

On the Jupyter ecosystem’s growth:

Jupyter is no longer just about notebooks — it’s powering AI workflows, enterprise analytics, and reproducible research pipelines at scale.

Read the full post for more about Debisree’s week in San Diego, the community sprint, and other key takeaways.

Acknowledgements #

We didn’t do any of the work in this post but do have some context from the Jupyter community that led to it being written and discovered, so here’s a brief “thank you” nonetheless…

Thanks to Debisree Ray for writing such a thoughtful reflection and sharing it publicly. And thanks to Matt Fisher from GeoJupyter for spotting the post and bringing it to our attention. Thanks also to Rick Wagner and Jason Grout for creating the slide as part of the executive council update.

Community learning: Hub config to pass oauth tokens into user environments

Thu, 06 Nov 2025 00:00:00 +0000

One of our favorite things to see: communities learning from and building on each other’s work!

MAAP recently contributed infrastructure configuration inspired by EarthScope’s approach to handling authentication tokens. Both communities need to pass OAuth tokens into user environments so their SDKs can access protected data - and MAAP adapted EarthScope’s pattern to fit their needs.

This is the kind of peer-to-peer knowledge sharing we hope to foster with our open infrastructure model. When infrastructure is open and communities can see each other’s solutions, they can adapt and build on proven approaches rather than starting from scratch.

Learn more #

MAAP’s PR adapting the configuration
EarthScope’s original config
Our infrastructure repository where all community configurations live

Acknowledgments #

MAAP team for adapting and contributing this configuration
EarthScope Consortium for the original implementation

2i2c Supports the Science Platforms Coordination IHDEA Working Group

Thu, 30 Oct 2025 00:00:00 +0000

The Science Platforms Coordination IHDEA working group (which includes our own Jim Colliander) is developing international standard software computing environments for Heliophysics. The working group recently presented their work at two major conferences: ML-Helio in Madrid and DASH/IHDEA in San Antonio.

The DASH/IHDEA 2025 conference brings together the heliophysics community to advance data, analysis, and software standards

When the working group received $2k from NASA SMCE for cloud infrastructure, they were already member organizations of 2i2c. This meant we could quickly stand up a JupyterHub with their Heliophysics-tailored environments for the conferences:

Easy access - Shared password authentication for conference attendees
Persistent storage - Work saved across sessions
Serious compute - Up to 119 GB RAM and 15 CPUs (much more than a typical laptop!)

The team successfully demonstrated how cloud resources can enable computational work that laptops simply can’t handle, and conference attendees responded positively to the presentations.

Why we’re excited about this #

This showcases a key benefit we want to create with 2i2c membership: reducing the accidental complexity of leveraging the cloud. Because the working group was already a member organization, deploying and managing infrastructure for the conferences was straightforward once they secured cloud funding. No lengthy setup, no new contracts - just quick deployment of the tools they needed.

Learn more #

ML-Helio Conference - Machine learning in heliophysics
DASH/IHDEA Conference - Data, analysis, and software in heliophysics

Acknowledgements #

NASA SMCE for providing $2k funding and AWS infrastructure
Shawn Polson for being the community champion leading this effort
The IHDEA working group for their collaborative partnership in advancing Heliophysics research infrastructure

BIDS joins as 2i2c's first premier member organization

Wed, 29 Oct 2025 00:00:00 +0000

We’re thrilled to announce that the Berkeley Institute for Data Science (BIDS) has joined as 2i2c’s first premier member organization! This partnership marks a significant milestone in our sustainability strategy and recognizes a relationship that’s been central to 2i2c’s story from the very beginning.

BIDS Executive Director Kirstie Whitaker and 2i2c Executive Director Chris Holdgraf discuss the partnership at the membership launch event.

What this partnership means #

As our founding premier member, BIDS is financially supporting 2i2c while helping us design our member network services and relationships. Together, we’ll work on:

Co-designing member services - BIDS will provide feedback and guidance as we develop how our member network operates
Technical collaboration - Partnering on JupyterHub development, cloud infrastructure improvements, and other open source projects
Strategic input - Advising on 2i2c’s direction and approach to strengthening open source communities

This gives us a foundation for both technical and social collaboration, and we hope it opens doors to deeper partnerships across the Berkeley community.

Berkeley has long been a leader in open source software development. This partnership lets us share our knowledge and support community development of open source infrastructure across institutions.

Kirstie Whitaker, BIDS Executive Director

Why we’re excited about this #

For open source: BIDS has been a leader in supporting open source and cross-disciplinary open science for many years - helping to shape projects like NumPy, scikit-image, NetworkX, and JupyterHub. Their feedback and partnership will help us improve our impact across the entire ecosystem.

For sustainability: This is the first paying member of our new membership model, which is a key part of our long-term sustainability strategy. It demonstrates that organizations value what we’re building and want to invest in shared open source infrastructure.

For 2i2c: BIDS has been part of our story from the beginning, and this partnership recognizes the continuing influence and support we’ve received from the organization.

Learn more #

Read the full announcements from our partners:

Acknowledgements #

The Berkeley Institute for Data Science and the entire BIDS team
UC Berkeley’s College of Computing, Data Science, and Society

NASA Openscapes mentors run airborne data machine learning workshop with 401 participants from 68 countries

Thu, 23 Oct 2025 00:00:00 +0000

NASA Openscapes mentors recently hosted a workshop attended by 401 participants from 68 countries to learn how to use airborne data and machine learning for environmental research!

They gave participants computational environments on a community hub managed by 2i2c to teach skills in data science like image classification with airborne spectroscopy and accessing data from NASA JPL AVIRIS-NG data from Earthdata cloud.

We’re proud to enable participants from all over the world to easily access standardized compute and NASA Earthdata data in the cloud for a seamless learning experience.

Learn more #

Acknowledgements #

Thank you to the Openscapes team for sharing this post with us, and
- Michele Thornton
- Rupesh Shrestha
for authoring the blog post.
NASA Openscapes mentors for running a great workshop

A helpful contribution to our JupyterHub SSH README from OpenScapes

Tue, 21 Oct 2025 00:00:00 +0000

We love when collaborators contribute back to the tools we maintain! Andy Teucher from OpenScapes recently fixed a documentation issue in jupyter-sshd-proxy that benefits everyone using the tool.

jupyter-sshd-proxy is a tool originally created by Yuvi to help 2i2c communities connect to their JupyterHub instances via SSH. Andy ran into an issue when using it with the VS Code fork that uses the open-remote-ssh extension - it failed unless double quotes were used around the authorization token in the ProxyCommand.

Through experimentation, Andy figured out the fix and contributed it back to the README. Now everyone using this tool will have clearer documentation.

While small, we think this is a nice example of a “Foundational contributions” from a community:

2i2c creates and maintains open source tools to help our communities
Our communities use those tools and run into issues
They debug, figure out solutions, and contribute improvements back
Everyone benefits from the improvements

This is exactly how we want 2i2c to help our communities - by making it easy for them to contribute back to the ecosystem and strengthen the tools everyone relies on.

Acknowledgements #

Thanks to Andy Teucher for the contribution and debugging!
Thanks to OpenScapes for being great collaborators places where can work with people like Andy

Communities learning from one another - Project Pythia and ICESat-2 Hackweeks

Tue, 21 Oct 2025 00:00:00 +0000

We wanted to share a short vignette about two of our communities learning from one another.

At the latest Project Pythia community meeting, Project Pythia met with representatives from ICESat-2 to share learning about notebooks and cookbooks in educational settings.

Anthony Arendt from UW’s eScience Institute shared how they’ve used educational notebooks in their hackweek programs. The discussion explored ways to improve cookbooks, especially for large collections that require different computational environments, sparking ideas about higher-level abstractions for organizing educational content. There is a lot of overlap in the needs and workflows of these communities, and we’re hopeful they can find ways to re-use one another’s ideas, content, and infrastructure.

One of our service goals is to make it easier for our member communities to learn from one another - using standardized tools and infrastructure means we can learn what works, what doesn’t, and collectively improve our workflows more quickly. We’re working on ways to encourage this kind of interaction in our member networks, so we wanted to celebrate this little win.

Learn more about these communities #

Project Pythia - An educational resource for geoscience computing with open-source Python
Project Pythia Cookbooks - Domain-specific example workflows for geoscience
ICESat-2 Hackweeks - Collaborative learning events combining tutorials, peer learning, and team projects

Openscapes is hiring a new team member

Tue, 07 Oct 2025 00:00:00 +0000

Openscapes is hiring a NASA Openscapes Suborbital Team Member to engage with NASA suborbital science teams and support open science practices. This is a part-time contract position (20 hrs/week) starting as early as December 1, 2025, with a 6-month initial term and potential for extension. The position is fully remote ($100/hr) with applications due by October 26, 2025.

Learn more #

Openscapes job posting

Acknowledgements #

Openscapes for their continued work in empowering the research community

Giving CCAD more control over data science infrastructure via a Catalyst Project hardware exchange

Tue, 02 Sep 2025 00:00:00 +0000

2i2c has successfully completed a hardware exchange with Universidad Nacional de Córdoba’s Centro de Computación de Alto Desempeño (CCAD) through funding from the Catalyst Project. CCAD used funding to purchase new on-prem computing infrastructure, significantly expanding their computing capabilities.

This exchange reduces CCAD’s reliance on ongoing cloud funding while giving them direct control over their infrastructure. The new hardware will support a scalable JupyterHub deployment and provide valuable training opportunities for researchers who may work with local computing resources.

Learn more #

Acknowledgements #

Chan Zuckerberg Initiative for their Catalyst Project award
CCAD for their collaboration on this hardware exchange

Harnessing Marine Open Data Science for Ocean Sustainability in Africa, South Asia and Latin America

Tue, 11 Mar 2025 00:00:00 +0000

Thank you to Emilio Mayorga for sharing this publication.

Several community members, including Paige Martin (Australian Climate Simulator), Eli Holmes (NOAA Fisheries), and Emilio Mayorga (University of Washington) published case studies in Oceanography magazine’s “Vision for Capacity Sharing” issue.

Their article Harnessing Marine Open Data Science for Ocean Sustainability in Africa, South Asia, and Latin America highlights the benefits of hackweek-style collaboration and learning events to build capacity in underrepresented communities, using 2i2c-supported JupyterHub for seamless set up and effective data sharing.

More on these three specific initiatives is available at their respective websites:

COESSING, Coastal Ocean Environment Summer School In Nigeria and Ghana.
OHWe - OceanHackWeek en Español (in Spanish).
ITCOocean Hack2Week (an Indian Ocean program). Training Course & HackWeek On Machine Learning Based Species Distribution Modeling.

We’re happy to see these communities extend their impact and make interactive computing more accessible to participants around the world.

2i2c communities at AGU 2024

Mon, 09 Dec 2024 00:00:00 +0000

We are proud to share that several of 2i2c’s community partners are presenting their work at AGU 2024! In each case, 2i2c’s infrastructure plays a part in helping communities create and share knowledge, and grow their community. As an organization rooted in community-centric practices, we are particularly excited to see 2i2c represented “indirectly” at this conference, and to see ourselves as a supporting role enabling the impact of others.

Here’s a summary and links to all of the sessions. See below for a brief overview of seach one.

ED31G-2272 Breaking down the barriers to Open Science with Project Pythia #

Link to session

Hall B-C (Poster Hall) (Convention Center)

Abstract #

Project Pythia is an open access educational initiative established with funding from the U.S. National Science Foundation. Its mission is to help students and scientists enhance their skills and adopt best practices using the tools and technologies of open science. As part of the Pangeo community, Project Pythia primarily focuses on the Pangeo stack, which includes cloud computing, Jupyter technologies, GitHub, and various software packages in the Scientific Python ecosystem, centered around Xarray. Project Pythia offers a wide range of open access content, such as datasets, software, tutorials, and annotated real-world workflows presented in the form of Jupyter Books.

Project Pythia serves as a resource for scientists, promoting and fostering open science. Although it is not a scientific research artifact itself, the development of Project Pythia adheres to many best practices advocated by open science proponents. The Pythia team actively encourages community engagement and collaborates openly with scientists and technologists to create new content. All Pythia resources are freely accessible, and the project follows the FAIR principles (Findable, Accessible, Interoperable, and Reusable) for managing research outputs, including publications, data, and other materials. We support and facilitate open evaluation and peer reviews of content to ensure verifiability and trust. Lastly, we endeavor to openly discuss ideas, designs, and methods before implementation.

This presentation will provide an overview of Project Pythia’s extensive educational resources and share our experiences in applying many open science principles to develop this flagship training resource for the geoscience community.

Authors #

John Clyne - NSF National Center for Atmospheric Research (first author)
Drew Camron - University Corporation for Atmospheric Research
Orhan Eroglu - NSF National Center for Atmospheric Research
Robert Ford - University at Albany State University of New York
Julia Kent - NSF National Center for Atmospheric Research
Ryan May - University Corporation for Atmospheric Research
James Munroe - 2i2c / Code for Science and Society
Brian E J Rose - SUNY at Albany

ED31G-2277 PACE Hackweek: An open community keeping up with PACE #

Link to session

Abstract #

The NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission, while bringing NASA’s Earth System Observatory up to speed with aquatic, atmospheric, and terrestrial science capabilities, is also providing data records of the Earth System for the next generation of scientists to grow into. The goal of the PACE Hackweek, supported by the Ocean Carbon & Biogeochemistry program and hosted at the University of Maryland Baltimore County in August 2024, was to enrich and support the practice of open science by both emerging and established researchers. Cloud-compute resources for the event were provided by CryoCloud, a NASA funded collaboration between ICESat-2 and the International Interactive Computing Collaboration (2i2c) to provide cryosphere researchers with a shared JupyterHub. We, the hackweek mentors, were buoyed by the NASA Openscapes program and adopted its mantra of striving toward “a kinder science for future us.” Participants faced two novelties: the “firehose” of data from the PACE instrument array (a hyper-spectral imaging spectrometer, a wide-swath hyper-angular polarimeter, and a narrow-swath spectro-polarimeter), and the distribution of PACE collections through the NASA Earthdata Cloud (a first for the Ocean Biology Distributed Active Archive Center). We present our approach and the challenges undertaken to hold an in-person, social coding event with 45 participants that provided a collaborative, supportive launchpad for doing open science with PACE. All lectures and tutorials produced for the event are freely available for examination and reuse. Our results additionally include highlights from the demonstration projects pursued by event participants and results from two post-event, qualitative surveys. One anonymous survey gathered participant feedback that will inform plans for growing these 45 participants into a lasting, open community. A separate, anonymous survey recorded participant demographics in order to evaluate our efforts at increasing diversity within the community of PACE data users. Key points of discussion include participant views, informed by our event, on whether and how the NASA Earthdata Cloud is a significant resource for the practice of open science with PACE, and how a shared JupyterHub can further the practice of open science by the community it serves.

Authors #

Ian Carroll - NASA Goddard Space Flight Center; University of Maryland Baltimore County (first author)
Kelsey Bisson - NASA Headquarters
Sean Foley - NASA Goddard Space Flight Center; Morgan State University
Patrick Clifton Gray - University of Maine
Elizabeth E Holmes - NOAA Fisheries
Carina Poulin - Science Systems and Applications, Inc.; NASA Goddard Space Flight Center
Tasha Snow - NASA Goddard Space Flight Center; University of Maryland College Park
Guoqing Wang - NASA Goddard Space Flight Center; Science Systems and Applications, Inc.
Jeremy Werdell - NASA Goddard Space Flight Center
Anna Windle - NASA Goddard Space Flight Center; Science Systems and Applications, Inc.
Pengwang Zhai - Department of Physics, University of Maryland Baltimore County

IN13A-2147 Including more solutions and more solvers via actionable open science #

Link to session

Monday, 9 December 2024 13:40 - 17:30
Hall B-C (Poster Hall) (Convention Center)

Abstract #

If we’re asking people to change for open science, we must be willing to change ourselves. Internalizing this as individuals and institutions is critical - “to address our climate emergency, we must rapidly, radically reshape society. We need every solution and every solver” (Johnson & Wilkinson, All We Can Save).

Radically reshaping our society and including more solvers requires Earth scientists of all disciplines, across AGU, to work together in new ways. Many of these shifts can be considered Open science. They change how we work daily, not just the open products we produce. And for that, people need to consider themselves part of a team, let go of perfection and embrace a growth mindset to continually reflect and improve skills – no matter their job title. Further, open science requires all of us to see ourselves as leaders making small changes that collectively add up to a movement.

Openscapes is an open source approach to cultivating leaders and change makers. Openscapes’ flywheel approach intervenes and builds momentum through identifying mentors within organizations and mentoring teams curious about shifting to open science (Robinson & Lowndes 2022). Collectively, the Openscapes flywheel iterations have had a significant impact over the past five years across institutions like the federal government and academia that seem impossible to change. Through stories working with professional scientists over the past 5 years including at NASA, NOAA, Black Women in Ecology, Evolution, and Marine Science, and many universities, and open source software communities like 2i2c, Posit, Pangeo, and RLadies, we will share actionable insights for flourishing in the open science commons, and are interested in learning with and growing flywheel momentum further at AGU.

Authors #

Julia S. Stewart Lowndes - Openscapes, LLC (first author)
Ileana Faye Fenwick - Hampton University
Elizabeth E Holmes - NOAA Fisheries
Luis Alberto Lopez - National Snow and Ice Data Center (NSIDC), CIRES, University of Colorado Boulder
Erin Robinson - Self Employed

IN34A-01 Beyond Open Data: Ensuring True Accessibility for All (Invited) #

Link to session

Abstract #

The Earth Observation (EO) industry has seen rapid technological advancements alongside a massive increase in the number of private and public missions, leading to exponentially growing data archives. For publicly funded entities, this data is typically required to be freely available. However, open data does not always guarantee accessibility, and significant barriers remain for even the most advanced users. The stagnation in the use and adoption of open data can be attributed to several factors, including 1) challenges in unifying and maintaining metadata standards, 2) inefficiencies associated with legacy data formats, 3) a lack of training and resources for transitioning to cloud-based infrastructure, and 4) systemic social inequalities.

This talk will explore real-life examples of these barriers and highlight success stories that have emerged from partnerships largely originating within open-source communities which foster diverse connections between private and public entities including efforts like GeoZarr, pangeo-forge, Openscapes and 2i2c. While many advancements in improving the usability and accessibility of EO data have come from private efforts (i.e. Google Earth Engine), the shutdown of the Planetary Computer is a reminder of the need for publicly funded alternatives. The sustainability of open source projects will be addressed, with questions posed around reliable funding mechanisms as a means to ensure equitable development to address barriers and ensure accessibility for all. While this talk will be presented by one individual, it is the review and reflection of the work done by dozens of people across various organizations.

Authors #

Brianna Rita Pagán - NASA Goddard Space Flight Center; ADNET Systems Inc. Greenbelt (first author)

Introducing GeoLab - An EarthScope JupyterHub for Enabling Collaborative Cloud-Native Geophysical Data Analysis and Skill Development Workshops #

Link to session

Abstract #

The EarthScope Consortium manages NSF’s GAGE and SAGE facilities and makes all of its geophysical data available in a commercial cloud system. This enables EarthScope and the communities it supports to leverage the abundant computational resources and cost-effective benefits of adopting data-proximate workflows with direct access to large, analysis-ready geophysical data sets.

In recent years, JupyterHub environments have gained popularity with data enthusiasts for their ability to provide open access to powerful compute resources. As part of a broad effort to support communities with intuitive resources to quickly adapt their workflows to the cloud, EarthScope has partnered with 2i2c to operate a scalable JupyterHub environment in AWS that will provide equitable access to cloud compute resources for researchers, educators, and the general public. GeoLab, the EarthScope hub, is aligned with related open science initiatives to establish rigorous and transparent standards for reproducible, data-intensive workflows. In addition to promoting interdisciplinary and inter-institutional collaborative work between researchers in GeoLab, EarthScope is developing and hosting workshops that can support both in-person and asynchronous learning modules that will train users how to utilize these new resources and transition their work to the cloud. We are excited to invite all geophysical data users to participate in the vigorous growth of this new platform and collaborate with adjacent open-science compute hub initiatives.

Authors #

Robert T Weekly - EarthScope Consortium (first author)
Tammy K Bravo - EarthScope Consortium
Jerry A Carter - EarthScope Consortium
Tim Dittmann - EarthScope Consortium
Alex Hamilton - EarthScope Consortium
David Mencin - EarthScope Consortium
Chad Trabant - EarthScope Consortium
Sarah Wilson - EarthScope Consortium

Link to session

Abstract #

Project Pythia is the flagship education and training initiative of the Pangeo community. Pangeo has advanced transformative platforms and paradigms for “Big Data” geoscience in the cloud; Pythia is creating on-ramps for new users with open, interactive learning resources centered on Python in the geosciences. Pythia is now building a vibrant community-owned clearinghouse of accessible, reusable, and reproducible tutorials and exemplar workflows in the cloud known as Pythia Cookbooks.

“Cookbooks” imply collections of recipes for transforming raw ingredients (publicly available data) into scientifically useful results. Based on Jupyter notebooks, Cookbooks are explicitly tied to reproducible computational environments and supported by a rich cloud-based infrastructure enabling collaborative authoring and automated health-checking – essential tools in the struggle against the widespread notebook obsolescence problem. Cookbooks are hosted on Pythia’s searchable gallery and nurtured by a growing community of open science enthusiasts from across the geosciences. The Pythia Cookbook gallery is essentially a crowd-sourced, community-curated collection of best practices for data analysis and visualization.

Here we will outline the stack of technologies and infrastructure enabling cookbook creation, collaboration, testing, publication, and interactive deployment, and how these are used in service of building an inclusive participatory community. We will discuss existing technical and social hurdles for contributors, as well as new infrastructure developments in collaboration with the Executable Books Project that are reducing these hurdles.

Authors #

Brian E J Rose - University at Albany State University of New York (first author)
Drew Camron - University Corporation for Atmospheric Research
John Clyne - NCAR
Orhan Eroglu - NSF National Center for Atmospheric Research
Robert Ford - University at Albany State University of New York
Julia Kent - NSF National Center for Atmospheric Research
Ryan May - University Corporation for Atmospheric Research
James Munroe - 2i2c / Code for Science and Society
Kevin Tyle - SUNY at Albany

U13A-2350 Supporting NASA Earthdata users in the Cloud: NASA Openscapes JupyterHub and User Onboarding & Fledging #

Link to session

Abstract #

In this talk we will highlight our NASA Openscapes community teaching approach to using the 2i2c-managed JupyterHub – how we’ve collaboratively developed it to meet user needs, and how it continues to enable researchers and users of NASA Earthdata in the new Cloud paradigm.

NASA Openscapes is an open source mentor community across NASA Earth science data centers ( DAACs) that helps users explore and use the Cloud for their science and applications. Earthdata Cloud Cookbook is a learner-focused open source tutorial collection that we update openly as we learn together.

A critical piece of the NASA Openscapes effort is our NASA Openscapes 2i2c JupyterHub, a managed cloud computing space. By working with cloud early adopters and science Champions, responding and co-developing solutions, the JupyterHub has evolved since its early days in 2021. We support cloud computing for several languages (python, R, Matlab, QGIS) and common science libraries with corn; we streamlined how to bulk-add workshop participants via GitHub Teams; we established policy and technology for a special authentication mechanism for large scale workshops; we are developing earthaccess as an community-developed python library for NASA Earthdata search and access, whether locally or in the cloud.

Based on the last 3 years of engaging with the user community and the Hub, we have evolved how we onboard (first experience in the cloud) and fledge (set up for Cloud that includes a plan, how to do it, how to pay for it; leaving the nest and perhaps building your own). Fledging is an important part of adoption and initiating users to the Cloud - where do researchers go when they decide to do their science in the Cloud? We’ve been developing practices that aim to be equitable and consider policy (cost), technical (where do people go, what admin setup is needed, what tech like base images etc are needed), and social (how do I learn, get support) aspects, and look forward to discussing further at AGU.

Authors #

Julia S. Stewart Lowndes - Openscapes, LLC (first author)
Andrew Barrett - National Snow and Ice Data Center (NSIDC)
Carl Boettiger - University of California Santa Cruz
Aaron M Friesz - Organization Not Listed
Elizabeth E Holmes - NOAA Fisheries
Alexis Hunzinger - NASA Goddard Space Flight Center
Daniel Kaufman - NASA Langley Research Center
Luis Alberto Lopez - National Snow and Ice Data Center (NSIDC), CIRES, University of Colorado Boulder
Catalina M Oaida Taglialatela - NASA Jet Propulsion Laboratory, California Institute of Technology
Yuvi Panda - University of California, Berkeley
Michele Thornton - Oak Ridge National Laboratory

V31A-08 VICTOR – A new Cyber-infrastructure for Volcanology #

Link to session

Abstract #

Numerical models are essential for forecasting volcanic hazards for both short-term responses and long-term hazard assessment. While many models of volcanic processes already exist, challenges in finding, installing, and evaluating these models, coupled with limited computational resources, hinder their widespread use. To address this, we introduce VICTOR, the Volcanology Infrastructure for Computational Tools and Resources.

VICTOR is a cutting-edge cyber-infrastructure platform offering an open-source, cloud-based environment tailored for the volcanology community. It features Jupyter notebooks that integrate existing volcano models, such as the lava flow codes MOLASSES and IMEX_lava, the tephra and ash dispersal codes Tephra2 and HYSPLIT, and the mass flow code TITAN2D. The backend of VICTOR is managed as a JupyterHub, operated by the non-profit 2i2c under the Code for Science and Society.

VICTOR not only provides access to individual modeling tools, but also hosts workflows that use them in data inversion, model benchmarking, and uncertainty quantification. For example, we developed a workflow to validate mass flow models using multiple metrics and Bayesian statistics. VICTOR provides built-in access to external databases such as OpenTopography, Copernicus, and NASA’s remote sensing products to streamline obtaining and using data in workflows.

VICTOR also serves as an educational resource. In Spring 2023 and 2024 we taught graduate level, multi-institutional courses in Computational Volcanology using VICTOR, and we are creating multilingual tutorials for the workflows. We are developing teaching modules on topics such as lava flows and remote sensing to be shared with instructors. Lastly, VICTOR collaborates with national efforts including CONVERSE and SZ4D.

In summary, VICTOR addresses the critical need for accessible, effective volcanic hazard modeling tools and resources, fostering advancements in both research and education within the volcanology community.

Plain-language Summary #

VICTOR is a new online platform designed to help scientists predict volcanic hazards more easily. Traditional models can be difficult to find, use, and combine with other tools. VICTOR solves these problems by offering a cloud-based, open-source environment with user-friendly tools.

VICTOR includes tools like Jupyter notebooks that combine various volcano models for lava flows, ash dispersal, and mass movements. It operates through JupyterHub, managed by the non-profit 2i2c. The platform not only provides access to these models but also offers workflows for tasks like data analysis and model validation. For example, it has a workflow for testing mass flow models using multiple evaluation methods.

VICTOR simplifies data access by connecting directly to databases like OpenTopography and NASA’s remote sensing products. It’s also an educational tool, used in graduate courses and offering multilingual tutorials. Additionally, VICTOR is developing teaching materials on topics like lava flows and remote sensing and collaborates with national projects like CONVERSE and SZ4D.

In essence, VICTOR makes volcanic hazard modeling more accessible and effective, benefiting both research and education in volcanology.

Authors #

Einat Lev - Columbia University of New York (first author)
Sylvain J Charbonnier - University of South Florida
Charles Connor - University of South Florida
Samuel Krasnoff - Lamont -Doherty Earth Observatory
Abani K Patra - University at Buffalo

Introducing the Catalyst Project Community Partner Highlights

Thu, 31 Oct 2024 00:00:00 +0000

Cross-posted from the Catalyst Project blog

Catalyst Project community partners using accessible cloud infrastructure for open science leadership and training. (clockwise from top-left) NNB-CCG, MUST, CICADA and INER. Photos courtesy of Shirley Alquicira Hernández, Bennett Kankuzi, María Inés Fariello Rico and Yalbi I. Balderas-Martinez.

The Catalyst Project is a community-engaged initiative designed to support the adoption of open science principles in under-served bioscientific research communities through the provision of reliable and sustainable cloud computing infrastructure. It’s a project we’ve been working on now for almost two years, which involves staff from seven different organizations: 2i2c, The Carpentries, CCAD, CSCCE, IOI, MetaDocencia, and OLS, and is funded by the Chan Zuckerberg Initiative.

A key part of the project is engaging with Community Partners in Africa and Latin America: Institutions, organizations, and individuals who are undertaking bioscientific research projects that require cloud computing infrastructure. As collaborators on the Catalyst Project, Community Partners can access and use 2i2c’s open science cloud services, and also receive training from 2i2c, The Carpentries, MetaDocencia, and OLS to support their work. Community Partners also play a vital role in shaping an evolving governance model for the Catalyst Project to help sustain, scale, and maximize impact in Latin America, Africa, and under-served communities around the world.

In a new collection of blog posts (that we hope will expand over the next couple of months!) we’re highlighting the work of the Catalyst Project Community Partners. This post is a gateway to learning more about the Catalyst Project and its Community Partners. If you have any questions or feedback about the project, please send an email to the core team.

Highlighting the Catalyst Project Community Partners #

The Catalyst Project currently involves 19 Community Partners, 9 in Africa and 10 in Latin America. Our initial blog post series showcases seven of the Partners, and each post is available in English and Spanish:

African Institute of Biomedical Science and Technology (AiBST) #

At the African Institute of Biomedical Sciences and Technology (AiBST) in Zimbabwe, Zedias Chikwambi and colleagues are working to discover and utilise biomarkers to guide personalized medical treatment.

“Through the Catalyst Project we are able to bring genomic information interpretation to patient bedsides.” - Zedias Chikwambi

Read more: EN | ES

Malawi University of Science and Technology (MUST) #

The Catalyst Project Community at the Malawi University of Science and Technology (MUST) is working to popularize the applicability of data science and artificial intelligence in various undergraduate and postgraduate research contexts in Malawi, including health, business, and education.

“…many staff and students need… a robust and easily accessible platform from which they can efficiently run their machine learning models and do advanced data analysis for their data science research…” - Bennett Kankuzi

Read more: EN | ES

MolerHealth #

MolerHealth is focused on revolutionizing healthcare in Nigeria by developing an accessible electronic health record (EHR) system aimed at reducing disease misdiagnosis.

“Access to training, like The Carpentries Instructor Training, has empowered our team with essential skills for effective teaching and collaboration.” - Monsurat Onabajo

Read more: EN | ES

Nelson Mandela African Institution of Science and Technology (NM-AIST) #

The Northern Tanzania One Health Research Group, hosted at the Nelson Mandela African Institution of Science and Technology (NM-AIST), is using the Catalyst Cloud Infrastructure to understand the transmission dynamics, genetic diversity, and antimicrobial resistance of the Mycobacterium tuberculosis complex (Mtb) between humans and livestock in Northern Tanzania.

“…access to training, particularly through the 2i2c Hub Champion Training, has significantly enhanced our ability to manage and optimize cloud-based resources." - Beatus M Lyimo

Read more: EN | ES

Nodo Nacional de Bioinformática (NNB-CCG) #

The Nodo Nacional de Bioinformática (NNB-CCG) of the Centro de Ciencias Genómicas (CCG) - Universidad Nacional Autónoma de México (UNAM) is a group that brings together professionals and academics to support, provide services, and maintain the growth of the field of bioinformatics in the country’s research.

“(Our) goal is to optimize our participation in events, assess the usefulness of the Catalyst Project’s resources, and, in turn, provide the Catalyst Project with guidelines to improve their service by identifying the necessary areas for improvement within the institutions." - Shirley Alquicira Hernández

Read more: EN | ES

Instituto Nacional de Enfermedades Respiratorias (INER) #

Collaborators at INER are using the Catalyst Cloud Infrastructure to implement machine learning algorithms that will classify radiology images of pulmonary thromboembolism (PTE), with a view to improving patient outcomes.

“The Catalyst Project is helping us to collaborate more efficiently and work remotely.” - Yalbi I. Balderas-Martinez

Read more: EN | ES

Centro Interdisciplinario en Ciencia de Datos y Aprendizaje Automático (CICADA) #

CICADA, an interdisciplinary center researching data science and machine learning, is using the Catalyst CLoud Infrastructure to analyze Uruguayan population data to understand patterns of migration, how much of the native footprint remains, and what can be said about the people who lived in the Uruguayan territory before the arrival of Europeans.

“The Catalyst Project…trainings are attractive, as they are respectful of the people, no previous knowledge is assumed, and the instructors are welcoming.” - María Inés Fariello Rico”

Read more: EN | ES

About the blog posts – Acknowledgements #

Creating a series of blog posts to highlight the work of the Catalyst Community Partners was a collaborative effort involving staff from CSCCE, 2i2c, OLS, and MetaDocencia. Specifically, Lou Woodley, Katie Pratt, Jenny Wong, and Tajuddeen Gwadabe conceived the idea during our regular Catalyst Project “website team” meetings, and developed a strategy for reaching out to community partners to gather information.

Katie then led that outreach, which involved a representative of each Community Partners completing a Google Form to answer three key questions and sharing a photo (or a selection of photos) to use on the blog. Katie curated all of the information, edited together the blog posts, and secured sign-off from all of the partners. Sabrina López and her team at MetaDocencia coordinated the translation of the posts from English to Spanish, and Jenny formatted and published them on the website.

Acknowledgements #

Thanks to the Catalyst Community Partners for generously sharing more about their work.
Thanks to CZI for funding this work.

From the GeoLab team - Pancakes are the future of geophysical data processing

Tue, 01 Oct 2024 00:00:00 +0000

Our partner EarthScope published a blog post about their cloud stack which includes heavy mention of 2i2c’s infrastructure model. Check it out!

Openscapes goes to the White House!

Mon, 23 Sep 2024 00:00:00 +0000

Our partner OpenScapes recently took a trip to the White House to advocate for Open Science and the Open Source ecosystem, check out their blog post about the experience.

Hub Champion Training Reflections (English)

Wed, 04 Sep 2024 00:00:00 +0000

We’ve developed and are now offering a Communtiy Hub Champion training, see this blog post from the Catalyst Project for more details.

Acknowledgements #

Thanks to the Catalyst Project for this work.
Thanks to CZI for funding this work.

Reflexiones sobre la formación de Campeones y Campeonas del Hub (Español)

Wed, 04 Sep 2024 00:00:00 +0000

MyST Mini-Hackathon with the DeepLabCut Team

Mon, 02 Sep 2024 00:00:00 +0000

The DeepLabCut Team #

Animal pose estimation using deep neural networks. Courtesy of the DeepLabCut Jupyter Book

The DeepLabCut team is a group of researchers and developers who are working on open source tools for analyzing animal pose estimation by training deep neural networks on videos.

Chris Holdgraf visited the lab in early August to learn more about how the group were using open-source tools to document and share their work.

Jupyter Book and MyST #

Extensive documentation for using the DeepLabCut software package is already available as a Jupyter Book. The group was interested in adopting MyST Markdown to stay ahead of the curve and upgrade their Jupyter Book (see the related announcement Jupyter Book 2 will be build upon the MyST-MD engine).

Chris led a mini-hackathon to introduce the group to MyST and collect feedback on where enhancement features could be made in the future. Here’s a summary of the outcomes:

Many improvements were made to the MyST documentation 📖
- The MyST Quick Start Guide was used to onboard new users. Amendments were upstreamed to the MyST docs directly and were immediately available to all.
- A tutorial on executable documents was added to the collection of MyST tutorials.
- MyST-MD installation instructions were simplified using mamba.
A bunch of enhancement features were requested ✨
And we found a bug in the table of contents validation 🐞

Summary #

Hackathons are a great way for quickly imparting knowledge and gathering feedback in a short space of time. The event spurred rapid contributions to the MyST ecosystem – embracing reuse of the MyST quick start guides saved time and effort, while engaging with users directly closed a tight feedback loop for enhancements.

Acknowledgments #

Thank to the Mackenzie Mathis Lab for hosting Chris Holdgraf at EPFL, Lausanne, Switzerland.
Thanks to the Jupyter Book team for collaborating on this with us.

NeuroHackademy Summer School Reflections

Mon, 19 Aug 2024 00:00:00 +0000

Thank you to Ariel Rokem and Noah Benson for guest writing this blog post!

Group photo from NeuroHackademy 2024

What is NeuroHackademy? #

Part summer school, part free-wheeling hackathon, all focused on the use of data science methods in neuroscience, NeuroHackademy is an event that was recently hosted by the University of Washington eScience Institute in Seattle, WA, USA. This event, that has been running annually since 2016, aims to provide early-career researchers in Psychology, Medicine, Neuroscience, and other related fields with the skills and knowledge that they need to effectively and rigorously work with open source tools and workflows for analyzing human neuroscience data. This supports the effort to make scientific analysis and results shareable, reproducible, and accessible.

Global and inclusive #

In 2020, the event had to rapidly pivot to an online format, and this format was also used in 2021. Through this experience, the organizers ( Ariel Rokem and Noah Benson) realized that many participants preferred the online format. For example, participants who could not afford to travel to Seattle, or participants who had care-taking responsibilities that precluded them from participating in a two-week event away from their homes. In 2022, the event pioneered a hybrid format, where half of the participants are present in-person and half join the event via zoom, slack, GitHub, and of course through a dedicated 2i2c JupyterHub. Taken together, this format allows the participation of students from a larger range of backgrounds and locations. This aspect plays an important part in building a global and inclusive community of practice. See the paper Hands-On Neuroinformatics Education at the Crossroads of Online and In-Person: Lessons Learned from NeuroHackademy to read more on this subject.

Collaboration with 2i2c #

Previous years #

NeuroHackademy has been an early adopter of the cloud-based JupyterHub model, setting up its first hub using the zero-to-jupyterhub guide in 2018. NeuroHackademy partnered with 2i2c as soon as it was founded, and 2i2c has operated a JupyterHub for the last 3 years. The hub provides an interactive computing platform for learners, and implements the “digital watering hole” for practical and immediate access to a range of cloud-based datasets in human neuroscience (see blog post announcing support for this year’s event).

In terms of the software environment, the following tools and features that have benefited the event over the years include

nbgitpuller allows students to synchronise lesson content with an organizational GitHub repository that is collaboratively maintained by the lesson instructors.
Shared data file storage with read-only access for learners and read-write access for instructors
Access to an abundance of neuroimaging data hosted in cloud object storage
- The Human Connectome Project
- The Natural Scenes Dataset
- OpenNeuro
- The Healthy Brain Network
- And more.

This year #

This year 2i2c supported the following tools and features for NeuroHackademy

A “Bring your own image” option where users can pull any image hosted on a container registry into the hub. See our Integrating BinderHub with JupyterHub: Empowering users to manage their own environments blog post for more details.
repo2docker and GitHub actions to build and prototype images from a repository.
The support services provided by 2i2c and the ability for instructors to open pull requests on 2i2c infrastructure for speedy resolution.
GPU instances to support more compute intensive workloads for machine learning.

Next year #

One thing we have learned is that 2i2c automatically shuts down a user server after one hour of inactivity by default to ensure efficient resource usage and limit runaway cloud costs. Naturally, we are seeing increasing demand from learners for longer and more complex analyses. In response to this, we are keen to explore how the jupyter-keepalive extension can keep the server alive for long-running processes.

We are pleased that learners have made great progress in making use of cloud-native, open-source workflows for analyzing human neuroscience data. We are keen to benefit from lessons learned this year and are looking forward to collaborating with 2i2c once again to deliver the NeuroHackademy Summer School in 2025.

Watch this space next year!

Acknowledgements #

Funded by grant R25MH112480 from the US National Institute of Mental Health awarded to Ariel Rokem and Noah Benson.

The NeuroHackademy Summer School is sponsored by

References #

Keeping PACE with GPU enabled compute to detect global cloud cover using satellite data

Mon, 12 Aug 2024 00:00:00 +0000

(left, b&w) Model inputs and (right, color) model outputs of a simple multi-layer perceptron for detecting cloud cover.

PACE is the NASA Plankton, Aerosol, Cloud, ocean Ecosystem mission that focuses on understanding ocean health and its impact on the atmosphere. Together with the Ocean Carbon and Biochemistry (OCB) program, a one-week hackathon ran from Aug 4 to Aug 8 on the 2i2c-hosted CryoCloud hub. The goal of the hackathon was to explore new Earth science data streams provided by the OCI, SPEXone and HARP2 instruments using Python.

Machine Learning with GPUs #

One of the most advanced tutorials delivered during the hackathon was the Machine Learning Tutorial. The tutorial focused on creating a machine learning pipeline to detect cloud cover from satellite imagery. This was done by training a convolutional neural network (CNN) to assign each pixel a binary value to indicate whether the location was covered by cloud or not. To improve the spatial context beyond a single pixel value, as the likelihood of a pixel containing cloud cover increases if its neighbours also contain cloud cover, the CNN needs to be trained on the entire image at once rather than at a single pixel level. This massively increases the training time, but also allows the CNN to learn more complex relationships between pixels.

GPUs have a far greater number of cores than CPUs that are well-suited for accelerating the massive parallel processing needed to train a neural network on the large amounts of image data in the above scenario. PyTorch is a popular Python library for training CNNs, available for both CPUs and GPUs, and is an ideal tool for performing this kind of work. In terms of the accelerator hardware available on the CryoCloud hub, 2i2c provisions an instance with an NVIDIA Tesla T4 GPU with 4 CPUS, 16GB of RAM and 2,560 CUDA cores.

Managing shared memory on 2i2c hubs #

While developing the above tutorial, tutorial lead Sean Foley (NASA/GSFC/SED & Morgan State University & GESTAR II) noticed that training neural networks was way slower than it should be given the GPUs available to them. They investigated the issue, and with help from the 2i2c engineering team, it was determined that shared memory was the issue. PyTorch uses shared memory via /dev/shm for faster parallel processing, and maximizing use of GPU. However in containerized environments, this is limited to a maximum of 64MB by default.

You can check the amount of shared memory available on your hub in a terminal with the command

df -h | grep /dev/shm

As you might expect, 64 MB of shared memory is not enough for training over 160,000 images in the tutorial. 2i2c was able to remove the limit, making /dev/shm share the memory the user has selected via their profile list, rather than be artificially limited to any particular size. This was done for all users on the CryoCloud hub within an hour of the issue being reported and we upstreamed the change for all 2i2c hubs (see GitHub pull requests for CryoCloud and all 2i2c hubs).

Conclusion #

This event demonstrates the economy of how running shared and open infrastructure dynamically solves problems for the benefit of many users, not just for one occasion. Learning experiences such as the above are transferred and embedded upstream into transparent and flexible open source software that impacts not only all users of 2i2c operated hubs, but also generalized for the wider research community at large (case in point, see the Slack thread below from Eli Holmes, operator of the NOAA Fisheries hubs)! We are grateful for the strong partnerships with our communities who help us to co-design impactful solutions that are specific for their needs and accessible to all.

The power of open infrastructure beyond 2i2c-operated hubs

References and Acknowledgments #

Sean Foley (NASA/GSFC/SED & Morgan State University & GESTAR II)
Tasha Snow (ESSIC UMD & NASA GSFC & CryoCloud)
PACE Hackweek Jupyter Book

Ephemeral Interactive Computing for the AmeriGEO Workshop

Mon, 05 Aug 2024 00:00:00 +0000

AmeriGEO provides a framework for cooperation in the Americas for the use of Earth data to benefit science and society with data driven decision-making. As part of a virtual workshop held on 1st August 2024, 2i2c provided an interactive computing environment to support the delivery of a NASA TOPST water module.

The workshop was facilitated by Kytt MacManus and Juan F. Martinez (both of CIESIN, Columbia University, New York). Juan presented interactive R code, with explanatory content written in Quarto, for hotspot vulnerability analysis for floods and landslides focused on Ecuador using earth observation data and socioeconomic data to develop an index of vulnerability. Check out their GitHub repo and explore interactively yourself on our BinderHub (see our blog post for more details of how to access the BinderHub deployments to provide Ephemeral Interactive Computing for NASA Communities).

Over 100 participants were able to access the interactive workshop on our infrastructure, with 8 GB of RAM per user to facilitate the processing of large amounts of earth data. We are pleased that the workshop was successful and the platform was able to provide a great experience for participants. After the workshop, Kytt reported that

The technology worked as expected and we didn’t run into 1 major technical problem. Thank you so much for that!".

Acknowledgements #

Funding from Science Mission Directorate’s Open Source Science Initiative, Research Opportunities in Space and Earth Science (ROSES-2022), F.14 Transform to Open Science
NASA NSPIRES F.15 High Priority Open-Source Science Award NNH22ZDA001N-HPOSS
NASA Socioeconomic Data and Applications Center (SEDAC)
Kytt MacManus
Juan F. Martinez
James Munroe for providing support and assistance for setting up the cyberinfrastructure for this workshop.

Collaborating with Development Seed to deliver cyberinfrastructure for NASA VEDA

Fri, 12 Jul 2024 00:00:00 +0000

Thank you to Sajjad Anwar and Sanjay Bhangar for contributing to this post.

The VEDA dashboard

The 2i2c team are proud to continue our strong working collaboration with Development Seed, following our previous work on launching the US GHG center (also see the Development Seed blog post). Together with scientists at NASA in our regular sync touchpoints, we have recently delivered a tranche of improvements to the Visualization, Exploration and Data Analysis (VEDA) project.

This platform is designed to thread open-source components together to consolidate GIS delivery mechanisms, processing, analysis and visualization tools, and presented in a collaborative interactive computing environment. All code repositories and associated resources stemming from this work are available on the VEDA GitHub page.

In the spirit of fully open development, you can see the objectives the combined 2i2c and Development Seed team had for the last quarter. In this blog post, we will describe some of the significant ones!

Better image management and testing #

The repo2docker-action is a GitHub action simplifying image building and testing for use with JupyterHub, using either a Dockerfile or various configuration files (like requirements.txt, environment.yml, etc) supported by repo2docker. We migrated our image building pipeline from a somewhat homegrown solution to this upstream action, making image updates and testing much easier. In particular, we can automatically run test notebooks on every change we make to the image! This way, we can easily catch any breaking changes in library versions or other package installs without disrupting users. We also debugged and contributed upstream fixes to the testing infrastructure so everyone could benefit from this, rather than just us.

Automatically pulling example notebooks on startup #

When a user logs into a JupyterHub, it is very helpful if we could have a bunch of example notebooks and other content pre-populated for them so they can get started right away. nbgitpuller is heavily used for this particular use case. However, it requires that nbgitpuller is installed inside the image the user is using - and not all images have it installed. In particular, we wanted to continue using the (wonderful) Rocker images maintained upstream for R users, however they do not have nbgitpuller installed. To solve this problem we built jupyterhub-gitpuller-init, which can be used as an init container to pre-populate user content on persistent home directories regardless of the image used. We also made sure to build this in a way that anyone can use it, and it is not tied into either 2i2c or VEDA infrastructure!

Opening specific visualizations in QGIS via URL #

QGIS is the world’s most used open source GIS software, and previously 2i2c had worked with Openscapes and QGreenland to bring this desktop software to JupyterHub. We had previously worked on a container image that allows users to access large datasets stored in the cloud directly through QGIS on the JupyterHub, allowing users to work with much larger datasets than they could on their desktops by bringing cloud compute adjacent to the data. As a continuation of this work, we developed jupyter-remote-qgis-proxy, which builds QGIS specific features on top of jupyter-remote-desktop-proxy. In particular, it allows creation of shareable links that when clicked, opens specific datasets and layers in QGIS in a JupyterHub! You can see this in action:

Launching QGIS on a Linux desktop served by the VEDA JupyterHub

This opens up exciting future possibilities. Imagine this exploration of the Camp Fire having an ‘Open in QGIS’ button that enables further exploration of the data without the user needing to download or install anything! Work will continue in the coming quarter towards achieving this vision.

We are also excited to see recent work in this space from QuantStack and Simula Labs, and will follow up to ensure an orderly transition to more web native workflows for existing users of QGIS in due time.

Better Profile Selection #

This is a continuation of our GESIS collaboration. In the path to deploying dynamic image building to end users, we wanted to stabilize jupyterhub-fancy-profiles enough to deploy to users of VEDA (and eventually everyone else). This is the primary interface users see after they log in to JupyterHub, and was ripe for UX improvements. The default interface looks like this:

The revamped one is much more streamlined and looks like this:

Revamped Profile Screen

This is currently deployed to a staging hub and has helped us shake out a lot of bugs! We expect the improved interface will be rolled out to all users in the near future. We are also planning further development to make the user experience even better and smoother for everyone.

Supporting workshops #

End users benefiting from our work is what ultimately gives meaning to our work. To that end, we were very happy to support running workshops during this collaboration – see our related blog post US Greenhouse Gas Center supports summer school at CIRA for more information.

Ongoing Collaboration #

Delivering on these objectives in a timely way heavily depended on the success of the team collaboration. Sanjay Bhangar of Development Seed commented

Working closely with the 2i2c team on growing features to support users on the VEDA and GHG Center hubs has been absolutely amazing. With 2i2c’s deep experience in the Jupyter ecosystem, we have been able to implement some fairly complex features quite easily, and their strong open-source roots have ensured that whatever we work on is broadly useful to the wider Jupyter and scientific computing communities.

Take a look at the companion Development Seed blog post of this work.

This collaboration continues, and we have now published our objectives for the coming quarter. Watch this space!

Acknowledgements #

Development Seed
NASA IMPACT
Tarashish Mishra, Julia Signell, Oliver Roick, Slesa Adhikari and Sanjay Bhangar for various code contributions towards these objectives

Openscapes Host a Surface Biology and Geology Workshop with Shared Password Feature

Tue, 09 Jul 2024 00:00:00 +0000

Thanks to Brianna Lind, Julia Lowndes and Andy Teucher for contributing to this blog post!

Surface Biology and Geology: VITALS Workshop

Openscapes is a value-based initiative that supports kinder, better science based on open source community. NASA Openscapes is in its fourth year as a project supporting NASA Earth science in the Cloud, co-developed by Julia Lowndes (Openscapes) and Erin Robinson (Metadata Game Changers).

The initiative recently supported the Surface Biology and Geology: VITALS Workshop hosted by NASA Land Processes Distributed Activate Archive Center (LP DAAC) and NASA Jet Propulsion Laboratory (JPL).

Instructors used the 2i2c Openscapes Hub to lead hands-on exercises teaching learners how to manipulate data collected from the ECOSTRESS and EMIT instruments onboard the International Space Station. They used Jupyter notebooks in the Hub to demonstrate how open source tools together with cloud data and compute resources could effectively analyse the the Canopy Water Content and the Land Surface Temperature over the Jack and Laura Dangermond Preserve, Santa Barbara, CA.

Plot of the Canopy Water Content over the Jack and Laura Dangermond Preserve, Santa Barbara, CA from a VITALS Workshop Jupyter notebook.

This event was attended by around 250 participants. An event of this size therefore requires a frictionless login flow so that organizers could focus on the essential complexity of teaching data analysis rather than the accidental complexity of managing Hub authorization. GitHub authentication is the default option for most 2i2c Hubs for research use cases, but for an educational event of this size this option was not fit for purpose since organizers had to

Retrieve the GitHub usernames of each participant (assuming everyone was familiar with GitHub!)
Manually invite GitHub users to a GitHub organization to authorize access to the Hub (invitations would expire within seven days)
Repeat the above two steps last-minute for participants who showed up on the day without preparing
Manually remove GitHub users from the GitHub organization if they wanted to revoke access to the Hub after the event.

In response to this need, we developed a shared password feature so that workshop organizers can simply hand the share password out to learners for access to the Hub. This bypassed the manual labour of managing GitHub accounts while not adding to the learner’s high cognitive load and improving the participant’s learning experience overall.

One of the elements that enabled us to recognize and solve this issue effectively is our close partnership with the Openscapes team. We engage in regular 6-weekly catch-ups where we can learn about user requirements and how we can develop our infrastructure to co-create optimal solutions. Together with our Product Delivery Flow, we were quickly able to architect the shared password solution in time for the workshop.

Feedback from Brianna Lind (LP DAAC)

We have documented the technical infrastructure changes required to enable a shared password for the Hub in our Infrastructure Guide and hope to support many future events with this mechanism!

Acknowledgements #

Determining Climate Risks with NASA Earthdata Cloud at Scipy 2024

Mon, 08 Jul 2024 00:00:00 +0000

Determining Climate Risks with NASA Earthdata Cloud is a ScienceCore curriculum module that comprises part of NASA’s Open Science and Transform to Open Science (TOPS) initiatives. The aim of this module is to deliver a hands-on experience with “data-proximate computing” in the cloud with NASA Earthdata products with content co-developed with MetaDocencia.

This module was delivered as a SciPy tutorial at this year’s conference. 2i2c have been working closely with the organizers to provide the hub infrastructure for the tutorial, including enabling a shared password for easy authentication (see our Openscapes post for more about this feature) and operating a small binder service for participants to view content after the event.

You can take a look at the tutorial on the NASA ephemeral hub!

The event was well-attended, with 40 learners taking part. Special thanks go to the organizers Dhavide Aruliah, Karthik Venkataramani and Patricia A. Loto for leading the tutorial.

Acknowledgements #

NASA F.14 Transform to Open Science Training award NNH23ZDA001N-TOPST
MetaDocencia
Dhavide Aruliah
Karthik Venkataramani
Patricia A. Loto

Enabling neuroscience in the cloud with HHMI Spyglass and MySQL on JupyterHub

Fri, 05 Jul 2024 00:00:00 +0000

The HHMI Spyglass tutorial

Spyglass #

Spyglass is a framework for reproducible and shareable neuroscience research produced by Loren Frank’s lab at the University of California, San Francisco. Check out our blog post about the release of their preprint to read more about the methods.

This post focuses on the complex data storage needed for the project, which can be difficult to set up locally or at scale in the cloud. In particular, the analysis needed a MySQL database for reproducibility. This is a fairly common task across many fields. The aim of 2i2c is to enable researchers to focus on the essential complexity of what they were doing, i.e. the science, without managing the accidental complexity of how to do it – in this case, setting up databases.

We describe how you can do this too for your own JupyterHubs. Since 2i2c commits to running our infrastructure in line with open-source values as much as possible, you can also directly see the configuration for the hub referenced in the paper.

What is a “sidecar container”? #

The Kubernetes definition of a sidecar container is

Sidecar containers are the secondary containers that run along with the main application container within the same Pod. These containers are used to enhance or to extend the functionality of the primary app container by providing additional services, or functionality such as logging, monitoring, security, or data synchronization, without directly altering the primary application code.

In this case, the primary app container is the JupyterLab instance where people are interactively running code and doing science. We want to provide a MySQL database as a sidecar so that each user server gets their own independent MySQL server instance (that is not accessible to anyone else). We can then run code such as

%%bash
mysql -h 127.0.0.1 -u root --password=tutorial < path-to-sql-file-with-data

to load data into the database. Note the IP address 127.0.0.1 - the MySQL server is listening on localhost, even though it is not running in the same container! Thanks to the magic of Linux Network Namespaces, the sidecar and main app container can share 127.0.0.1. This allows you to write code that works in the exact same way on a user’s local computers as on the JupyterHub, making transitions and replication easier.

Setting up sidecars in JupyterHub on Kubernetes #

We’re leveraging multiple tools from the open-source ecosystem - JupyterHub, Kubernetes, Linux as well as MySQL itself.

Since this is a Kubernetes feature, we can pass through config to it. There are two layers here, which are

singleuser.extraContainers in z2jh configuration
KubeSpawner.extra_containers in KubeSpawner configuration

The hub configuration looks like

 singleuser:
 extraContainers:
 - name: mysql
 image: datajoint/mysql:8.0 # following the spyglass tutorial at https://lorenfranklab.github.io/spyglass/latest/notebooks/00_Setup/#existing-database
 ports:
 - name: mysql
 containerPort: 3306
 resources:
 limits:
 # Best effort only. No more than 1 CPU, and if mysql uses more than 4G, restart it
 memory: 4Gi
 cpu: 1.0
 requests:
 # If we don't set requests, k8s sets requests == limits!
 # So we set something tiny
 memory: 64Mi
 cpu: 0.01
 env:
 # Configured using the env vars documented in https://lorenfranklab.github.io/spyglass/latest/notebooks/00_Setup/#existing-database
 - name: MYSQL_ROOT_PASSWORD
 value: "tutorial"

By setting this up, we allow users to insert the code snippet above

%%bash
mysql -h 127.0.0.1 -u root --password=tutorial < path-to-sql-file-with-data

into their Jupyter Notebooks, which gives access to their MySQL database in the hub!

However, this configuration does not include permanently store the database itself between hub server sessions. Thanks to a pilot in a prior collaboration with University of Texas, Austin, we do have some documentation on how you can enable that as well!

Acknowledgements #

Howard Hughes Medical Institute
National Institute of Mental Health (NIMH), grant number RF1MH130623
kubespawner
zero-to-jupyterhub-k8s and the JupyterHub community

Ephemeral Interactive Computing for NASA Communities

Thu, 27 Jun 2024 00:00:00 +0000

We are pleased to announce that we have deployed two ephemeral hubs for NASA communities!

What did we do? #

As part of the deliverables for our NASA High Priority Open-Source Science (HPOSS) award, we deployed two new ephemeral hubs:

a public small BinderHub that offers a “reader” experience where learners can interactively view GitHub repositories that deliver light scientific content with small compute and no barriers to authentication
a big BinderHub that offers an “explorer” experience where learners can log in to access more substantial compute resources to interactively investigate large datasets and run large workflows from any GitHub repository.

These services enrich the interactive computing ecosystem for NASA communities by

improving the shareability and reproducibility of scientific information
broadening participation for historically excluded and under-resourced science communities
enabling activities such as hackathons, demonstrations or training, during workshops and conferences.

How did we do it? #

Ephemeral interactive computing services benefited from some of our previous development work in collaboration with GESIS (see our detailed blog post for more information). The research and development of this project achieved wide-reaching impact across many NASA communities we currently serve, including TOPST ScienceCore, Openscapes, US Greenhouse Gas Center, VEDA and CryoCloud; as well as networks beyond the NASA scope, such as the NSF-funded Project Pythia and HHMI-funded Spyglass projects.

What next? #

We will focus on bolstering the community- and knowledge-building needed for making the best use of these binder services in the next phase of our HPOSS work to accelerate broader participation in science. This includes opportunities such as running workshops and tutorials, as well as disseminating best practices for collaborative research. Further engineering developments will proceed in collaboration with the NASA VEDA project to set up a binder service, improve the sharing of custom environments, and refine QGIS integrations for analysing geospatial data.

Can I use this ephemeral hub service? #

The answer is yes!

For the public small BinderHub anyone can view GitHub repositories that deliver light scientific content with small compute and no barriers to authentication
For the big BinderHub you will need to be member of a NASA community. This requires a GitHub account for membership of the GitHub Team 2i2c-nasa-binder-access:big-binder-team for authorization. Please send us an email at binder-requests@2i2c.org to be added to the GitHub Team.

Acknowledgements #

NASA NSPIRES F.15 High Priority Open-Source Science Award NNH22ZDA001N-HPOSS

Neurohackademy Summer School in Neuroimaging and Data Science 2024

Fri, 21 Jun 2024 00:00:00 +0000

Neurohackademy Summer School

2i2c are pleased to support the Neurohackademy Summer School in neuroimaging and data science again!

Following the success of our collaboration in previous years (see the event page for 2023), this year’s course will be held July 29th – August 10th, 2024 and will be hosted by the University of Washington eScience Institute.

We provide an interactive computing platform for participants to get hands on experience in data pipelining, machine learning and data visualization techniques. Take a look at the following links to learn more about the neurohackathon:

Acknowledgements #

Funded by grant R25MH112480 from the US National Institute of Mental Health awarded to Ariel Rokem and Noah Benson.

The Neurohackademy Summer School is sponsored by

US Greenhouse Gas Center supports summer school at CIRA

Thu, 20 Jun 2024 00:00:00 +0000

Summer school for inverse modeling of greenhouse gases 2024

The Cooperative Institute for Research in the Atmosphere ( CIRA) is an interdisciplinary cooperation between NOAA research scientists and Colorado State University. CIRA is hosting a summer school for inverse modeling of greenhouse gases using atmospheric data assimilation techniques. The US Greenhouse Gas Center is supporting the workshop by providing 40+ attendees access to their interactive computing hub operated by 2i2c (see our blog post about their launch).

Hub administrators have built a customized software environment with container technology for use at the workshop. In doing so, this bypasses the need for participants to individually install software on their own machines and the online hub provides a consistent and reproducible interactive computing environment that is easily accessible and scalable.

Acknowledgements #

2i2c would like to credit the following individuals for their great efforts supporting this workshop:

Sanjay Bhangar ( Development seed)
Slesa Adhikari (NASA IMPACT)

Hacking the Project Pythia Cook-off with MyST Markdown

Tue, 18 Jun 2024 00:00:00 +0000

Photo courtesy of Dr Debanjana Das

What is Project Pythia? #

Project Pythia is the education working group for Pangeo, a community platform for Big Data geoscience in which 2i2c operates a cloud hub. The core aim of Project Pythia is to spearhead the creation and curation of community-driven, open-source documentation, in the form of “cookbooks”, to enable the adoption of open, scalable and reproducible workflows for geoscientists.

What did 2i2c do? #

Jenny, James and Angus from the 2i2c team participated in the annual Project Pythia Cook-off 2024, a hackathon where cookbook authors and collaborators can spend dedicated time on creating and maintaining their content using Jupyter Book and deploying their cookbooks with GitHub actions.

2i2c teamed up with the infrastructure breakout group during the hackathon, led by Katelyn FitzGerald ( UCAR) and Kevin Tyle ( University at Albany), and members of the Curvenote team also joined the group.

Day 1 #

2i2c deployed and demonstrated a dedicated BinderHub service for Project Pythia that allowed hackathon participants to “self-serve” images of their software environment, which were specified by including a list of packages in an environment.yml file placed in their GitHub cookbook repository. Participants could then pull the image from a container registry into their 2i2c hub (or indeed, any other JupyterHub server) to share and reproduce their computational environments with ease.

Day 2 #

During the first half of the day, we quickly identified a number of issues that were proving to be a maintenance headache for the Project Pythia infrastructure group:

Configuration files for each cookbook were difficult to update at scale. Project Pythia currently have a gallery of over 30 cookbooks!
Changes to Sphinx-based themes inherited from upstream were prone to breaking custom Project Pythia branding downstream.
Executable content was not able to run on the Project Pythia’s dedicated BinderHub hosted on JetStream2 (operated by NSF).
Cookbooks frequently cross-referenced materials from other cookbooks to build upon pre-existing knowledge, but this was not easy to author and the reader experience was not as smooth as it could be.

Following the announcement that Jupyter Book 2.0 will use MyST last month, Rowan (Curvenote) and Angus (2i2c) delivered a compelling demonstration of the MyST ecosystem centered around modern web-first technologies (JavaScript/TypeScript) that offers improved interactivity and accessibility.

In the second half of the day, we decided to use the hackathon to explore migrating the Pythia cookbooks from using a Sphinx-based to a MyST-based document structure and engine. Within one afternoon, the group migrated four cookbooks to use MyST MD

This moment was palpably exciting! It was evident that MyST MD supported backwards compatible content out of the box, which alleviated fears of sunk cost into existing Sphinx-based cookbooks. The migration workflow was as simple as executing the following commands

conda install mystmd

myst.

Day 3 #

We spent this day tackling support for managing a gallery of Project Pythia cookbooks at scale. See the Executable Books blog post for technical details on how we

Centralized configuration
Prototyped a gallery plugin in Python
Fixed a number of bugs related to integrated computation with Binder and JupyterLite
Embraced the referencing and reuse of content with simple markdown syntax for hover-references.

Day 4 #

Looking to the future, we spent time reflecting on our experiences and discussing the potential, transformative impact MyST MD tooling could have in the hands of the scientific community at large, including the communities served by 2i2c. Knowledge-sharing based on static figures and PDFs would fall obsolete and give way to a dynamic, web-first approach to sharing interactive narratives backed by compute from a Jupyter server.

Throughout the course of the hackathon, the rate of iterated development for both end users of the community cookbook and the developers of the open-source tooling was astounding. For example, we were able to quickly expose small bugs ( e.g. support for HTML video tags) in the MyST MD tooling, which were immediately fixed upstream and released within minutes. The feedback loop that connected the user experience with the software tooling was incredibly synergistic, with immediate impact both upstream and downstream that 2i2c hopes to continue replicating across many facets of their operations.

Beyond the Project Pythia Cook-off, the breakout group will continue conversations around strengthening their community of practice and hopefully advocating for wider adoption of MyST MD amongst the scientific community (say hello to some of our group members at SciPy 2024 in July!).

Acknowledgements #

University at Albany (NSF award 2324302): Led the funding acquisition, helped organize and facilitate the event
UCAR (NSF award 2324303): Led the planning and logistics for the event
Project Pythia for organizing this workshop.
Jupyter Book for providing development and collaboration at this workshop.
2i2c / Code for Science and Society (NSF award 2324304): Provided tailored compute services and on-site support
Curvenote: Contributed engineering cycles to MyST MD development.

Howard Hughes Medical Institute publishes preprint on Spyglass, a framework for reproducible and shareable neuroscience research

Tue, 21 May 2024 00:00:00 +0000

Spyglass landing page

Spyglass is a framework for reproducible and shareable neuroscience research produced by Loren Frank’s lab at the University of California, San Francisco. They recently released a preprint about their toolbox, and are using a 2i2c hub to provide accessible interactive cloud environments that demonstrate its functionality and helps researchers get started.

Acknowledgements #

Thanks to HHMI for funding and collaborating on this work.

Researchers at LEAP-Pangeo investigate overlooked sub-grid air-sea heat flux in climate models

Tue, 21 May 2024 00:00:00 +0000

Figure from the preprint showing large and small scale air-sea fluxes are separated. By Julius Busecke et al., licensed under CC BY 4.0

Julius Busecke et al. of the LEAP-Pangeo¹ hub, have recently published a preprint² that investigates “The Overlooked Sub-Grid Air-Sea Flux in Climate Models” using 2i2c infrastructure.

See Julius’ social media post for a more bite-sized outline of the work done.

Well done all! 🎉

Acknowledgements #

This research was conducted using the Pangeo ecosystem and infrastructure provided by 2i2c.

NSF Science and Technology Center (STC) Learning the Earth with Artificial intelligence and Physics (LEAP) (Award # 2019625) ↩︎
doi.org/10.31223/X5WQ47 ↩︎

Digital public goods for Earth system management: U.S. Greenhouse Gas Center launches

Tue, 05 Dec 2023 00:00:00 +0000

Abstract

The International Interactive Computing Collaboration ( 2i2c.org), working with NASA VEDA, Development Seed and other partners, operates an interactive computing platform for The U.S. Greenhouse Gas Center. The U.S. GHG Center, announced yesterday at the 28th annual United Nations Climate Conference (COP-28) in Dubai, is an interagency collaboration of the Environmental Protection Agency (EPA), the National Aeronautics and Space Administration (NASA), the National Institute of Standards and Technology (NIST), and the National Ocean and Atmospheric Administration (NOAA). This note places the launch of the U.S. GHG Center in a scientific, international, and national context and argues that similar digital public goods are needed for humanity to understand and manage the Earth system.

Scientific Context #

It was controversial in 1827 when Joseph Fourier (the discoverer of the law of heat conduction) argued ¹ that the atmosphere keeps the Earth warm, like a puffy down comforter, but it’s not now. Gases in the atmosphere trap heat near Earth. How much heat is trapped depends on the gas mixture. Putting more heat-trapping gases in is like putting a wool blanket on top of the down comforter. Human activity since industrialization is injecting lots more heat-trapping gas into the atmosphere and changing the Earth’s climate.

The science is clear. The up-to-date consensus view of the global scientific community is expressed in the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC):

International Context #

The international community officially recognized human-influenced climate change at the World Climate Conference (WCC-1) ² in 1979. The 1979 declarationis remarkably prescient and detailed. A complex and interconnected collection of scientific and diplomatic activities were catalyzed by WCC-1. Some important milestones from this history are captured in the chart and numbered list below.

gantt dateFormat YYYY-MM-DD title International Climate Change Milestones section Study WCC-1 (1979) :crit, done, admin0, 1979-02-12, 1979-02-23 WCP :crit, adminA, 1979-06-01, 2025-12-31 CMIP1: crit, done, adminT, 1995-01-01,1995-12-31 CMIP2: crit, done, adminR, 1997-01-01, 1998-12-31 CMIP2+: crit,done,adminS, 2000-05-09, 2001-12-31 CMIP3 :crit, done, adminP, 2004-10-01, 2006-12-31 CMIP5 :crit, done, adminO, 2008-09-01, 2013-03-15 CMIP6 :crit, done, adminQ, 2014-02-01, 2024-12-31 IPCC :crit, admin1, 1988-12-06, 2025-12-31 IPCC-AR1 :crit, done, adminH, 1990-08-01, 1992-06-30 IPCC-AR2 :crit, done, adminI, 1995-01-01,1995-12-31 IPCC-AR3 :crit,done, adminJ, 2001-01-01, 2001-12-31 IPCC-AR4 :crit, done,adminK, 2007-01-01,2007-12-31 IPCC awarded Nobel Prize :crit, done, adminN, 2007-10-12, 2007-11-12 IPCC-AR5 :crit,done,adminL, 2014-01-01,2014-12-31 IPCC-AR6 :crit,done,adminM,2023-01-01,2023-12-31 section Treaties Rio Earth Summit (1992) :crit, done, adminC, 1992-06-03, 1992-06-14 UNFCC :crit, admin2, 1994-03-21, 2025-12-31 Berlin (COP-1) :crit, done, adminE, 1995-03-28, 1995-04-07 Byrd-Hagel Resolution :crit, done, adminX, 1997-07-25, 1997-07-30 Kyoto (COP-3) :crit, done, adminD, 1997-12-01, 1997-12-10 Kyoto Protocol :crit, done, admin3, 1997-12-11, 2020-12-31 Paris (COP-21) :crit, done, adminF, 2015-11-30, 2015-12-12 Paris Agreement :crit, adminG, 2016-11-04, 2025-12-31 Glasgow (COP-26) :crit, done, adminV, 2021-10-31, 2021-11-12 Dubai (COP-28) :crit, adminW, 2023-11-20, 2023-12-12 ETF :crit, adminU, 2024-01-01, 2025-12-31

The table above describes a subset (for a more systematic review see ³, ⁴) of key milestones in global efforts to understand and address climate change. A glossary of acronyms and additional background:

The First World Climate Conference (WCC-1) ² was held in 1979.
The World Climate Programme ( WCP), an activity overseen by the World Meteorological Organization was established after WCC-1. WCP, in partnership with other organizations, operates programs (e.g. the World Climate Research Program (WCRP)) that organize and integrate international scientific efforts to understand the climate. The WMO also operates the Integrated Global Greenhouse Gas Information System (IG3IS), a natural partner for the emerging work described below.
WCRP manages the Common Model Intercomparison Project (CMIP). CMIP serves as a kind of league for intercomparing models of the Earth’s climate system developed by teams who approach the problems with different methods and designs. Intercomparison, an approach that enables finding the consensus views of teams with divergent approaches to problems, is used in other modeling scenarios.
Research papers on the climate are rapidly produced by scholars from essentially all knowledge disciplines. This overwhelming stream of content, like snowflakes in a blizzard, is coalesced into coherent and carefully scrutinized IPCC Assessment Reports by the Intergovernmental Panel on Climate Change (IPCC).
The Earth Summit held in Rio de Janeiro in 1992 led to the United Nations Framework Convention on Climate Change (UNFCC). The UNFCCC is an international treaty that recognizes the dangers to the climate system caused by human activity, calls for ongoing study, and establishes recurring Conference of the Parties (COP) meetings.
COP-3 (Kyoto) led to the Kyoto Protocol Treaty.
The Byrd-Hagel Resolution was a unanimous United States Senate Resolution that stipulated the United States would not sign treaties promising greenhouse gas reductions by developed countries that did not mandate similar reductions from developing countries. This killed USA participation in the Kyoto Protocol Treaty.
The Paris Agreement, established at COP-21 (Paris), effectively replaces the Kyoto Protocol, includes specifications by participant countries on greenhouse gas reductions called National Determined Contributions (NDCs). The United States entered the Paris Agreement under President Obama, exited under President Trump and rejoined under President Biden.
COP-26 (Glasgow)established an accountability system for the Paris Agreement called the Enhanced Transparency Framework (ETF). Participant countries to the Paris Agreement will submit their first Biennial Transparency Reports (BTR1) under the ETF in 2024.

🇺🇸 U.S.A. Context #

The United States Environmental Protection Agency (EPA) annually releases the Inventory of U.S. Greenhouse Gas Emissions and Sinks reports. These reports are submitted to the United Nations in accordance with the UNFCCC. The EPA openly shares software, tools, data, and builds capacity to assist other nations to assemble their own greenhouse gas inventories.

An Interagency Working Group (IWG) on the Social Cost of Carbon was set up by the Obama Administration in 2010. The IWG, renamed as the Interagency Working Group on Social Cost of Greenhouse Gases in 2016, synthesizes research on integrated assessment modelling to quantify the dollar costs associated to damage caused by an incremental increase in GHG emissions in a given year. Quantifying the impacts of GHG emissions in monetary terms is vital to effective rulemaking across the Federal Government. This EPA fact sheet on the social costs of carbon provides further background. A 2017 consensus report ⁵ of the National Academies of Science Engineering and Medicine (NASEM) offered recommendations for ongoing research to improve the assignment of social costs to GHG emissions.

Other federal agencies have developed expertise, data, and analyses that give insights into GHG emissions that compliment and potentially extend the Inventory reports developed annually by the EPA. How should the United States integrate federal agency efforts to monitor and measure greenhouse gas emissions? A 2022 NASEM consensus report ⁶ investigated this question. In January of this year, the Biden Administration released guidance⁷ for federal agencies on incorporating GHG emissions information in policies and reports. Shortly thereafter, a draft federal strategy to advance an integrated greenhouse gas monitoring system was released by NASA with a request for public input.

Some important insights from the NASEM consensus report, the draft federal strategy, and the IWG reports:

Data streams on greenhouse gas emissions can be sorted into two broad categories:
- Activity-based: Activity-based data, sometimes called “bottom-up” data, quantify GHG emissions by measuring activities that generate GHG emissions. Economic or business activity data (gallons of diesel sold in a county on Tuesday; miles flown by a 747 in October) can be converted into quantified GHG emissions information.
- Atmospheric-based: Atmosphere-based data, sometimes called “top-down” data, quantify GHG emissions by performing atmospheric measurements. For example, the Orbiting Carbon Observatory (OCO2) remotely senses $CO_2$ from space.
- A hybrid approach that blends activity-based and atmospheric-based GHG data has the potential to provide new insights.
Interoperable and easily accessed tools and data products for analyzing GHG emissions information and assigning costs should be made available across the Federal government.
GHG emissions information is needed in scenarios outside the international context of participating nations reporting for UNFCCC and Paris Agreement ETF compliance:
- Subnational governments – cities, states, provinces, counties – want GHG data products to measure their progress on emission reduction programs.
- Facilities – harbours, toll roads, power plants, factories, universities – similarly want GHG data products.
- Companies – airlines, trucking, construction – want GHG data products.
Reliable and transparent GHG emissions information is required to enable effective environmental-social-governance (ESG) investment without “greenwashing”.
Accurate and improving quantifications of the social costs associated to GHG emissions require ongoing research.

The U.S. Greenhouse Gas Center #

The launch of U.S. GHG Center, an interagency collaboration of the Environmental Protection Agency (EPA), the National Aeronautics and Space Administration (NASA), the National Institute of Standards and Technology (NIST), and the National Ocean and Atmospheric Administration (NOAA), was announced on 2023-12-04 at COP-28 (Dubai)

How much GHG emission is generated through oil and gas production? How much GHG emission is generated by urban centers? Do landfills contribute significant GHG emissions? How do human-generated GHG emissions compare to natural sources of GHG emissions? The U.S. GHG Center is designed to assemble the data, tools, and people to scientifically address these kinds of questions.

The U.S. Greenhouse Gas Center builds on EPA’s leadership to openly share the data and tools for the Inventoryand the 2023 Year of Open Science. Instead of building a walled garden with proprietary technology from a vendor selected through RFP, the Center launched a prototype platform using curated open source tools integrated with public federal data. This open toolchain approach amplifies the open data efforts developed over the past two decades.

The U.S. GHG Center’s interactive computing platform is open source science infrastructure. The platform is:

transparently operated by 2i2c on a cloud data center under a right to replicate that ensures zero vendor lock-in with data integrations and visualizations built with using software from a vibrant open source ecosystem by Development Seed, NASA VEDA, and collaborators;
proximate to and optimized ⁸ for analyzing geospatial data (e.g. NASA, NOAA);
designed to be a digital public good.

Research, data and recommendations developed by scientists and engineers that influence policies set by democratic governments should be accessible by voters. No entity should own the ways humans communicate and learn about the Earth system. The U.S. Greenhouse Gas Center’s generous approach to digital infrastructure – an open toolchain adjacent to open data – is vital for democracy and should be replicated across government agencies worldwide.

Acknowledgements #

This work was developed in collaboration with Development Seed and NASA VEDA, key partners in building the U.S. Greenhouse Gas Center’s open source science infrastructure.

References #

Mémoire sur les températures du globe terrestre et des espaces planétaires. in Oeuvres de Fourier: Publiées par les soins de Gaston Darboux (eds. Fourier, J. B. J. & Darboux, J. G.) vol. 2 95–126 (Cambridge University Press, 2013). ↩︎
World Climate Conference. World Climate Conference - Declaration and supporting documents. library.wmo.int/records/item/54699-world-climate-conference-declaration-and-supporting-documents (1979). ↩︎ ↩︎
Gupta, J. A history of international climate change policy. WIREs Climate Change 1, 636–653 (2010). ↩︎
Zillman, J. A history of climate activities. WMO Bulletin 58, (2009). ↩︎
Valuing Climate Changes: Updating Estimation of the Social Cost of Carbon Dioxide. (National Academies Press, 2017). doi: 10.17226/24651. ↩︎
Greenhouse Gas Emissions Information for Decision Making: A Framework Going Forward. (National Academies Press, 2022). doi: 10.17226/26641. ↩︎
CEQguidance. National Environmental Policy Act Guidance on Consideration of Greenhouse Gas Emissions and Climate Change. Federal Register www.federalregister.gov/documents/2023/01/09/2023-00158/national-environmental-policy-act-guidance-on-consideration-of-greenhouse-gas-emissions-and-climate (2023). ↩︎
Abernathey, R. P. et al. Cloud-Native Repositories for Big Scientific Data. Computing in Science & Engineering 23, 26–35 (2021). ↩︎

UNITEFA forms the first community of the Catalyst Project at UNC, through the CCAD (in Spanish)

Mon, 23 Oct 2023 00:00:00 +0000

New project: Open science cloud infrastructure and training for communities in Latin America and Africa

Tue, 20 Dec 2022 00:00:00 +0000

We are excited to announce that the team and proposal described in this blog post has been awarded funding by the Chan Zuckerberg Initiative! We informally call this project The Catalyst Project.

This announcement may be cross-posted on the websites of several collaborating organizations of this grant. Para leer este post en español, vea el blog de MetaDocencia.

Our goal is to create a collaborative cloud infrastructure service that enables community-based cloud-native workflows in the biosciences. We will promote values of open and inclusive community practices, infrastructure that enables these practices, and a “train the trainers” approach that empowers community leaders to share expertise in cloud infrastructure with others in their communities. Our focus will be on communities in Latin America and Africa, and we hope to learn how this model could be extended to other global communities that are historically marginalized from large-scale scientific infrastructure projects.

2i2c will be providing cloud infrastructure operation and support for the communities that we partner with in this effort. We will also assist with creating content to teach cloud-native workflows and assist community leaders in learning this content so that they can share these skills with others.

This is a collaborative effort between 2i2c, The Carpentries, CSCCE, Invest in Open Infrastructure, MetaDocencia, and Open Life Science. For more detailed information, see the blog post with our full grant narrative.

We are hiring #

As a part of this effort, we will also hire several new team members! There are currently two job postings open. Here are links for more information in case you are interested:

Cloud infrastructure engineer to join 2i2c’s Site Reliability Engineering team that will operate and support the cloud infrastructure in this project.
Programme manager role to join Open Life Science and support this project via project management and operational support.

We may be hiring other positions related to this effort, so please stay tuned for more information if you are interested.

Where to follow along #

If you’d like to follow along with this work, please share your e-mail address in this short form. We’ll send updates as we work out longer-term spaces for communication or documentation.

💡 Follow our work! Sign up for our mailing list for updates about 2i2c. Send us an e-mail about collaborating or partnering on a project. See our Service Documentation or our Team Compass to learn about our service and organization.

The why, what, and how of our NASA Openscapes cloud infrastructure: 2i2c JupyterHub and corn environment

Thu, 17 Nov 2022 00:00:00 +0000

We recently shared a demo of our infrastructure stack with the OpenScapes community. Check out the blog post about it here.

Reflections on the Jack Eddy Symposium

Thu, 14 Jul 2022 00:00:00 +0000

Reflections on the Jack Eddy Symposium #

2i2c supported and participated in the 3rd Eddy Cross Disciplinary Symposium held recently in Vail Colorado. The event was hosted by the Cooperative Programs for the Advancement of Earth System Science ( CPAESS) team at the University Corporation for Atmospheric Research (UCAR) with support from NASA.

Context #

The Symposium was framed by the interesting and interdisciplinary scientific career of the late Jack Eddy. Eddy’s legacy was highlighted and his influence has been extended by dynamic leadership from NASA Program Officer Madhulika Guhathakurta (Lika). Lika helped launch and has sustained NASA’s Living with a Star (LWS) program over the past two decades. Prior to LWS, NASA had a variety of siloed efforts focused on near-Sun and near-Earth behavior. The LWS program led to an integration of these efforts under “system science” or “systems engineering” approaches and an expressed desired to connect LWS research activities with impacts on Earth (society, biology, culture, etc.). The program has expanded to include explorations of similar questions arising around other planets in our solar system and the recently discovered collection of exoplanets. Scientists from diverse disciplines (plasma physics, stellar evolution, atmospheric chemistry, space weather, planetary science,…) work together on “cross disciplinary” research that helps us understand our lives near our star.

The Symposium focused on three disciplinary areas (Exoplanets; Sun-Climate and Star-Climate interactions; Risk and resilience of space weather) unified under the cross-cutting thread of open science. Frequent references were made to the upcoming 2023 Year of Open Science and NASA’s Transform to Open Science (TOPS) mission. Symposium attendees listened to talks surveying the four areas in the morning and participated in hackathon-style breakout projects during the afternoons. Work on the projects launched at the Eddy Symposium continues. The space weather group is investigating ways to make the power grid more resilient. The Sun-climate group is exploring plans to establish an institute focused on Sun-climate interactions and improve connections between climate and heliophysics research communities. The exoplanets team is developing tools to programmatically compare Sun-Earth and star-exoplanet interactions.

2i2c’s role #

2i2c, with input from Symposium CoChair’s Dan Marsh and Ryan McGranaghan, rapidly deployed a cloud-hosted JupyterHub for use during the event. The hub provided a shared space for participants to explore data, run analyses, and collaborate with one another using modern tools including Zarr, Xarray and Dask Gateway. Access to the interactive computing platform was granted to any member of the Symposium’s GitHub organization. The work to set up that hub, openly chronicled in this GitHub issue ( 2i2c-org/infrastructure#1329 ), included swapping out a Pangeo-style software environment for a heliophysics-specific resource developed by HelioCloud with special thanks to Brian Thomas!

2i2c co-founder Fernando Pérez gave a talk on how he is “living la vida nube”. Fernando described the ways he, research collaborators, and students are using the Jupyter ecosystem. Diverse and curated tools in Jupyter hubs for the Jupyter Meets the Earth Project and Berkeley’s data science programs were highlighted. The talk showcased how these tools have been integrated to support individuals and communities of practice in data-driven research. In response to requests from the organizers and participants, Fernando gave a demonstration on how to use the hub 2i2c set up for the Symposium and an introduction to version control using git.

2i2c co-founder Jim Colliander gave a talk titled Governing the Science Commons. Three key points from Jim’s talk were: the virtue that should guide the improvements to the scientific enterprise is intellectual generosity; implementation of intellectual generosity into science requires commons-based governance; the convergence of open source tools that support data-intensive collaborative research and learning (as showcased by Fernando) and agency interest ( NASA TOPS, UNESCO) in open science is an inflection point for global change. The talk ended with a call to action for the diverse communities represented at the Symposium to improve the ways we do science.

Things we learned #

Our experience with the Symposium taught 2i2c a few things.

We learned that our engineering team can rapidly deploy interactive computing resources to support a research and education community. Along the way, we confirmed what we’ve been learning from Pangeo and the neuroscience communities: flexible methods to customize the software environment are necessary. We confirmed that our developing shared responsibility model, enabling domain-specific experts to provide curated toolchains for their communities while leveraging 2i2c’s infrastructure expertise, is the right approach.

We learned that managing access to the hub using members in a GitHub organization works but involves some toil since organizers had to work through the GitHub invitation process for each participant. We are exploring others ways to systematically grant event participants access to a hub.

The Eddy Symposium experience reminded us that some skill at using git is vital for collaboration. Fernando’s brief introduction to git provided the mental model of working on a directed acyclyic graph. Roving support from Jim and Fernando during the afternoon hackathon sessions normalized the skill level across the groups but not without a few merge conflicts and frustration. Near the beginning of future workshops, we will follow an improved approach aimed at establishing good git hygeine and familiarity with the collaboration workflow using a simple pull request.

We are honored to have had the opportunity to collaborate with the Eddy Symposium team by managing infrastructure and participating in the workshop. We learned a lot about how to support the Helio and adjacent communities, and are proud of the ways in which our infrastructure helped them do their work more openly and effectively. We hope to build on these successes with these and other communities in the future!

Pangeo Cloud goes live on 2i2c!

Tue, 16 Nov 2021 00:00:00 +0000

Pangeo Cloud is an experimental service providing public cloud-based data-science environments for data-intensive geoscience research. We have recently finished re-creating the Pangeo community JupyterHub hosted on GCP in the 2i2c-org/infrastructure repository. This is a huge milestone in our partnership with Pangeo to provide expertise and operations of cloud-based, vendor-agnostic Jupyter infrastructure and workflows.

For users of Pangeo Cloud, the switch should have been a smooth one! The new hub should behave nearly identically to the old one, and will be managed by 2i2c engineers moving forward, in partnership with the Pangeo community. It will be available at the same URL ( us-central1-b.gcp.pangeo.io) and there’s no need to worry about your home directories, they were synced to the new hub only a few days before the migration took place. Development and operations on this hub will all be done in the open and we invite participation and feedback from others in our infrastructure work. Please see this Discourse thread as an initial place to provide feedback.

On 22nd November 2021, the old Pangeo GCP JupyterHub will be shut down, and the project will move forward on the new 2i2c Pangeo Hub. Moving forward, we plan to collaborate together in order to find new pathways for development in the Jupyter ecosystem - we will share more ideas of things we will work on soon!

History of Pangeo Cloud Hubs #

Pangeo has pioneered a new model in using open source and cloud-agnostic infrastructure to support scientific research in the cloud.

The first Pangeo cloud JupyterHub (pangeo.pydata.org; now defuct) was deployed for the 2017 American Meteoroligical Society Meeting; since then, the Pangeo community has iterated through several different versions of prototype cloud-based hubs. This allowed for many new workflows that enabled a more open and collaborative pathway to doing world class research, and included access to datasets and computational resources that were previously unattainable. Pangeo achieved this by working in partnership with open source communities and building technology that leveraged modular open source components for their platform.

In the last several years, Pangeo have built a thriving community of practice around this infrastructure. However as the community has grown, so has the need for more reliable and dedicated operational and developmental support since parts of the Pangeo stack require dedicated expertise and attention to managed. Modern scalable cloud infrastructure is one example of this. Maintaining a complex JupyterHub with many users is a difficult task, and has required significant resources from the Pangeo Project up to this point.

The Pangeo-2i2c Partnership #

2i2c is a non-profit team that develops and operates cloud infrastructure for interactive computing workflows. We have extensive experience in Jupyter workflows in the cloud and a long history of contributions to projects in this ecosystem. We have built a cloud deployment management system that allows us to centralise and configure the deployment of many independent JupyterHubs, empowering communities to leverage the same infrastructure (and team!) for JupyterHubs running in the cloud.

Similarly to Pangeo, all of 2i2c’s core infrastructure is cloud- and vendor-agnostic, and follows a model of building open source tools and giving back to those communities. Our partnership with Pangeo began through 2i2c’s core competency in these areas and the similarity between the two project’s technical stacks.

We’ve begun a partnership whereby 2i2c will manage Pangeo’s cloud infrastructure and lead efforts to develop new features, in partnership with open source communities. We sketched out a few ideas to focus on in this kick-off thread on Discourse. This approach allows each community to focus on it’s core strengths: Pangeo will continue to grow an open community and scientific software ecosystem around geospatial analytics, and 2i2c will oversee the development and operations of the core cloud infrastructure stack that powers Pangeo’s workflows. In some areas we are still experimenting with different collaboration models to ensure that the needs of the Pangeo community are met in a way that is also sustainable for 2i2c. Over the coming weeks, you may see some conversations (and threads for feedback!) about different support and operations models that work best for the community. We are excited to use this as an opportunity to learn more about how to serve more complex and diverse communities like Pangeo.

Acknowledgements #

We are extremely grateful to the Pangeo project for giving us the opportunity to serve their community, as well as the Moore Foundation for funding this work. We look forward to a long partnership ahead! 🚀

2i2c partners with UC Berkeley and CloudBank to provide data science education hubs for community colleges in California

Fri, 01 Jan 2021 00:00:00 +0000

Data8. MIT licensed.

Data8 began as a large introductory data science class at UC Berkeley. It uses a Jupyter Book for all course materials, and uses JupyterHub magic links to distribute course content from the textbook.

2i2c is working with the Data 8 team to deploy JupyterHubs for community colleges in California that run the Data8 course, to make the infrastructure and content broadly accessible.

Giving people curricula, content, and infrastructure goes a long way to adoption. Communities want to remix content for their specific needs.

Acknowledgements #

This effort is funded by 2i2c together with UC Berkeley and CloudBank.

Community-Impact | 2i2c

BIDS joins the mybinder.org federation with help from 2i2c

STRUDEL enables rapid scientific GUI prototyping in partnership with 2i2c

What happened #

Why we’re excited about this #

Links to learn more #

Acknowledgements #

April joins the Jupyter Community Building Working Group

Acknowledgements #

Supporting NASA Openscapes Champions with Cloud Infrastructure

Debisree Ray on her positive JupyterCon 2025 experience

Acknowledgements #

Community learning: Hub config to pass oauth tokens into user environments

Learn more #

Acknowledgments #

2i2c Supports the Science Platforms Coordination IHDEA Working Group

Why we’re excited about this #

Learn more #

Acknowledgements #

BIDS joins as 2i2c's first premier member organization

What this partnership means #

Why we’re excited about this #

Learn more #

Acknowledgements #

NASA Openscapes mentors run airborne data machine learning workshop with 401 participants from 68 countries

Learn more #

Acknowledgements #

A helpful contribution to our JupyterHub SSH README from OpenScapes

Acknowledgements #

Communities learning from one another - Project Pythia and ICESat-2 Hackweeks

Learn more about these communities #

Openscapes is hiring a new team member

Learn more #

Acknowledgements #

Giving CCAD more control over data science infrastructure via a Catalyst Project hardware exchange

Learn more #

Acknowledgements #

Harnessing Marine Open Data Science for Ocean Sustainability in Africa, South Asia and Latin America

2i2c communities at AGU 2024

ED31G-2272 Breaking down the barriers to Open Science with Project Pythia #

Abstract #

Authors #

ED31G-2277 PACE Hackweek: An open community keeping up with PACE #

Abstract #

Authors #

IN13A-2147 Including more solutions and more solvers via actionable open science #

Abstract #

Authors #

IN34A-01 Beyond Open Data: Ensuring True Accessibility for All (Invited) #

Abstract #

Authors #

Introducing GeoLab - An EarthScope JupyterHub for Enabling Collaborative Cloud-Native Geophysical Data Analysis and Skill Development Workshops #

Abstract #

Authors #

U13A-2349 Sharing recipes for cloud computing: the Project Pythia Cookbook Initiative #

Abstract #

Authors #

U13A-2350 Supporting NASA Earthdata users in the Cloud: NASA Openscapes JupyterHub and User Onboarding & Fledging #

Abstract #

Authors #

V31A-08 VICTOR – A new Cyber-infrastructure for Volcanology #

Abstract #

Plain-language Summary #

Authors #

Introducing the Catalyst Project Community Partner Highlights

Highlighting the Catalyst Project Community Partners #

African Institute of Biomedical Science and Technology (AiBST) #

Malawi University of Science and Technology (MUST) #

MolerHealth #

Nelson Mandela African Institution of Science and Technology (NM-AIST) #

Nodo Nacional de Bioinformática (NNB-CCG) #

Instituto Nacional de Enfermedades Respiratorias (INER) #

Centro Interdisciplinario en Ciencia de Datos y Aprendizaje Automático (CICADA) #

About the blog posts – Acknowledgements #

Acknowledgements #

From the GeoLab team - Pancakes are the future of geophysical data processing

Openscapes goes to the White House!

Hub Champion Training Reflections (English)

Acknowledgements #

Reflexiones sobre la formación de Campeones y Campeonas del Hub (Español)